Jul 30 19:39:38.776896 ip-10-0-134-200 systemd[1]: Starting Kubernetes Kubelet...
Jul 30 19:39:39.238530 ip-10-0-134-200 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 19:39:39.238530 ip-10-0-134-200 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 30 19:39:39.238530 ip-10-0-134-200 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 19:39:39.238530 ip-10-0-134-200 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 30 19:39:39.238530 ip-10-0-134-200 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 19:39:39.239080 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.238601    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 30 19:39:39.244865 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244850    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 19:39:39.244865 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244865    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 19:39:39.244933 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244869    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 19:39:39.244933 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244873    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 19:39:39.244933 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244876    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 19:39:39.244933 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244880    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 19:39:39.244933 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244883    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 19:39:39.244933 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244885    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 19:39:39.244933 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244888    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 19:39:39.244933 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244891    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 19:39:39.244933 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244894    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 19:39:39.244933 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244896    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 19:39:39.244933 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244899    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 19:39:39.244933 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244902    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 19:39:39.244933 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244904    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 19:39:39.244933 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244914    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 19:39:39.244933 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244917    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 19:39:39.244933 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244920    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 19:39:39.244933 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244922    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 19:39:39.244933 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244924    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 19:39:39.244933 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244927    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 19:39:39.244933 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244929    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 19:39:39.245394 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244932    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 19:39:39.245394 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244934    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 19:39:39.245394 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244937    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 19:39:39.245394 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244940    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 19:39:39.245394 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244943    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 19:39:39.245394 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244945    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 19:39:39.245394 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244948    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 19:39:39.245394 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244951    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 19:39:39.245394 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244953    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 19:39:39.245394 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244956    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 19:39:39.245394 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244958    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 19:39:39.245394 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244961    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 19:39:39.245394 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244963    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 19:39:39.245394 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244966    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 19:39:39.245394 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244968    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 19:39:39.245394 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244971    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 19:39:39.245394 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244973    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 19:39:39.245394 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244976    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 19:39:39.245394 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244978    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 19:39:39.245394 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244981    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 19:39:39.245906 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244983    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 19:39:39.245906 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244986    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 19:39:39.245906 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244988    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 19:39:39.245906 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244991    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 19:39:39.245906 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244993    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 19:39:39.245906 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244996    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 19:39:39.245906 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.244998    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 19:39:39.245906 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245001    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 19:39:39.245906 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245003    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 19:39:39.245906 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245005    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 19:39:39.245906 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245008    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 19:39:39.245906 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245012    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 19:39:39.245906 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245014    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 19:39:39.245906 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245018    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 19:39:39.245906 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245020    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 19:39:39.245906 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245023    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 19:39:39.245906 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245025    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 19:39:39.245906 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245028    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 19:39:39.245906 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245030    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 19:39:39.245906 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245033    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 19:39:39.246384 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245035    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 19:39:39.246384 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245037    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 19:39:39.246384 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245040    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 19:39:39.246384 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245042    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 19:39:39.246384 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245045    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 19:39:39.246384 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245047    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 19:39:39.246384 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245050    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 19:39:39.246384 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245052    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 19:39:39.246384 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245055    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 19:39:39.246384 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245058    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 19:39:39.246384 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245061    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 19:39:39.246384 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245063    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 19:39:39.246384 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245066    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 19:39:39.246384 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245068    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 19:39:39.246384 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245070    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 19:39:39.246384 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245073    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 19:39:39.246384 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245075    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 19:39:39.246384 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245078    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 19:39:39.246384 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245081    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 19:39:39.246840 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245084    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 19:39:39.246840 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245087    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 19:39:39.246840 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245089    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 19:39:39.246840 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245092    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 19:39:39.246840 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245094    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 19:39:39.246840 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245097    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 19:39:39.246840 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245100    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 19:39:39.246840 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245104    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 19:39:39.246840 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245108    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 19:39:39.246840 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245113    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 19:39:39.246840 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245117    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 19:39:39.246840 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245120    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 19:39:39.246840 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245124    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 19:39:39.246840 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245127    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 19:39:39.246840 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245130    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 19:39:39.246840 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245133    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 19:39:39.246840 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245136    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 19:39:39.246840 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245138    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 19:39:39.246840 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245820    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 19:39:39.247309 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245826    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 19:39:39.247309 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245831    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 19:39:39.247309 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245835    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 19:39:39.247309 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245838    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 19:39:39.247309 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245841    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 19:39:39.247309 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245845    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 19:39:39.247309 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245848    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 19:39:39.247309 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245850    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 19:39:39.247309 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245853    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 19:39:39.247309 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245856    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 19:39:39.247309 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245858    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 19:39:39.247309 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245861    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 19:39:39.247309 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245864    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 19:39:39.247309 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245867    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 19:39:39.247309 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245870    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 19:39:39.247309 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245874    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 19:39:39.247309 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245878    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 19:39:39.247309 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245881    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 19:39:39.247309 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245884    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 19:39:39.247802 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245887    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 19:39:39.247802 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245890    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 19:39:39.247802 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245892    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 19:39:39.247802 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245895    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 19:39:39.247802 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245897    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 19:39:39.247802 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245900    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 19:39:39.247802 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245902    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 19:39:39.247802 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245905    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 19:39:39.247802 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245907    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 19:39:39.247802 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245910    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 19:39:39.247802 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245913    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 19:39:39.247802 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245915    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 19:39:39.247802 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245918    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 19:39:39.247802 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245921    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 19:39:39.247802 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245924    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 19:39:39.247802 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245926    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 19:39:39.247802 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245929    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 19:39:39.247802 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245932    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 19:39:39.247802 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245935    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 19:39:39.247802 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245938    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 19:39:39.248282 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245941    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 19:39:39.248282 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245944    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 19:39:39.248282 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245946    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 19:39:39.248282 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245949    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 19:39:39.248282 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245952    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 19:39:39.248282 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245954    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 19:39:39.248282 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245957    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 19:39:39.248282 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245960    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 19:39:39.248282 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245962    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 19:39:39.248282 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245965    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 19:39:39.248282 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245968    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 19:39:39.248282 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245970    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 19:39:39.248282 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245973    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 19:39:39.248282 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245976    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 19:39:39.248282 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245978    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 19:39:39.248282 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245981    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 19:39:39.248282 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245983    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 19:39:39.248282 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245986    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 19:39:39.248282 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245989    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 19:39:39.248282 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245991    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 19:39:39.248792 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245993    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 19:39:39.248792 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245996    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 19:39:39.248792 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.245999    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 19:39:39.248792 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246001    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 19:39:39.248792 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246003    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 19:39:39.248792 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246006    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 19:39:39.248792 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246008    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 19:39:39.248792 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246010    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 19:39:39.248792 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246013    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 19:39:39.248792 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246016    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 19:39:39.248792 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246019    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 19:39:39.248792 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246022    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 19:39:39.248792 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246025    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 19:39:39.248792 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246027    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 19:39:39.248792 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246030    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 19:39:39.248792 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246032    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 19:39:39.248792 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246035    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 19:39:39.248792 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246038    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 19:39:39.248792 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246040    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 19:39:39.249248 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246043    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 19:39:39.249248 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246045    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 19:39:39.249248 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246048    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 19:39:39.249248 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246050    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 19:39:39.249248 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246053    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 19:39:39.249248 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246055    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 19:39:39.249248 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246058    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 19:39:39.249248 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246060    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 19:39:39.249248 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246063    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 19:39:39.249248 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246066    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 19:39:39.249248 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246068    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 19:39:39.249248 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246071    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 19:39:39.249248 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246073    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 19:39:39.249248 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246076    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 19:39:39.249248 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246078    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 19:39:39.249248 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246081    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 19:39:39.249248 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246085    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 19:39:39.249248 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246088    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 19:39:39.249248 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246091    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 19:39:39.249248 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246094    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 19:39:39.249746 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246488    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 19:39:39.249746 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246493    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 19:39:39.249746 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246497    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 19:39:39.249746 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246500    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 19:39:39.249746 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246503    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 19:39:39.249746 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246507    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 19:39:39.249746 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246509    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 19:39:39.249746 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246512    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 19:39:39.249746 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246515    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 19:39:39.249746 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246518    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 19:39:39.249746 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246522    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 19:39:39.249746 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246526    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 19:39:39.249746 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246529    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 19:39:39.249746 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246532    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 19:39:39.249746 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246535    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 19:39:39.249746 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246538    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 19:39:39.249746 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246541    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 19:39:39.249746 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246544    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 19:39:39.249746 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246547    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 19:39:39.249746 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246549    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 19:39:39.250252 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246552    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 19:39:39.250252 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246554    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 19:39:39.250252 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246557    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 19:39:39.250252 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246559    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 19:39:39.250252 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246575    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 19:39:39.250252 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246578    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 19:39:39.250252 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246581    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 19:39:39.250252 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246583    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 19:39:39.250252 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246586    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 19:39:39.250252 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246589    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 19:39:39.250252 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246591    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 19:39:39.250252 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246594    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 19:39:39.250252 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246597    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 19:39:39.250252 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246600    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 19:39:39.250252 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246602    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 19:39:39.250252 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246605    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 19:39:39.250252 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246607    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 19:39:39.250252 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246611    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 19:39:39.250252 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246613    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 19:39:39.250252 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246618    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 19:39:39.250744 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246621    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 19:39:39.250744 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246623    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 19:39:39.250744 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246626    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 19:39:39.250744 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246629    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 19:39:39.250744 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246631    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 19:39:39.250744 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246634    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 19:39:39.250744 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246636    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 19:39:39.250744 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246639    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 19:39:39.250744 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246641    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 19:39:39.250744 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246644    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 19:39:39.250744 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246647    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 19:39:39.250744 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246649    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 19:39:39.250744 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246652    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 19:39:39.250744 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246655    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 19:39:39.250744 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246657    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 19:39:39.250744 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246660    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 19:39:39.250744 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246662    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 19:39:39.250744 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246665    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 19:39:39.250744 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246667    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 19:39:39.250744 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246670    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 19:39:39.251251 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246672    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 19:39:39.251251 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246675    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 19:39:39.251251 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246677    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 19:39:39.251251 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246680    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 19:39:39.251251 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246682    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 19:39:39.251251 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246685    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 19:39:39.251251 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246688    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 19:39:39.251251 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246690    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 19:39:39.251251 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246693    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 19:39:39.251251 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246695    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 19:39:39.251251 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246699    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 19:39:39.251251 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246703    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 19:39:39.251251 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246706    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 19:39:39.251251 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246709    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 19:39:39.251251 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246713    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 19:39:39.251251 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246716    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 19:39:39.251251 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246719    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 19:39:39.251251 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246721    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 19:39:39.251251 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246724    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 19:39:39.251754 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246727    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 19:39:39.251754 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246729    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 19:39:39.251754 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246735    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 19:39:39.251754 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246738    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 19:39:39.251754 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246740    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 19:39:39.251754 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246743    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 19:39:39.251754 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246745    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 19:39:39.251754 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246748    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 19:39:39.251754 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246750    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 19:39:39.251754 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246753    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 19:39:39.251754 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246756    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 19:39:39.251754 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246758    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 19:39:39.251754 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246761    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 19:39:39.251754 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246764    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 19:39:39.251754 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246766    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 19:39:39.251754 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246769    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 19:39:39.251754 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246772    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 19:39:39.251754 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246774    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 19:39:39.251754 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246777    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.246779    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246848    2568 flags.go:64] FLAG: --address="0.0.0.0"
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246863    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246872    2568 flags.go:64] FLAG: --anonymous-auth="true"
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246879    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246886    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246890    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246897    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246901    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246904    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246907    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246910    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246914    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246917    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246920    2568 flags.go:64] FLAG: --cgroup-root=""
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246924    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246927    2568 flags.go:64] FLAG: --client-ca-file=""
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246930    2568 flags.go:64] FLAG: --cloud-provider="external"
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246933    2568 flags.go:64] FLAG: --cluster-dns="[]"
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246938    2568 flags.go:64] FLAG: --cluster-domain=""
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246941    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246944    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246947    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 30 19:39:39.252208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246950    2568 flags.go:64] FLAG: --container-log-max-files="5"
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246953    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246956    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246959    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246962    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246965    2568 flags.go:64] FLAG: --contention-profiling="false"
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246968    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246971    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246974    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246977    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246981    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246984    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246987    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246990    2568 flags.go:64] FLAG: --enable-load-reader="false"
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246993    2568 flags.go:64] FLAG: --enable-server="true"
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.246998    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247003    2568 flags.go:64] FLAG: --event-burst="100"
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247006    2568 flags.go:64] FLAG: --event-qps="50"
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247008    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247011    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247014    2568 flags.go:64] FLAG: --eviction-hard=""
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247017    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247020    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247023    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247026    2568 flags.go:64] FLAG: --eviction-soft=""
Jul 30 19:39:39.252846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247029    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247032    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247036    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247038    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247041    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247044    2568 flags.go:64] FLAG: --fail-swap-on="true"
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247047    2568 flags.go:64] FLAG: --feature-gates=""
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247051    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247054    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247057    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247060    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247063    2568 flags.go:64] FLAG: --healthz-port="10248"
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247066    2568 flags.go:64] FLAG: --help="false"
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247069    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-134-200.ec2.internal"
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247072    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247074    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247077    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247081    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247084    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247087    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247089    2568 flags.go:64] FLAG: --image-service-endpoint=""
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247092    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247095    2568 flags.go:64] FLAG: --kube-api-burst="100"
Jul 30 19:39:39.253438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247098    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247102    2568 flags.go:64] FLAG: --kube-api-qps="50"
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247104    2568 flags.go:64] FLAG: --kube-reserved=""
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247107    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247110    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247113    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247115    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247118    2568 flags.go:64] FLAG: --lock-file=""
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247121    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247128    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247131    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247136    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247139    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247142    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247145    2568 flags.go:64] FLAG: --logging-format="text"
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247148    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247151    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247154    2568 flags.go:64] FLAG: --manifest-url=""
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247156    2568 flags.go:64] FLAG: --manifest-url-header=""
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247160    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247163    2568 flags.go:64] FLAG: --max-open-files="1000000"
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247167    2568 flags.go:64] FLAG: --max-pods="110"
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247170    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247173    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247176    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 30 19:39:39.254118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247179    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247182    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247185    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247188    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247195    2568 flags.go:64] FLAG: --node-status-max-images="50"
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247198    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247201    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247204    2568 flags.go:64] FLAG: --pod-cidr=""
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247207    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247212    2568 flags.go:64] FLAG: --pod-manifest-path=""
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247215    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247218    2568 flags.go:64] FLAG: --pods-per-core="0"
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247221    2568 flags.go:64] FLAG: --port="10250"
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247224    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247226    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dfc968146050bfa2"
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247229    2568 flags.go:64] FLAG: --qos-reserved=""
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247233    2568 flags.go:64] FLAG: --read-only-port="10255"
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247236    2568 flags.go:64] FLAG: --register-node="true"
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247239    2568 flags.go:64] FLAG: --register-with-taints=""
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247243    2568 flags.go:64] FLAG: --registry-burst="10"
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247246    2568 flags.go:64] FLAG: --registry-qps="5"
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247248    2568 flags.go:64] FLAG: --reserved-cpus=""
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247251    2568 flags.go:64] FLAG: --reserved-memory=""
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247254    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247257    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 30 19:39:39.254810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247261    2568 flags.go:64] FLAG: --rotate-certificates="false"
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247263    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247267    2568 flags.go:64] FLAG: --runonce="false"
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247269    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247272    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247275    2568 flags.go:64] FLAG: --seccomp-default="false"
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247278    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247281    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247284    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247286    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247289    2568 flags.go:64] FLAG: --storage-driver-password="root"
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247292    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247295    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247297    2568 flags.go:64] FLAG: --storage-driver-user="root"
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247300    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247303    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247306    2568 flags.go:64] FLAG: --system-cgroups=""
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247309    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247315    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247317    2568 flags.go:64] FLAG: --tls-cert-file=""
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247320    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247324    2568 flags.go:64] FLAG: --tls-min-version=""
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247327    2568 flags.go:64] FLAG: --tls-private-key-file=""
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247332    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247335    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 30 19:39:39.255422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247337    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 30 19:39:39.256048 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247340    2568 flags.go:64] FLAG: --v="2"
Jul 30 19:39:39.256048 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247344    2568 flags.go:64] FLAG: --version="false"
Jul 30 19:39:39.256048 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247348    2568 flags.go:64] FLAG: --vmodule=""
Jul 30 19:39:39.256048 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247351    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 30 19:39:39.256048 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.247354    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 30 19:39:39.256048 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247461    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 19:39:39.256048 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247465    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 19:39:39.256048 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247468    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 19:39:39.256048 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247470    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 19:39:39.256048 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247473    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 19:39:39.256048 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247476    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 19:39:39.256048 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247480    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 19:39:39.256048 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247483    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 19:39:39.256048 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247485    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 19:39:39.256048 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247488    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 19:39:39.256048 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247491    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 19:39:39.256048 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247494    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 19:39:39.256048 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247497    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 19:39:39.256048 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247500    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 19:39:39.256048 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247502    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 19:39:39.256048 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247505    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 19:39:39.256609 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247507    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 19:39:39.256609 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247510    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 19:39:39.256609 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247513    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 19:39:39.256609 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247515    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 19:39:39.256609 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247518    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 19:39:39.256609 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247520    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 19:39:39.256609 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247523    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 19:39:39.256609 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247526    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 19:39:39.256609 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247531    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 19:39:39.256609 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247543    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 19:39:39.256609 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247546    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 19:39:39.256609 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247549    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 19:39:39.256609 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247552    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 19:39:39.256609 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247555    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 19:39:39.256609 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247558    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 19:39:39.256609 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247574    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 19:39:39.256609 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247577    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 19:39:39.256609 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247579    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 19:39:39.256609 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247582    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 19:39:39.256609 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247585    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 19:39:39.257130 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247587    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 19:39:39.257130 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247590    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 19:39:39.257130 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247593    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 19:39:39.257130 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247595    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 19:39:39.257130 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247598    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 19:39:39.257130 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247600    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 19:39:39.257130 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247603    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 19:39:39.257130 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247605    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 19:39:39.257130 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247608    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 19:39:39.257130 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247610    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 19:39:39.257130 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247613    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 19:39:39.257130 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247618    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 19:39:39.257130 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247621    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 19:39:39.257130 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247624    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 19:39:39.257130 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247627    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 19:39:39.257130 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247631    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 19:39:39.257130 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247635    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 19:39:39.257130 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247638    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 19:39:39.257560 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247641    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 19:39:39.257560 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247644    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 19:39:39.257560 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247650    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 19:39:39.257560 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247653    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 19:39:39.257560 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247656    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 19:39:39.257560 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247659    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 19:39:39.257560 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247662    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 19:39:39.257560 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247665    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 19:39:39.257560 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247668    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 19:39:39.257560 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247671    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 19:39:39.257560 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247673    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 19:39:39.257560 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247676    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 19:39:39.257560 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247678    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 19:39:39.257560 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247681    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 19:39:39.257560 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247684    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 19:39:39.257560 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247686    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 19:39:39.257560 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247689    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 19:39:39.257560 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247692    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 19:39:39.257560 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247694    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 19:39:39.257560 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247696    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 19:39:39.258326 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247699    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 19:39:39.258326 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247702    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 19:39:39.258326 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247704    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 19:39:39.258326 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247707    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 19:39:39.258326 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247709    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 19:39:39.258326 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247712    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 19:39:39.258326 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247715    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 19:39:39.258326 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247717    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 19:39:39.258326 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247720    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 19:39:39.258326 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247722    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 19:39:39.258326 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247725    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 19:39:39.258326 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247728    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 19:39:39.258326 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247731    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 19:39:39.258326 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247733    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 19:39:39.258326 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247738    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 19:39:39.258326 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247742    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 19:39:39.258326 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247745    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 19:39:39.258326 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247748    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 19:39:39.258326 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247751    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 19:39:39.258985 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247753    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 19:39:39.258985 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247756    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 19:39:39.258985 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247758    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 19:39:39.258985 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247761    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 19:39:39.258985 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247763    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 19:39:39.258985 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.247766    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 19:39:39.258985 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.248518    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 19:39:39.258985 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.254951    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 30 19:39:39.258985 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.254965    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 30 19:39:39.258985 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.254980    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 30 19:39:39.258985 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.254985    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 30 19:39:39.258985 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255038    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 19:39:39.258985 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255042    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 19:39:39.258985 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255046    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 19:39:39.258985 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255049    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 19:39:39.259363 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255052    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 19:39:39.259363 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255055    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 19:39:39.259363 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255058    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 19:39:39.259363 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255061    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 19:39:39.259363 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255063    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 19:39:39.259363 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255066    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 19:39:39.259363 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255069    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 19:39:39.259363 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255071    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 19:39:39.259363 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255074    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 19:39:39.259363 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255077    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 19:39:39.259363 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255079    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 19:39:39.259363 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255082    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 19:39:39.259363 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255084    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 19:39:39.259363 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255087    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 19:39:39.259363 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255090    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 19:39:39.259363 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255092    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 19:39:39.259363 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255095    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 19:39:39.259363 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255097    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 19:39:39.259363 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255100    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 19:39:39.259363 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255103    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 19:39:39.259921 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255106    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 19:39:39.259921 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255108    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 19:39:39.259921 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255111    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 19:39:39.259921 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255113    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 19:39:39.259921 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255116    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 19:39:39.259921 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255120    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 19:39:39.259921 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255123    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 19:39:39.259921 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255125    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 19:39:39.259921 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255128    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 19:39:39.259921 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255130    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 19:39:39.259921 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255133    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 19:39:39.259921 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255136    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 19:39:39.259921 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255138    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 19:39:39.259921 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255141    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 19:39:39.259921 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255144    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 19:39:39.259921 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255146    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 19:39:39.259921 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255149    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 19:39:39.259921 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255151    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 19:39:39.259921 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255154    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 19:39:39.259921 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255157    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 19:39:39.260426 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255159    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 19:39:39.260426 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255162    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 19:39:39.260426 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255164    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 19:39:39.260426 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255167    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 19:39:39.260426 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255169    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 19:39:39.260426 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255172    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 19:39:39.260426 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255175    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 19:39:39.260426 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255178    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 19:39:39.260426 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255180    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 19:39:39.260426 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255183    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 19:39:39.260426 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255185    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 19:39:39.260426 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255188    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 19:39:39.260426 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255190    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 19:39:39.260426 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255193    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 19:39:39.260426 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255196    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 19:39:39.260426 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255198    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 19:39:39.260426 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255202    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 19:39:39.260426 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255206    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 19:39:39.260426 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255210    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 19:39:39.260916 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255212    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 19:39:39.260916 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255215    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 19:39:39.260916 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255218    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 19:39:39.260916 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255222    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 19:39:39.260916 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255225    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 19:39:39.260916 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255228    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 19:39:39.260916 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255231    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 19:39:39.260916 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255233    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 19:39:39.260916 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255236    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 19:39:39.260916 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255239    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 19:39:39.260916 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255242    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 19:39:39.260916 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255244    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 19:39:39.260916 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255247    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 19:39:39.260916 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255250    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 19:39:39.260916 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255252    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 19:39:39.260916 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255255    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 19:39:39.260916 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255258    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 19:39:39.260916 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255261    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 19:39:39.260916 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255264    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 19:39:39.260916 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255267    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 19:39:39.261434 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255270    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 19:39:39.261434 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255274    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 19:39:39.261434 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255278    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 19:39:39.261434 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255281    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 19:39:39.261434 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255284    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 19:39:39.261434 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255287    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 19:39:39.261434 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255289    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 19:39:39.261434 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255292    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 19:39:39.261434 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255295    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 19:39:39.261434 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255297    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 19:39:39.261434 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255300    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 19:39:39.261434 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255303    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 19:39:39.261434 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255305    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 19:39:39.261434 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255308    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 19:39:39.261434 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255311    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 19:39:39.261434 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255313    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 19:39:39.261899 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.255318    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 19:39:39.261899 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255421    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 19:39:39.261899 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255426    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 19:39:39.261899 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255429    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 19:39:39.261899 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255432    2568 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 19:39:39.261899 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255435    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 19:39:39.261899 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255437    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 19:39:39.261899 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255440    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 19:39:39.261899 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255443    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 19:39:39.261899 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255445    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 19:39:39.261899 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255448    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 19:39:39.261899 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255450    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 19:39:39.261899 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255453    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 19:39:39.261899 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255456    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 19:39:39.261899 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255459    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 19:39:39.262262 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255461    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 19:39:39.262262 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255464    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 19:39:39.262262 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255467    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 19:39:39.262262 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255470    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 19:39:39.262262 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255472    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 19:39:39.262262 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255475    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 19:39:39.262262 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255478    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 19:39:39.262262 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255481    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 19:39:39.262262 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255483    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 19:39:39.262262 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255486    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 19:39:39.262262 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255488    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 19:39:39.262262 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255491    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 19:39:39.262262 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255493    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 19:39:39.262262 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255496    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 19:39:39.262262 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255499    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 19:39:39.262262 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255501    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 19:39:39.262262 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255503    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 19:39:39.262262 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255506    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 19:39:39.262262 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255509    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 19:39:39.262758 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255511    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 19:39:39.262758 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255515    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 19:39:39.262758 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255518    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 19:39:39.262758 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255520    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 19:39:39.262758 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255523    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 19:39:39.262758 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255525    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 19:39:39.262758 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255528    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 19:39:39.262758 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255530    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 19:39:39.262758 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255542    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 19:39:39.262758 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255545    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 19:39:39.262758 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255548    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 19:39:39.262758 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255551    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 19:39:39.262758 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255554    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 19:39:39.262758 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255556    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 19:39:39.262758 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255559    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 19:39:39.262758 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255575    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 19:39:39.262758 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255578    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 19:39:39.262758 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255581    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 19:39:39.262758 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255584    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 19:39:39.263209 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255588    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 19:39:39.263209 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255591    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 19:39:39.263209 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255594    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 19:39:39.263209 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255596    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 19:39:39.263209 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255599    2568 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 19:39:39.263209 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255602    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 19:39:39.263209 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255604    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 19:39:39.263209 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255607    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 19:39:39.263209 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255609    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 19:39:39.263209 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255612    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 19:39:39.263209 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255614    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 19:39:39.263209 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255617    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 19:39:39.263209 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255619    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 19:39:39.263209 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255622    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 19:39:39.263209 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255624    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 19:39:39.263209 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255627    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 19:39:39.263209 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255629    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 19:39:39.263209 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255632    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 19:39:39.263209 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255634    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 19:39:39.263209 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255637    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 19:39:39.263735 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255639    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 19:39:39.263735 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255642    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 19:39:39.263735 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255644    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 19:39:39.263735 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255647    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 19:39:39.263735 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255649    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 19:39:39.263735 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255652    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 19:39:39.263735 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255655    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 19:39:39.263735 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255657    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 19:39:39.263735 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255660    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 19:39:39.263735 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255662    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 19:39:39.263735 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255665    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 19:39:39.263735 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255668    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 19:39:39.263735 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255670    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 19:39:39.263735 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255673    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 19:39:39.263735 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255675    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 19:39:39.263735 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255678    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 19:39:39.263735 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255680    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 19:39:39.263735 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255683    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 19:39:39.263735 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255685    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 19:39:39.263735 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255688    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 19:39:39.264214 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255690    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 19:39:39.264214 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255692    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 19:39:39.264214 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255695    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 19:39:39.264214 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255697    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 19:39:39.264214 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255700    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 19:39:39.264214 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255702    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 19:39:39.264214 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:39.255706    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 19:39:39.264214 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.255711    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 19:39:39.264214 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.255808    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 30 19:39:39.264214 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.259547    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 30 19:39:39.264214 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.261081    2568 server.go:1019] "Starting client certificate rotation"
Jul 30 19:39:39.264214 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.261177    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 19:39:39.264214 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.261924    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 19:39:39.265496 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.265483    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 19:39:39.266692 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.266677    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 19:39:39.277895 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.277879    2568 log.go:25] "Validated CRI v1 runtime API"
Jul 30 19:39:39.282010 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.281994    2568 log.go:25] "Validated CRI v1 image API"
Jul 30 19:39:39.282884 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.282866    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 30 19:39:39.286251 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.286234    2568 fs.go:135] Filesystem UUIDs: map[3f25dc35-19bb-404e-beb6-803e0e51a352:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b6f01045-df02-44cd-ae13-b5c0c07a981e:/dev/nvme0n1p4]
Jul 30 19:39:39.286300 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.286252    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 30 19:39:39.292110 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.292006    2568 manager.go:216] Machine: {Timestamp:2026-07-30 19:39:39.290766828 +0000 UTC m=+0.390848010 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098906 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c546a97bb73709f93ccaff4fd549c SystemUUID:ec2c546a-97bb-7370-9f93-ccaff4fd549c BootID:ca3dcc4e-2ab3-45f5-b83b-af060b394d57 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d1:b0:3c:c3:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d1:b0:3c:c3:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:f6:d0:62:bc:a9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 30 19:39:39.292110 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.292099    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 30 19:39:39.292225 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.292189    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 30 19:39:39.293754 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.293739    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 19:39:39.295598 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.295575    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 30 19:39:39.295760 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.295604    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-200.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 30 19:39:39.296390 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.296378    2568 topology_manager.go:138] "Creating topology manager with none policy"
Jul 30 19:39:39.296440 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.296395    2568 container_manager_linux.go:309] "Creating device plugin manager"
Jul 30 19:39:39.296440 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.296405    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 19:39:39.297346 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.297334    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 19:39:39.299093 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.299082    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 30 19:39:39.303919 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.303905    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 19:39:39.304043 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.304032    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 30 19:39:39.304103 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.304068    2568 kubelet.go:486] "Attempting to sync node with API server"
Jul 30 19:39:39.304103 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.304082    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 30 19:39:39.304103 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.304100    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 30 19:39:39.304221 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.304113    2568 kubelet.go:398] "Adding apiserver pod source"
Jul 30 19:39:39.304221 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.304124    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 30 19:39:39.304865 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.304851    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 19:39:39.304941 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.304873    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 19:39:39.308168 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.308151    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 30 19:39:39.309798 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.309781    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 30 19:39:39.309882 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.309820    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 30 19:39:39.310602 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.310588    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 30 19:39:39.310674 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.310609    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 30 19:39:39.310674 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.310618    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 30 19:39:39.310674 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.310626    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 30 19:39:39.310674 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.310638    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 30 19:39:39.310674 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.310646    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 30 19:39:39.310674 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.310659    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 30 19:39:39.310674 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.310667    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 30 19:39:39.310674 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.310677    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 30 19:39:39.310910 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.310685    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 30 19:39:39.310910 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.310697    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 30 19:39:39.310910 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.310706    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 30 19:39:39.311347 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.311337    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 30 19:39:39.311398 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.311349    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 30 19:39:39.314206 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.314190    2568 server.go:1268] "Started kubelet"
Jul 30 19:39:39.314347 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.314315    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 30 19:39:39.314726 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.314297    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 30 19:39:39.314815 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.314758    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 30 19:39:39.314916 ip-10-0-134-200 systemd[1]: Started Kubernetes Kubelet.
Jul 30 19:39:39.315670 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.315643    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-200.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 30 19:39:39.316015 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.315962    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 30 19:39:39.316148 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.316123    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-200.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 30 19:39:39.316148 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.316125    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 30 19:39:39.316606 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.316592    2568 server.go:310] "Adding debug handlers to kubelet server"
Jul 30 19:39:39.320490 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.320472    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 30 19:39:39.322574 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.322545    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 30 19:39:39.322654 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.322575    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 30 19:39:39.322743 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.322725    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-200.ec2.internal\" not found"
Jul 30 19:39:39.323116 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.322154    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-200.ec2.internal.18c72890b8a8cbc0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-200.ec2.internal,UID:ip-10-0-134-200.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-200.ec2.internal,},FirstTimestamp:2026-07-30 19:39:39.314162624 +0000 UTC m=+0.414243802,LastTimestamp:2026-07-30 19:39:39.314162624 +0000 UTC m=+0.414243802,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-200.ec2.internal,}"
Jul 30 19:39:39.323220 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.323200    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 30 19:39:39.323220 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.323211    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 30 19:39:39.323220 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.323220    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 30 19:39:39.323412 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.323294    2568 reconstruct.go:97] "Volume reconstruction finished"
Jul 30 19:39:39.323412 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.323303    2568 reconciler.go:29] "Reconciler: start to sync state"
Jul 30 19:39:39.323412 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.323319    2568 factory.go:55] Registering systemd factory
Jul 30 19:39:39.323412 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.323357    2568 factory.go:223] Registration of the systemd container factory successfully
Jul 30 19:39:39.323608 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.323519    2568 factory.go:153] Registering CRI-O factory
Jul 30 19:39:39.323608 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.323528    2568 factory.go:223] Registration of the crio container factory successfully
Jul 30 19:39:39.323722 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.323705    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 30 19:39:39.323803 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.323734    2568 factory.go:103] Registering Raw factory
Jul 30 19:39:39.323803 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.323749    2568 manager.go:1196] Started watching for new ooms in manager
Jul 30 19:39:39.324141 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.324129    2568 manager.go:349] Starting recovery of all containers
Jul 30 19:39:39.326913 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.326885    2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-200.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 30 19:39:39.326999 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.326948    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 30 19:39:39.335048 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.335026    2568 manager.go:354] Recovery completed
Jul 30 19:39:39.337209 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.337187    2568 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 30 19:39:39.340954 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.340942    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 19:39:39.345239 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.345216    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 19:39:39.345289 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.345251    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 19:39:39.345289 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.345262    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasSufficientPID"
Jul 30 19:39:39.345772 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.345758    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 30 19:39:39.345831 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.345772    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 30 19:39:39.345831 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.345759    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 19:39:39.345831 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.345791    2568 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 19:39:39.347215 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.347200    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 19:39:39.347278 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.347229    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 19:39:39.347278 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.347243    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasSufficientPID"
Jul 30 19:39:39.347343 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.347286    2568 policy_none.go:49] "None policy: Start"
Jul 30 19:39:39.347343 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.347301    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 30 19:39:39.347343 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.347313    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 30 19:39:39.347556 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.347488    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-200.ec2.internal.18c72890ba82fd44  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-200.ec2.internal,UID:ip-10-0-134-200.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-200.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-200.ec2.internal,},FirstTimestamp:2026-07-30 19:39:39.345239364 +0000 UTC m=+0.445320541,LastTimestamp:2026-07-30 19:39:39.345239364 +0000 UTC m=+0.445320541,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-200.ec2.internal,}"
Jul 30 19:39:39.348631 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.348620    2568 policy_none.go:47] "Start"
Jul 30 19:39:39.356912 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.356759    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-200.ec2.internal.18c72890ba833df8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-200.ec2.internal,UID:ip-10-0-134-200.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-200.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-200.ec2.internal,},FirstTimestamp:2026-07-30 19:39:39.345255928 +0000 UTC m=+0.445337106,LastTimestamp:2026-07-30 19:39:39.345255928 +0000 UTC m=+0.445337106,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-200.ec2.internal,}"
Jul 30 19:39:39.367782 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.367701    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-200.ec2.internal.18c72890ba8365a3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-200.ec2.internal,UID:ip-10-0-134-200.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-200.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-200.ec2.internal,},FirstTimestamp:2026-07-30 19:39:39.345266083 +0000 UTC m=+0.445347260,LastTimestamp:2026-07-30 19:39:39.345266083 +0000 UTC m=+0.445347260,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-200.ec2.internal,}"
Jul 30 19:39:39.374068 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.374047    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rfgfb"
Jul 30 19:39:39.380071 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.380017    2568 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-200.ec2.internal.18c72890ba82fd44\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-200.ec2.internal.18c72890ba82fd44  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-200.ec2.internal,UID:ip-10-0-134-200.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-200.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-200.ec2.internal,},FirstTimestamp:2026-07-30 19:39:39.345239364 +0000 UTC m=+0.445320541,LastTimestamp:2026-07-30 19:39:39.34721535 +0000 UTC m=+0.447296530,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-200.ec2.internal,}"
Jul 30 19:39:39.382063 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.382047    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rfgfb"
Jul 30 19:39:39.391118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.391106    2568 manager.go:337] "Starting Device Plugin manager"
Jul 30 19:39:39.391203 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.391132    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 30 19:39:39.391203 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.391141    2568 server.go:87] "Starting device plugin registration server"
Jul 30 19:39:39.391385 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.391371    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 30 19:39:39.391453 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.391383    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 30 19:39:39.391501 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.391471    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 30 19:39:39.391588 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.391577    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 30 19:39:39.391634 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.391589    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 30 19:39:39.392155 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.392136    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 30 19:39:39.392219 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.392193    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-200.ec2.internal\" not found"
Jul 30 19:39:39.473340 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.473302    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 30 19:39:39.474437 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.474421    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 30 19:39:39.474492 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.474458    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 30 19:39:39.474492 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.474479    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 30 19:39:39.474608 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.474514    2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 30 19:39:39.476705 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.476686    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 19:39:39.492327 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.492275    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 19:39:39.492989 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.492974    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 19:39:39.493051 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.493002    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 19:39:39.493051 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.493013    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasSufficientPID"
Jul 30 19:39:39.493051 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.493034    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-200.ec2.internal"
Jul 30 19:39:39.498630 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.498615    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-200.ec2.internal"
Jul 30 19:39:39.498730 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.498638    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-200.ec2.internal\": node \"ip-10-0-134-200.ec2.internal\" not found"
Jul 30 19:39:39.510788 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.510765    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-200.ec2.internal\" not found"
Jul 30 19:39:39.576020 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.575984    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-200.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal"]
Jul 30 19:39:39.576101 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.576060    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 19:39:39.577007 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.576989    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 19:39:39.577090 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.577022    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 19:39:39.577090 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.577033    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasSufficientPID"
Jul 30 19:39:39.578381 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.578369    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 19:39:39.578505 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.578488    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-200.ec2.internal"
Jul 30 19:39:39.578559 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.578523    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 19:39:39.579090 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.579072    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 19:39:39.579176 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.579107    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 19:39:39.579176 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.579123    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasSufficientPID"
Jul 30 19:39:39.579176 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.579078    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 19:39:39.579336 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.579180    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 19:39:39.579336 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.579189    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasSufficientPID"
Jul 30 19:39:39.580418 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.580401    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal"
Jul 30 19:39:39.580499 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.580437    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 19:39:39.581102 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.581087    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 19:39:39.581183 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.581116    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 19:39:39.581183 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.581131    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasSufficientPID"
Jul 30 19:39:39.594216 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.594194    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-200.ec2.internal\" not found" node="ip-10-0-134-200.ec2.internal"
Jul 30 19:39:39.598435 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.598421    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-200.ec2.internal\" not found" node="ip-10-0-134-200.ec2.internal"
Jul 30 19:39:39.611009 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.610988    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-200.ec2.internal\" not found"
Jul 30 19:39:39.624933 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.624913    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3dc51865d6685864a4b4f2bd96b4a37b-config\") pod \"kube-apiserver-proxy-ip-10-0-134-200.ec2.internal\" (UID: \"3dc51865d6685864a4b4f2bd96b4a37b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-200.ec2.internal"
Jul 30 19:39:39.625001 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.624937    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b4d93a9fae06bd9f23914c1e69705cf7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal\" (UID: \"b4d93a9fae06bd9f23914c1e69705cf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal"
Jul 30 19:39:39.625001 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.624957    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4d93a9fae06bd9f23914c1e69705cf7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal\" (UID: \"b4d93a9fae06bd9f23914c1e69705cf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal"
Jul 30 19:39:39.712392 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.712356    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-200.ec2.internal\" not found"
Jul 30 19:39:39.725359 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.725333    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3dc51865d6685864a4b4f2bd96b4a37b-config\") pod \"kube-apiserver-proxy-ip-10-0-134-200.ec2.internal\" (UID: \"3dc51865d6685864a4b4f2bd96b4a37b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-200.ec2.internal"
Jul 30 19:39:39.725429 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.725367    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b4d93a9fae06bd9f23914c1e69705cf7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal\" (UID: \"b4d93a9fae06bd9f23914c1e69705cf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal"
Jul 30 19:39:39.725429 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.725385    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4d93a9fae06bd9f23914c1e69705cf7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal\" (UID: \"b4d93a9fae06bd9f23914c1e69705cf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal"
Jul 30 19:39:39.725429 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.725421    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4d93a9fae06bd9f23914c1e69705cf7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal\" (UID: \"b4d93a9fae06bd9f23914c1e69705cf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal"
Jul 30 19:39:39.725535 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.725440    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b4d93a9fae06bd9f23914c1e69705cf7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal\" (UID: \"b4d93a9fae06bd9f23914c1e69705cf7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal"
Jul 30 19:39:39.725535 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.725415    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3dc51865d6685864a4b4f2bd96b4a37b-config\") pod \"kube-apiserver-proxy-ip-10-0-134-200.ec2.internal\" (UID: \"3dc51865d6685864a4b4f2bd96b4a37b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-200.ec2.internal"
Jul 30 19:39:39.812896 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.812849    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-200.ec2.internal\" not found"
Jul 30 19:39:39.902145 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.902113    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal"
Jul 30 19:39:39.902222 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:39.902123    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-200.ec2.internal"
Jul 30 19:39:39.913796 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:39.913776    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-200.ec2.internal\" not found"
Jul 30 19:39:40.014838 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:40.014805    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-200.ec2.internal\" not found"
Jul 30 19:39:40.121459 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:40.121406    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-200.ec2.internal\" not found"
Jul 30 19:39:40.224718 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:40.224684    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-200.ec2.internal\" not found"
Jul 30 19:39:40.230658 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:40.230629    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 19:39:40.232435 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:40.232419    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 19:39:40.261237 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:40.261216    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 30 19:39:40.261637 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:40.261318    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 19:39:40.261637 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:40.261347    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 19:39:40.261637 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:40.261360    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 19:39:40.325637 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:40.325611    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-200.ec2.internal\" not found"
Jul 30 19:39:40.386959 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:40.386902    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 19:34:40 +0000 UTC" deadline="2028-03-26 13:09:27.29691239 +0000 UTC"
Jul 30 19:39:40.386959 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:40.386929    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14513h29m46.909986103s"
Jul 30 19:39:40.426252 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:40.426214    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-200.ec2.internal\" not found"
Jul 30 19:39:40.527229 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:40.527206    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-200.ec2.internal\" not found"
Jul 30 19:39:40.553709 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:40.553692    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 19:39:40.555085 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:40.555062    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 19:39:40.555172 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:40.555096    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 19:39:40.555172 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:40.555109    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeHasSufficientPID"
Jul 30 19:39:40.560956 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:40.560931    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d93a9fae06bd9f23914c1e69705cf7.slice/crio-b17234352040cc73499fad905d163c670b404c6bd01f280f1fe21eebab1315bc WatchSource:0}: Error finding container b17234352040cc73499fad905d163c670b404c6bd01f280f1fe21eebab1315bc: Status 404 returned error can't find the container with id b17234352040cc73499fad905d163c670b404c6bd01f280f1fe21eebab1315bc
Jul 30 19:39:40.566849 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:40.566833    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 19:39:40.583296 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:40.583273    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 19:39:40.625054 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:40.625032    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-200.ec2.internal"
Jul 30 19:39:40.636039 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:40.636020    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 19:39:40.637280 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:40.637247    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal"
Jul 30 19:39:40.647635 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:40.647617    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 19:39:40.833910 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:40.833892    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dc51865d6685864a4b4f2bd96b4a37b.slice/crio-8ca1da2a414baa68283388150dbb712e7cb6bf2a0d8fe9c35e951f5b0f2f9171 WatchSource:0}: Error finding container 8ca1da2a414baa68283388150dbb712e7cb6bf2a0d8fe9c35e951f5b0f2f9171: Status 404 returned error can't find the container with id 8ca1da2a414baa68283388150dbb712e7cb6bf2a0d8fe9c35e951f5b0f2f9171
Jul 30 19:39:41.307886 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.307862    2568 apiserver.go:52] "Watching apiserver"
Jul 30 19:39:41.317494 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.317465    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 30 19:39:41.317884 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.317861    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-r56cv","kube-system/global-pull-secret-syncer-mv7nq","kube-system/konnectivity-agent-9gpps","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln","openshift-dns/node-resolver-zpc52","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal","openshift-multus/multus-additional-cni-plugins-qnlc6","openshift-multus/multus-mh5vv","openshift-multus/network-metrics-daemon-86z7s","kube-system/kube-apiserver-proxy-ip-10-0-134-200.ec2.internal","openshift-cluster-node-tuning-operator/tuned-pjt7g","openshift-image-registry/node-ca-2jrpc","openshift-network-diagnostics/network-check-target-nmtml","openshift-network-operator/iptables-alerter-62s26"]
Jul 30 19:39:41.319411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.319389    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.320561 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.320539    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:39:41.320679 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:41.320636    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:39:41.321826 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.321800    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9gpps"
Jul 30 19:39:41.322026 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.322007    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 30 19:39:41.322545 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.322338    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 30 19:39:41.322545 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.322344    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 30 19:39:41.322545 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.322395    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rtctb\""
Jul 30 19:39:41.322545 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.322429    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 30 19:39:41.322545 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.322544    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 30 19:39:41.323000 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.322979    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.323310 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.323291    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 30 19:39:41.323938 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.323916    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 30 19:39:41.324354 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.324159    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zpc52"
Jul 30 19:39:41.324822 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.324790    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n7479\""
Jul 30 19:39:41.324938 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.324801    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 30 19:39:41.325254 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.325233    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 30 19:39:41.325768 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.325749    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 30 19:39:41.325955 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.325938    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-62s26"
Jul 30 19:39:41.326096 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.326080    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5hbz8\""
Jul 30 19:39:41.326295 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.326275    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 30 19:39:41.326792 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.326773    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 30 19:39:41.326919 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.326896    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rxj9s\""
Jul 30 19:39:41.327070 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.327056    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 30 19:39:41.327220 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.327204    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:39:41.327304 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:41.327281    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:39:41.328328 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.328302    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 30 19:39:41.328469 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.328450    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fm6lb\""
Jul 30 19:39:41.328604 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.328580    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 30 19:39:41.328715 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.328696    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 30 19:39:41.329058 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.328972    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.330334 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.330313    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:41.330425 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:41.330378    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:39:41.331396 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.331375    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 30 19:39:41.331618 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.331600    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 30 19:39:41.331722 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.331649    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 30 19:39:41.331722 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.331697    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 30 19:39:41.331722 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.331716    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s7w95\""
Jul 30 19:39:41.331888 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.331731    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 30 19:39:41.332548 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.332427    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d757dd80-c33b-454b-9de0-4440157edd68-hosts-file\") pod \"node-resolver-zpc52\" (UID: \"d757dd80-c33b-454b-9de0-4440157edd68\") " pod="openshift-dns/node-resolver-zpc52"
Jul 30 19:39:41.332548 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.332465    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g45nq\" (UniqueName: \"kubernetes.io/projected/d757dd80-c33b-454b-9de0-4440157edd68-kube-api-access-g45nq\") pod \"node-resolver-zpc52\" (UID: \"d757dd80-c33b-454b-9de0-4440157edd68\") " pod="openshift-dns/node-resolver-zpc52"
Jul 30 19:39:41.332548 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.332493    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2f94aa8-23b3-4c33-beb7-8aebeac90767-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.332769 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.332548    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f2f94aa8-23b3-4c33-beb7-8aebeac90767-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.332769 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.332580    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7cfd4cae-3acd-4982-9f61-b94b5743f8e2-registration-dir\") pod \"aws-ebs-csi-driver-node-bfcln\" (UID: \"7cfd4cae-3acd-4982-9f61-b94b5743f8e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.332769 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.332607    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbznd\" (UniqueName: \"kubernetes.io/projected/7cfd4cae-3acd-4982-9f61-b94b5743f8e2-kube-api-access-kbznd\") pod \"aws-ebs-csi-driver-node-bfcln\" (UID: \"7cfd4cae-3acd-4982-9f61-b94b5743f8e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.332769 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.332657    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f2f94aa8-23b3-4c33-beb7-8aebeac90767-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.332769 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.332683    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7cfd4cae-3acd-4982-9f61-b94b5743f8e2-socket-dir\") pod \"aws-ebs-csi-driver-node-bfcln\" (UID: \"7cfd4cae-3acd-4982-9f61-b94b5743f8e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.332769 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.332708    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7cfd4cae-3acd-4982-9f61-b94b5743f8e2-etc-selinux\") pod \"aws-ebs-csi-driver-node-bfcln\" (UID: \"7cfd4cae-3acd-4982-9f61-b94b5743f8e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.332769 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.332734    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d757dd80-c33b-454b-9de0-4440157edd68-tmp-dir\") pod \"node-resolver-zpc52\" (UID: \"d757dd80-c33b-454b-9de0-4440157edd68\") " pod="openshift-dns/node-resolver-zpc52"
Jul 30 19:39:41.333116 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.332782    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8cb73230-50ef-4678-adb0-5b410131ece0-agent-certs\") pod \"konnectivity-agent-9gpps\" (UID: \"8cb73230-50ef-4678-adb0-5b410131ece0\") " pod="kube-system/konnectivity-agent-9gpps"
Jul 30 19:39:41.333116 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.332802    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8cb73230-50ef-4678-adb0-5b410131ece0-konnectivity-ca\") pod \"konnectivity-agent-9gpps\" (UID: \"8cb73230-50ef-4678-adb0-5b410131ece0\") " pod="kube-system/konnectivity-agent-9gpps"
Jul 30 19:39:41.333116 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.332830    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2f94aa8-23b3-4c33-beb7-8aebeac90767-system-cni-dir\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.333116 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.332857    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2f94aa8-23b3-4c33-beb7-8aebeac90767-cnibin\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.333725 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.333699    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2f94aa8-23b3-4c33-beb7-8aebeac90767-cni-binary-copy\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.333805 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.333779    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h9xb\" (UniqueName: \"kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb\") pod \"network-check-target-nmtml\" (UID: \"d8218233-3f22-47de-ad92-830ea3a1450f\") " pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:39:41.333861 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.333826    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2f94aa8-23b3-4c33-beb7-8aebeac90767-os-release\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.333919 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.333862    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djvt4\" (UniqueName: \"kubernetes.io/projected/f2f94aa8-23b3-4c33-beb7-8aebeac90767-kube-api-access-djvt4\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.333919 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.333897    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7cfd4cae-3acd-4982-9f61-b94b5743f8e2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bfcln\" (UID: \"7cfd4cae-3acd-4982-9f61-b94b5743f8e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.334023 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.333929    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7cfd4cae-3acd-4982-9f61-b94b5743f8e2-device-dir\") pod \"aws-ebs-csi-driver-node-bfcln\" (UID: \"7cfd4cae-3acd-4982-9f61-b94b5743f8e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.334023 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.333962    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7cfd4cae-3acd-4982-9f61-b94b5743f8e2-sys-fs\") pod \"aws-ebs-csi-driver-node-bfcln\" (UID: \"7cfd4cae-3acd-4982-9f61-b94b5743f8e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.335910 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.335885    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 30 19:39:41.337702 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.336334    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.337702 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.336340    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.338480 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.338430    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 19:39:41.339371 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.339033    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2jrpc"
Jul 30 19:39:41.339371 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.339163    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ghwwg\""
Jul 30 19:39:41.339371 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.339192    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 30 19:39:41.339580 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.339398    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 30 19:39:41.339640 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.339610    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 30 19:39:41.339724 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.339715    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qhqtt\""
Jul 30 19:39:41.341443 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.341354    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 30 19:39:41.341551 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.341477    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 30 19:39:41.341900 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.341879    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 30 19:39:41.341997 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.341921    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zh2bj\""
Jul 30 19:39:41.357205 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.357171    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vzw6p"
Jul 30 19:39:41.368221 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.368206    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vzw6p"
Jul 30 19:39:41.424461 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.424443    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 30 19:39:41.435177 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435155    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-run-ovn\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.435279 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435188    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/240109d1-295d-4d6d-9458-c4829d56128a-ovnkube-script-lib\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.435279 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435214    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cw7q\" (UniqueName: \"kubernetes.io/projected/240109d1-295d-4d6d-9458-c4829d56128a-kube-api-access-5cw7q\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.435279 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435238    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-multus-cni-dir\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.435412 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435277    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-host-var-lib-cni-multus\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.435412 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435313    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-multus-daemon-config\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.435412 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435347    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2f94aa8-23b3-4c33-beb7-8aebeac90767-cnibin\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.435412 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435372    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/879177db-60de-4eb3-9399-e2ccb55e23e2-tmp\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.435412 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435398    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-host-var-lib-cni-bin\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.435658 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435423    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2f94aa8-23b3-4c33-beb7-8aebeac90767-os-release\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.435658 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435433    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f2f94aa8-23b3-4c33-beb7-8aebeac90767-cnibin\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.435658 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435448    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs\") pod \"network-metrics-daemon-86z7s\" (UID: \"8f19aff0-c9c2-4e81-87c3-2d878901215b\") " pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:39:41.435658 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435471    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/879177db-60de-4eb3-9399-e2ccb55e23e2-etc-tuned\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.435658 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435508    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-host-kubelet\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.435658 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435523    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f2f94aa8-23b3-4c33-beb7-8aebeac90767-os-release\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.435658 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435555    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-host-cni-netd\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.435658 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435597    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-multus-socket-dir-parent\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.435658 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435627    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2f94aa8-23b3-4c33-beb7-8aebeac90767-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.435658 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435653    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f2f94aa8-23b3-4c33-beb7-8aebeac90767-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.436116 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435679    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-cni-binary-copy\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.436116 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435703    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-hostroot\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.436116 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435730    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7cfd4cae-3acd-4982-9f61-b94b5743f8e2-socket-dir\") pod \"aws-ebs-csi-driver-node-bfcln\" (UID: \"7cfd4cae-3acd-4982-9f61-b94b5743f8e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.436116 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435773    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-etc-modprobe-d\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.436116 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435792    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-host-cni-bin\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.436116 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435813    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.436116 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435813    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f2f94aa8-23b3-4c33-beb7-8aebeac90767-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.436116 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435836    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a6e31fef-83df-4b5f-9af8-c207817e875d-kubelet-config\") pod \"global-pull-secret-syncer-mv7nq\" (UID: \"a6e31fef-83df-4b5f-9af8-c207817e875d\") " pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:41.436116 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435884    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-systemd-units\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.436116 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435900    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-host-run-netns\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.436116 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435923    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5lkm\" (UniqueName: \"kubernetes.io/projected/82ec3276-358b-4dbf-bc7f-74ab582afa50-kube-api-access-p5lkm\") pod \"node-ca-2jrpc\" (UID: \"82ec3276-358b-4dbf-bc7f-74ab582afa50\") " pod="openshift-image-registry/node-ca-2jrpc"
Jul 30 19:39:41.436116 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435949    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h9xb\" (UniqueName: \"kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb\") pod \"network-check-target-nmtml\" (UID: \"d8218233-3f22-47de-ad92-830ea3a1450f\") " pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:39:41.436116 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435948    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7cfd4cae-3acd-4982-9f61-b94b5743f8e2-socket-dir\") pod \"aws-ebs-csi-driver-node-bfcln\" (UID: \"7cfd4cae-3acd-4982-9f61-b94b5743f8e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.436116 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435976    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-etc-kubernetes\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.436116 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.435999    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vr2n\" (UniqueName: \"kubernetes.io/projected/879177db-60de-4eb3-9399-e2ccb55e23e2-kube-api-access-2vr2n\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.436116 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436108    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-run-systemd\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.436913 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436134    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7cfd4cae-3acd-4982-9f61-b94b5743f8e2-device-dir\") pod \"aws-ebs-csi-driver-node-bfcln\" (UID: \"7cfd4cae-3acd-4982-9f61-b94b5743f8e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.436913 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436153    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/82ec3276-358b-4dbf-bc7f-74ab582afa50-serviceca\") pod \"node-ca-2jrpc\" (UID: \"82ec3276-358b-4dbf-bc7f-74ab582afa50\") " pod="openshift-image-registry/node-ca-2jrpc"
Jul 30 19:39:41.436913 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436168    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-etc-sysconfig\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.436913 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436230    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7cfd4cae-3acd-4982-9f61-b94b5743f8e2-device-dir\") pod \"aws-ebs-csi-driver-node-bfcln\" (UID: \"7cfd4cae-3acd-4982-9f61-b94b5743f8e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.436913 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436264    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/240109d1-295d-4d6d-9458-c4829d56128a-ovnkube-config\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.436913 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436294    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/240109d1-295d-4d6d-9458-c4829d56128a-ovn-node-metrics-cert\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.436913 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436320    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-etc-openvswitch\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.436913 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436367    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-node-log\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.436913 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436428    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7cfd4cae-3acd-4982-9f61-b94b5743f8e2-registration-dir\") pod \"aws-ebs-csi-driver-node-bfcln\" (UID: \"7cfd4cae-3acd-4982-9f61-b94b5743f8e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.436913 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436458    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7cfd4cae-3acd-4982-9f61-b94b5743f8e2-registration-dir\") pod \"aws-ebs-csi-driver-node-bfcln\" (UID: \"7cfd4cae-3acd-4982-9f61-b94b5743f8e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.436913 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436457    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbznd\" (UniqueName: \"kubernetes.io/projected/7cfd4cae-3acd-4982-9f61-b94b5743f8e2-kube-api-access-kbznd\") pod \"aws-ebs-csi-driver-node-bfcln\" (UID: \"7cfd4cae-3acd-4982-9f61-b94b5743f8e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.436913 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436521    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82ec3276-358b-4dbf-bc7f-74ab582afa50-host\") pod \"node-ca-2jrpc\" (UID: \"82ec3276-358b-4dbf-bc7f-74ab582afa50\") " pod="openshift-image-registry/node-ca-2jrpc"
Jul 30 19:39:41.436913 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436551    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-etc-systemd\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.436913 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436669    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-sys\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.436913 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436700    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-host\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.436913 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436728    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f2f94aa8-23b3-4c33-beb7-8aebeac90767-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.436913 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436758    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7cfd4cae-3acd-4982-9f61-b94b5743f8e2-etc-selinux\") pod \"aws-ebs-csi-driver-node-bfcln\" (UID: \"7cfd4cae-3acd-4982-9f61-b94b5743f8e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.437787 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436784    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d757dd80-c33b-454b-9de0-4440157edd68-tmp-dir\") pod \"node-resolver-zpc52\" (UID: \"d757dd80-c33b-454b-9de0-4440157edd68\") " pod="openshift-dns/node-resolver-zpc52"
Jul 30 19:39:41.437787 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436809    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-var-lib-kubelet\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.437787 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436833    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-host-slash\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.437787 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436831    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f2f94aa8-23b3-4c33-beb7-8aebeac90767-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.437787 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436856    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-os-release\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.437787 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436879    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-host-run-k8s-cni-cncf-io\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.437787 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436919    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg9b4\" (UniqueName: \"kubernetes.io/projected/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-kube-api-access-mg9b4\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.437787 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436923    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7cfd4cae-3acd-4982-9f61-b94b5743f8e2-etc-selinux\") pod \"aws-ebs-csi-driver-node-bfcln\" (UID: \"7cfd4cae-3acd-4982-9f61-b94b5743f8e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.437787 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436946    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8cb73230-50ef-4678-adb0-5b410131ece0-konnectivity-ca\") pod \"konnectivity-agent-9gpps\" (UID: \"8cb73230-50ef-4678-adb0-5b410131ece0\") " pod="kube-system/konnectivity-agent-9gpps"
Jul 30 19:39:41.437787 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.436973    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2f94aa8-23b3-4c33-beb7-8aebeac90767-cni-binary-copy\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.437787 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437001    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmzlx\" (UniqueName: \"kubernetes.io/projected/8f19aff0-c9c2-4e81-87c3-2d878901215b-kube-api-access-pmzlx\") pod \"network-metrics-daemon-86z7s\" (UID: \"8f19aff0-c9c2-4e81-87c3-2d878901215b\") " pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:39:41.437787 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437026    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-host-run-multus-certs\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.437787 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437072    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djvt4\" (UniqueName: \"kubernetes.io/projected/f2f94aa8-23b3-4c33-beb7-8aebeac90767-kube-api-access-djvt4\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.437787 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437096    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7cfd4cae-3acd-4982-9f61-b94b5743f8e2-sys-fs\") pod \"aws-ebs-csi-driver-node-bfcln\" (UID: \"7cfd4cae-3acd-4982-9f61-b94b5743f8e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.437787 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437120    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/deda4082-5e19-4f14-835f-41a8802fee20-iptables-alerter-script\") pod \"iptables-alerter-62s26\" (UID: \"deda4082-5e19-4f14-835f-41a8802fee20\") " pod="openshift-network-operator/iptables-alerter-62s26"
Jul 30 19:39:41.437787 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437144    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/240109d1-295d-4d6d-9458-c4829d56128a-env-overrides\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.438508 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437168    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a6e31fef-83df-4b5f-9af8-c207817e875d-dbus\") pod \"global-pull-secret-syncer-mv7nq\" (UID: \"a6e31fef-83df-4b5f-9af8-c207817e875d\") " pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:41.438508 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437180    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d757dd80-c33b-454b-9de0-4440157edd68-tmp-dir\") pod \"node-resolver-zpc52\" (UID: \"d757dd80-c33b-454b-9de0-4440157edd68\") " pod="openshift-dns/node-resolver-zpc52"
Jul 30 19:39:41.438508 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437194    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret\") pod \"global-pull-secret-syncer-mv7nq\" (UID: \"a6e31fef-83df-4b5f-9af8-c207817e875d\") " pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:41.438508 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437219    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-host-run-netns\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.438508 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437244    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-host-run-ovn-kubernetes\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.438508 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437267    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-cnibin\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.438508 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437281    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7cfd4cae-3acd-4982-9f61-b94b5743f8e2-sys-fs\") pod \"aws-ebs-csi-driver-node-bfcln\" (UID: \"7cfd4cae-3acd-4982-9f61-b94b5743f8e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.438508 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437291    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-host-var-lib-kubelet\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.438508 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437293    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f2f94aa8-23b3-4c33-beb7-8aebeac90767-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.438508 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437319    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tm8k\" (UniqueName: \"kubernetes.io/projected/deda4082-5e19-4f14-835f-41a8802fee20-kube-api-access-2tm8k\") pod \"iptables-alerter-62s26\" (UID: \"deda4082-5e19-4f14-835f-41a8802fee20\") " pod="openshift-network-operator/iptables-alerter-62s26"
Jul 30 19:39:41.438508 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437348    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8cb73230-50ef-4678-adb0-5b410131ece0-agent-certs\") pod \"konnectivity-agent-9gpps\" (UID: \"8cb73230-50ef-4678-adb0-5b410131ece0\") " pod="kube-system/konnectivity-agent-9gpps"
Jul 30 19:39:41.438508 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437396    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2f94aa8-23b3-4c33-beb7-8aebeac90767-system-cni-dir\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.438508 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437436    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-etc-sysctl-d\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.438508 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437439    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f2f94aa8-23b3-4c33-beb7-8aebeac90767-system-cni-dir\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.438508 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437442    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f2f94aa8-23b3-4c33-beb7-8aebeac90767-cni-binary-copy\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.438508 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437478    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-log-socket\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.438508 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437509    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-run-openvswitch\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.439309 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437610    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7cfd4cae-3acd-4982-9f61-b94b5743f8e2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bfcln\" (UID: \"7cfd4cae-3acd-4982-9f61-b94b5743f8e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.439309 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437643    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8cb73230-50ef-4678-adb0-5b410131ece0-konnectivity-ca\") pod \"konnectivity-agent-9gpps\" (UID: \"8cb73230-50ef-4678-adb0-5b410131ece0\") " pod="kube-system/konnectivity-agent-9gpps"
Jul 30 19:39:41.439309 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437649    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d757dd80-c33b-454b-9de0-4440157edd68-hosts-file\") pod \"node-resolver-zpc52\" (UID: \"d757dd80-c33b-454b-9de0-4440157edd68\") " pod="openshift-dns/node-resolver-zpc52"
Jul 30 19:39:41.439309 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437709    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g45nq\" (UniqueName: \"kubernetes.io/projected/d757dd80-c33b-454b-9de0-4440157edd68-kube-api-access-g45nq\") pod \"node-resolver-zpc52\" (UID: \"d757dd80-c33b-454b-9de0-4440157edd68\") " pod="openshift-dns/node-resolver-zpc52"
Jul 30 19:39:41.439309 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437715    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7cfd4cae-3acd-4982-9f61-b94b5743f8e2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bfcln\" (UID: \"7cfd4cae-3acd-4982-9f61-b94b5743f8e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.439309 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437738    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-run\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.439309 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437736    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 30 19:39:41.439309 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437776    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-var-lib-openvswitch\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.439309 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437785    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d757dd80-c33b-454b-9de0-4440157edd68-hosts-file\") pod \"node-resolver-zpc52\" (UID: \"d757dd80-c33b-454b-9de0-4440157edd68\") " pod="openshift-dns/node-resolver-zpc52"
Jul 30 19:39:41.439309 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437796    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-etc-sysctl-conf\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.439309 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437837    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-lib-modules\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.439309 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437874    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-system-cni-dir\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.439309 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437896    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-multus-conf-dir\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.439309 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437930    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-etc-kubernetes\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.439309 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.437964    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/deda4082-5e19-4f14-835f-41a8802fee20-host-slash\") pod \"iptables-alerter-62s26\" (UID: \"deda4082-5e19-4f14-835f-41a8802fee20\") " pod="openshift-network-operator/iptables-alerter-62s26"
Jul 30 19:39:41.442270 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.442251    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8cb73230-50ef-4678-adb0-5b410131ece0-agent-certs\") pod \"konnectivity-agent-9gpps\" (UID: \"8cb73230-50ef-4678-adb0-5b410131ece0\") " pod="kube-system/konnectivity-agent-9gpps"
Jul 30 19:39:41.442813 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:41.442791    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 19:39:41.442908 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:41.442820    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 19:39:41.442908 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:41.442839    2568 projected.go:196] Error preparing data for projected volume kube-api-access-9h9xb for pod openshift-network-diagnostics/network-check-target-nmtml: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:41.442908 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:41.442905    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb podName:d8218233-3f22-47de-ad92-830ea3a1450f nodeName:}" failed. No retries permitted until 2026-07-30 19:39:41.94287508 +0000 UTC m=+3.042956261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9h9xb" (UniqueName: "kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb") pod "network-check-target-nmtml" (UID: "d8218233-3f22-47de-ad92-830ea3a1450f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:41.445097 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.445070    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbznd\" (UniqueName: \"kubernetes.io/projected/7cfd4cae-3acd-4982-9f61-b94b5743f8e2-kube-api-access-kbznd\") pod \"aws-ebs-csi-driver-node-bfcln\" (UID: \"7cfd4cae-3acd-4982-9f61-b94b5743f8e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.445982 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.445960    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djvt4\" (UniqueName: \"kubernetes.io/projected/f2f94aa8-23b3-4c33-beb7-8aebeac90767-kube-api-access-djvt4\") pod \"multus-additional-cni-plugins-qnlc6\" (UID: \"f2f94aa8-23b3-4c33-beb7-8aebeac90767\") " pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.446458 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.446438    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g45nq\" (UniqueName: \"kubernetes.io/projected/d757dd80-c33b-454b-9de0-4440157edd68-kube-api-access-g45nq\") pod \"node-resolver-zpc52\" (UID: \"d757dd80-c33b-454b-9de0-4440157edd68\") " pod="openshift-dns/node-resolver-zpc52"
Jul 30 19:39:41.480262 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.480206    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-200.ec2.internal" event={"ID":"3dc51865d6685864a4b4f2bd96b4a37b","Type":"ContainerStarted","Data":"8ca1da2a414baa68283388150dbb712e7cb6bf2a0d8fe9c35e951f5b0f2f9171"}
Jul 30 19:39:41.481504 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.481483    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal" event={"ID":"b4d93a9fae06bd9f23914c1e69705cf7","Type":"ContainerStarted","Data":"b17234352040cc73499fad905d163c670b404c6bd01f280f1fe21eebab1315bc"}
Jul 30 19:39:41.538458 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538434    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-var-lib-openvswitch\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.538554 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538466    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-etc-sysctl-conf\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.538554 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538486    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-lib-modules\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.538554 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538502    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-system-cni-dir\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.538554 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538517    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-multus-conf-dir\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.538554 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538532    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-etc-kubernetes\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.538828 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538575    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-etc-kubernetes\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.538828 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538600    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-var-lib-openvswitch\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.538828 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538616    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-system-cni-dir\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.538828 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538620    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-etc-sysctl-conf\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.538828 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538649    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/deda4082-5e19-4f14-835f-41a8802fee20-host-slash\") pod \"iptables-alerter-62s26\" (UID: \"deda4082-5e19-4f14-835f-41a8802fee20\") " pod="openshift-network-operator/iptables-alerter-62s26"
Jul 30 19:39:41.538828 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538636    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-lib-modules\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.538828 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538620    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-multus-conf-dir\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.538828 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538679    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-run-ovn\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.538828 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538701    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/deda4082-5e19-4f14-835f-41a8802fee20-host-slash\") pod \"iptables-alerter-62s26\" (UID: \"deda4082-5e19-4f14-835f-41a8802fee20\") " pod="openshift-network-operator/iptables-alerter-62s26"
Jul 30 19:39:41.538828 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538712    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-run-ovn\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.538828 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538744    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/240109d1-295d-4d6d-9458-c4829d56128a-ovnkube-script-lib\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.538828 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538765    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cw7q\" (UniqueName: \"kubernetes.io/projected/240109d1-295d-4d6d-9458-c4829d56128a-kube-api-access-5cw7q\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.538828 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538782    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-multus-cni-dir\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.538828 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538798    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-host-var-lib-cni-multus\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.538828 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538821    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-multus-daemon-config\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.539620 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538844    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/879177db-60de-4eb3-9399-e2ccb55e23e2-tmp\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.539620 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538859    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-host-var-lib-cni-multus\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.539620 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538948    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-host-var-lib-cni-bin\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.539620 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538977    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-multus-cni-dir\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.539620 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.538982    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs\") pod \"network-metrics-daemon-86z7s\" (UID: \"8f19aff0-c9c2-4e81-87c3-2d878901215b\") " pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:39:41.539620 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539023    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-host-var-lib-cni-bin\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.539620 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539041    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/879177db-60de-4eb3-9399-e2ccb55e23e2-etc-tuned\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.539620 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:41.539056    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:41.539620 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539068    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-host-kubelet\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.539620 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539094    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-host-cni-netd\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.539620 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:41.539112    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs podName:8f19aff0-c9c2-4e81-87c3-2d878901215b nodeName:}" failed. No retries permitted until 2026-07-30 19:39:42.039094573 +0000 UTC m=+3.139175742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs") pod "network-metrics-daemon-86z7s" (UID: "8f19aff0-c9c2-4e81-87c3-2d878901215b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:41.539620 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539134    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-host-cni-netd\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.539620 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539140    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-multus-socket-dir-parent\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.539620 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539156    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-host-kubelet\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.539620 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539170    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-cni-binary-copy\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.539620 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539194    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-hostroot\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.539620 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539220    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-etc-modprobe-d\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.539620 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539232    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-multus-socket-dir-parent\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.540571 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539247    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-host-cni-bin\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.540571 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539273    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-hostroot\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.540571 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539279    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.540571 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539308    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a6e31fef-83df-4b5f-9af8-c207817e875d-kubelet-config\") pod \"global-pull-secret-syncer-mv7nq\" (UID: \"a6e31fef-83df-4b5f-9af8-c207817e875d\") " pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:41.540571 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539332    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-systemd-units\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.540571 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539331    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/240109d1-295d-4d6d-9458-c4829d56128a-ovnkube-script-lib\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.540571 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539377    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-host-cni-bin\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.540571 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539391    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.540571 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539401    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-systemd-units\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.540571 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539405    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-multus-daemon-config\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.540571 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539413    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-host-run-netns\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.540571 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539442    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-etc-modprobe-d\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.540571 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539453    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-host-run-netns\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.540571 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539448    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5lkm\" (UniqueName: \"kubernetes.io/projected/82ec3276-358b-4dbf-bc7f-74ab582afa50-kube-api-access-p5lkm\") pod \"node-ca-2jrpc\" (UID: \"82ec3276-358b-4dbf-bc7f-74ab582afa50\") " pod="openshift-image-registry/node-ca-2jrpc"
Jul 30 19:39:41.540571 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539498    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a6e31fef-83df-4b5f-9af8-c207817e875d-kubelet-config\") pod \"global-pull-secret-syncer-mv7nq\" (UID: \"a6e31fef-83df-4b5f-9af8-c207817e875d\") " pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:41.540571 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539513    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-etc-kubernetes\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.540571 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539553    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vr2n\" (UniqueName: \"kubernetes.io/projected/879177db-60de-4eb3-9399-e2ccb55e23e2-kube-api-access-2vr2n\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.541411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539581    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-run-systemd\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.541411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539628    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-etc-kubernetes\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.541411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539647    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-run-systemd\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.541411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539688    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/82ec3276-358b-4dbf-bc7f-74ab582afa50-serviceca\") pod \"node-ca-2jrpc\" (UID: \"82ec3276-358b-4dbf-bc7f-74ab582afa50\") " pod="openshift-image-registry/node-ca-2jrpc"
Jul 30 19:39:41.541411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539728    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-etc-sysconfig\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.541411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539759    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-cni-binary-copy\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.541411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539781    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-etc-sysconfig\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.541411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539804    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/240109d1-295d-4d6d-9458-c4829d56128a-ovnkube-config\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.541411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539831    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/240109d1-295d-4d6d-9458-c4829d56128a-ovn-node-metrics-cert\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.541411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539894    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-etc-openvswitch\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.541411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539920    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-node-log\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.541411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539957    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82ec3276-358b-4dbf-bc7f-74ab582afa50-host\") pod \"node-ca-2jrpc\" (UID: \"82ec3276-358b-4dbf-bc7f-74ab582afa50\") " pod="openshift-image-registry/node-ca-2jrpc"
Jul 30 19:39:41.541411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.539992    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-etc-systemd\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.541411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540019    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-sys\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.541411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540044    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-host\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.541411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540063    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-etc-systemd\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.541411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540075    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-var-lib-kubelet\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.541411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540102    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-host-slash\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.542010 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540114    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-sys\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.542010 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540129    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-os-release\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.542010 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540156    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-host-run-k8s-cni-cncf-io\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.542010 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540020    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-node-log\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.542010 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540174    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/82ec3276-358b-4dbf-bc7f-74ab582afa50-serviceca\") pod \"node-ca-2jrpc\" (UID: \"82ec3276-358b-4dbf-bc7f-74ab582afa50\") " pod="openshift-image-registry/node-ca-2jrpc"
Jul 30 19:39:41.542010 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540182    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg9b4\" (UniqueName: \"kubernetes.io/projected/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-kube-api-access-mg9b4\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.542010 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540213    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmzlx\" (UniqueName: \"kubernetes.io/projected/8f19aff0-c9c2-4e81-87c3-2d878901215b-kube-api-access-pmzlx\") pod \"network-metrics-daemon-86z7s\" (UID: \"8f19aff0-c9c2-4e81-87c3-2d878901215b\") " pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:39:41.542010 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540233    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82ec3276-358b-4dbf-bc7f-74ab582afa50-host\") pod \"node-ca-2jrpc\" (UID: \"82ec3276-358b-4dbf-bc7f-74ab582afa50\") " pod="openshift-image-registry/node-ca-2jrpc"
Jul 30 19:39:41.542010 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540180    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-etc-openvswitch\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.542010 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540251    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-var-lib-kubelet\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.542010 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540274    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/240109d1-295d-4d6d-9458-c4829d56128a-ovnkube-config\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.542010 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540288    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-host-slash\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.542010 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540320    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-host\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.542010 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540348    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-host-run-multus-certs\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.542010 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540360    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-host-run-k8s-cni-cncf-io\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.542010 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540371    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-host-run-multus-certs\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.542010 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540364    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-os-release\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.542010 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540382    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/deda4082-5e19-4f14-835f-41a8802fee20-iptables-alerter-script\") pod \"iptables-alerter-62s26\" (UID: \"deda4082-5e19-4f14-835f-41a8802fee20\") " pod="openshift-network-operator/iptables-alerter-62s26"
Jul 30 19:39:41.542561 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540498    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/240109d1-295d-4d6d-9458-c4829d56128a-env-overrides\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.542561 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540518    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a6e31fef-83df-4b5f-9af8-c207817e875d-dbus\") pod \"global-pull-secret-syncer-mv7nq\" (UID: \"a6e31fef-83df-4b5f-9af8-c207817e875d\") " pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:41.542561 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540606    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a6e31fef-83df-4b5f-9af8-c207817e875d-dbus\") pod \"global-pull-secret-syncer-mv7nq\" (UID: \"a6e31fef-83df-4b5f-9af8-c207817e875d\") " pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:41.542561 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540614    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret\") pod \"global-pull-secret-syncer-mv7nq\" (UID: \"a6e31fef-83df-4b5f-9af8-c207817e875d\") " pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:41.542561 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540640    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-host-run-netns\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.542561 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540731    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-host-run-netns\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.542561 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:41.540735    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:41.542561 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540795    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-host-run-ovn-kubernetes\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.542561 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:41.540857    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret podName:a6e31fef-83df-4b5f-9af8-c207817e875d nodeName:}" failed. No retries permitted until 2026-07-30 19:39:42.040838841 +0000 UTC m=+3.140920010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret") pod "global-pull-secret-syncer-mv7nq" (UID: "a6e31fef-83df-4b5f-9af8-c207817e875d") : object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:41.542561 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540866    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-host-run-ovn-kubernetes\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.542561 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540899    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-cnibin\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.542561 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540934    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-host-var-lib-kubelet\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.542561 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540989    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-cnibin\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.542561 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.541005    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tm8k\" (UniqueName: \"kubernetes.io/projected/deda4082-5e19-4f14-835f-41a8802fee20-kube-api-access-2tm8k\") pod \"iptables-alerter-62s26\" (UID: \"deda4082-5e19-4f14-835f-41a8802fee20\") " pod="openshift-network-operator/iptables-alerter-62s26"
Jul 30 19:39:41.542561 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.541045    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-etc-sysctl-d\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.542561 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.541071    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-log-socket\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.542561 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.541095    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-run-openvswitch\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.543081 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.541104    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/deda4082-5e19-4f14-835f-41a8802fee20-iptables-alerter-script\") pod \"iptables-alerter-62s26\" (UID: \"deda4082-5e19-4f14-835f-41a8802fee20\") " pod="openshift-network-operator/iptables-alerter-62s26"
Jul 30 19:39:41.543081 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.541126    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-run\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.543081 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540969    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/240109d1-295d-4d6d-9458-c4829d56128a-env-overrides\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.543081 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.541197    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-run\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.543081 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.540977    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-host-var-lib-kubelet\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.543081 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.541229    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/879177db-60de-4eb3-9399-e2ccb55e23e2-etc-sysctl-d\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.543081 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.541238    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-run-openvswitch\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.543081 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.541250    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/240109d1-295d-4d6d-9458-c4829d56128a-log-socket\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.543081 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.541443    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/879177db-60de-4eb3-9399-e2ccb55e23e2-tmp\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.543081 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.542611    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/240109d1-295d-4d6d-9458-c4829d56128a-ovn-node-metrics-cert\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.543081 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.542627    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/879177db-60de-4eb3-9399-e2ccb55e23e2-etc-tuned\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.548038 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.548012    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cw7q\" (UniqueName: \"kubernetes.io/projected/240109d1-295d-4d6d-9458-c4829d56128a-kube-api-access-5cw7q\") pod \"ovnkube-node-r56cv\" (UID: \"240109d1-295d-4d6d-9458-c4829d56128a\") " pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.548628 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.548596    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5lkm\" (UniqueName: \"kubernetes.io/projected/82ec3276-358b-4dbf-bc7f-74ab582afa50-kube-api-access-p5lkm\") pod \"node-ca-2jrpc\" (UID: \"82ec3276-358b-4dbf-bc7f-74ab582afa50\") " pod="openshift-image-registry/node-ca-2jrpc"
Jul 30 19:39:41.548733 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.548586    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg9b4\" (UniqueName: \"kubernetes.io/projected/d69b93d6-a4ba-421e-808a-2b07c9c4ccb9-kube-api-access-mg9b4\") pod \"multus-mh5vv\" (UID: \"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9\") " pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.549051 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.549028    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmzlx\" (UniqueName: \"kubernetes.io/projected/8f19aff0-c9c2-4e81-87c3-2d878901215b-kube-api-access-pmzlx\") pod \"network-metrics-daemon-86z7s\" (UID: \"8f19aff0-c9c2-4e81-87c3-2d878901215b\") " pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:39:41.549139 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.549028    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tm8k\" (UniqueName: \"kubernetes.io/projected/deda4082-5e19-4f14-835f-41a8802fee20-kube-api-access-2tm8k\") pod \"iptables-alerter-62s26\" (UID: \"deda4082-5e19-4f14-835f-41a8802fee20\") " pod="openshift-network-operator/iptables-alerter-62s26"
Jul 30 19:39:41.549139 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.549066    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vr2n\" (UniqueName: \"kubernetes.io/projected/879177db-60de-4eb3-9399-e2ccb55e23e2-kube-api-access-2vr2n\") pod \"tuned-pjt7g\" (UID: \"879177db-60de-4eb3-9399-e2ccb55e23e2\") " pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.635202 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.635134    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qnlc6"
Jul 30 19:39:41.641304 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.641279    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zpc52"
Jul 30 19:39:41.649163 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.649131    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9gpps"
Jul 30 19:39:41.654722 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.654703    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln"
Jul 30 19:39:41.661346 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.661321    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-62s26"
Jul 30 19:39:41.667463 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.667441    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:39:41.672370 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.672350    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pjt7g"
Jul 30 19:39:41.677884 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.677861    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mh5vv"
Jul 30 19:39:41.681710 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.681691    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2jrpc"
Jul 30 19:39:41.825033 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.824969    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 19:39:41.931786 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.931715    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 19:39:41.943737 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:41.943122    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h9xb\" (UniqueName: \"kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb\") pod \"network-check-target-nmtml\" (UID: \"d8218233-3f22-47de-ad92-830ea3a1450f\") " pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:39:41.943737 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:41.943298    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 19:39:41.943737 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:41.943321    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 19:39:41.943737 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:41.943334    2568 projected.go:196] Error preparing data for projected volume kube-api-access-9h9xb for pod openshift-network-diagnostics/network-check-target-nmtml: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:41.943737 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:41.943387    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb podName:d8218233-3f22-47de-ad92-830ea3a1450f nodeName:}" failed. No retries permitted until 2026-07-30 19:39:42.943369237 +0000 UTC m=+4.043450407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9h9xb" (UniqueName: "kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb") pod "network-check-target-nmtml" (UID: "d8218233-3f22-47de-ad92-830ea3a1450f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:42.043757 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:42.043721    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret\") pod \"global-pull-secret-syncer-mv7nq\" (UID: \"a6e31fef-83df-4b5f-9af8-c207817e875d\") " pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:42.043941 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:42.043783    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs\") pod \"network-metrics-daemon-86z7s\" (UID: \"8f19aff0-c9c2-4e81-87c3-2d878901215b\") " pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:39:42.043941 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:42.043912    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:42.043941 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:42.043936    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:42.044114 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:42.044008    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret podName:a6e31fef-83df-4b5f-9af8-c207817e875d nodeName:}" failed. No retries permitted until 2026-07-30 19:39:43.043981713 +0000 UTC m=+4.144062901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret") pod "global-pull-secret-syncer-mv7nq" (UID: "a6e31fef-83df-4b5f-9af8-c207817e875d") : object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:42.044114 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:42.044033    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs podName:8f19aff0-c9c2-4e81-87c3-2d878901215b nodeName:}" failed. No retries permitted until 2026-07-30 19:39:43.044022199 +0000 UTC m=+4.144103366 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs") pod "network-metrics-daemon-86z7s" (UID: "8f19aff0-c9c2-4e81-87c3-2d878901215b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:42.088011 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:42.087974    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod879177db_60de_4eb3_9399_e2ccb55e23e2.slice/crio-e5f6104b13208fcb6bd72d41018641c4d05ea4afb926839061fae5b7040a1875 WatchSource:0}: Error finding container e5f6104b13208fcb6bd72d41018641c4d05ea4afb926839061fae5b7040a1875: Status 404 returned error can't find the container with id e5f6104b13208fcb6bd72d41018641c4d05ea4afb926839061fae5b7040a1875
Jul 30 19:39:42.088773 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:42.088734    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod240109d1_295d_4d6d_9458_c4829d56128a.slice/crio-f39e9d3043fe2d601899754e531a7ffd773a7fcc43c655476b560d6ecea7e751 WatchSource:0}: Error finding container f39e9d3043fe2d601899754e531a7ffd773a7fcc43c655476b560d6ecea7e751: Status 404 returned error can't find the container with id f39e9d3043fe2d601899754e531a7ffd773a7fcc43c655476b560d6ecea7e751
Jul 30 19:39:42.096175 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:42.096102    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd757dd80_c33b_454b_9de0_4440157edd68.slice/crio-f8448d8f131ade0819bf2c7f31cd048bc3649800d7d299494f89df69e5dfeec0 WatchSource:0}: Error finding container f8448d8f131ade0819bf2c7f31cd048bc3649800d7d299494f89df69e5dfeec0: Status 404 returned error can't find the container with id f8448d8f131ade0819bf2c7f31cd048bc3649800d7d299494f89df69e5dfeec0
Jul 30 19:39:42.098479 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:42.098449    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cfd4cae_3acd_4982_9f61_b94b5743f8e2.slice/crio-6a5fceb4b2207b7a637a8093d61488e3946aa3e915c297a1c25965422038bfd0 WatchSource:0}: Error finding container 6a5fceb4b2207b7a637a8093d61488e3946aa3e915c297a1c25965422038bfd0: Status 404 returned error can't find the container with id 6a5fceb4b2207b7a637a8093d61488e3946aa3e915c297a1c25965422038bfd0
Jul 30 19:39:42.100402 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:42.100375    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ec3276_358b_4dbf_bc7f_74ab582afa50.slice/crio-006ce0db325398f26fa41965042365db80291639523dcbe6668f292d71f0bfb5 WatchSource:0}: Error finding container 006ce0db325398f26fa41965042365db80291639523dcbe6668f292d71f0bfb5: Status 404 returned error can't find the container with id 006ce0db325398f26fa41965042365db80291639523dcbe6668f292d71f0bfb5
Jul 30 19:39:42.101145 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:42.101109    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeda4082_5e19_4f14_835f_41a8802fee20.slice/crio-8a7b8f63cc2379a258ac4095c03768db371caa1d48041c9ed69fcd498100191e WatchSource:0}: Error finding container 8a7b8f63cc2379a258ac4095c03768db371caa1d48041c9ed69fcd498100191e: Status 404 returned error can't find the container with id 8a7b8f63cc2379a258ac4095c03768db371caa1d48041c9ed69fcd498100191e
Jul 30 19:39:42.103238 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:39:42.103200    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cb73230_50ef_4678_adb0_5b410131ece0.slice/crio-e928fa006cf017855371d6feb68d681acdb8a49dddce9663ab538571533c2839 WatchSource:0}: Error finding container e928fa006cf017855371d6feb68d681acdb8a49dddce9663ab538571533c2839: Status 404 returned error can't find the container with id e928fa006cf017855371d6feb68d681acdb8a49dddce9663ab538571533c2839
Jul 30 19:39:42.314925 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:42.314837    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 19:39:42.370157 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:42.370125    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 19:34:42 +0000 UTC" deadline="2028-02-08 13:25:31.203586775 +0000 UTC"
Jul 30 19:39:42.370269 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:42.370158    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13385h45m48.833433066s"
Jul 30 19:39:42.475221 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:42.475196    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:42.475364 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:42.475339    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:39:42.484778 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:42.484750    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9gpps" event={"ID":"8cb73230-50ef-4678-adb0-5b410131ece0","Type":"ContainerStarted","Data":"e928fa006cf017855371d6feb68d681acdb8a49dddce9663ab538571533c2839"}
Jul 30 19:39:42.486108 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:42.486082    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2jrpc" event={"ID":"82ec3276-358b-4dbf-bc7f-74ab582afa50","Type":"ContainerStarted","Data":"006ce0db325398f26fa41965042365db80291639523dcbe6668f292d71f0bfb5"}
Jul 30 19:39:42.487489 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:42.487460    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-62s26" event={"ID":"deda4082-5e19-4f14-835f-41a8802fee20","Type":"ContainerStarted","Data":"8a7b8f63cc2379a258ac4095c03768db371caa1d48041c9ed69fcd498100191e"}
Jul 30 19:39:42.488801 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:42.488774    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qnlc6" event={"ID":"f2f94aa8-23b3-4c33-beb7-8aebeac90767","Type":"ContainerStarted","Data":"bf5ede68bee0d0a7f1fe4d8a937b6e152229e6a707befbed42518676c1bcd55c"}
Jul 30 19:39:42.490097 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:42.490069    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pjt7g" event={"ID":"879177db-60de-4eb3-9399-e2ccb55e23e2","Type":"ContainerStarted","Data":"e5f6104b13208fcb6bd72d41018641c4d05ea4afb926839061fae5b7040a1875"}
Jul 30 19:39:42.491452 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:42.491425    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln" event={"ID":"7cfd4cae-3acd-4982-9f61-b94b5743f8e2","Type":"ContainerStarted","Data":"6a5fceb4b2207b7a637a8093d61488e3946aa3e915c297a1c25965422038bfd0"}
Jul 30 19:39:42.492776 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:42.492752    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mh5vv" event={"ID":"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9","Type":"ContainerStarted","Data":"c4196de96d68334c918a51815210e528b1670a2d65e495bb2588c6619aefa2a1"}
Jul 30 19:39:42.494037 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:42.494012    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zpc52" event={"ID":"d757dd80-c33b-454b-9de0-4440157edd68","Type":"ContainerStarted","Data":"f8448d8f131ade0819bf2c7f31cd048bc3649800d7d299494f89df69e5dfeec0"}
Jul 30 19:39:42.495461 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:42.495436    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r56cv" event={"ID":"240109d1-295d-4d6d-9458-c4829d56128a","Type":"ContainerStarted","Data":"f39e9d3043fe2d601899754e531a7ffd773a7fcc43c655476b560d6ecea7e751"}
Jul 30 19:39:42.497885 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:42.497859    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal" event={"ID":"b4d93a9fae06bd9f23914c1e69705cf7","Type":"ContainerStarted","Data":"72014165c6208406d86454ffbcdc134e812c2f2afc81606d5d98b5c0cabef8c2"}
Jul 30 19:39:42.951787 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:42.951737    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h9xb\" (UniqueName: \"kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb\") pod \"network-check-target-nmtml\" (UID: \"d8218233-3f22-47de-ad92-830ea3a1450f\") " pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:39:42.952006 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:42.951951    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 19:39:42.952006 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:42.951976    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 19:39:42.952006 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:42.951990    2568 projected.go:196] Error preparing data for projected volume kube-api-access-9h9xb for pod openshift-network-diagnostics/network-check-target-nmtml: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:42.952206 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:42.952052    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb podName:d8218233-3f22-47de-ad92-830ea3a1450f nodeName:}" failed. No retries permitted until 2026-07-30 19:39:44.952031899 +0000 UTC m=+6.052113069 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9h9xb" (UniqueName: "kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb") pod "network-check-target-nmtml" (UID: "d8218233-3f22-47de-ad92-830ea3a1450f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:43.052744 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:43.052192    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs\") pod \"network-metrics-daemon-86z7s\" (UID: \"8f19aff0-c9c2-4e81-87c3-2d878901215b\") " pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:39:43.052744 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:43.052289    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret\") pod \"global-pull-secret-syncer-mv7nq\" (UID: \"a6e31fef-83df-4b5f-9af8-c207817e875d\") " pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:43.052744 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:43.052432    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:43.052744 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:43.052502    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret podName:a6e31fef-83df-4b5f-9af8-c207817e875d nodeName:}" failed. No retries permitted until 2026-07-30 19:39:45.052479444 +0000 UTC m=+6.152560632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret") pod "global-pull-secret-syncer-mv7nq" (UID: "a6e31fef-83df-4b5f-9af8-c207817e875d") : object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:43.052744 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:43.052634    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:43.052744 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:43.052689    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs podName:8f19aff0-c9c2-4e81-87c3-2d878901215b nodeName:}" failed. No retries permitted until 2026-07-30 19:39:45.052673938 +0000 UTC m=+6.152755122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs") pod "network-metrics-daemon-86z7s" (UID: "8f19aff0-c9c2-4e81-87c3-2d878901215b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:43.374059 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:43.370456    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 19:34:42 +0000 UTC" deadline="2028-03-17 15:28:33.966351539 +0000 UTC"
Jul 30 19:39:43.374059 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:43.370515    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14299h48m50.59584068s"
Jul 30 19:39:43.475780 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:43.475749    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:39:43.475926 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:43.475888    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:39:43.476417 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:43.476396    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:39:43.476534 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:43.476516    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:39:43.507486 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:43.507390    2568 generic.go:356] "Generic (PLEG): container finished" podID="b4d93a9fae06bd9f23914c1e69705cf7" containerID="72014165c6208406d86454ffbcdc134e812c2f2afc81606d5d98b5c0cabef8c2" exitCode=0
Jul 30 19:39:43.507601 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:43.507488    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal" event={"ID":"b4d93a9fae06bd9f23914c1e69705cf7","Type":"ContainerDied","Data":"72014165c6208406d86454ffbcdc134e812c2f2afc81606d5d98b5c0cabef8c2"}
Jul 30 19:39:43.515359 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:43.515329    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-200.ec2.internal" event={"ID":"3dc51865d6685864a4b4f2bd96b4a37b","Type":"ContainerStarted","Data":"4a3db033832f73821dc131839ae45d0e970f132b79c2f90026b4144422e8c96e"}
Jul 30 19:39:44.476561 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:44.476063    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:44.476561 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:44.476197    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:39:44.526459 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:44.526257    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal" event={"ID":"b4d93a9fae06bd9f23914c1e69705cf7","Type":"ContainerStarted","Data":"9f97bd515ca6b177d6318a43da8e4eca7710def0bcd64d66bb304ccefb4d413a"}
Jul 30 19:39:44.542007 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:44.541821    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-200.ec2.internal" podStartSLOduration=3.541799951 podStartE2EDuration="3.541799951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:43.542346727 +0000 UTC m=+4.642427919" watchObservedRunningTime="2026-07-30 19:39:44.541799951 +0000 UTC m=+5.641881144"
Jul 30 19:39:44.968775 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:44.968660    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h9xb\" (UniqueName: \"kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb\") pod \"network-check-target-nmtml\" (UID: \"d8218233-3f22-47de-ad92-830ea3a1450f\") " pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:39:44.968950 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:44.968843    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 19:39:44.968950 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:44.968866    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 19:39:44.968950 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:44.968881    2568 projected.go:196] Error preparing data for projected volume kube-api-access-9h9xb for pod openshift-network-diagnostics/network-check-target-nmtml: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:44.968950 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:44.968950    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb podName:d8218233-3f22-47de-ad92-830ea3a1450f nodeName:}" failed. No retries permitted until 2026-07-30 19:39:48.968929409 +0000 UTC m=+10.069010578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9h9xb" (UniqueName: "kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb") pod "network-check-target-nmtml" (UID: "d8218233-3f22-47de-ad92-830ea3a1450f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:45.069932 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:45.069895    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret\") pod \"global-pull-secret-syncer-mv7nq\" (UID: \"a6e31fef-83df-4b5f-9af8-c207817e875d\") " pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:45.070112 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:45.069962    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs\") pod \"network-metrics-daemon-86z7s\" (UID: \"8f19aff0-c9c2-4e81-87c3-2d878901215b\") " pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:39:45.070112 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:45.070082    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:45.070248 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:45.070143    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs podName:8f19aff0-c9c2-4e81-87c3-2d878901215b nodeName:}" failed. No retries permitted until 2026-07-30 19:39:49.070125315 +0000 UTC m=+10.170206486 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs") pod "network-metrics-daemon-86z7s" (UID: "8f19aff0-c9c2-4e81-87c3-2d878901215b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:45.070248 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:45.070082    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:45.070248 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:45.070191    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret podName:a6e31fef-83df-4b5f-9af8-c207817e875d nodeName:}" failed. No retries permitted until 2026-07-30 19:39:49.070180999 +0000 UTC m=+10.170262169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret") pod "global-pull-secret-syncer-mv7nq" (UID: "a6e31fef-83df-4b5f-9af8-c207817e875d") : object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:45.475438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:45.475402    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:39:45.475662 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:45.475621    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:39:45.477746 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:45.477721    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:39:45.478172 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:45.477857    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:39:46.475619 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:46.475559    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:46.476087 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:46.476055    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:39:47.476905 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:47.476871    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:39:47.477393 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:47.476887    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:39:47.477393 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:47.477016    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:39:47.477393 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:47.477146    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:39:48.475406 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:48.475290    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:48.475613 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:48.475440    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:39:49.006016 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:49.005944    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h9xb\" (UniqueName: \"kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb\") pod \"network-check-target-nmtml\" (UID: \"d8218233-3f22-47de-ad92-830ea3a1450f\") " pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:39:49.006467 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:49.006102    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 19:39:49.006467 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:49.006127    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 19:39:49.006467 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:49.006142    2568 projected.go:196] Error preparing data for projected volume kube-api-access-9h9xb for pod openshift-network-diagnostics/network-check-target-nmtml: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:49.006467 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:49.006207    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb podName:d8218233-3f22-47de-ad92-830ea3a1450f nodeName:}" failed. No retries permitted until 2026-07-30 19:39:57.006187756 +0000 UTC m=+18.106268925 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9h9xb" (UniqueName: "kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb") pod "network-check-target-nmtml" (UID: "d8218233-3f22-47de-ad92-830ea3a1450f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:49.106607 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:49.106554    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs\") pod \"network-metrics-daemon-86z7s\" (UID: \"8f19aff0-c9c2-4e81-87c3-2d878901215b\") " pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:39:49.106763 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:49.106679    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret\") pod \"global-pull-secret-syncer-mv7nq\" (UID: \"a6e31fef-83df-4b5f-9af8-c207817e875d\") " pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:49.106763 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:49.106689    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:49.106858 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:49.106767    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs podName:8f19aff0-c9c2-4e81-87c3-2d878901215b nodeName:}" failed. No retries permitted until 2026-07-30 19:39:57.106744857 +0000 UTC m=+18.206826047 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs") pod "network-metrics-daemon-86z7s" (UID: "8f19aff0-c9c2-4e81-87c3-2d878901215b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:49.106858 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:49.106774    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:49.106858 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:49.106825    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret podName:a6e31fef-83df-4b5f-9af8-c207817e875d nodeName:}" failed. No retries permitted until 2026-07-30 19:39:57.106812054 +0000 UTC m=+18.206893226 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret") pod "global-pull-secret-syncer-mv7nq" (UID: "a6e31fef-83df-4b5f-9af8-c207817e875d") : object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:49.476071 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:49.475907    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:39:49.476071 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:49.476021    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:39:49.476301 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:49.476081    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:39:49.476301 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:49.476200    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:39:50.475009 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:50.474969    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:50.475500 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:50.475118    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:39:51.475502 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:51.475461    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:39:51.476047 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:51.475602    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:39:51.476047 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:51.475612    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:39:51.476047 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:51.475726    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:39:52.475150 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:52.475122    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:52.475345 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:52.475232    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:39:53.475626 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:53.475594    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:39:53.475955 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:53.475716    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:39:53.475955 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:53.475773    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:39:53.475955 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:53.475869    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:39:54.474728 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:54.474697    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:54.474911 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:54.474808    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:39:55.475710 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:55.475672    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:39:55.476121 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:55.475682    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:39:55.476512 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:55.476454    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:39:55.476512 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:55.476287    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:39:56.474837 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:56.474809    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:56.475055 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:56.474910    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:39:57.067519 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:57.067485    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h9xb\" (UniqueName: \"kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb\") pod \"network-check-target-nmtml\" (UID: \"d8218233-3f22-47de-ad92-830ea3a1450f\") " pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:39:57.068003 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:57.067663    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 19:39:57.068003 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:57.067683    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 19:39:57.068003 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:57.067692    2568 projected.go:196] Error preparing data for projected volume kube-api-access-9h9xb for pod openshift-network-diagnostics/network-check-target-nmtml: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:57.068003 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:57.067744    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb podName:d8218233-3f22-47de-ad92-830ea3a1450f nodeName:}" failed. No retries permitted until 2026-07-30 19:40:13.067726534 +0000 UTC m=+34.167807700 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9h9xb" (UniqueName: "kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb") pod "network-check-target-nmtml" (UID: "d8218233-3f22-47de-ad92-830ea3a1450f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:39:57.168800 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:57.168771    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret\") pod \"global-pull-secret-syncer-mv7nq\" (UID: \"a6e31fef-83df-4b5f-9af8-c207817e875d\") " pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:57.168954 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:57.168813    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs\") pod \"network-metrics-daemon-86z7s\" (UID: \"8f19aff0-c9c2-4e81-87c3-2d878901215b\") " pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:39:57.168954 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:57.168926    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:57.169047 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:57.168961    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:57.169047 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:57.168979    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret podName:a6e31fef-83df-4b5f-9af8-c207817e875d nodeName:}" failed. No retries permitted until 2026-07-30 19:40:13.168967136 +0000 UTC m=+34.269048302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret") pod "global-pull-secret-syncer-mv7nq" (UID: "a6e31fef-83df-4b5f-9af8-c207817e875d") : object "kube-system"/"original-pull-secret" not registered
Jul 30 19:39:57.169047 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:57.169001    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs podName:8f19aff0-c9c2-4e81-87c3-2d878901215b nodeName:}" failed. No retries permitted until 2026-07-30 19:40:13.16898921 +0000 UTC m=+34.269070375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs") pod "network-metrics-daemon-86z7s" (UID: "8f19aff0-c9c2-4e81-87c3-2d878901215b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:39:57.475071 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:57.474960    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:39:57.475071 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:57.474999    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:39:57.475245 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:57.475101    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:39:57.475284 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:57.475238    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:39:58.475486 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:58.475457    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:39:58.475956 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:58.475576    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:39:59.476631 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:59.476596    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:39:59.477046 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:59.476718    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:39:59.477046 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:39:59.476777    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:39:59.477046 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:39:59.476958    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:40:00.475189 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:00.475156    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:00.475350 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:00.475264    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:40:01.476925 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:01.476899    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:01.477243 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:01.477023    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:40:01.477418 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:01.477398    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:01.477529 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:01.477510    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:40:01.563354 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:01.563179    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pjt7g" event={"ID":"879177db-60de-4eb3-9399-e2ccb55e23e2","Type":"ContainerStarted","Data":"556836224e4efc158aa224a913326279add0458027b781b88e0a7a44789a7955"}
Jul 30 19:40:01.565554 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:01.565473    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mh5vv" event={"ID":"d69b93d6-a4ba-421e-808a-2b07c9c4ccb9","Type":"ContainerStarted","Data":"88f6711e98d4dfa9a8f0a189203e39cf3fd4e0ba1a52c5f5bb7e69fbb46e19a6"}
Jul 30 19:40:01.568703 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:01.568589    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9gpps" event={"ID":"8cb73230-50ef-4678-adb0-5b410131ece0","Type":"ContainerStarted","Data":"589d3fb5a3433aeff59975f747ed164544451a116c4e38bf7b6c47b4687a6752"}
Jul 30 19:40:01.571243 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:01.570855    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2jrpc" event={"ID":"82ec3276-358b-4dbf-bc7f-74ab582afa50","Type":"ContainerStarted","Data":"f88cab4c01371e7e1bfc62192d227b1438baf1cd3a94b3f1e99972c383d697ba"}
Jul 30 19:40:01.582529 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:01.582475    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pjt7g" podStartSLOduration=2.30212539 podStartE2EDuration="21.582458585s" totalImagesPullingTime="19.280333195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:01.581487419 +0000 UTC m=+22.681568610" watchObservedRunningTime="2026-07-30 19:40:01.582458585 +0000 UTC m=+22.682539775"
Jul 30 19:40:01.584600 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:01.584085    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-200.ec2.internal" podStartSLOduration=20.584068249 podStartE2EDuration="20.584068249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:39:44.542922206 +0000 UTC m=+5.643003397" watchObservedRunningTime="2026-07-30 19:40:01.584068249 +0000 UTC m=+22.684149441"
Jul 30 19:40:01.607211 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:01.606983    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mh5vv" podStartSLOduration=2.295462825 podStartE2EDuration="21.606968147s" totalImagesPullingTime="19.311505322s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:01.606652112 +0000 UTC m=+22.706733301" watchObservedRunningTime="2026-07-30 19:40:01.606968147 +0000 UTC m=+22.707049334"
Jul 30 19:40:01.620007 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:01.619905    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2jrpc" podStartSLOduration=2.371501572 podStartE2EDuration="21.619880834s" totalImagesPullingTime="19.248379262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:01.619121289 +0000 UTC m=+22.719202478" watchObservedRunningTime="2026-07-30 19:40:01.619880834 +0000 UTC m=+22.719962022"
Jul 30 19:40:01.633741 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:01.633700    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9gpps" podStartSLOduration=2.390478388 podStartE2EDuration="21.633686321s" totalImagesPullingTime="19.243207933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:01.633195932 +0000 UTC m=+22.733277119" watchObservedRunningTime="2026-07-30 19:40:01.633686321 +0000 UTC m=+22.733767554"
Jul 30 19:40:02.475833 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:02.475669    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:02.475921 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:02.475905    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:40:02.574880 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:02.574853    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-62s26" event={"ID":"deda4082-5e19-4f14-835f-41a8802fee20","Type":"ContainerStarted","Data":"046aed373b1da06429b6f4679e7915688e35945705999ddd88b05a8a181f906a"}
Jul 30 19:40:02.576643 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:02.576604    2568 generic.go:356] "Generic (PLEG): container finished" podID="f2f94aa8-23b3-4c33-beb7-8aebeac90767" containerID="ccbfe476e89c96406bcbb1cea21a74246beacda81e95d7daf90a0916d4cd98d0" exitCode=0
Jul 30 19:40:02.576756 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:02.576683    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qnlc6" event={"ID":"f2f94aa8-23b3-4c33-beb7-8aebeac90767","Type":"ContainerDied","Data":"ccbfe476e89c96406bcbb1cea21a74246beacda81e95d7daf90a0916d4cd98d0"}
Jul 30 19:40:02.580518 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:02.580497    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln" event={"ID":"7cfd4cae-3acd-4982-9f61-b94b5743f8e2","Type":"ContainerStarted","Data":"a259c3707e85dcb1c957dd5ada60665b67e1656ac193faf5c8dfdc08650f2fb1"}
Jul 30 19:40:02.588200 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:02.588171    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zpc52" event={"ID":"d757dd80-c33b-454b-9de0-4440157edd68","Type":"ContainerStarted","Data":"8deb18241fb6e6643fce285ef2ac96423787bde0cda980dafce53b7c14ea8c2a"}
Jul 30 19:40:02.592047 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:02.591992    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r56cv" event={"ID":"240109d1-295d-4d6d-9458-c4829d56128a","Type":"ContainerStarted","Data":"807e3d80ee2e8e1bf452f9f858122a57e2c63fbfc8d997e2b6e3af4172dcb271"}
Jul 30 19:40:02.592150 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:02.592072    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r56cv" event={"ID":"240109d1-295d-4d6d-9458-c4829d56128a","Type":"ContainerStarted","Data":"72adfa092c12442f55a72a5008bad7e24183beaf17fbe23f63901c58b2ca0b16"}
Jul 30 19:40:02.592150 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:02.592125    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r56cv" event={"ID":"240109d1-295d-4d6d-9458-c4829d56128a","Type":"ContainerStarted","Data":"d0548f77c916a0a625bff355a6b059b987c0e4e1c9fe6c26a9f3ac6dfe5fa107"}
Jul 30 19:40:02.592267 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:02.592171    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r56cv" event={"ID":"240109d1-295d-4d6d-9458-c4829d56128a","Type":"ContainerStarted","Data":"0d52842538b458129d9d997218d735ec2710d90a561a60b0253895fa1a4865ed"}
Jul 30 19:40:02.592267 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:02.592132    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-62s26" podStartSLOduration=3.3900925170000002 podStartE2EDuration="22.592115025s" totalImagesPullingTime="19.202022508s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:02.591989808 +0000 UTC m=+23.692070997" watchObservedRunningTime="2026-07-30 19:40:02.592115025 +0000 UTC m=+23.692196213"
Jul 30 19:40:02.592267 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:02.592222    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r56cv" event={"ID":"240109d1-295d-4d6d-9458-c4829d56128a","Type":"ContainerStarted","Data":"9f78608f1b8444d4e41a6ac6ffa2076388056315336e09e0550320ffaa7df3d3"}
Jul 30 19:40:02.592421 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:02.592270    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r56cv" event={"ID":"240109d1-295d-4d6d-9458-c4829d56128a","Type":"ContainerStarted","Data":"d9d5dafd161c364debb7bcb32101f8527725bc726a1792c4c1315a747603a7a2"}
Jul 30 19:40:02.606846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:02.606806    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zpc52" podStartSLOduration=3.33463626 podStartE2EDuration="22.606794378s" totalImagesPullingTime="19.272158118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:02.606648894 +0000 UTC m=+23.706730079" watchObservedRunningTime="2026-07-30 19:40:02.606794378 +0000 UTC m=+23.706875564"
Jul 30 19:40:02.646473 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:02.646418    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9gpps"
Jul 30 19:40:02.646931 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:02.646911    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9gpps"
Jul 30 19:40:03.359318 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:03.359293    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 30 19:40:03.406872 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:03.406773    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T19:40:03.359314401Z","UUID":"65c2a7c1-f402-45e7-b07e-cc206939ca11","Handler":null,"Name":"","Endpoint":""}
Jul 30 19:40:03.408236 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:03.408207    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 30 19:40:03.408332 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:03.408254    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 30 19:40:03.475636 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:03.475614    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:03.475774 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:03.475654    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:03.475774 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:03.475735    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:40:03.475888 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:03.475873    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:40:03.596255 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:03.596226    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln" event={"ID":"7cfd4cae-3acd-4982-9f61-b94b5743f8e2","Type":"ContainerStarted","Data":"3c6f7040774b4acc7171a1767984a23074b49bcf9d0d98c42e1a3029210c842f"}
Jul 30 19:40:03.596743 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:03.596445    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9gpps"
Jul 30 19:40:03.597120 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:03.597104    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9gpps"
Jul 30 19:40:04.475120 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:04.475097    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:04.475237 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:04.475215    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:40:04.605831 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:04.605798    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r56cv" event={"ID":"240109d1-295d-4d6d-9458-c4829d56128a","Type":"ContainerStarted","Data":"898b9eea832cce598ca1b3934dac5710746e4faf0dd1e7f0263674c4740ed36f"}
Jul 30 19:40:05.475402 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:05.475211    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:05.475598 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:05.475267    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:05.475598 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:05.475482    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:40:05.475598 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:05.475554    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:40:05.610044 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:05.610004    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln" event={"ID":"7cfd4cae-3acd-4982-9f61-b94b5743f8e2","Type":"ContainerStarted","Data":"c931f140819d53dd41b19efa75e00901072e1c98ce15679ea73f63876e1c1a79"}
Jul 30 19:40:05.626337 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:05.626294    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bfcln" podStartSLOduration=3.582812317 podStartE2EDuration="25.626279425s" totalImagesPullingTime="22.043467108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:05.625140901 +0000 UTC m=+26.725222089" watchObservedRunningTime="2026-07-30 19:40:05.626279425 +0000 UTC m=+26.726360611"
Jul 30 19:40:06.475607 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:06.475576    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:06.475790 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:06.475686    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:40:06.530255 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:06.530227    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zpc52_d757dd80-c33b-454b-9de0-4440157edd68/dns-node-resolver/0.log"
Jul 30 19:40:07.108936 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:07.108903    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2jrpc_82ec3276-358b-4dbf-bc7f-74ab582afa50/node-ca/0.log"
Jul 30 19:40:07.474757 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:07.474735    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:07.474872 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:07.474852    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:40:07.474930 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:07.474902    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:07.475041 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:07.475020    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:40:07.618802 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:07.618601    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r56cv" event={"ID":"240109d1-295d-4d6d-9458-c4829d56128a","Type":"ContainerStarted","Data":"0c54f84c03694519c5debeb5c54153345d0bfd75661351e5aa91bd649d4d46f5"}
Jul 30 19:40:07.618987 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:07.618966    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:40:07.619069 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:07.619031    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:40:07.619123 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:07.619080    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:40:07.620846 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:07.620814    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qnlc6" event={"ID":"f2f94aa8-23b3-4c33-beb7-8aebeac90767","Type":"ContainerStarted","Data":"6d503467070b927e61e3f624adf0abadb1326cacba9fad5c49dc58fb37a11214"}
Jul 30 19:40:07.633363 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:07.633342    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:40:07.633496 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:07.633483    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:40:07.648293 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:07.648241    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-r56cv" podStartSLOduration=8.256809751 podStartE2EDuration="27.648224146s" totalImagesPullingTime="19.391414395s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:07.647911048 +0000 UTC m=+28.747992236" watchObservedRunningTime="2026-07-30 19:40:07.648224146 +0000 UTC m=+28.748305334"
Jul 30 19:40:08.474782 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:08.474750    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:08.475552 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:08.474857    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:40:08.624667 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:08.624635    2568 generic.go:356] "Generic (PLEG): container finished" podID="f2f94aa8-23b3-4c33-beb7-8aebeac90767" containerID="6d503467070b927e61e3f624adf0abadb1326cacba9fad5c49dc58fb37a11214" exitCode=0
Jul 30 19:40:08.624813 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:08.624717    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qnlc6" event={"ID":"f2f94aa8-23b3-4c33-beb7-8aebeac90767","Type":"ContainerDied","Data":"6d503467070b927e61e3f624adf0abadb1326cacba9fad5c49dc58fb37a11214"}
Jul 30 19:40:09.475664 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:09.475635    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:09.476097 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:09.475719    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:40:09.476097 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:09.475832    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:09.476097 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:09.475952    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:40:10.475120 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:10.475092    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:10.475257 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:10.475186    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:40:10.630636 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:10.630610    2568 generic.go:356] "Generic (PLEG): container finished" podID="f2f94aa8-23b3-4c33-beb7-8aebeac90767" containerID="f11d48c58ce9f25659916a5fce4b45017552fc49faff4e49746cfeaafdb62edb" exitCode=0
Jul 30 19:40:10.631056 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:10.630651    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qnlc6" event={"ID":"f2f94aa8-23b3-4c33-beb7-8aebeac90767","Type":"ContainerDied","Data":"f11d48c58ce9f25659916a5fce4b45017552fc49faff4e49746cfeaafdb62edb"}
Jul 30 19:40:11.475661 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:11.475626    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:11.475831 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:11.475635    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:11.475831 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:11.475725    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:40:11.475920 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:11.475826    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:40:12.474864 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:12.474838    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:12.475213 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:12.474926    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:40:12.636146 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:12.636114    2568 generic.go:356] "Generic (PLEG): container finished" podID="f2f94aa8-23b3-4c33-beb7-8aebeac90767" containerID="de5362734a98d9abd1b1dec93b7f672ad3312b8d6563666a4d186e7e08110eac" exitCode=0
Jul 30 19:40:12.636292 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:12.636179    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qnlc6" event={"ID":"f2f94aa8-23b3-4c33-beb7-8aebeac90767","Type":"ContainerDied","Data":"de5362734a98d9abd1b1dec93b7f672ad3312b8d6563666a4d186e7e08110eac"}
Jul 30 19:40:13.094138 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:13.094109    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h9xb\" (UniqueName: \"kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb\") pod \"network-check-target-nmtml\" (UID: \"d8218233-3f22-47de-ad92-830ea3a1450f\") " pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:13.094278 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:13.094228    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 19:40:13.094278 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:13.094247    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 19:40:13.094278 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:13.094257    2568 projected.go:196] Error preparing data for projected volume kube-api-access-9h9xb for pod openshift-network-diagnostics/network-check-target-nmtml: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:40:13.094375 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:13.094298    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb podName:d8218233-3f22-47de-ad92-830ea3a1450f nodeName:}" failed. No retries permitted until 2026-07-30 19:40:45.094286436 +0000 UTC m=+66.194367600 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9h9xb" (UniqueName: "kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb") pod "network-check-target-nmtml" (UID: "d8218233-3f22-47de-ad92-830ea3a1450f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 19:40:13.194708 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:13.194676    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret\") pod \"global-pull-secret-syncer-mv7nq\" (UID: \"a6e31fef-83df-4b5f-9af8-c207817e875d\") " pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:13.194840 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:13.194717    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs\") pod \"network-metrics-daemon-86z7s\" (UID: \"8f19aff0-c9c2-4e81-87c3-2d878901215b\") " pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:13.194840 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:13.194796    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:40:13.194840 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:13.194801    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 19:40:13.194933 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:13.194842    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs podName:8f19aff0-c9c2-4e81-87c3-2d878901215b nodeName:}" failed. No retries permitted until 2026-07-30 19:40:45.19482881 +0000 UTC m=+66.294909976 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs") pod "network-metrics-daemon-86z7s" (UID: "8f19aff0-c9c2-4e81-87c3-2d878901215b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 19:40:13.194933 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:13.194858    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret podName:a6e31fef-83df-4b5f-9af8-c207817e875d nodeName:}" failed. No retries permitted until 2026-07-30 19:40:45.194850199 +0000 UTC m=+66.294931364 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret") pod "global-pull-secret-syncer-mv7nq" (UID: "a6e31fef-83df-4b5f-9af8-c207817e875d") : object "kube-system"/"original-pull-secret" not registered
Jul 30 19:40:13.474987 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:13.474919    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:13.475320 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:13.474922    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:13.475320 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:13.475044    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:40:13.475320 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:13.475097    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:40:14.475227 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:14.475196    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:14.475600 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:14.475316    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:40:15.475460 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:15.475431    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:15.475928 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:15.475437    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:15.475928 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:15.475593    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:40:15.475928 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:15.475665    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:40:16.475752 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:16.475638    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:16.476210 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:16.475768    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:40:17.475075 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:17.475045    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:17.475270 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:17.475146    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:40:17.475270 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:17.475232    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:17.475381 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:17.475356    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:40:17.652745 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:17.652681    2568 generic.go:356] "Generic (PLEG): container finished" podID="f2f94aa8-23b3-4c33-beb7-8aebeac90767" containerID="3cdc1608bde821431f4364f88ca76acc5b1f67b9df580eacfdc97be6e6253302" exitCode=0
Jul 30 19:40:17.652745 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:17.652720    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qnlc6" event={"ID":"f2f94aa8-23b3-4c33-beb7-8aebeac90767","Type":"ContainerDied","Data":"3cdc1608bde821431f4364f88ca76acc5b1f67b9df580eacfdc97be6e6253302"}
Jul 30 19:40:18.475599 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:18.475411    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:18.475738 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:18.475665    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:40:18.657452 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:18.657423    2568 generic.go:356] "Generic (PLEG): container finished" podID="f2f94aa8-23b3-4c33-beb7-8aebeac90767" containerID="af8bfc0e239ec527110403dd7fb7ed77f25986c4e350ffb4ef1a1bbf63c0b411" exitCode=0
Jul 30 19:40:18.657854 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:18.657470    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qnlc6" event={"ID":"f2f94aa8-23b3-4c33-beb7-8aebeac90767","Type":"ContainerDied","Data":"af8bfc0e239ec527110403dd7fb7ed77f25986c4e350ffb4ef1a1bbf63c0b411"}
Jul 30 19:40:19.476422 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:19.476398    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:19.476544 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:19.476488    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:40:19.476618 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:19.476599    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:19.476706 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:19.476688    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:40:19.661942 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:19.661915    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qnlc6" event={"ID":"f2f94aa8-23b3-4c33-beb7-8aebeac90767","Type":"ContainerStarted","Data":"3e538c3b4ee772334ad8defaf9bd6b40d6bf7cccb142e19225593df02040d604"}
Jul 30 19:40:19.682911 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:19.682873    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qnlc6" podStartSLOduration=8.613940315 podStartE2EDuration="39.682856657s" totalImagesPullingTime="31.068916342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:19.681751622 +0000 UTC m=+40.781832809" watchObservedRunningTime="2026-07-30 19:40:19.682856657 +0000 UTC m=+40.782937838"
Jul 30 19:40:20.475291 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:20.475262    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:20.475484 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:20.475373    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:40:21.475411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:21.475373    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:21.475921 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:21.475483    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:40:21.475921 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:21.475512    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:21.475921 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:21.475582    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:40:22.474905 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:22.474872    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:22.475074 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:22.474968    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:40:23.474833 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:23.474803    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:23.475192 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:23.474909    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:40:23.475192 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:23.474983    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:23.475192 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:23.475090    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:40:24.474918 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:24.474886    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:24.475400 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:24.475003    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:40:25.475538 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:25.475505    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:25.475930 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:25.475648    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:40:25.475930 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:25.475704    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:25.475930 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:25.475792    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:40:26.475405 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:26.475374    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:26.475590 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:26.475467    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:40:27.475775 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:27.475740    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:27.476200 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:27.475888    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:40:27.476200 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:27.475941    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:27.476200 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:27.476047    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:40:28.376899 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:28.376872    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mv7nq"]
Jul 30 19:40:28.377035 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:28.376965    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:28.377102 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:28.377049    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:40:28.381069 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:28.381038    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-86z7s"]
Jul 30 19:40:28.381186 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:28.381122    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nmtml"]
Jul 30 19:40:28.381186 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:28.381182    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:28.381298 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:28.381266    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:40:28.381462 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:28.381440    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:28.381594 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:28.381539    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:40:29.475547 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:29.475517    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:29.476408 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:29.475627    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:40:30.474900 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:30.474872    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:30.475065 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:30.474989    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:40:30.475065 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:30.475037    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:30.475185 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:30.475115    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:40:31.475648 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:31.475617    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:31.476009 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:31.475736    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mv7nq" podUID="a6e31fef-83df-4b5f-9af8-c207817e875d"
Jul 30 19:40:32.475040 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:32.474821    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:32.475301 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:32.474880    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:32.475301 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:32.475134    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-86z7s" podUID="8f19aff0-c9c2-4e81-87c3-2d878901215b"
Jul 30 19:40:32.475301 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:32.475193    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nmtml" podUID="d8218233-3f22-47de-ad92-830ea3a1450f"
Jul 30 19:40:33.192521 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.192454    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-200.ec2.internal" event="NodeReady"
Jul 30 19:40:33.192898 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.192551    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 30 19:40:33.237918 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.237895    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6pcrs"]
Jul 30 19:40:33.251794 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.251768    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jrfg8"]
Jul 30 19:40:33.251916 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.251879    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6pcrs"
Jul 30 19:40:33.254466 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.254439    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 30 19:40:33.254625 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.254503    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 30 19:40:33.254625 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.254439    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xj98q\""
Jul 30 19:40:33.262529 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.262512    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6pcrs"]
Jul 30 19:40:33.262635 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.262538    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jrfg8"]
Jul 30 19:40:33.262702 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.262633    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jrfg8"
Jul 30 19:40:33.265043 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.265025    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 30 19:40:33.265115 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.265062    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 30 19:40:33.265238 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.265224    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gccm8\""
Jul 30 19:40:33.265303 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.265270    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 30 19:40:33.265370 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.265325    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 30 19:40:33.339676 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.339658    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xkf9t"]
Jul 30 19:40:33.350306 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.350283    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/752cf85f-98ea-4bd7-8a53-0fc42191f080-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrfg8\" (UID: \"752cf85f-98ea-4bd7-8a53-0fc42191f080\") " pod="openshift-insights/insights-runtime-extractor-jrfg8"
Jul 30 19:40:33.350414 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.350344    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vtlx\" (UniqueName: \"kubernetes.io/projected/752cf85f-98ea-4bd7-8a53-0fc42191f080-kube-api-access-5vtlx\") pod \"insights-runtime-extractor-jrfg8\" (UID: \"752cf85f-98ea-4bd7-8a53-0fc42191f080\") " pod="openshift-insights/insights-runtime-extractor-jrfg8"
Jul 30 19:40:33.350414 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.350383    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/752cf85f-98ea-4bd7-8a53-0fc42191f080-data-volume\") pod \"insights-runtime-extractor-jrfg8\" (UID: \"752cf85f-98ea-4bd7-8a53-0fc42191f080\") " pod="openshift-insights/insights-runtime-extractor-jrfg8"
Jul 30 19:40:33.350414 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.350402    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44cc3183-f50b-469f-a5e9-a27e039583ff-tmp-dir\") pod \"dns-default-6pcrs\" (UID: \"44cc3183-f50b-469f-a5e9-a27e039583ff\") " pod="openshift-dns/dns-default-6pcrs"
Jul 30 19:40:33.350584 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.350420    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwgj4\" (UniqueName: \"kubernetes.io/projected/44cc3183-f50b-469f-a5e9-a27e039583ff-kube-api-access-mwgj4\") pod \"dns-default-6pcrs\" (UID: \"44cc3183-f50b-469f-a5e9-a27e039583ff\") " pod="openshift-dns/dns-default-6pcrs"
Jul 30 19:40:33.350584 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.350438    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44cc3183-f50b-469f-a5e9-a27e039583ff-metrics-tls\") pod \"dns-default-6pcrs\" (UID: \"44cc3183-f50b-469f-a5e9-a27e039583ff\") " pod="openshift-dns/dns-default-6pcrs"
Jul 30 19:40:33.350584 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.350511    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/752cf85f-98ea-4bd7-8a53-0fc42191f080-crio-socket\") pod \"insights-runtime-extractor-jrfg8\" (UID: \"752cf85f-98ea-4bd7-8a53-0fc42191f080\") " pod="openshift-insights/insights-runtime-extractor-jrfg8"
Jul 30 19:40:33.350584 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.350525    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/44cc3183-f50b-469f-a5e9-a27e039583ff-config-volume\") pod \"dns-default-6pcrs\" (UID: \"44cc3183-f50b-469f-a5e9-a27e039583ff\") " pod="openshift-dns/dns-default-6pcrs"
Jul 30 19:40:33.350792 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.350596    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/752cf85f-98ea-4bd7-8a53-0fc42191f080-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrfg8\" (UID: \"752cf85f-98ea-4bd7-8a53-0fc42191f080\") " pod="openshift-insights/insights-runtime-extractor-jrfg8"
Jul 30 19:40:33.355287 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.355269    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xkf9t"]
Jul 30 19:40:33.355373 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.355340    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xkf9t"
Jul 30 19:40:33.357958 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.357941    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 30 19:40:33.358053 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.358040    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 30 19:40:33.358134 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.358117    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 30 19:40:33.358312 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.358299    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rlq6w\""
Jul 30 19:40:33.451590 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.451525    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44cc3183-f50b-469f-a5e9-a27e039583ff-metrics-tls\") pod \"dns-default-6pcrs\" (UID: \"44cc3183-f50b-469f-a5e9-a27e039583ff\") " pod="openshift-dns/dns-default-6pcrs"
Jul 30 19:40:33.451590 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.451582    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/752cf85f-98ea-4bd7-8a53-0fc42191f080-crio-socket\") pod \"insights-runtime-extractor-jrfg8\" (UID: \"752cf85f-98ea-4bd7-8a53-0fc42191f080\") " pod="openshift-insights/insights-runtime-extractor-jrfg8"
Jul 30 19:40:33.451742 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.451607    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/44cc3183-f50b-469f-a5e9-a27e039583ff-config-volume\") pod \"dns-default-6pcrs\" (UID: \"44cc3183-f50b-469f-a5e9-a27e039583ff\") " pod="openshift-dns/dns-default-6pcrs"
Jul 30 19:40:33.451742 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.451628    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5eb89f1c-020e-42b9-b5e7-84ab77c0d4ce-cert\") pod \"ingress-canary-xkf9t\" (UID: \"5eb89f1c-020e-42b9-b5e7-84ab77c0d4ce\") " pod="openshift-ingress-canary/ingress-canary-xkf9t"
Jul 30 19:40:33.451742 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.451652    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/752cf85f-98ea-4bd7-8a53-0fc42191f080-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrfg8\" (UID: \"752cf85f-98ea-4bd7-8a53-0fc42191f080\") " pod="openshift-insights/insights-runtime-extractor-jrfg8"
Jul 30 19:40:33.451742 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.451673    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/752cf85f-98ea-4bd7-8a53-0fc42191f080-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrfg8\" (UID: \"752cf85f-98ea-4bd7-8a53-0fc42191f080\") " pod="openshift-insights/insights-runtime-extractor-jrfg8"
Jul 30 19:40:33.451742 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.451697    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq2qk\" (UniqueName: \"kubernetes.io/projected/5eb89f1c-020e-42b9-b5e7-84ab77c0d4ce-kube-api-access-tq2qk\") pod \"ingress-canary-xkf9t\" (UID: \"5eb89f1c-020e-42b9-b5e7-84ab77c0d4ce\") " pod="openshift-ingress-canary/ingress-canary-xkf9t"
Jul 30 19:40:33.451742 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.451737    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/752cf85f-98ea-4bd7-8a53-0fc42191f080-crio-socket\") pod \"insights-runtime-extractor-jrfg8\" (UID: \"752cf85f-98ea-4bd7-8a53-0fc42191f080\") " pod="openshift-insights/insights-runtime-extractor-jrfg8"
Jul 30 19:40:33.451995 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.451783    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vtlx\" (UniqueName: \"kubernetes.io/projected/752cf85f-98ea-4bd7-8a53-0fc42191f080-kube-api-access-5vtlx\") pod \"insights-runtime-extractor-jrfg8\" (UID: \"752cf85f-98ea-4bd7-8a53-0fc42191f080\") " pod="openshift-insights/insights-runtime-extractor-jrfg8"
Jul 30 19:40:33.451995 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.451830    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/752cf85f-98ea-4bd7-8a53-0fc42191f080-data-volume\") pod \"insights-runtime-extractor-jrfg8\" (UID: \"752cf85f-98ea-4bd7-8a53-0fc42191f080\") " pod="openshift-insights/insights-runtime-extractor-jrfg8"
Jul 30 19:40:33.451995 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.451976    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44cc3183-f50b-469f-a5e9-a27e039583ff-tmp-dir\") pod \"dns-default-6pcrs\" (UID: \"44cc3183-f50b-469f-a5e9-a27e039583ff\") " pod="openshift-dns/dns-default-6pcrs"
Jul 30 19:40:33.452119 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.452009    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwgj4\" (UniqueName: \"kubernetes.io/projected/44cc3183-f50b-469f-a5e9-a27e039583ff-kube-api-access-mwgj4\") pod \"dns-default-6pcrs\" (UID: \"44cc3183-f50b-469f-a5e9-a27e039583ff\") " pod="openshift-dns/dns-default-6pcrs"
Jul 30 19:40:33.452119 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.452058    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/752cf85f-98ea-4bd7-8a53-0fc42191f080-data-volume\") pod \"insights-runtime-extractor-jrfg8\" (UID: \"752cf85f-98ea-4bd7-8a53-0fc42191f080\") " pod="openshift-insights/insights-runtime-extractor-jrfg8"
Jul 30 19:40:33.452273 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.452253    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44cc3183-f50b-469f-a5e9-a27e039583ff-tmp-dir\") pod \"dns-default-6pcrs\" (UID: \"44cc3183-f50b-469f-a5e9-a27e039583ff\") " pod="openshift-dns/dns-default-6pcrs"
Jul 30 19:40:33.452320 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.452304    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/752cf85f-98ea-4bd7-8a53-0fc42191f080-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jrfg8\" (UID: \"752cf85f-98ea-4bd7-8a53-0fc42191f080\") " pod="openshift-insights/insights-runtime-extractor-jrfg8"
Jul 30 19:40:33.452320 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.452307    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/44cc3183-f50b-469f-a5e9-a27e039583ff-config-volume\") pod \"dns-default-6pcrs\" (UID: \"44cc3183-f50b-469f-a5e9-a27e039583ff\") " pod="openshift-dns/dns-default-6pcrs"
Jul 30 19:40:33.455525 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.455506    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/752cf85f-98ea-4bd7-8a53-0fc42191f080-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jrfg8\" (UID: \"752cf85f-98ea-4bd7-8a53-0fc42191f080\") " pod="openshift-insights/insights-runtime-extractor-jrfg8"
Jul 30 19:40:33.455620 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.455535    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/44cc3183-f50b-469f-a5e9-a27e039583ff-metrics-tls\") pod \"dns-default-6pcrs\" (UID: \"44cc3183-f50b-469f-a5e9-a27e039583ff\") " pod="openshift-dns/dns-default-6pcrs"
Jul 30 19:40:33.456619 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.456602    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-c9q7c"]
Jul 30 19:40:33.463324 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.463302    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwgj4\" (UniqueName: \"kubernetes.io/projected/44cc3183-f50b-469f-a5e9-a27e039583ff-kube-api-access-mwgj4\") pod \"dns-default-6pcrs\" (UID: \"44cc3183-f50b-469f-a5e9-a27e039583ff\") " pod="openshift-dns/dns-default-6pcrs"
Jul 30 19:40:33.464132 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.464117    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vtlx\" (UniqueName: \"kubernetes.io/projected/752cf85f-98ea-4bd7-8a53-0fc42191f080-kube-api-access-5vtlx\") pod \"insights-runtime-extractor-jrfg8\" (UID: \"752cf85f-98ea-4bd7-8a53-0fc42191f080\") " pod="openshift-insights/insights-runtime-extractor-jrfg8"
Jul 30 19:40:33.476063 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.476041    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-c9q7c"
Jul 30 19:40:33.476156 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.476102    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:33.478448 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.478429    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 30 19:40:33.478534 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.478459    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 30 19:40:33.478807 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.478737    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 30 19:40:33.478893 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.478858    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 30 19:40:33.478962 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.478945    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 30 19:40:33.479015 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.478985    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-swh5x\""
Jul 30 19:40:33.479063 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.479051    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 19:40:33.479327 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.479311    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-c9q7c"]
Jul 30 19:40:33.553043 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.553017    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-c9q7c\" (UID: \"be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-c9q7c"
Jul 30 19:40:33.553158 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.553065    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-c9q7c\" (UID: \"be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-c9q7c"
Jul 30 19:40:33.553158 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.553082    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx846\" (UniqueName: \"kubernetes.io/projected/be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0-kube-api-access-vx846\") pod \"prometheus-operator-758d7cb874-c9q7c\" (UID: \"be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-c9q7c"
Jul 30 19:40:33.553158 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.553152    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5eb89f1c-020e-42b9-b5e7-84ab77c0d4ce-cert\") pod \"ingress-canary-xkf9t\" (UID: \"5eb89f1c-020e-42b9-b5e7-84ab77c0d4ce\") " pod="openshift-ingress-canary/ingress-canary-xkf9t"
Jul 30 19:40:33.553282 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.553179    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-c9q7c\" (UID: \"be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-c9q7c"
Jul 30 19:40:33.553282 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.553212    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq2qk\" (UniqueName: \"kubernetes.io/projected/5eb89f1c-020e-42b9-b5e7-84ab77c0d4ce-kube-api-access-tq2qk\") pod \"ingress-canary-xkf9t\" (UID: \"5eb89f1c-020e-42b9-b5e7-84ab77c0d4ce\") " pod="openshift-ingress-canary/ingress-canary-xkf9t"
Jul 30 19:40:33.555514 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.555493    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5eb89f1c-020e-42b9-b5e7-84ab77c0d4ce-cert\") pod \"ingress-canary-xkf9t\" (UID: \"5eb89f1c-020e-42b9-b5e7-84ab77c0d4ce\") " pod="openshift-ingress-canary/ingress-canary-xkf9t"
Jul 30 19:40:33.561063 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.561047    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq2qk\" (UniqueName: \"kubernetes.io/projected/5eb89f1c-020e-42b9-b5e7-84ab77c0d4ce-kube-api-access-tq2qk\") pod \"ingress-canary-xkf9t\" (UID: \"5eb89f1c-020e-42b9-b5e7-84ab77c0d4ce\") " pod="openshift-ingress-canary/ingress-canary-xkf9t"
Jul 30 19:40:33.562914 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.562897    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6pcrs"
Jul 30 19:40:33.570198 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.570184    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jrfg8"
Jul 30 19:40:33.653810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.653778    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-c9q7c\" (UID: \"be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-c9q7c"
Jul 30 19:40:33.653943 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.653854    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-c9q7c\" (UID: \"be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-c9q7c"
Jul 30 19:40:33.653943 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.653918    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-c9q7c\" (UID: \"be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-c9q7c"
Jul 30 19:40:33.654054 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.653946    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx846\" (UniqueName: \"kubernetes.io/projected/be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0-kube-api-access-vx846\") pod \"prometheus-operator-758d7cb874-c9q7c\" (UID: \"be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-c9q7c"
Jul 30 19:40:33.654749 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:33.654726    2568 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 30 19:40:33.654868 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:33.654809    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0-prometheus-operator-tls podName:be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:34.154789943 +0000 UTC m=+55.254871119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0-prometheus-operator-tls") pod "prometheus-operator-758d7cb874-c9q7c" (UID: "be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0") : secret "prometheus-operator-tls" not found
Jul 30 19:40:33.655232 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.655205    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-c9q7c\" (UID: \"be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-c9q7c"
Jul 30 19:40:33.657306 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.657278    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-c9q7c\" (UID: \"be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-c9q7c"
Jul 30 19:40:33.662854 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.662740    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xkf9t"
Jul 30 19:40:33.665673 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.665636    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx846\" (UniqueName: \"kubernetes.io/projected/be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0-kube-api-access-vx846\") pod \"prometheus-operator-758d7cb874-c9q7c\" (UID: \"be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-c9q7c"
Jul 30 19:40:33.737462 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.737430    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jrfg8"]
Jul 30 19:40:33.738475 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.738448    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6pcrs"]
Jul 30 19:40:33.742056 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:40:33.742032    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44cc3183_f50b_469f_a5e9_a27e039583ff.slice/crio-a36443e469e5e95315c91c2858dd52bd1e83cee8cff89cfe8784fa48dcd9d1bc WatchSource:0}: Error finding container a36443e469e5e95315c91c2858dd52bd1e83cee8cff89cfe8784fa48dcd9d1bc: Status 404 returned error can't find the container with id a36443e469e5e95315c91c2858dd52bd1e83cee8cff89cfe8784fa48dcd9d1bc
Jul 30 19:40:33.817696 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:33.817533    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xkf9t"]
Jul 30 19:40:33.820799 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:40:33.820776    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eb89f1c_020e_42b9_b5e7_84ab77c0d4ce.slice/crio-90d287785fa4ba01d0620c48a1a548e939d14465ee4f15e48963c42de5a6c96a WatchSource:0}: Error finding container 90d287785fa4ba01d0620c48a1a548e939d14465ee4f15e48963c42de5a6c96a: Status 404 returned error can't find the container with id 90d287785fa4ba01d0620c48a1a548e939d14465ee4f15e48963c42de5a6c96a
Jul 30 19:40:34.158343 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:34.158311    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-c9q7c\" (UID: \"be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-c9q7c"
Jul 30 19:40:34.161209 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:34.161185    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-c9q7c\" (UID: \"be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-c9q7c"
Jul 30 19:40:34.386206 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:34.386167    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-c9q7c"
Jul 30 19:40:34.475642 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:34.475610    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:34.476169 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:34.476139    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:34.480756 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:34.480005    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 19:40:34.480756 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:34.480327    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p96kd\""
Jul 30 19:40:34.480756 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:34.480550    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 19:40:34.481013 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:34.480760    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-chvmd\""
Jul 30 19:40:34.481866 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:34.481735    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 19:40:34.535527 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:34.535500    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-c9q7c"]
Jul 30 19:40:34.538962 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:40:34.538932    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe8ccaee_b8c1_488d_9c07_b59e1f9ca5b0.slice/crio-41066f3a0cc36e11591432d373f3d7865cfe8023780c07a2955336ffd433eae8 WatchSource:0}: Error finding container 41066f3a0cc36e11591432d373f3d7865cfe8023780c07a2955336ffd433eae8: Status 404 returned error can't find the container with id 41066f3a0cc36e11591432d373f3d7865cfe8023780c07a2955336ffd433eae8
Jul 30 19:40:34.695847 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:34.695768    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jrfg8" event={"ID":"752cf85f-98ea-4bd7-8a53-0fc42191f080","Type":"ContainerStarted","Data":"a52baa1e1219387762947ad75bae3384db8a4bbd3211135a27a82498b13669ca"}
Jul 30 19:40:34.695847 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:34.695829    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jrfg8" event={"ID":"752cf85f-98ea-4bd7-8a53-0fc42191f080","Type":"ContainerStarted","Data":"2817bee4adf9b052cdc7b5ff06e0800163a76b41001bfb862e1113af56573ec3"}
Jul 30 19:40:34.697173 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:34.697135    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6pcrs" event={"ID":"44cc3183-f50b-469f-a5e9-a27e039583ff","Type":"ContainerStarted","Data":"a36443e469e5e95315c91c2858dd52bd1e83cee8cff89cfe8784fa48dcd9d1bc"}
Jul 30 19:40:34.698687 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:34.698658    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xkf9t" event={"ID":"5eb89f1c-020e-42b9-b5e7-84ab77c0d4ce","Type":"ContainerStarted","Data":"90d287785fa4ba01d0620c48a1a548e939d14465ee4f15e48963c42de5a6c96a"}
Jul 30 19:40:34.700146 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:34.700093    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-c9q7c" event={"ID":"be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0","Type":"ContainerStarted","Data":"41066f3a0cc36e11591432d373f3d7865cfe8023780c07a2955336ffd433eae8"}
Jul 30 19:40:35.705828 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:35.705743    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jrfg8" event={"ID":"752cf85f-98ea-4bd7-8a53-0fc42191f080","Type":"ContainerStarted","Data":"dfe63c901de7e307fec5c809ee6a188b58c61f40f9d9ad2d11fd6bdb86a223f1"}
Jul 30 19:40:37.713960 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:37.713927    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jrfg8" event={"ID":"752cf85f-98ea-4bd7-8a53-0fc42191f080","Type":"ContainerStarted","Data":"bf8af55134e0882ad69b0bfabb2465780b6bdd641653ae59af52145f0b8d7379"}
Jul 30 19:40:37.715799 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:37.715777    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6pcrs" event={"ID":"44cc3183-f50b-469f-a5e9-a27e039583ff","Type":"ContainerStarted","Data":"c5e5ccc2a63080cc3623b992249d76745ea089e38540eb2a8cc08d88f9b355cf"}
Jul 30 19:40:37.715938 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:37.715821    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6pcrs" event={"ID":"44cc3183-f50b-469f-a5e9-a27e039583ff","Type":"ContainerStarted","Data":"794d9d29efc59fbe8a6c6cded9307486de36e4ccbd748c3524e73e6b37255a85"}
Jul 30 19:40:37.715938 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:37.715846    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6pcrs"
Jul 30 19:40:37.717242 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:37.717217    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xkf9t" event={"ID":"5eb89f1c-020e-42b9-b5e7-84ab77c0d4ce","Type":"ContainerStarted","Data":"a3e169b8043b728ae1f781819123d39edd7e6cf30197384f1ff0200591710130"}
Jul 30 19:40:37.718886 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:37.718864    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-c9q7c" event={"ID":"be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0","Type":"ContainerStarted","Data":"e13d8c103b8a9410490dee19fbe61e156aee1b193687057983b157fe5735c6a1"}
Jul 30 19:40:37.719011 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:37.718905    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-c9q7c" event={"ID":"be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0","Type":"ContainerStarted","Data":"da1215e0c911c0dbd1e13c8c08f5efdca3e3badbcb7a980d4e336bf376927b6b"}
Jul 30 19:40:37.733327 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:37.733292    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jrfg8" podStartSLOduration=1.665407979 podStartE2EDuration="4.733281245s" totalImagesPullingTime="3.067873266s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:40:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:37.73187568 +0000 UTC m=+58.831956865" watchObservedRunningTime="2026-07-30 19:40:37.733281245 +0000 UTC m=+58.833362422"
Jul 30 19:40:37.748709 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:37.748677    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-c9q7c" podStartSLOduration=2.284609906 podStartE2EDuration="4.748665729s" totalImagesPullingTime="2.464055823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:40:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:37.74813555 +0000 UTC m=+58.848216737" watchObservedRunningTime="2026-07-30 19:40:37.748665729 +0000 UTC m=+58.848746916"
Jul 30 19:40:37.763497 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:37.763464    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6pcrs" podStartSLOduration=1.5096767070000001 podStartE2EDuration="4.763452457s" totalImagesPullingTime="3.25377575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:40:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:37.7629125 +0000 UTC m=+58.862993685" watchObservedRunningTime="2026-07-30 19:40:37.763452457 +0000 UTC m=+58.863533643"
Jul 30 19:40:37.778470 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:37.778430    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xkf9t" podStartSLOduration=1.6036548819999998 podStartE2EDuration="4.778415384s" totalImagesPullingTime="3.174760502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:40:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:37.777950758 +0000 UTC m=+58.878031945" watchObservedRunningTime="2026-07-30 19:40:37.778415384 +0000 UTC m=+58.878496572"
Jul 30 19:40:39.641146 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.641117    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r56cv"
Jul 30 19:40:39.815098 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.815070    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq"]
Jul 30 19:40:39.848036 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.847996    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq"]
Jul 30 19:40:39.848036 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.848021    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq"
Jul 30 19:40:39.848229 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.848075    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"]
Jul 30 19:40:39.850749 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.850720    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 30 19:40:39.850885 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.850726    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 30 19:40:39.850885 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.850787    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-qxxft\""
Jul 30 19:40:39.859226 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.859211    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nf77v"]
Jul 30 19:40:39.859342 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.859328    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"
Jul 30 19:40:39.862118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.862100    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-tw4pd\""
Jul 30 19:40:39.862118 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.862108    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 30 19:40:39.862312 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.862148    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 30 19:40:39.862312 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.862151    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 30 19:40:39.881657 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.881635    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"]
Jul 30 19:40:39.881775 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.881730    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:39.884134 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.884117    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 30 19:40:39.884272 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.884257    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 30 19:40:39.884341 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.884308    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 30 19:40:39.884398 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.884369    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hgzkn\""
Jul 30 19:40:39.899514 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.899458    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c113a31-c028-4bd8-8d55-98f3384f3d6a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-mgzfq\" (UID: \"5c113a31-c028-4bd8-8d55-98f3384f3d6a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq"
Jul 30 19:40:39.899514 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.899488    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c113a31-c028-4bd8-8d55-98f3384f3d6a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-mgzfq\" (UID: \"5c113a31-c028-4bd8-8d55-98f3384f3d6a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq"
Jul 30 19:40:39.899514 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.899511    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c113a31-c028-4bd8-8d55-98f3384f3d6a-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-mgzfq\" (UID: \"5c113a31-c028-4bd8-8d55-98f3384f3d6a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq"
Jul 30 19:40:39.899691 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.899534    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c1abfd2c-697d-4db7-a92b-cb9c60db3067-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-64bm9\" (UID: \"c1abfd2c-697d-4db7-a92b-cb9c60db3067\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"
Jul 30 19:40:39.899691 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.899612    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2d86\" (UniqueName: \"kubernetes.io/projected/5c113a31-c028-4bd8-8d55-98f3384f3d6a-kube-api-access-f2d86\") pod \"openshift-state-metrics-6bb4d7b4dd-mgzfq\" (UID: \"5c113a31-c028-4bd8-8d55-98f3384f3d6a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq"
Jul 30 19:40:39.899691 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.899638    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1abfd2c-697d-4db7-a92b-cb9c60db3067-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-64bm9\" (UID: \"c1abfd2c-697d-4db7-a92b-cb9c60db3067\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"
Jul 30 19:40:39.899691 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.899666    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1abfd2c-697d-4db7-a92b-cb9c60db3067-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-64bm9\" (UID: \"c1abfd2c-697d-4db7-a92b-cb9c60db3067\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"
Jul 30 19:40:39.899691 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.899685    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdncj\" (UniqueName: \"kubernetes.io/projected/c1abfd2c-697d-4db7-a92b-cb9c60db3067-kube-api-access-sdncj\") pod \"kube-state-metrics-6bd9664c4-64bm9\" (UID: \"c1abfd2c-697d-4db7-a92b-cb9c60db3067\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"
Jul 30 19:40:39.899857 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.899725    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1abfd2c-697d-4db7-a92b-cb9c60db3067-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-64bm9\" (UID: \"c1abfd2c-697d-4db7-a92b-cb9c60db3067\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"
Jul 30 19:40:39.899857 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.899753    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c1abfd2c-697d-4db7-a92b-cb9c60db3067-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-64bm9\" (UID: \"c1abfd2c-697d-4db7-a92b-cb9c60db3067\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"
Jul 30 19:40:40.000024 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:39.999996    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a49e79d-01ee-4c00-ac27-6ad38345c98d-node-exporter-accelerators-collector-config\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.000169 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.000029    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1abfd2c-697d-4db7-a92b-cb9c60db3067-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-64bm9\" (UID: \"c1abfd2c-697d-4db7-a92b-cb9c60db3067\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"
Jul 30 19:40:40.000169 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.000049    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1abfd2c-697d-4db7-a92b-cb9c60db3067-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-64bm9\" (UID: \"c1abfd2c-697d-4db7-a92b-cb9c60db3067\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"
Jul 30 19:40:40.000169 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.000097    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c1abfd2c-697d-4db7-a92b-cb9c60db3067-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-64bm9\" (UID: \"c1abfd2c-697d-4db7-a92b-cb9c60db3067\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"
Jul 30 19:40:40.000169 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.000148    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c113a31-c028-4bd8-8d55-98f3384f3d6a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-mgzfq\" (UID: \"5c113a31-c028-4bd8-8d55-98f3384f3d6a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq"
Jul 30 19:40:40.000169 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:40.000162    2568 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 30 19:40:40.000425 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.000177    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c113a31-c028-4bd8-8d55-98f3384f3d6a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-mgzfq\" (UID: \"5c113a31-c028-4bd8-8d55-98f3384f3d6a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq"
Jul 30 19:40:40.000425 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.000209    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2d86\" (UniqueName: \"kubernetes.io/projected/5c113a31-c028-4bd8-8d55-98f3384f3d6a-kube-api-access-f2d86\") pod \"openshift-state-metrics-6bb4d7b4dd-mgzfq\" (UID: \"5c113a31-c028-4bd8-8d55-98f3384f3d6a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq"
Jul 30 19:40:40.000425 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:40.000227    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1abfd2c-697d-4db7-a92b-cb9c60db3067-kube-state-metrics-tls podName:c1abfd2c-697d-4db7-a92b-cb9c60db3067 nodeName:}" failed. No retries permitted until 2026-07-30 19:40:40.500206775 +0000 UTC m=+61.600287962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c1abfd2c-697d-4db7-a92b-cb9c60db3067-kube-state-metrics-tls") pod "kube-state-metrics-6bd9664c4-64bm9" (UID: "c1abfd2c-697d-4db7-a92b-cb9c60db3067") : secret "kube-state-metrics-tls" not found
Jul 30 19:40:40.000425 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.000268    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdncj\" (UniqueName: \"kubernetes.io/projected/c1abfd2c-697d-4db7-a92b-cb9c60db3067-kube-api-access-sdncj\") pod \"kube-state-metrics-6bd9664c4-64bm9\" (UID: \"c1abfd2c-697d-4db7-a92b-cb9c60db3067\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"
Jul 30 19:40:40.000425 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.000316    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a49e79d-01ee-4c00-ac27-6ad38345c98d-sys\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.000425 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.000347    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1abfd2c-697d-4db7-a92b-cb9c60db3067-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-64bm9\" (UID: \"c1abfd2c-697d-4db7-a92b-cb9c60db3067\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"
Jul 30 19:40:40.000425 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.000373    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a49e79d-01ee-4c00-ac27-6ad38345c98d-node-exporter-textfile\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.000425 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.000396    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a49e79d-01ee-4c00-ac27-6ad38345c98d-node-exporter-wtmp\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.000841 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.000434    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a49e79d-01ee-4c00-ac27-6ad38345c98d-root\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.000841 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.000458    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a49e79d-01ee-4c00-ac27-6ad38345c98d-metrics-client-ca\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.000841 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.000538    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a49e79d-01ee-4c00-ac27-6ad38345c98d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.000841 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.000611    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c1abfd2c-697d-4db7-a92b-cb9c60db3067-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-64bm9\" (UID: \"c1abfd2c-697d-4db7-a92b-cb9c60db3067\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"
Jul 30 19:40:40.000841 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.000658    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrpzk\" (UniqueName: \"kubernetes.io/projected/0a49e79d-01ee-4c00-ac27-6ad38345c98d-kube-api-access-wrpzk\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.000841 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.000716    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c113a31-c028-4bd8-8d55-98f3384f3d6a-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-mgzfq\" (UID: \"5c113a31-c028-4bd8-8d55-98f3384f3d6a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq"
Jul 30 19:40:40.000841 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.000746    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a49e79d-01ee-4c00-ac27-6ad38345c98d-node-exporter-tls\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.001112 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.000926    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c1abfd2c-697d-4db7-a92b-cb9c60db3067-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-64bm9\" (UID: \"c1abfd2c-697d-4db7-a92b-cb9c60db3067\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"
Jul 30 19:40:40.001112 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.000927    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c1abfd2c-697d-4db7-a92b-cb9c60db3067-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-64bm9\" (UID: \"c1abfd2c-697d-4db7-a92b-cb9c60db3067\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"
Jul 30 19:40:40.001175 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.001135    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1abfd2c-697d-4db7-a92b-cb9c60db3067-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-64bm9\" (UID: \"c1abfd2c-697d-4db7-a92b-cb9c60db3067\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"
Jul 30 19:40:40.001374 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.001358    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c113a31-c028-4bd8-8d55-98f3384f3d6a-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-mgzfq\" (UID: \"5c113a31-c028-4bd8-8d55-98f3384f3d6a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq"
Jul 30 19:40:40.002869 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.002849    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c113a31-c028-4bd8-8d55-98f3384f3d6a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-mgzfq\" (UID: \"5c113a31-c028-4bd8-8d55-98f3384f3d6a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq"
Jul 30 19:40:40.003054 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.003037    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1abfd2c-697d-4db7-a92b-cb9c60db3067-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-64bm9\" (UID: \"c1abfd2c-697d-4db7-a92b-cb9c60db3067\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"
Jul 30 19:40:40.003597 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.003578    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c113a31-c028-4bd8-8d55-98f3384f3d6a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-mgzfq\" (UID: \"5c113a31-c028-4bd8-8d55-98f3384f3d6a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq"
Jul 30 19:40:40.008380 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.008352    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2d86\" (UniqueName: \"kubernetes.io/projected/5c113a31-c028-4bd8-8d55-98f3384f3d6a-kube-api-access-f2d86\") pod \"openshift-state-metrics-6bb4d7b4dd-mgzfq\" (UID: \"5c113a31-c028-4bd8-8d55-98f3384f3d6a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq"
Jul 30 19:40:40.011393 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.011366    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdncj\" (UniqueName: \"kubernetes.io/projected/c1abfd2c-697d-4db7-a92b-cb9c60db3067-kube-api-access-sdncj\") pod \"kube-state-metrics-6bd9664c4-64bm9\" (UID: \"c1abfd2c-697d-4db7-a92b-cb9c60db3067\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"
Jul 30 19:40:40.101686 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.101649    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a49e79d-01ee-4c00-ac27-6ad38345c98d-node-exporter-accelerators-collector-config\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.101831 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.101747    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a49e79d-01ee-4c00-ac27-6ad38345c98d-sys\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.101831 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.101774    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a49e79d-01ee-4c00-ac27-6ad38345c98d-node-exporter-textfile\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.101831 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.101796    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a49e79d-01ee-4c00-ac27-6ad38345c98d-node-exporter-wtmp\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.101933 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.101830    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a49e79d-01ee-4c00-ac27-6ad38345c98d-root\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.101933 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.101866    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a49e79d-01ee-4c00-ac27-6ad38345c98d-sys\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.101991 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.101933    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0a49e79d-01ee-4c00-ac27-6ad38345c98d-root\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.101991 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.101942    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0a49e79d-01ee-4c00-ac27-6ad38345c98d-node-exporter-wtmp\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.101991 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.101963    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a49e79d-01ee-4c00-ac27-6ad38345c98d-metrics-client-ca\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.102114 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.101997    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a49e79d-01ee-4c00-ac27-6ad38345c98d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.102114 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.102028    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrpzk\" (UniqueName: \"kubernetes.io/projected/0a49e79d-01ee-4c00-ac27-6ad38345c98d-kube-api-access-wrpzk\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.102114 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.102069    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a49e79d-01ee-4c00-ac27-6ad38345c98d-node-exporter-tls\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.102221 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.102108    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0a49e79d-01ee-4c00-ac27-6ad38345c98d-node-exporter-textfile\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.102221 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:40.102162    2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 30 19:40:40.102221 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:40:40.102222    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a49e79d-01ee-4c00-ac27-6ad38345c98d-node-exporter-tls podName:0a49e79d-01ee-4c00-ac27-6ad38345c98d nodeName:}" failed. No retries permitted until 2026-07-30 19:40:40.602207738 +0000 UTC m=+61.702288904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0a49e79d-01ee-4c00-ac27-6ad38345c98d-node-exporter-tls") pod "node-exporter-nf77v" (UID: "0a49e79d-01ee-4c00-ac27-6ad38345c98d") : secret "node-exporter-tls" not found
Jul 30 19:40:40.102344 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.102257    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0a49e79d-01ee-4c00-ac27-6ad38345c98d-node-exporter-accelerators-collector-config\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.102503 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.102483    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a49e79d-01ee-4c00-ac27-6ad38345c98d-metrics-client-ca\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.104115 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.104099    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0a49e79d-01ee-4c00-ac27-6ad38345c98d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.113059 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.113037    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrpzk\" (UniqueName: \"kubernetes.io/projected/0a49e79d-01ee-4c00-ac27-6ad38345c98d-kube-api-access-wrpzk\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.157697 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.157644    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq"
Jul 30 19:40:40.317480 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.317451    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq"]
Jul 30 19:40:40.320432 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:40:40.320405    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c113a31_c028_4bd8_8d55_98f3384f3d6a.slice/crio-5aa33f1334d7fa84001d21e5caeb879221c929a82334393f2411ee4f3d3b79fd WatchSource:0}: Error finding container 5aa33f1334d7fa84001d21e5caeb879221c929a82334393f2411ee4f3d3b79fd: Status 404 returned error can't find the container with id 5aa33f1334d7fa84001d21e5caeb879221c929a82334393f2411ee4f3d3b79fd
Jul 30 19:40:40.504365 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.504333    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1abfd2c-697d-4db7-a92b-cb9c60db3067-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-64bm9\" (UID: \"c1abfd2c-697d-4db7-a92b-cb9c60db3067\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"
Jul 30 19:40:40.506438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.506415    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c1abfd2c-697d-4db7-a92b-cb9c60db3067-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-64bm9\" (UID: \"c1abfd2c-697d-4db7-a92b-cb9c60db3067\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"
Jul 30 19:40:40.605211 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.605189    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a49e79d-01ee-4c00-ac27-6ad38345c98d-node-exporter-tls\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.607201 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.607178    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0a49e79d-01ee-4c00-ac27-6ad38345c98d-node-exporter-tls\") pod \"node-exporter-nf77v\" (UID: \"0a49e79d-01ee-4c00-ac27-6ad38345c98d\") " pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.728459 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.728405    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq" event={"ID":"5c113a31-c028-4bd8-8d55-98f3384f3d6a","Type":"ContainerStarted","Data":"88287b5646e7980b5c2372c2244203e5b79b8dc3bc97fe652e4c9c1c50fcac41"}
Jul 30 19:40:40.728741 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.728480    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq" event={"ID":"5c113a31-c028-4bd8-8d55-98f3384f3d6a","Type":"ContainerStarted","Data":"9b48dc1cf94f40bde601ff8ef5248c881ebfaf8bc39f42b08f5518fe47f76135"}
Jul 30 19:40:40.728741 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.728501    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq" event={"ID":"5c113a31-c028-4bd8-8d55-98f3384f3d6a","Type":"ContainerStarted","Data":"5aa33f1334d7fa84001d21e5caeb879221c929a82334393f2411ee4f3d3b79fd"}
Jul 30 19:40:40.767083 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.767061    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"
Jul 30 19:40:40.790400 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.790383    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nf77v"
Jul 30 19:40:40.817489 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:40:40.817466    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a49e79d_01ee_4c00_ac27_6ad38345c98d.slice/crio-cefe44b61fd06d0a3cb910edfc616a0e8a683bc8187f958b3ac5f74a1f983472 WatchSource:0}: Error finding container cefe44b61fd06d0a3cb910edfc616a0e8a683bc8187f958b3ac5f74a1f983472: Status 404 returned error can't find the container with id cefe44b61fd06d0a3cb910edfc616a0e8a683bc8187f958b3ac5f74a1f983472
Jul 30 19:40:40.863881 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.863842    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 19:40:40.896213 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.896186    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 19:40:40.896367 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.896351    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:40.899288 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.899270    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 30 19:40:40.899404 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.899269    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 30 19:40:40.899404 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.899324    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 30 19:40:40.899755 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.899741    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 30 19:40:40.900121 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.900060    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 30 19:40:40.900121 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.900060    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 30 19:40:40.900121 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.900091    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cmsmz\""
Jul 30 19:40:40.900321 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.900123    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 30 19:40:40.900321 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.900090    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 30 19:40:40.900390 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.900379    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 30 19:40:40.905942 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:40.905925    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9"]
Jul 30 19:40:40.908335 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:40:40.908318    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1abfd2c_697d_4db7_a92b_cb9c60db3067.slice/crio-55eb0615aa8e7afa89a46980e8626607162a084f44a1a853a4cbf83bcb6ec5c9 WatchSource:0}: Error finding container 55eb0615aa8e7afa89a46980e8626607162a084f44a1a853a4cbf83bcb6ec5c9: Status 404 returned error can't find the container with id 55eb0615aa8e7afa89a46980e8626607162a084f44a1a853a4cbf83bcb6ec5c9
Jul 30 19:40:41.009099 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.009047    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-config-out\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.009099 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.009074    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.009099 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.009089    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.009296 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.009106    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.009296 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.009137    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.009296 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.009219    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.009296 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.009252    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-web-config\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.009296 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.009286    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.009491 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.009311    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.009491 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.009338    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jgdv\" (UniqueName: \"kubernetes.io/projected/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-kube-api-access-8jgdv\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.009491 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.009418    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.009491 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.009487    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.009689 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.009531    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.110504 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.110481    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.110636 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.110513    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.110636 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.110542    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-config-out\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.110636 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.110587    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.110636 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.110611    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.110877 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.110637    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.110877 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.110685    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.110877 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.110723    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.110877 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.110759    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-web-config\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.110877 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.110792    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.110877 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.110815    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.110877 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.110840    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jgdv\" (UniqueName: \"kubernetes.io/projected/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-kube-api-access-8jgdv\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.110877 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.110880    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.111235 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.110932    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.111634 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.111545    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.111725 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.111671    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.113488 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.113462    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-config-volume\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.114214 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.114194    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-config-out\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.114293 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.114222    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.114444 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.114423    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.114481 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.114451    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.114576 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.114541    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.114835 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.114818    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.115060 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.115041    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.115129 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.115114    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-web-config\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.119559 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.119535    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jgdv\" (UniqueName: \"kubernetes.io/projected/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-kube-api-access-8jgdv\") pod \"alertmanager-main-0\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.207535 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.207491    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:40:41.367865 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.367827    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 19:40:41.372052 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:40:41.372024    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a402607_132b_45ba_a3b6_c8e1f7b65c3f.slice/crio-7cd6906ed0575109f6192d9f868adcb1cbcbc13dbb341c3c81e096eba473472c WatchSource:0}: Error finding container 7cd6906ed0575109f6192d9f868adcb1cbcbc13dbb341c3c81e096eba473472c: Status 404 returned error can't find the container with id 7cd6906ed0575109f6192d9f868adcb1cbcbc13dbb341c3c81e096eba473472c
Jul 30 19:40:41.733134 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.733094    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9" event={"ID":"c1abfd2c-697d-4db7-a92b-cb9c60db3067","Type":"ContainerStarted","Data":"55eb0615aa8e7afa89a46980e8626607162a084f44a1a853a4cbf83bcb6ec5c9"}
Jul 30 19:40:41.734535 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.734507    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a402607-132b-45ba-a3b6-c8e1f7b65c3f","Type":"ContainerStarted","Data":"7cd6906ed0575109f6192d9f868adcb1cbcbc13dbb341c3c81e096eba473472c"}
Jul 30 19:40:41.735650 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.735627    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nf77v" event={"ID":"0a49e79d-01ee-4c00-ac27-6ad38345c98d","Type":"ContainerStarted","Data":"cefe44b61fd06d0a3cb910edfc616a0e8a683bc8187f958b3ac5f74a1f983472"}
Jul 30 19:40:41.771393 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.771363    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-79c646665d-br8xc"]
Jul 30 19:40:41.774428 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.774409    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.777960 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.777290    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 30 19:40:41.777960 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.777626    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 30 19:40:41.780587 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.778175    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 30 19:40:41.780587 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.778375    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 30 19:40:41.780587 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.778918    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 30 19:40:41.780587 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.779012    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-z2vl2\""
Jul 30 19:40:41.780587 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.779824    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ai07694pcp8et\""
Jul 30 19:40:41.788744 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.788724    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79c646665d-br8xc"]
Jul 30 19:40:41.819555 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.819530    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/74d4facc-2b39-4dd8-8378-681d49d12197-secret-thanos-querier-tls\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.819684 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.819560    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74d4facc-2b39-4dd8-8378-681d49d12197-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.819684 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.819607    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74d4facc-2b39-4dd8-8378-681d49d12197-metrics-client-ca\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.819800 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.819682    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfvl4\" (UniqueName: \"kubernetes.io/projected/74d4facc-2b39-4dd8-8378-681d49d12197-kube-api-access-jfvl4\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.819800 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.819717    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/74d4facc-2b39-4dd8-8378-681d49d12197-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.819800 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.819763    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74d4facc-2b39-4dd8-8378-681d49d12197-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.819922 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.819796    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/74d4facc-2b39-4dd8-8378-681d49d12197-secret-grpc-tls\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.819922 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.819824    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/74d4facc-2b39-4dd8-8378-681d49d12197-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.920996 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.920966    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfvl4\" (UniqueName: \"kubernetes.io/projected/74d4facc-2b39-4dd8-8378-681d49d12197-kube-api-access-jfvl4\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.921144 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.921002    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/74d4facc-2b39-4dd8-8378-681d49d12197-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.921144 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.921030    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74d4facc-2b39-4dd8-8378-681d49d12197-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.921261 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.921200    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/74d4facc-2b39-4dd8-8378-681d49d12197-secret-grpc-tls\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.921261 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.921247    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/74d4facc-2b39-4dd8-8378-681d49d12197-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.921357 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.921344    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/74d4facc-2b39-4dd8-8378-681d49d12197-secret-thanos-querier-tls\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.921409 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.921376    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74d4facc-2b39-4dd8-8378-681d49d12197-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.921464 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.921418    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74d4facc-2b39-4dd8-8378-681d49d12197-metrics-client-ca\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.922177 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.922150    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74d4facc-2b39-4dd8-8378-681d49d12197-metrics-client-ca\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.923874 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.923852    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74d4facc-2b39-4dd8-8378-681d49d12197-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.923979 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.923889    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/74d4facc-2b39-4dd8-8378-681d49d12197-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.924033 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.924009    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/74d4facc-2b39-4dd8-8378-681d49d12197-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.924239 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.924218    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/74d4facc-2b39-4dd8-8378-681d49d12197-secret-grpc-tls\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.924453 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.924438    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74d4facc-2b39-4dd8-8378-681d49d12197-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.924487 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.924441    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/74d4facc-2b39-4dd8-8378-681d49d12197-secret-thanos-querier-tls\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:41.928957 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:41.928938    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfvl4\" (UniqueName: \"kubernetes.io/projected/74d4facc-2b39-4dd8-8378-681d49d12197-kube-api-access-jfvl4\") pod \"thanos-querier-79c646665d-br8xc\" (UID: \"74d4facc-2b39-4dd8-8378-681d49d12197\") " pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:42.088157 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:42.088126    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:42.451798 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:42.451390    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79c646665d-br8xc"]
Jul 30 19:40:42.745201 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:42.745119    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq" event={"ID":"5c113a31-c028-4bd8-8d55-98f3384f3d6a","Type":"ContainerStarted","Data":"54894f2f9090ecdec8f931006095b4531ccafead5091b987cd7004a6f555d031"}
Jul 30 19:40:42.747707 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:42.747681    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9" event={"ID":"c1abfd2c-697d-4db7-a92b-cb9c60db3067","Type":"ContainerStarted","Data":"ac2cc113fcd145e1f6227c487655854f292b92e9aad4ba5262e26221c88718ec"}
Jul 30 19:40:42.747826 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:42.747731    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9" event={"ID":"c1abfd2c-697d-4db7-a92b-cb9c60db3067","Type":"ContainerStarted","Data":"a67a9be958ecded236f881d2c7393396398fdf8706b827a7cb80541c4d7ea561"}
Jul 30 19:40:42.747826 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:42.747763    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9" event={"ID":"c1abfd2c-697d-4db7-a92b-cb9c60db3067","Type":"ContainerStarted","Data":"396e07e797366f4c3637d33f496cef65ecbd97416e1ab0b28ed3d327c3032282"}
Jul 30 19:40:42.749288 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:42.749263    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nf77v" event={"ID":"0a49e79d-01ee-4c00-ac27-6ad38345c98d","Type":"ContainerStarted","Data":"2a2f75c724b757785a3f5ad6c2bbc390d37957864348149336501844d44d25c9"}
Jul 30 19:40:42.750468 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:42.750442    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79c646665d-br8xc" event={"ID":"74d4facc-2b39-4dd8-8378-681d49d12197","Type":"ContainerStarted","Data":"8f1c819b3139abc7674880a13b793fa92d413dabe2217b3a13f6eff0376aede1"}
Jul 30 19:40:42.766735 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:42.766690    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-mgzfq" podStartSLOduration=2.056641485 podStartE2EDuration="3.766676731s" totalImagesPullingTime="1.710035246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:42.765945623 +0000 UTC m=+63.866026820" watchObservedRunningTime="2026-07-30 19:40:42.766676731 +0000 UTC m=+63.866757919"
Jul 30 19:40:42.786723 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:42.786670    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-64bm9" podStartSLOduration=2.408605939 podStartE2EDuration="3.786652732s" totalImagesPullingTime="1.378046793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:42.786191013 +0000 UTC m=+63.886272202" watchObservedRunningTime="2026-07-30 19:40:42.786652732 +0000 UTC m=+63.886733920"
Jul 30 19:40:43.756153 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:43.756121    2568 generic.go:356] "Generic (PLEG): container finished" podID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerID="27ff7eb87d8b1dbe5548ebd7c30327239947f3ecb8f0f1a3d9aabc0e08097928" exitCode=0
Jul 30 19:40:43.756579 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:43.756187    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a402607-132b-45ba-a3b6-c8e1f7b65c3f","Type":"ContainerDied","Data":"27ff7eb87d8b1dbe5548ebd7c30327239947f3ecb8f0f1a3d9aabc0e08097928"}
Jul 30 19:40:43.757805 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:43.757737    2568 generic.go:356] "Generic (PLEG): container finished" podID="0a49e79d-01ee-4c00-ac27-6ad38345c98d" containerID="2a2f75c724b757785a3f5ad6c2bbc390d37957864348149336501844d44d25c9" exitCode=0
Jul 30 19:40:43.757872 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:43.757829    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nf77v" event={"ID":"0a49e79d-01ee-4c00-ac27-6ad38345c98d","Type":"ContainerDied","Data":"2a2f75c724b757785a3f5ad6c2bbc390d37957864348149336501844d44d25c9"}
Jul 30 19:40:44.304348 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.304312    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-865f79dbd6-5752d"]
Jul 30 19:40:44.306884 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.306859    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.310606 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.310402    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 30 19:40:44.310606 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.310419    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ckraitshkomg8\""
Jul 30 19:40:44.310606 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.310446    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 30 19:40:44.310606 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.310492    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 30 19:40:44.310606 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.310528    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-bxnhk\""
Jul 30 19:40:44.310941 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.310722    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 30 19:40:44.317044 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.317018    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-865f79dbd6-5752d"]
Jul 30 19:40:44.344449 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.344426    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0eae0ee6-4f33-41de-a109-360fb82637fa-client-ca-bundle\") pod \"metrics-server-865f79dbd6-5752d\" (UID: \"0eae0ee6-4f33-41de-a109-360fb82637fa\") " pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.344580 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.344467    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0eae0ee6-4f33-41de-a109-360fb82637fa-audit-log\") pod \"metrics-server-865f79dbd6-5752d\" (UID: \"0eae0ee6-4f33-41de-a109-360fb82637fa\") " pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.344580 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.344497    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0eae0ee6-4f33-41de-a109-360fb82637fa-secret-metrics-server-tls\") pod \"metrics-server-865f79dbd6-5752d\" (UID: \"0eae0ee6-4f33-41de-a109-360fb82637fa\") " pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.344580 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.344545    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0eae0ee6-4f33-41de-a109-360fb82637fa-metrics-server-audit-profiles\") pod \"metrics-server-865f79dbd6-5752d\" (UID: \"0eae0ee6-4f33-41de-a109-360fb82637fa\") " pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.344742 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.344632    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eae0ee6-4f33-41de-a109-360fb82637fa-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-865f79dbd6-5752d\" (UID: \"0eae0ee6-4f33-41de-a109-360fb82637fa\") " pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.344742 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.344678    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0eae0ee6-4f33-41de-a109-360fb82637fa-secret-metrics-server-client-certs\") pod \"metrics-server-865f79dbd6-5752d\" (UID: \"0eae0ee6-4f33-41de-a109-360fb82637fa\") " pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.344742 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.344715    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb9wj\" (UniqueName: \"kubernetes.io/projected/0eae0ee6-4f33-41de-a109-360fb82637fa-kube-api-access-rb9wj\") pod \"metrics-server-865f79dbd6-5752d\" (UID: \"0eae0ee6-4f33-41de-a109-360fb82637fa\") " pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.445857 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.445821    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0eae0ee6-4f33-41de-a109-360fb82637fa-metrics-server-audit-profiles\") pod \"metrics-server-865f79dbd6-5752d\" (UID: \"0eae0ee6-4f33-41de-a109-360fb82637fa\") " pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.446028 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.445910    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eae0ee6-4f33-41de-a109-360fb82637fa-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-865f79dbd6-5752d\" (UID: \"0eae0ee6-4f33-41de-a109-360fb82637fa\") " pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.446028 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.445949    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0eae0ee6-4f33-41de-a109-360fb82637fa-secret-metrics-server-client-certs\") pod \"metrics-server-865f79dbd6-5752d\" (UID: \"0eae0ee6-4f33-41de-a109-360fb82637fa\") " pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.446028 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.445995    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb9wj\" (UniqueName: \"kubernetes.io/projected/0eae0ee6-4f33-41de-a109-360fb82637fa-kube-api-access-rb9wj\") pod \"metrics-server-865f79dbd6-5752d\" (UID: \"0eae0ee6-4f33-41de-a109-360fb82637fa\") " pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.446191 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.446043    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0eae0ee6-4f33-41de-a109-360fb82637fa-client-ca-bundle\") pod \"metrics-server-865f79dbd6-5752d\" (UID: \"0eae0ee6-4f33-41de-a109-360fb82637fa\") " pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.446191 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.446077    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0eae0ee6-4f33-41de-a109-360fb82637fa-audit-log\") pod \"metrics-server-865f79dbd6-5752d\" (UID: \"0eae0ee6-4f33-41de-a109-360fb82637fa\") " pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.446191 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.446106    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0eae0ee6-4f33-41de-a109-360fb82637fa-secret-metrics-server-tls\") pod \"metrics-server-865f79dbd6-5752d\" (UID: \"0eae0ee6-4f33-41de-a109-360fb82637fa\") " pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.446788 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.446764    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eae0ee6-4f33-41de-a109-360fb82637fa-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-865f79dbd6-5752d\" (UID: \"0eae0ee6-4f33-41de-a109-360fb82637fa\") " pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.446788 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.446772    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0eae0ee6-4f33-41de-a109-360fb82637fa-audit-log\") pod \"metrics-server-865f79dbd6-5752d\" (UID: \"0eae0ee6-4f33-41de-a109-360fb82637fa\") " pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.447123 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.447076    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0eae0ee6-4f33-41de-a109-360fb82637fa-metrics-server-audit-profiles\") pod \"metrics-server-865f79dbd6-5752d\" (UID: \"0eae0ee6-4f33-41de-a109-360fb82637fa\") " pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.449016 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.448994    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0eae0ee6-4f33-41de-a109-360fb82637fa-client-ca-bundle\") pod \"metrics-server-865f79dbd6-5752d\" (UID: \"0eae0ee6-4f33-41de-a109-360fb82637fa\") " pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.449135 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.449111    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0eae0ee6-4f33-41de-a109-360fb82637fa-secret-metrics-server-client-certs\") pod \"metrics-server-865f79dbd6-5752d\" (UID: \"0eae0ee6-4f33-41de-a109-360fb82637fa\") " pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.449219 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.449113    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0eae0ee6-4f33-41de-a109-360fb82637fa-secret-metrics-server-tls\") pod \"metrics-server-865f79dbd6-5752d\" (UID: \"0eae0ee6-4f33-41de-a109-360fb82637fa\") " pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.454169 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.454134    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb9wj\" (UniqueName: \"kubernetes.io/projected/0eae0ee6-4f33-41de-a109-360fb82637fa-kube-api-access-rb9wj\") pod \"metrics-server-865f79dbd6-5752d\" (UID: \"0eae0ee6-4f33-41de-a109-360fb82637fa\") " pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.566392 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.566370    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-dg6rh"]
Jul 30 19:40:44.568492 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.568474    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-dg6rh"
Jul 30 19:40:44.570928 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.570816    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 30 19:40:44.570928 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.570887    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-lsp4v\""
Jul 30 19:40:44.580049 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.580027    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-dg6rh"]
Jul 30 19:40:44.619251 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.619227    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:40:44.647664 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.647624    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5114dce3-f997-48e9-aeed-f034be235611-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-dg6rh\" (UID: \"5114dce3-f997-48e9-aeed-f034be235611\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-dg6rh"
Jul 30 19:40:44.647759 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.647702    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jbsl\" (UniqueName: \"kubernetes.io/projected/5114dce3-f997-48e9-aeed-f034be235611-kube-api-access-5jbsl\") pod \"monitoring-plugin-6dffbbd67-dg6rh\" (UID: \"5114dce3-f997-48e9-aeed-f034be235611\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-dg6rh"
Jul 30 19:40:44.748167 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.748132    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5114dce3-f997-48e9-aeed-f034be235611-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-dg6rh\" (UID: \"5114dce3-f997-48e9-aeed-f034be235611\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-dg6rh"
Jul 30 19:40:44.748326 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.748250    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jbsl\" (UniqueName: \"kubernetes.io/projected/5114dce3-f997-48e9-aeed-f034be235611-kube-api-access-5jbsl\") pod \"monitoring-plugin-6dffbbd67-dg6rh\" (UID: \"5114dce3-f997-48e9-aeed-f034be235611\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-dg6rh"
Jul 30 19:40:44.750804 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.750779    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5114dce3-f997-48e9-aeed-f034be235611-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-dg6rh\" (UID: \"5114dce3-f997-48e9-aeed-f034be235611\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-dg6rh"
Jul 30 19:40:44.758262 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.758238    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jbsl\" (UniqueName: \"kubernetes.io/projected/5114dce3-f997-48e9-aeed-f034be235611-kube-api-access-5jbsl\") pod \"monitoring-plugin-6dffbbd67-dg6rh\" (UID: \"5114dce3-f997-48e9-aeed-f034be235611\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-dg6rh"
Jul 30 19:40:44.763384 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.763198    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-865f79dbd6-5752d"]
Jul 30 19:40:44.764843 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.764769    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nf77v" event={"ID":"0a49e79d-01ee-4c00-ac27-6ad38345c98d","Type":"ContainerStarted","Data":"a40895575fe97c0ec9695ee1b11a5b05a041f4622095e87f805373832b87ea54"}
Jul 30 19:40:44.764843 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.764825    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nf77v" event={"ID":"0a49e79d-01ee-4c00-ac27-6ad38345c98d","Type":"ContainerStarted","Data":"ae934dc150e2f4f866466fc3c49936ad30ddfa5ed24133cd5fd9efa42bc50e65"}
Jul 30 19:40:44.766191 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:40:44.766168    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eae0ee6_4f33_41de_a109_360fb82637fa.slice/crio-314c4de191df648e99798f40767eefe9fc8eb97d2a52d692374cde5c7cef0694 WatchSource:0}: Error finding container 314c4de191df648e99798f40767eefe9fc8eb97d2a52d692374cde5c7cef0694: Status 404 returned error can't find the container with id 314c4de191df648e99798f40767eefe9fc8eb97d2a52d692374cde5c7cef0694
Jul 30 19:40:44.767382 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.767359    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79c646665d-br8xc" event={"ID":"74d4facc-2b39-4dd8-8378-681d49d12197","Type":"ContainerStarted","Data":"2e6b21e3fb9290f3ac8bab3ab00404595e69d63be2c434d11954481abd35db7f"}
Jul 30 19:40:44.767481 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.767429    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79c646665d-br8xc" event={"ID":"74d4facc-2b39-4dd8-8378-681d49d12197","Type":"ContainerStarted","Data":"ba67b1a338f6a1d4e39a5ff88514387df42f610fa48480805461407d389c5757"}
Jul 30 19:40:44.767481 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.767476    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79c646665d-br8xc" event={"ID":"74d4facc-2b39-4dd8-8378-681d49d12197","Type":"ContainerStarted","Data":"2f3503a10432a0bb444d9576e22fd1bccaca9ddd57ab05ab6c4389ac04a3ebd0"}
Jul 30 19:40:44.782364 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.782323    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nf77v" podStartSLOduration=4.211349267 podStartE2EDuration="5.78231147s" totalImagesPullingTime="1.467831211s" totalInitContainerRuntime="103.130992ms" isStatefulPod=true podCreationTimestamp="2026-07-30 19:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:44.781264935 +0000 UTC m=+65.881346122" watchObservedRunningTime="2026-07-30 19:40:44.78231147 +0000 UTC m=+65.882392657"
Jul 30 19:40:44.878113 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:44.878053    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-dg6rh"
Jul 30 19:40:45.004175 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.004143    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-dg6rh"]
Jul 30 19:40:45.007076 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:40:45.007053    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5114dce3_f997_48e9_aeed_f034be235611.slice/crio-e6f8df72dbff6b36c33346f9c21d70827f01da2fa5bf7f2006a3a8403316a546 WatchSource:0}: Error finding container e6f8df72dbff6b36c33346f9c21d70827f01da2fa5bf7f2006a3a8403316a546: Status 404 returned error can't find the container with id e6f8df72dbff6b36c33346f9c21d70827f01da2fa5bf7f2006a3a8403316a546
Jul 30 19:40:45.051060 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.048007    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-65bf9b5695-qjp89"]
Jul 30 19:40:45.053861 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.053839    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.056308 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.056287    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 30 19:40:45.056401 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.056315    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 30 19:40:45.056401 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.056289    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 30 19:40:45.056401 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.056368    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 30 19:40:45.056546 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.056408    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wgjnp\""
Jul 30 19:40:45.056674 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.056661    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 30 19:40:45.062280 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.062260    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 30 19:40:45.062786 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.062765    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65bf9b5695-qjp89"]
Jul 30 19:40:45.152502 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.152438    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae1c786-aa44-4572-ad3a-96e9bb8d8605-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.152502 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.152481    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bae1c786-aa44-4572-ad3a-96e9bb8d8605-federate-client-tls\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.152700 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.152509    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bae1c786-aa44-4572-ad3a-96e9bb8d8605-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.152700 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.152551    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bae1c786-aa44-4572-ad3a-96e9bb8d8605-metrics-client-ca\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.152700 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.152635    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae1c786-aa44-4572-ad3a-96e9bb8d8605-serving-certs-ca-bundle\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.152700 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.152692    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bae1c786-aa44-4572-ad3a-96e9bb8d8605-secret-telemeter-client\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.152854 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.152734    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bae1c786-aa44-4572-ad3a-96e9bb8d8605-telemeter-client-tls\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.152854 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.152802    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h9xb\" (UniqueName: \"kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb\") pod \"network-check-target-nmtml\" (UID: \"d8218233-3f22-47de-ad92-830ea3a1450f\") " pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:45.152854 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.152834    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvx49\" (UniqueName: \"kubernetes.io/projected/bae1c786-aa44-4572-ad3a-96e9bb8d8605-kube-api-access-hvx49\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.155415 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.155397    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 19:40:45.165466 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.165452    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 19:40:45.176389 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.176369    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h9xb\" (UniqueName: \"kubernetes.io/projected/d8218233-3f22-47de-ad92-830ea3a1450f-kube-api-access-9h9xb\") pod \"network-check-target-nmtml\" (UID: \"d8218233-3f22-47de-ad92-830ea3a1450f\") " pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:45.253548 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.253504    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bae1c786-aa44-4572-ad3a-96e9bb8d8605-metrics-client-ca\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.253739 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.253611    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae1c786-aa44-4572-ad3a-96e9bb8d8605-serving-certs-ca-bundle\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.253739 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.253637    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bae1c786-aa44-4572-ad3a-96e9bb8d8605-secret-telemeter-client\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.253739 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.253658    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bae1c786-aa44-4572-ad3a-96e9bb8d8605-telemeter-client-tls\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.253739 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.253689    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs\") pod \"network-metrics-daemon-86z7s\" (UID: \"8f19aff0-c9c2-4e81-87c3-2d878901215b\") " pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:45.253739 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.253733    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvx49\" (UniqueName: \"kubernetes.io/projected/bae1c786-aa44-4572-ad3a-96e9bb8d8605-kube-api-access-hvx49\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.253983 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.253773    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret\") pod \"global-pull-secret-syncer-mv7nq\" (UID: \"a6e31fef-83df-4b5f-9af8-c207817e875d\") " pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:45.253983 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.253894    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae1c786-aa44-4572-ad3a-96e9bb8d8605-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.253983 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.253945    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bae1c786-aa44-4572-ad3a-96e9bb8d8605-federate-client-tls\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.254138 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.253979    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bae1c786-aa44-4572-ad3a-96e9bb8d8605-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.254364 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.254331    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae1c786-aa44-4572-ad3a-96e9bb8d8605-serving-certs-ca-bundle\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.254364 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.254345    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bae1c786-aa44-4572-ad3a-96e9bb8d8605-metrics-client-ca\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.254809 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.254788    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae1c786-aa44-4572-ad3a-96e9bb8d8605-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.256072 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.256049    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bae1c786-aa44-4572-ad3a-96e9bb8d8605-telemeter-client-tls\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.256358 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.256336    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bae1c786-aa44-4572-ad3a-96e9bb8d8605-federate-client-tls\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.256487 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.256469    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bae1c786-aa44-4572-ad3a-96e9bb8d8605-secret-telemeter-client\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.256555 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.256487    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 19:40:45.256555 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.256505    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 19:40:45.256555 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.256539    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bae1c786-aa44-4572-ad3a-96e9bb8d8605-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.261414 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.261398    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvx49\" (UniqueName: \"kubernetes.io/projected/bae1c786-aa44-4572-ad3a-96e9bb8d8605-kube-api-access-hvx49\") pod \"telemeter-client-65bf9b5695-qjp89\" (UID: \"bae1c786-aa44-4572-ad3a-96e9bb8d8605\") " pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.265970 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.265949    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a6e31fef-83df-4b5f-9af8-c207817e875d-original-pull-secret\") pod \"global-pull-secret-syncer-mv7nq\" (UID: \"a6e31fef-83df-4b5f-9af8-c207817e875d\") " pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:45.266063 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.266042    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f19aff0-c9c2-4e81-87c3-2d878901215b-metrics-certs\") pod \"network-metrics-daemon-86z7s\" (UID: \"8f19aff0-c9c2-4e81-87c3-2d878901215b\") " pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:45.297609 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.297543    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p96kd\""
Jul 30 19:40:45.303837 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.303819    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-chvmd\""
Jul 30 19:40:45.305679 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.305664    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-86z7s"
Jul 30 19:40:45.312346 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.312331    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:45.364758 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.364730    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89"
Jul 30 19:40:45.490138 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.489954    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mv7nq"
Jul 30 19:40:45.779332 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.779247    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-865f79dbd6-5752d" event={"ID":"0eae0ee6-4f33-41de-a109-360fb82637fa","Type":"ContainerStarted","Data":"314c4de191df648e99798f40767eefe9fc8eb97d2a52d692374cde5c7cef0694"}
Jul 30 19:40:45.781739 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.781523    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-dg6rh" event={"ID":"5114dce3-f997-48e9-aeed-f034be235611","Type":"ContainerStarted","Data":"e6f8df72dbff6b36c33346f9c21d70827f01da2fa5bf7f2006a3a8403316a546"}
Jul 30 19:40:45.848734 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.848666    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mv7nq"]
Jul 30 19:40:45.872711 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:40:45.868711    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6e31fef_83df_4b5f_9af8_c207817e875d.slice/crio-ad3be2eb550257652ccca9a8731ea2abbd1b46cd22802eeb7fafe53f48ed8b9f WatchSource:0}: Error finding container ad3be2eb550257652ccca9a8731ea2abbd1b46cd22802eeb7fafe53f48ed8b9f: Status 404 returned error can't find the container with id ad3be2eb550257652ccca9a8731ea2abbd1b46cd22802eeb7fafe53f48ed8b9f
Jul 30 19:40:45.906484 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.906406    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65bf9b5695-qjp89"]
Jul 30 19:40:45.911883 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:40:45.911860    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae1c786_aa44_4572_ad3a_96e9bb8d8605.slice/crio-67ba2d6c0643c2bd9c688564fd7af9d98c51886361c3abe2d022e5a78d00c750 WatchSource:0}: Error finding container 67ba2d6c0643c2bd9c688564fd7af9d98c51886361c3abe2d022e5a78d00c750: Status 404 returned error can't find the container with id 67ba2d6c0643c2bd9c688564fd7af9d98c51886361c3abe2d022e5a78d00c750
Jul 30 19:40:45.924101 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:45.924077    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-86z7s"]
Jul 30 19:40:45.931316 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:40:45.931290    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f19aff0_c9c2_4e81_87c3_2d878901215b.slice/crio-8691400ad250cc4fc22a72a77c7ee7e80c1452ed79aadc904824719f3d27c412 WatchSource:0}: Error finding container 8691400ad250cc4fc22a72a77c7ee7e80c1452ed79aadc904824719f3d27c412: Status 404 returned error can't find the container with id 8691400ad250cc4fc22a72a77c7ee7e80c1452ed79aadc904824719f3d27c412
Jul 30 19:40:46.133091 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.131381    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 19:40:46.138317 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.138293    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nmtml"]
Jul 30 19:40:46.138441 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.138428    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.141367 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.141310    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5j6jg\""
Jul 30 19:40:46.143184 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.142228    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 30 19:40:46.143184 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.143076    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 30 19:40:46.143424 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.143252    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 30 19:40:46.143575 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.143478    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 30 19:40:46.143792 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.143751    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 30 19:40:46.143869 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.143792    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 30 19:40:46.143869 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.143467    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 30 19:40:46.144141 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.144066    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 30 19:40:46.144315 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.144295    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b0dr33db7s495\""
Jul 30 19:40:46.144377 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.144359    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 30 19:40:46.145297 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.145276    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 30 19:40:46.145504 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.145487    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 30 19:40:46.145801 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.145773    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 30 19:40:46.152164 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.149212    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 30 19:40:46.156284 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.156260    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 30 19:40:46.157609 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.157276    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 19:40:46.159622 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:40:46.159601    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8218233_3f22_47de_ad92_830ea3a1450f.slice/crio-bf941b0b2e45c3035ee6812aed310bdf54ad82317737584653883ea0de425355 WatchSource:0}: Error finding container bf941b0b2e45c3035ee6812aed310bdf54ad82317737584653883ea0de425355: Status 404 returned error can't find the container with id bf941b0b2e45c3035ee6812aed310bdf54ad82317737584653883ea0de425355
Jul 30 19:40:46.269033 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.268137    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.269033 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.268192    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.269033 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.268220    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.269033 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.268241    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.269033 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.268265    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.269033 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.268297    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.269033 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.268346    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-config-out\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.269033 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.268367    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.269033 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.268391    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.269033 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.268424    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.269033 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.268455    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.269033 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.268522    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-web-config\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.269033 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.268595    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn99v\" (UniqueName: \"kubernetes.io/projected/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-kube-api-access-mn99v\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.269033 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.268664    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.269033 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.268703    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.269033 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.268730    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.270004 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.268796    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.270004 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.268859    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-config\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.270004 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.268900    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.270004 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.268941    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.370580 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.370405    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-config-out\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.370580 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.370449    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.370580 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.370475    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.370580 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.370507    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.370580 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.370541    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.370580 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.370581    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-web-config\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.373041 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.370603    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn99v\" (UniqueName: \"kubernetes.io/projected/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-kube-api-access-mn99v\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.373041 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.370635    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.373041 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.370661    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.373041 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.370687    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.373041 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.370716    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.373041 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.370747    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-config\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.373041 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.370773    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.373041 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.370803    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.373041 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.370849    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.373041 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.370880    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.373041 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.370910    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.373041 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.370935    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.373041 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.370961    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.373041 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.371000    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.373041 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.371834    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.373041 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.372478    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.375149 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.374976    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.378669 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.378374    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.379032 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.378989    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.379295 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.379269    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.382036 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.381986    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.382196 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.382147    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.382291 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.382210    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.383295 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.382544    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-config\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.383295 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.382730    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.383295 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.382858    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.383295 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.382879    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-config-out\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.383295 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.382895    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.383295 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.383263    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-web-config\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.383295 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.383262    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.383735 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.383523    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.383917 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.383873    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.385953 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.385927    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.386335 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.386290    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn99v\" (UniqueName: \"kubernetes.io/projected/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-kube-api-access-mn99v\") pod \"prometheus-k8s-0\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.466046 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.465965    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:40:46.674173 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.674087    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 19:40:46.796413 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.796239    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89" event={"ID":"bae1c786-aa44-4572-ad3a-96e9bb8d8605","Type":"ContainerStarted","Data":"67ba2d6c0643c2bd9c688564fd7af9d98c51886361c3abe2d022e5a78d00c750"}
Jul 30 19:40:46.804605 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.804147    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a402607-132b-45ba-a3b6-c8e1f7b65c3f","Type":"ContainerStarted","Data":"a37bb3f44bc33fcc03504c91c44045e558ae2ee8eed74eacb963a16072e900b2"}
Jul 30 19:40:46.804605 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.804238    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a402607-132b-45ba-a3b6-c8e1f7b65c3f","Type":"ContainerStarted","Data":"c9211bab34bf74e3fde543e38ba194d5f7139766026540544b4144c67a93410f"}
Jul 30 19:40:46.804605 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.804285    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a402607-132b-45ba-a3b6-c8e1f7b65c3f","Type":"ContainerStarted","Data":"cd1b67e76d318f1260b406f5bbef0e1336cc65ecd1d62b2afb2e03223ad1eff9"}
Jul 30 19:40:46.804605 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.804326    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a402607-132b-45ba-a3b6-c8e1f7b65c3f","Type":"ContainerStarted","Data":"c3f7a08d44e5ab8d50f8da8d4acee46bb7055c6b237207d64bded2cf6c74a53d"}
Jul 30 19:40:46.804605 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.804369    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a402607-132b-45ba-a3b6-c8e1f7b65c3f","Type":"ContainerStarted","Data":"031e93c2ef8ce18158e1afd49eba798bd3f098e1de9e4e65fc5659df9dc0e4ca"}
Jul 30 19:40:46.804605 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.804407    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a402607-132b-45ba-a3b6-c8e1f7b65c3f","Type":"ContainerStarted","Data":"16c56903dc38c68f2f656ea2346500ba307f2954352225c3465ffa55d57111f1"}
Jul 30 19:40:46.808279 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.808216    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-86z7s" event={"ID":"8f19aff0-c9c2-4e81-87c3-2d878901215b","Type":"ContainerStarted","Data":"8691400ad250cc4fc22a72a77c7ee7e80c1452ed79aadc904824719f3d27c412"}
Jul 30 19:40:46.811631 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.811537    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mv7nq" event={"ID":"a6e31fef-83df-4b5f-9af8-c207817e875d","Type":"ContainerStarted","Data":"ad3be2eb550257652ccca9a8731ea2abbd1b46cd22802eeb7fafe53f48ed8b9f"}
Jul 30 19:40:46.815508 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.815421    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79c646665d-br8xc" event={"ID":"74d4facc-2b39-4dd8-8378-681d49d12197","Type":"ContainerStarted","Data":"62a7ce65887b0b5883e3da5b88060a7fed21c408c53004c0e20e09d11085bf07"}
Jul 30 19:40:46.816824 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.816767    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nmtml" event={"ID":"d8218233-3f22-47de-ad92-830ea3a1450f","Type":"ContainerStarted","Data":"bf941b0b2e45c3035ee6812aed310bdf54ad82317737584653883ea0de425355"}
Jul 30 19:40:46.836309 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:46.835682    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.102391169 podStartE2EDuration="6.835662323s" totalImagesPullingTime="3.71761159s" totalInitContainerRuntime="15.659564ms" isStatefulPod=false podCreationTimestamp="2026-07-30 19:40:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:46.83427582 +0000 UTC m=+67.934357007" watchObservedRunningTime="2026-07-30 19:40:46.835662323 +0000 UTC m=+67.935743512"
Jul 30 19:40:47.244748 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:40:47.244361    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36ac7ed8_2a0f_4524_9bf1_1e55dce4f4d2.slice/crio-0338cc85648367ddb313a59f3b8749db4fbe3ce834fd7092816bd3bf10f65ae9 WatchSource:0}: Error finding container 0338cc85648367ddb313a59f3b8749db4fbe3ce834fd7092816bd3bf10f65ae9: Status 404 returned error can't find the container with id 0338cc85648367ddb313a59f3b8749db4fbe3ce834fd7092816bd3bf10f65ae9
Jul 30 19:40:47.723920 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:47.723892    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6pcrs"
Jul 30 19:40:47.823523 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:47.823464    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2","Type":"ContainerStarted","Data":"0338cc85648367ddb313a59f3b8749db4fbe3ce834fd7092816bd3bf10f65ae9"}
Jul 30 19:40:51.849291 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.848861    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-dg6rh" event={"ID":"5114dce3-f997-48e9-aeed-f034be235611","Type":"ContainerStarted","Data":"192cd4c78acc05b1298fa69c0da7c095f0bfe5ac5a00ad9b3652b9c30b064f32"}
Jul 30 19:40:51.849291 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.849189    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-dg6rh"
Jul 30 19:40:51.852103 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.852039    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89" event={"ID":"bae1c786-aa44-4572-ad3a-96e9bb8d8605","Type":"ContainerStarted","Data":"4726041a2f527e78d443c99ac56dcedcd232a893c9e61a5c49760a36d61c3b95"}
Jul 30 19:40:51.855856 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.855265    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-86z7s" event={"ID":"8f19aff0-c9c2-4e81-87c3-2d878901215b","Type":"ContainerStarted","Data":"8bb4ca4bc88565887f75471efe40d607a4edbeec472021dc1aeb3d79bb4558b5"}
Jul 30 19:40:51.855856 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.855312    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-86z7s" event={"ID":"8f19aff0-c9c2-4e81-87c3-2d878901215b","Type":"ContainerStarted","Data":"dcce38a8e14b3e55b3ebd57e03f1ee33d789f650a95ca1487c4e6a0f24936663"}
Jul 30 19:40:51.856774 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.856753    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-dg6rh"
Jul 30 19:40:51.857419 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.857396    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mv7nq" event={"ID":"a6e31fef-83df-4b5f-9af8-c207817e875d","Type":"ContainerStarted","Data":"99a7f0070bb3e175b6c5c65e3f71e9a63eb7a5d06b76ec6aba071fd149855c8a"}
Jul 30 19:40:51.867486 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.865916    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-dg6rh" podStartSLOduration=1.30594635 podStartE2EDuration="7.865900733s" totalImagesPullingTime="6.559954383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:51.865094643 +0000 UTC m=+72.965175829" watchObservedRunningTime="2026-07-30 19:40:51.865900733 +0000 UTC m=+72.965981926"
Jul 30 19:40:51.873201 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.871821    2568 generic.go:356] "Generic (PLEG): container finished" podID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerID="d082d80464ac9f674631393157dd495ce63a104126f229ff7587ce9898f93daa" exitCode=0
Jul 30 19:40:51.873201 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.872648    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2","Type":"ContainerDied","Data":"d082d80464ac9f674631393157dd495ce63a104126f229ff7587ce9898f93daa"}
Jul 30 19:40:51.877367 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.877342    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79c646665d-br8xc" event={"ID":"74d4facc-2b39-4dd8-8378-681d49d12197","Type":"ContainerStarted","Data":"db9c0b9cf1af820d3e7df4ac87aa37cfddb86c24c81117cc180fc13c8b205f34"}
Jul 30 19:40:51.877458 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.877407    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79c646665d-br8xc" event={"ID":"74d4facc-2b39-4dd8-8378-681d49d12197","Type":"ContainerStarted","Data":"460d609cb13e7738bc021a3dc1e7f2ffe50764181ee29a53c244fa0ba29412be"}
Jul 30 19:40:51.878341 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.878325    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:51.879663 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.879513    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-86z7s" podStartSLOduration=66.245329708 podStartE2EDuration="1m11.879498032s" totalImagesPullingTime="5.634168324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:51.879176702 +0000 UTC m=+72.979257888" watchObservedRunningTime="2026-07-30 19:40:51.879498032 +0000 UTC m=+72.979579219"
Jul 30 19:40:51.881105 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.881040    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-865f79dbd6-5752d" event={"ID":"0eae0ee6-4f33-41de-a109-360fb82637fa","Type":"ContainerStarted","Data":"ef2200616d1de943a074a3337c3510883dbeee0e80fd6a8b8b1e1620d2ac7eac"}
Jul 30 19:40:51.883004 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.882984    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nmtml" event={"ID":"d8218233-3f22-47de-ad92-830ea3a1450f","Type":"ContainerStarted","Data":"59b8a693eed42a3aab4a50ec0968a6f36a931f3df5dd0e22941b6c6e9b278815"}
Jul 30 19:40:51.883127 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.883111    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:40:51.886254 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.886237    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-79c646665d-br8xc"
Jul 30 19:40:51.908251 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.908143    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mv7nq" podStartSLOduration=66.20027024 podStartE2EDuration="1m11.908126744s" totalImagesPullingTime="5.707856504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 19:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:51.906807992 +0000 UTC m=+73.006889173" watchObservedRunningTime="2026-07-30 19:40:51.908126744 +0000 UTC m=+73.008207930"
Jul 30 19:40:51.923053 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.922982    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-865f79dbd6-5752d" podStartSLOduration=1.131364363 podStartE2EDuration="7.922964733s" totalImagesPullingTime="6.79160037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:40:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:51.922307167 +0000 UTC m=+73.022388348" watchObservedRunningTime="2026-07-30 19:40:51.922964733 +0000 UTC m=+73.023045920"
Jul 30 19:40:51.938745 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.938691    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nmtml" podStartSLOduration=66.519888433 podStartE2EDuration="1m11.938674709s" totalImagesPullingTime="5.418786276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:51.937542158 +0000 UTC m=+73.037623324" watchObservedRunningTime="2026-07-30 19:40:51.938674709 +0000 UTC m=+73.038755896"
Jul 30 19:40:51.962344 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:51.960852    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-79c646665d-br8xc" podStartSLOduration=7.108900176 podStartE2EDuration="10.960833462s" totalImagesPullingTime="3.851933286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:40:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:51.960443948 +0000 UTC m=+73.060525134" watchObservedRunningTime="2026-07-30 19:40:51.960833462 +0000 UTC m=+73.060914648"
Jul 30 19:40:52.893224 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:52.893135    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89" event={"ID":"bae1c786-aa44-4572-ad3a-96e9bb8d8605","Type":"ContainerStarted","Data":"758632afabaed15186b4a25af9074b5cb47b8c04cb0258c4d8f3c987f97f15de"}
Jul 30 19:40:52.893224 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:52.893209    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89" event={"ID":"bae1c786-aa44-4572-ad3a-96e9bb8d8605","Type":"ContainerStarted","Data":"573e412c10a2117e6832551b0c9f92fee79b730abc93db9c3013ba56ca37f268"}
Jul 30 19:40:52.915267 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:52.915224    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-65bf9b5695-qjp89" podStartSLOduration=2.267764724 podStartE2EDuration="7.915210482s" totalImagesPullingTime="5.647445758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:52.914917842 +0000 UTC m=+74.014999029" watchObservedRunningTime="2026-07-30 19:40:52.915210482 +0000 UTC m=+74.015291667"
Jul 30 19:40:55.912011 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:55.911975    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2","Type":"ContainerStarted","Data":"80829635f3590b79f373d666c95a1f17c9f355406ee0fa401490e828355e7911"}
Jul 30 19:40:55.912374 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:55.912042    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2","Type":"ContainerStarted","Data":"e15654e1de3ca745d1a8382d6a3981fbe13945e1d91873ee95d8480808e80b12"}
Jul 30 19:40:55.912374 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:55.912067    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2","Type":"ContainerStarted","Data":"702931a74cb63f889254f4c904dcd816465ae16ae419b743bc52529dba74203f"}
Jul 30 19:40:55.912374 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:55.912091    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2","Type":"ContainerStarted","Data":"9af7a031cfa3fe7ebb9d31161d3e92d5c5f2145bc21c80f10c77b86f391e5df1"}
Jul 30 19:40:55.912374 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:55.912114    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2","Type":"ContainerStarted","Data":"a63e3544ab7b17ce7dcaf6c7e0696bec48a7bfa1d57d134b63fe313a9c880f10"}
Jul 30 19:40:55.912374 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:55.912134    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2","Type":"ContainerStarted","Data":"3c37f3e900a72c8cd47c060014538cb27e7989fb6b86f5b43054217fb8f05a20"}
Jul 30 19:40:55.942163 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:55.942097    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.827087347 podStartE2EDuration="9.942075706s" totalImagesPullingTime="3.080154614s" totalInitContainerRuntime="34.833745ms" isStatefulPod=false podCreationTimestamp="2026-07-30 19:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:40:55.939246308 +0000 UTC m=+77.039327495" watchObservedRunningTime="2026-07-30 19:40:55.942075706 +0000 UTC m=+77.042156953"
Jul 30 19:40:56.466601 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:40:56.466544    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:41:04.619704 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:41:04.619542    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:41:04.619704 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:41:04.619632    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:41:22.895111 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:41:22.895078    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nmtml"
Jul 30 19:41:24.624591 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:41:24.624547    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:41:24.628522 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:41:24.628500    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-865f79dbd6-5752d"
Jul 30 19:41:46.466236 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:41:46.466194    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:41:46.485522 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:41:46.485500    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:41:47.139356 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:41:47.139323    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:00.098438 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:00.098406    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 19:42:00.098836 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:00.098700    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="alertmanager" containerID="cri-o://16c56903dc38c68f2f656ea2346500ba307f2954352225c3465ffa55d57111f1" gracePeriod=120
Jul 30 19:42:00.098836 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:00.098750    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="kube-rbac-proxy-metric" containerID="cri-o://c9211bab34bf74e3fde543e38ba194d5f7139766026540544b4144c67a93410f" gracePeriod=120
Jul 30 19:42:00.098836 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:00.098772    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="kube-rbac-proxy-web" containerID="cri-o://c3f7a08d44e5ab8d50f8da8d4acee46bb7055c6b237207d64bded2cf6c74a53d" gracePeriod=120
Jul 30 19:42:00.098836 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:00.098785    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="kube-rbac-proxy" containerID="cri-o://cd1b67e76d318f1260b406f5bbef0e1336cc65ecd1d62b2afb2e03223ad1eff9" gracePeriod=120
Jul 30 19:42:00.099050 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:00.098830    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="config-reloader" containerID="cri-o://031e93c2ef8ce18158e1afd49eba798bd3f098e1de9e4e65fc5659df9dc0e4ca" gracePeriod=120
Jul 30 19:42:00.099050 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:00.098909    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="prom-label-proxy" containerID="cri-o://a37bb3f44bc33fcc03504c91c44045e558ae2ee8eed74eacb963a16072e900b2" gracePeriod=120
Jul 30 19:42:01.202096 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.202063    2568 generic.go:356] "Generic (PLEG): container finished" podID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerID="a37bb3f44bc33fcc03504c91c44045e558ae2ee8eed74eacb963a16072e900b2" exitCode=0
Jul 30 19:42:01.202467 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.202099    2568 generic.go:356] "Generic (PLEG): container finished" podID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerID="cd1b67e76d318f1260b406f5bbef0e1336cc65ecd1d62b2afb2e03223ad1eff9" exitCode=0
Jul 30 19:42:01.202467 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.202110    2568 generic.go:356] "Generic (PLEG): container finished" podID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerID="031e93c2ef8ce18158e1afd49eba798bd3f098e1de9e4e65fc5659df9dc0e4ca" exitCode=0
Jul 30 19:42:01.202467 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.202119    2568 generic.go:356] "Generic (PLEG): container finished" podID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerID="16c56903dc38c68f2f656ea2346500ba307f2954352225c3465ffa55d57111f1" exitCode=0
Jul 30 19:42:01.202467 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.202133    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a402607-132b-45ba-a3b6-c8e1f7b65c3f","Type":"ContainerDied","Data":"a37bb3f44bc33fcc03504c91c44045e558ae2ee8eed74eacb963a16072e900b2"}
Jul 30 19:42:01.202467 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.202253    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a402607-132b-45ba-a3b6-c8e1f7b65c3f","Type":"ContainerDied","Data":"cd1b67e76d318f1260b406f5bbef0e1336cc65ecd1d62b2afb2e03223ad1eff9"}
Jul 30 19:42:01.202467 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.202298    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a402607-132b-45ba-a3b6-c8e1f7b65c3f","Type":"ContainerDied","Data":"031e93c2ef8ce18158e1afd49eba798bd3f098e1de9e4e65fc5659df9dc0e4ca"}
Jul 30 19:42:01.202467 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.202339    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a402607-132b-45ba-a3b6-c8e1f7b65c3f","Type":"ContainerDied","Data":"16c56903dc38c68f2f656ea2346500ba307f2954352225c3465ffa55d57111f1"}
Jul 30 19:42:01.330500 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.330480    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:01.483553 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.483466    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-config-out\") pod \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") "
Jul 30 19:42:01.483553 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.483504    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-kube-rbac-proxy-web\") pod \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") "
Jul 30 19:42:01.483553 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.483529    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-web-config\") pod \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") "
Jul 30 19:42:01.483553 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.483556    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-tls-assets\") pod \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") "
Jul 30 19:42:01.483873 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.483592    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-metrics-client-ca\") pod \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") "
Jul 30 19:42:01.483873 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.483632    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") "
Jul 30 19:42:01.483873 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.483663    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-config-volume\") pod \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") "
Jul 30 19:42:01.483873 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.483692    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jgdv\" (UniqueName: \"kubernetes.io/projected/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-kube-api-access-8jgdv\") pod \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") "
Jul 30 19:42:01.483873 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.483721    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-alertmanager-trusted-ca-bundle\") pod \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") "
Jul 30 19:42:01.483873 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.483760    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-main-tls\") pod \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") "
Jul 30 19:42:01.483873 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.483788    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-cluster-tls-config\") pod \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") "
Jul 30 19:42:01.483873 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.483815    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-alertmanager-main-db\") pod \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") "
Jul 30 19:42:01.483873 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.483841    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-kube-rbac-proxy\") pod \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\" (UID: \"0a402607-132b-45ba-a3b6-c8e1f7b65c3f\") "
Jul 30 19:42:01.484299 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.484015    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0a402607-132b-45ba-a3b6-c8e1f7b65c3f" (UID: "0a402607-132b-45ba-a3b6-c8e1f7b65c3f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:42:01.484299 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.484167    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-metrics-client-ca\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:01.484299 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.484212    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0a402607-132b-45ba-a3b6-c8e1f7b65c3f" (UID: "0a402607-132b-45ba-a3b6-c8e1f7b65c3f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:42:01.484453 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.484437    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0a402607-132b-45ba-a3b6-c8e1f7b65c3f" (UID: "0a402607-132b-45ba-a3b6-c8e1f7b65c3f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:42:01.486678 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.486480    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0a402607-132b-45ba-a3b6-c8e1f7b65c3f" (UID: "0a402607-132b-45ba-a3b6-c8e1f7b65c3f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:42:01.486901 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.486872    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0a402607-132b-45ba-a3b6-c8e1f7b65c3f" (UID: "0a402607-132b-45ba-a3b6-c8e1f7b65c3f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:42:01.487012 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.486916    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-config-volume" (OuterVolumeSpecName: "config-volume") pod "0a402607-132b-45ba-a3b6-c8e1f7b65c3f" (UID: "0a402607-132b-45ba-a3b6-c8e1f7b65c3f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:42:01.487075 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.487002    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0a402607-132b-45ba-a3b6-c8e1f7b65c3f" (UID: "0a402607-132b-45ba-a3b6-c8e1f7b65c3f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:42:01.487199 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.487177    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0a402607-132b-45ba-a3b6-c8e1f7b65c3f" (UID: "0a402607-132b-45ba-a3b6-c8e1f7b65c3f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:42:01.488361 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.488336    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-config-out" (OuterVolumeSpecName: "config-out") pod "0a402607-132b-45ba-a3b6-c8e1f7b65c3f" (UID: "0a402607-132b-45ba-a3b6-c8e1f7b65c3f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:42:01.488549 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.488532    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-kube-api-access-8jgdv" (OuterVolumeSpecName: "kube-api-access-8jgdv") pod "0a402607-132b-45ba-a3b6-c8e1f7b65c3f" (UID: "0a402607-132b-45ba-a3b6-c8e1f7b65c3f"). InnerVolumeSpecName "kube-api-access-8jgdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:42:01.488740 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.488721    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0a402607-132b-45ba-a3b6-c8e1f7b65c3f" (UID: "0a402607-132b-45ba-a3b6-c8e1f7b65c3f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:42:01.491778 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.491556    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0a402607-132b-45ba-a3b6-c8e1f7b65c3f" (UID: "0a402607-132b-45ba-a3b6-c8e1f7b65c3f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:42:01.498207 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.498185    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-web-config" (OuterVolumeSpecName: "web-config") pod "0a402607-132b-45ba-a3b6-c8e1f7b65c3f" (UID: "0a402607-132b-45ba-a3b6-c8e1f7b65c3f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:42:01.585225 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.585200    2568 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-web-config\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:01.585225 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.585223    2568 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-tls-assets\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:01.585377 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.585233    2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:01.585377 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.585242    2568 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:01.585377 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.585251    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jgdv\" (UniqueName: \"kubernetes.io/projected/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-kube-api-access-8jgdv\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:01.585377 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.585260    2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:01.585377 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.585270    2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-main-tls\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:01.585377 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.585278    2568 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-cluster-tls-config\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:01.585377 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.585287    2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-alertmanager-main-db\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:01.585377 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.585295    2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:01.585377 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.585303    2568 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-config-out\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:01.585377 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:01.585312    2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a402607-132b-45ba-a3b6-c8e1f7b65c3f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:02.209258 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.209228    2568 generic.go:356] "Generic (PLEG): container finished" podID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerID="c9211bab34bf74e3fde543e38ba194d5f7139766026540544b4144c67a93410f" exitCode=0
Jul 30 19:42:02.209258 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.209257    2568 generic.go:356] "Generic (PLEG): container finished" podID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerID="c3f7a08d44e5ab8d50f8da8d4acee46bb7055c6b237207d64bded2cf6c74a53d" exitCode=0
Jul 30 19:42:02.209627 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.209301    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a402607-132b-45ba-a3b6-c8e1f7b65c3f","Type":"ContainerDied","Data":"c9211bab34bf74e3fde543e38ba194d5f7139766026540544b4144c67a93410f"}
Jul 30 19:42:02.209627 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.209316    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.209627 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.209365    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a402607-132b-45ba-a3b6-c8e1f7b65c3f","Type":"ContainerDied","Data":"c3f7a08d44e5ab8d50f8da8d4acee46bb7055c6b237207d64bded2cf6c74a53d"}
Jul 30 19:42:02.209627 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.209390    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0a402607-132b-45ba-a3b6-c8e1f7b65c3f","Type":"ContainerDied","Data":"7cd6906ed0575109f6192d9f868adcb1cbcbc13dbb341c3c81e096eba473472c"}
Jul 30 19:42:02.209627 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.209420    2568 scope.go:117] "RemoveContainer" containerID="a37bb3f44bc33fcc03504c91c44045e558ae2ee8eed74eacb963a16072e900b2"
Jul 30 19:42:02.217865 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.217848    2568 scope.go:117] "RemoveContainer" containerID="c9211bab34bf74e3fde543e38ba194d5f7139766026540544b4144c67a93410f"
Jul 30 19:42:02.224597 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.224580    2568 scope.go:117] "RemoveContainer" containerID="cd1b67e76d318f1260b406f5bbef0e1336cc65ecd1d62b2afb2e03223ad1eff9"
Jul 30 19:42:02.230705 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.230619    2568 scope.go:117] "RemoveContainer" containerID="c3f7a08d44e5ab8d50f8da8d4acee46bb7055c6b237207d64bded2cf6c74a53d"
Jul 30 19:42:02.235025 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.235004    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 19:42:02.237240 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.237223    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 19:42:02.239328 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.239316    2568 scope.go:117] "RemoveContainer" containerID="031e93c2ef8ce18158e1afd49eba798bd3f098e1de9e4e65fc5659df9dc0e4ca"
Jul 30 19:42:02.245841 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.245825    2568 scope.go:117] "RemoveContainer" containerID="16c56903dc38c68f2f656ea2346500ba307f2954352225c3465ffa55d57111f1"
Jul 30 19:42:02.252738 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.252721    2568 scope.go:117] "RemoveContainer" containerID="27ff7eb87d8b1dbe5548ebd7c30327239947f3ecb8f0f1a3d9aabc0e08097928"
Jul 30 19:42:02.259402 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.259381    2568 scope.go:117] "RemoveContainer" containerID="a37bb3f44bc33fcc03504c91c44045e558ae2ee8eed74eacb963a16072e900b2"
Jul 30 19:42:02.259787 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:42:02.259760    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a37bb3f44bc33fcc03504c91c44045e558ae2ee8eed74eacb963a16072e900b2\": container with ID starting with a37bb3f44bc33fcc03504c91c44045e558ae2ee8eed74eacb963a16072e900b2 not found: ID does not exist" containerID="a37bb3f44bc33fcc03504c91c44045e558ae2ee8eed74eacb963a16072e900b2"
Jul 30 19:42:02.259882 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.259794    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a37bb3f44bc33fcc03504c91c44045e558ae2ee8eed74eacb963a16072e900b2"} err="failed to get container status \"a37bb3f44bc33fcc03504c91c44045e558ae2ee8eed74eacb963a16072e900b2\": rpc error: code = NotFound desc = could not find container \"a37bb3f44bc33fcc03504c91c44045e558ae2ee8eed74eacb963a16072e900b2\": container with ID starting with a37bb3f44bc33fcc03504c91c44045e558ae2ee8eed74eacb963a16072e900b2 not found: ID does not exist"
Jul 30 19:42:02.259882 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.259832    2568 scope.go:117] "RemoveContainer" containerID="c9211bab34bf74e3fde543e38ba194d5f7139766026540544b4144c67a93410f"
Jul 30 19:42:02.260165 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:42:02.260144    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9211bab34bf74e3fde543e38ba194d5f7139766026540544b4144c67a93410f\": container with ID starting with c9211bab34bf74e3fde543e38ba194d5f7139766026540544b4144c67a93410f not found: ID does not exist" containerID="c9211bab34bf74e3fde543e38ba194d5f7139766026540544b4144c67a93410f"
Jul 30 19:42:02.260252 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.260173    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9211bab34bf74e3fde543e38ba194d5f7139766026540544b4144c67a93410f"} err="failed to get container status \"c9211bab34bf74e3fde543e38ba194d5f7139766026540544b4144c67a93410f\": rpc error: code = NotFound desc = could not find container \"c9211bab34bf74e3fde543e38ba194d5f7139766026540544b4144c67a93410f\": container with ID starting with c9211bab34bf74e3fde543e38ba194d5f7139766026540544b4144c67a93410f not found: ID does not exist"
Jul 30 19:42:02.260252 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.260191    2568 scope.go:117] "RemoveContainer" containerID="cd1b67e76d318f1260b406f5bbef0e1336cc65ecd1d62b2afb2e03223ad1eff9"
Jul 30 19:42:02.260444 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:42:02.260424    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd1b67e76d318f1260b406f5bbef0e1336cc65ecd1d62b2afb2e03223ad1eff9\": container with ID starting with cd1b67e76d318f1260b406f5bbef0e1336cc65ecd1d62b2afb2e03223ad1eff9 not found: ID does not exist" containerID="cd1b67e76d318f1260b406f5bbef0e1336cc65ecd1d62b2afb2e03223ad1eff9"
Jul 30 19:42:02.260488 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.260448    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd1b67e76d318f1260b406f5bbef0e1336cc65ecd1d62b2afb2e03223ad1eff9"} err="failed to get container status \"cd1b67e76d318f1260b406f5bbef0e1336cc65ecd1d62b2afb2e03223ad1eff9\": rpc error: code = NotFound desc = could not find container \"cd1b67e76d318f1260b406f5bbef0e1336cc65ecd1d62b2afb2e03223ad1eff9\": container with ID starting with cd1b67e76d318f1260b406f5bbef0e1336cc65ecd1d62b2afb2e03223ad1eff9 not found: ID does not exist"
Jul 30 19:42:02.260488 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.260463    2568 scope.go:117] "RemoveContainer" containerID="c3f7a08d44e5ab8d50f8da8d4acee46bb7055c6b237207d64bded2cf6c74a53d"
Jul 30 19:42:02.260688 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:42:02.260672    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3f7a08d44e5ab8d50f8da8d4acee46bb7055c6b237207d64bded2cf6c74a53d\": container with ID starting with c3f7a08d44e5ab8d50f8da8d4acee46bb7055c6b237207d64bded2cf6c74a53d not found: ID does not exist" containerID="c3f7a08d44e5ab8d50f8da8d4acee46bb7055c6b237207d64bded2cf6c74a53d"
Jul 30 19:42:02.260733 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.260693    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3f7a08d44e5ab8d50f8da8d4acee46bb7055c6b237207d64bded2cf6c74a53d"} err="failed to get container status \"c3f7a08d44e5ab8d50f8da8d4acee46bb7055c6b237207d64bded2cf6c74a53d\": rpc error: code = NotFound desc = could not find container \"c3f7a08d44e5ab8d50f8da8d4acee46bb7055c6b237207d64bded2cf6c74a53d\": container with ID starting with c3f7a08d44e5ab8d50f8da8d4acee46bb7055c6b237207d64bded2cf6c74a53d not found: ID does not exist"
Jul 30 19:42:02.260733 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.260710    2568 scope.go:117] "RemoveContainer" containerID="031e93c2ef8ce18158e1afd49eba798bd3f098e1de9e4e65fc5659df9dc0e4ca"
Jul 30 19:42:02.260947 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:42:02.260931    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"031e93c2ef8ce18158e1afd49eba798bd3f098e1de9e4e65fc5659df9dc0e4ca\": container with ID starting with 031e93c2ef8ce18158e1afd49eba798bd3f098e1de9e4e65fc5659df9dc0e4ca not found: ID does not exist" containerID="031e93c2ef8ce18158e1afd49eba798bd3f098e1de9e4e65fc5659df9dc0e4ca"
Jul 30 19:42:02.260995 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.260950    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"031e93c2ef8ce18158e1afd49eba798bd3f098e1de9e4e65fc5659df9dc0e4ca"} err="failed to get container status \"031e93c2ef8ce18158e1afd49eba798bd3f098e1de9e4e65fc5659df9dc0e4ca\": rpc error: code = NotFound desc = could not find container \"031e93c2ef8ce18158e1afd49eba798bd3f098e1de9e4e65fc5659df9dc0e4ca\": container with ID starting with 031e93c2ef8ce18158e1afd49eba798bd3f098e1de9e4e65fc5659df9dc0e4ca not found: ID does not exist"
Jul 30 19:42:02.260995 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.260971    2568 scope.go:117] "RemoveContainer" containerID="16c56903dc38c68f2f656ea2346500ba307f2954352225c3465ffa55d57111f1"
Jul 30 19:42:02.261082 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261044    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 19:42:02.261183 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:42:02.261169    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16c56903dc38c68f2f656ea2346500ba307f2954352225c3465ffa55d57111f1\": container with ID starting with 16c56903dc38c68f2f656ea2346500ba307f2954352225c3465ffa55d57111f1 not found: ID does not exist" containerID="16c56903dc38c68f2f656ea2346500ba307f2954352225c3465ffa55d57111f1"
Jul 30 19:42:02.261216 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261187    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16c56903dc38c68f2f656ea2346500ba307f2954352225c3465ffa55d57111f1"} err="failed to get container status \"16c56903dc38c68f2f656ea2346500ba307f2954352225c3465ffa55d57111f1\": rpc error: code = NotFound desc = could not find container \"16c56903dc38c68f2f656ea2346500ba307f2954352225c3465ffa55d57111f1\": container with ID starting with 16c56903dc38c68f2f656ea2346500ba307f2954352225c3465ffa55d57111f1 not found: ID does not exist"
Jul 30 19:42:02.261216 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261205    2568 scope.go:117] "RemoveContainer" containerID="27ff7eb87d8b1dbe5548ebd7c30327239947f3ecb8f0f1a3d9aabc0e08097928"
Jul 30 19:42:02.261374 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261357    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="init-config-reloader"
Jul 30 19:42:02.261374 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261374    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="init-config-reloader"
Jul 30 19:42:02.261491 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261391    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="kube-rbac-proxy-metric"
Jul 30 19:42:02.261491 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261397    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="kube-rbac-proxy-metric"
Jul 30 19:42:02.261491 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261416    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="kube-rbac-proxy-web"
Jul 30 19:42:02.261491 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:42:02.261418    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27ff7eb87d8b1dbe5548ebd7c30327239947f3ecb8f0f1a3d9aabc0e08097928\": container with ID starting with 27ff7eb87d8b1dbe5548ebd7c30327239947f3ecb8f0f1a3d9aabc0e08097928 not found: ID does not exist" containerID="27ff7eb87d8b1dbe5548ebd7c30327239947f3ecb8f0f1a3d9aabc0e08097928"
Jul 30 19:42:02.261491 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261442    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ff7eb87d8b1dbe5548ebd7c30327239947f3ecb8f0f1a3d9aabc0e08097928"} err="failed to get container status \"27ff7eb87d8b1dbe5548ebd7c30327239947f3ecb8f0f1a3d9aabc0e08097928\": rpc error: code = NotFound desc = could not find container \"27ff7eb87d8b1dbe5548ebd7c30327239947f3ecb8f0f1a3d9aabc0e08097928\": container with ID starting with 27ff7eb87d8b1dbe5548ebd7c30327239947f3ecb8f0f1a3d9aabc0e08097928 not found: ID does not exist"
Jul 30 19:42:02.261491 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261457    2568 scope.go:117] "RemoveContainer" containerID="a37bb3f44bc33fcc03504c91c44045e558ae2ee8eed74eacb963a16072e900b2"
Jul 30 19:42:02.261781 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261423    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="kube-rbac-proxy-web"
Jul 30 19:42:02.261781 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261603    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="alertmanager"
Jul 30 19:42:02.261781 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261625    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="alertmanager"
Jul 30 19:42:02.261781 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261637    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="kube-rbac-proxy"
Jul 30 19:42:02.261781 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261656    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="kube-rbac-proxy"
Jul 30 19:42:02.261781 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261683    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="config-reloader"
Jul 30 19:42:02.261781 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261693    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="config-reloader"
Jul 30 19:42:02.261781 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261702    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="prom-label-proxy"
Jul 30 19:42:02.261781 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261710    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="prom-label-proxy"
Jul 30 19:42:02.262122 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261701    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a37bb3f44bc33fcc03504c91c44045e558ae2ee8eed74eacb963a16072e900b2"} err="failed to get container status \"a37bb3f44bc33fcc03504c91c44045e558ae2ee8eed74eacb963a16072e900b2\": rpc error: code = NotFound desc = could not find container \"a37bb3f44bc33fcc03504c91c44045e558ae2ee8eed74eacb963a16072e900b2\": container with ID starting with a37bb3f44bc33fcc03504c91c44045e558ae2ee8eed74eacb963a16072e900b2 not found: ID does not exist"
Jul 30 19:42:02.262122 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261819    2568 scope.go:117] "RemoveContainer" containerID="c9211bab34bf74e3fde543e38ba194d5f7139766026540544b4144c67a93410f"
Jul 30 19:42:02.262122 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261846    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="config-reloader"
Jul 30 19:42:02.262122 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261864    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="prom-label-proxy"
Jul 30 19:42:02.262122 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261873    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="kube-rbac-proxy-web"
Jul 30 19:42:02.262122 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261893    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="kube-rbac-proxy-metric"
Jul 30 19:42:02.262122 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261901    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="kube-rbac-proxy"
Jul 30 19:42:02.262122 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.261910    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" containerName="alertmanager"
Jul 30 19:42:02.262382 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.262186    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9211bab34bf74e3fde543e38ba194d5f7139766026540544b4144c67a93410f"} err="failed to get container status \"c9211bab34bf74e3fde543e38ba194d5f7139766026540544b4144c67a93410f\": rpc error: code = NotFound desc = could not find container \"c9211bab34bf74e3fde543e38ba194d5f7139766026540544b4144c67a93410f\": container with ID starting with c9211bab34bf74e3fde543e38ba194d5f7139766026540544b4144c67a93410f not found: ID does not exist"
Jul 30 19:42:02.262382 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.262203    2568 scope.go:117] "RemoveContainer" containerID="cd1b67e76d318f1260b406f5bbef0e1336cc65ecd1d62b2afb2e03223ad1eff9"
Jul 30 19:42:02.262466 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.262446    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd1b67e76d318f1260b406f5bbef0e1336cc65ecd1d62b2afb2e03223ad1eff9"} err="failed to get container status \"cd1b67e76d318f1260b406f5bbef0e1336cc65ecd1d62b2afb2e03223ad1eff9\": rpc error: code = NotFound desc = could not find container \"cd1b67e76d318f1260b406f5bbef0e1336cc65ecd1d62b2afb2e03223ad1eff9\": container with ID starting with cd1b67e76d318f1260b406f5bbef0e1336cc65ecd1d62b2afb2e03223ad1eff9 not found: ID does not exist"
Jul 30 19:42:02.262466 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.262465    2568 scope.go:117] "RemoveContainer" containerID="c3f7a08d44e5ab8d50f8da8d4acee46bb7055c6b237207d64bded2cf6c74a53d"
Jul 30 19:42:02.262729 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.262707    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3f7a08d44e5ab8d50f8da8d4acee46bb7055c6b237207d64bded2cf6c74a53d"} err="failed to get container status \"c3f7a08d44e5ab8d50f8da8d4acee46bb7055c6b237207d64bded2cf6c74a53d\": rpc error: code = NotFound desc = could not find container \"c3f7a08d44e5ab8d50f8da8d4acee46bb7055c6b237207d64bded2cf6c74a53d\": container with ID starting with c3f7a08d44e5ab8d50f8da8d4acee46bb7055c6b237207d64bded2cf6c74a53d not found: ID does not exist"
Jul 30 19:42:02.262780 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.262730    2568 scope.go:117] "RemoveContainer" containerID="031e93c2ef8ce18158e1afd49eba798bd3f098e1de9e4e65fc5659df9dc0e4ca"
Jul 30 19:42:02.262960 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.262943    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"031e93c2ef8ce18158e1afd49eba798bd3f098e1de9e4e65fc5659df9dc0e4ca"} err="failed to get container status \"031e93c2ef8ce18158e1afd49eba798bd3f098e1de9e4e65fc5659df9dc0e4ca\": rpc error: code = NotFound desc = could not find container \"031e93c2ef8ce18158e1afd49eba798bd3f098e1de9e4e65fc5659df9dc0e4ca\": container with ID starting with 031e93c2ef8ce18158e1afd49eba798bd3f098e1de9e4e65fc5659df9dc0e4ca not found: ID does not exist"
Jul 30 19:42:02.263013 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.262960    2568 scope.go:117] "RemoveContainer" containerID="16c56903dc38c68f2f656ea2346500ba307f2954352225c3465ffa55d57111f1"
Jul 30 19:42:02.263248 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.263223    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16c56903dc38c68f2f656ea2346500ba307f2954352225c3465ffa55d57111f1"} err="failed to get container status \"16c56903dc38c68f2f656ea2346500ba307f2954352225c3465ffa55d57111f1\": rpc error: code = NotFound desc = could not find container \"16c56903dc38c68f2f656ea2346500ba307f2954352225c3465ffa55d57111f1\": container with ID starting with 16c56903dc38c68f2f656ea2346500ba307f2954352225c3465ffa55d57111f1 not found: ID does not exist"
Jul 30 19:42:02.263248 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.263247    2568 scope.go:117] "RemoveContainer" containerID="27ff7eb87d8b1dbe5548ebd7c30327239947f3ecb8f0f1a3d9aabc0e08097928"
Jul 30 19:42:02.263509 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.263488    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ff7eb87d8b1dbe5548ebd7c30327239947f3ecb8f0f1a3d9aabc0e08097928"} err="failed to get container status \"27ff7eb87d8b1dbe5548ebd7c30327239947f3ecb8f0f1a3d9aabc0e08097928\": rpc error: code = NotFound desc = could not find container \"27ff7eb87d8b1dbe5548ebd7c30327239947f3ecb8f0f1a3d9aabc0e08097928\": container with ID starting with 27ff7eb87d8b1dbe5548ebd7c30327239947f3ecb8f0f1a3d9aabc0e08097928 not found: ID does not exist"
Jul 30 19:42:02.265536 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.265522    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.267886 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.267867    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 30 19:42:02.267962 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.267869    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 30 19:42:02.267962 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.267930    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 30 19:42:02.268075 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.267968    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 30 19:42:02.268196 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.268181    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 30 19:42:02.268439 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.268422    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 30 19:42:02.268606 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.268592    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 30 19:42:02.268674 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.268659    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 30 19:42:02.268739 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.268726    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cmsmz\""
Jul 30 19:42:02.273257 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.273238    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 30 19:42:02.277689 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.277670    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 19:42:02.392733 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.392705    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.392836 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.392739    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.392836 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.392780    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.392836 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.392828    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.392938 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.392863    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzkpp\" (UniqueName: \"kubernetes.io/projected/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-kube-api-access-mzkpp\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.392938 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.392897    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-web-config\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.392938 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.392914    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-config-volume\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.393026 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.392969    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.393026 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.393001    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.393080 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.393038    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.393080 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.393058    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-config-out\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.393170 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.393081    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.393170 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.393098    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.493779 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.493714    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.493779 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.493758    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.493779 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.493785    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.493999 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.493825    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.494047 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.493993    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzkpp\" (UniqueName: \"kubernetes.io/projected/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-kube-api-access-mzkpp\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.494095 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.494044    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-web-config\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.494095 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.494079    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-config-volume\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.494195 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.494116    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.494195 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.494145    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.494310 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.494195    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.494310 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.494221    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-config-out\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.494310 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.494249    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.494310 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.494271    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.494887 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.494524    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.494987 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.494956    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.495196 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.495170    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.496822 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.496797    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-web-config\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.496973 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.496948    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.497042 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.497005    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.497042 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.497033    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.497456 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.497433    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.497539 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.497465    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-config-out\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.497539 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.497506    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.497743 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.497726    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-config-volume\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.499111 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.499093    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.501773 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.501743    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzkpp\" (UniqueName: \"kubernetes.io/projected/8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35-kube-api-access-mzkpp\") pod \"alertmanager-main-0\" (UID: \"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.575520 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.575501    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 19:42:02.703806 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:02.703781    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 19:42:02.705658 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:42:02.705631    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fe2f6b4_ee77_46f3_a0d3_e5ca0c7f5f35.slice/crio-f9465d8080037ac28da071757ea59b18a3ef3d394b988b996bc284d857917c80 WatchSource:0}: Error finding container f9465d8080037ac28da071757ea59b18a3ef3d394b988b996bc284d857917c80: Status 404 returned error can't find the container with id f9465d8080037ac28da071757ea59b18a3ef3d394b988b996bc284d857917c80
Jul 30 19:42:03.216195 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:03.216166    2568 generic.go:356] "Generic (PLEG): container finished" podID="8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35" containerID="bd84312ecd482c13774d62c76998cfb3e62f1e7057f8a57a55dd177e6d20d10c" exitCode=0
Jul 30 19:42:03.216533 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:03.216254    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35","Type":"ContainerDied","Data":"bd84312ecd482c13774d62c76998cfb3e62f1e7057f8a57a55dd177e6d20d10c"}
Jul 30 19:42:03.216533 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:03.216324    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35","Type":"ContainerStarted","Data":"f9465d8080037ac28da071757ea59b18a3ef3d394b988b996bc284d857917c80"}
Jul 30 19:42:03.481015 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:03.480988    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a402607-132b-45ba-a3b6-c8e1f7b65c3f" path="/var/lib/kubelet/pods/0a402607-132b-45ba-a3b6-c8e1f7b65c3f/volumes"
Jul 30 19:42:04.224395 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:04.224359    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35","Type":"ContainerStarted","Data":"b1a8d4c38e4c649f6fb961a24c88c9fcb94e8657c5fc10d6a732a3f1ab33f57c"}
Jul 30 19:42:04.224768 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:04.224441    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35","Type":"ContainerStarted","Data":"ffcf6b111ce880d1a9a03896f3a98fb097e5a49433c61f77a70d3d0c64ec1211"}
Jul 30 19:42:04.224768 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:04.224480    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35","Type":"ContainerStarted","Data":"8c763e341b3ac80733cd7d07a0ec5ba9efb5cdc35ef23f3791092d5d9927d927"}
Jul 30 19:42:04.224768 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:04.224518    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35","Type":"ContainerStarted","Data":"814ec332f75043db3d243586fd712a0380dab4e1a56234cef441e1048d7149c2"}
Jul 30 19:42:04.224768 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:04.224557    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35","Type":"ContainerStarted","Data":"a5251f34f843f322fca96ef7fe99e003c119b3c5e928a10bc48139cd2a4b9212"}
Jul 30 19:42:04.224768 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:04.224610    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35","Type":"ContainerStarted","Data":"8d3ecfc8873d7f72f386b942047ec101fcbbdfb440e261800b6b43e24f0ea6fd"}
Jul 30 19:42:04.252398 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:04.252324    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.234701493 podStartE2EDuration="2.252301683s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.60019ms" isStatefulPod=false podCreationTimestamp="2026-07-30 19:42:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:42:04.250662787 +0000 UTC m=+145.350743976" watchObservedRunningTime="2026-07-30 19:42:04.252301683 +0000 UTC m=+145.352382869"
Jul 30 19:42:04.315993 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:04.315962    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 19:42:04.316431 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:04.316249    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="prometheus" containerID="cri-o://3c37f3e900a72c8cd47c060014538cb27e7989fb6b86f5b43054217fb8f05a20" gracePeriod=600
Jul 30 19:42:04.316431 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:04.316283    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="config-reloader" containerID="cri-o://a63e3544ab7b17ce7dcaf6c7e0696bec48a7bfa1d57d134b63fe313a9c880f10" gracePeriod=600
Jul 30 19:42:04.316431 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:04.316270    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="thanos-sidecar" containerID="cri-o://9af7a031cfa3fe7ebb9d31161d3e92d5c5f2145bc21c80f10c77b86f391e5df1" gracePeriod=600
Jul 30 19:42:04.316431 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:04.316323    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="kube-rbac-proxy-web" containerID="cri-o://702931a74cb63f889254f4c904dcd816465ae16ae419b743bc52529dba74203f" gracePeriod=600
Jul 30 19:42:04.316431 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:04.316249    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="kube-rbac-proxy" containerID="cri-o://e15654e1de3ca745d1a8382d6a3981fbe13945e1d91873ee95d8480808e80b12" gracePeriod=600
Jul 30 19:42:04.316431 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:04.316292    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="kube-rbac-proxy-thanos" containerID="cri-o://80829635f3590b79f373d666c95a1f17c9f355406ee0fa401490e828355e7911" gracePeriod=600
Jul 30 19:42:05.236031 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.235994    2568 generic.go:356] "Generic (PLEG): container finished" podID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerID="80829635f3590b79f373d666c95a1f17c9f355406ee0fa401490e828355e7911" exitCode=0
Jul 30 19:42:05.236031 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.236021    2568 generic.go:356] "Generic (PLEG): container finished" podID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerID="e15654e1de3ca745d1a8382d6a3981fbe13945e1d91873ee95d8480808e80b12" exitCode=0
Jul 30 19:42:05.236031 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.236028    2568 generic.go:356] "Generic (PLEG): container finished" podID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerID="9af7a031cfa3fe7ebb9d31161d3e92d5c5f2145bc21c80f10c77b86f391e5df1" exitCode=0
Jul 30 19:42:05.236031 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.236035    2568 generic.go:356] "Generic (PLEG): container finished" podID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerID="a63e3544ab7b17ce7dcaf6c7e0696bec48a7bfa1d57d134b63fe313a9c880f10" exitCode=0
Jul 30 19:42:05.236551 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.236044    2568 generic.go:356] "Generic (PLEG): container finished" podID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerID="3c37f3e900a72c8cd47c060014538cb27e7989fb6b86f5b43054217fb8f05a20" exitCode=0
Jul 30 19:42:05.236551 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.236067    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2","Type":"ContainerDied","Data":"80829635f3590b79f373d666c95a1f17c9f355406ee0fa401490e828355e7911"}
Jul 30 19:42:05.236551 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.236144    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2","Type":"ContainerDied","Data":"e15654e1de3ca745d1a8382d6a3981fbe13945e1d91873ee95d8480808e80b12"}
Jul 30 19:42:05.236551 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.236185    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2","Type":"ContainerDied","Data":"9af7a031cfa3fe7ebb9d31161d3e92d5c5f2145bc21c80f10c77b86f391e5df1"}
Jul 30 19:42:05.236551 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.236227    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2","Type":"ContainerDied","Data":"a63e3544ab7b17ce7dcaf6c7e0696bec48a7bfa1d57d134b63fe313a9c880f10"}
Jul 30 19:42:05.236551 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.236269    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2","Type":"ContainerDied","Data":"3c37f3e900a72c8cd47c060014538cb27e7989fb6b86f5b43054217fb8f05a20"}
Jul 30 19:42:05.564215 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.564193    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:05.722661 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.722633    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-prometheus-k8s-tls\") pod \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") "
Jul 30 19:42:05.722661 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.722665    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-kube-rbac-proxy\") pod \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") "
Jul 30 19:42:05.722883 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.722683    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-grpc-tls\") pod \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") "
Jul 30 19:42:05.722883 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.722713    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") "
Jul 30 19:42:05.722883 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.722767    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") "
Jul 30 19:42:05.722883 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.722797    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-trusted-ca-bundle\") pod \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") "
Jul 30 19:42:05.722883 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.722856    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-configmap-metrics-client-ca\") pod \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") "
Jul 30 19:42:05.723142 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.722887    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-db\") pod \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") "
Jul 30 19:42:05.723142 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.722932    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-config\") pod \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") "
Jul 30 19:42:05.723142 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.722964    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-tls-assets\") pod \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") "
Jul 30 19:42:05.723142 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.723036    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-rulefiles-1\") pod \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") "
Jul 30 19:42:05.723142 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.723084    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-rulefiles-0\") pod \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") "
Jul 30 19:42:05.723142 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.723114    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mn99v\" (UniqueName: \"kubernetes.io/projected/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-kube-api-access-mn99v\") pod \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") "
Jul 30 19:42:05.723142 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.723138    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-metrics-client-certs\") pod \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") "
Jul 30 19:42:05.723468 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.723167    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-configmap-kubelet-serving-ca-bundle\") pod \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") "
Jul 30 19:42:05.723468 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.723193    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-rulefiles-2\") pod \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") "
Jul 30 19:42:05.723468 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.723223    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-thanos-prometheus-http-client-file\") pod \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") "
Jul 30 19:42:05.723468 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.723273    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-web-config\") pod \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") "
Jul 30 19:42:05.723468 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.723268    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" (UID: "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:42:05.723468 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.723307    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-configmap-serving-certs-ca-bundle\") pod \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") "
Jul 30 19:42:05.723468 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.723355    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-config-out\") pod \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\" (UID: \"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2\") "
Jul 30 19:42:05.723812 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.723650    2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:05.723812 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.723657    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" (UID: "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:42:05.724781 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.724133    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" (UID: "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:42:05.724781 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.724521    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" (UID: "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:42:05.725446 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.725418    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" (UID: "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:42:05.725796 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.725531    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" (UID: "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:42:05.726409 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.726112    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" (UID: "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:42:05.726550 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.726513    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" (UID: "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:42:05.726704 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.726676    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-config-out" (OuterVolumeSpecName: "config-out") pod "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" (UID: "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:42:05.726704 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.726689    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" (UID: "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:42:05.727092 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.727015    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" (UID: "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:42:05.727542 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.727250    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-config" (OuterVolumeSpecName: "config") pod "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" (UID: "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:42:05.727542 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.727282    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" (UID: "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:42:05.727542 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.727512    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" (UID: "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:42:05.727542 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.727535    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" (UID: "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:42:05.727921 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.727902    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-kube-api-access-mn99v" (OuterVolumeSpecName: "kube-api-access-mn99v") pod "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" (UID: "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2"). InnerVolumeSpecName "kube-api-access-mn99v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:42:05.728195 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.728173    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" (UID: "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:42:05.728255 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.728236    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" (UID: "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:42:05.728855 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.728839    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" (UID: "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:42:05.738431 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.738410    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-web-config" (OuterVolumeSpecName: "web-config") pod "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" (UID: "36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:42:05.824392 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.824366    2568 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-tls-assets\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:05.824392 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.824394    2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:05.824504 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.824403    2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:05.824504 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.824412    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mn99v\" (UniqueName: \"kubernetes.io/projected/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-kube-api-access-mn99v\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:05.824504 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.824422    2568 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-metrics-client-certs\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:05.824504 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.824430    2568 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:05.824504 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.824439    2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:05.824504 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.824447    2568 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:05.824504 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.824457    2568 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-web-config\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:05.824504 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.824464    2568 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:05.824504 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.824472    2568 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-config-out\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:05.824504 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.824480    2568 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:05.824504 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.824488    2568 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-kube-rbac-proxy\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:05.824504 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.824495    2568 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-grpc-tls\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:05.824504 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.824503    2568 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:05.824873 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.824512    2568 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:05.824873 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.824521    2568 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-configmap-metrics-client-ca\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:05.824873 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.824530    2568 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-prometheus-k8s-db\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:05.824873 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:05.824539    2568 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2-config\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:42:06.247308 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.247278    2568 generic.go:356] "Generic (PLEG): container finished" podID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerID="702931a74cb63f889254f4c904dcd816465ae16ae419b743bc52529dba74203f" exitCode=0
Jul 30 19:42:06.247684 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.247356    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2","Type":"ContainerDied","Data":"702931a74cb63f889254f4c904dcd816465ae16ae419b743bc52529dba74203f"}
Jul 30 19:42:06.247684 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.247366    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.247684 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.247464    2568 scope.go:117] "RemoveContainer" containerID="80829635f3590b79f373d666c95a1f17c9f355406ee0fa401490e828355e7911"
Jul 30 19:42:06.247684 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.247450    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2","Type":"ContainerDied","Data":"0338cc85648367ddb313a59f3b8749db4fbe3ce834fd7092816bd3bf10f65ae9"}
Jul 30 19:42:06.255643 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.255624    2568 scope.go:117] "RemoveContainer" containerID="e15654e1de3ca745d1a8382d6a3981fbe13945e1d91873ee95d8480808e80b12"
Jul 30 19:42:06.262262 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.262242    2568 scope.go:117] "RemoveContainer" containerID="702931a74cb63f889254f4c904dcd816465ae16ae419b743bc52529dba74203f"
Jul 30 19:42:06.268439 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.268425    2568 scope.go:117] "RemoveContainer" containerID="9af7a031cfa3fe7ebb9d31161d3e92d5c5f2145bc21c80f10c77b86f391e5df1"
Jul 30 19:42:06.272821 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.272800    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 19:42:06.276345 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.276326    2568 scope.go:117] "RemoveContainer" containerID="a63e3544ab7b17ce7dcaf6c7e0696bec48a7bfa1d57d134b63fe313a9c880f10"
Jul 30 19:42:06.277111 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.277093    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 19:42:06.282920 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.282901    2568 scope.go:117] "RemoveContainer" containerID="3c37f3e900a72c8cd47c060014538cb27e7989fb6b86f5b43054217fb8f05a20"
Jul 30 19:42:06.289631 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.289612    2568 scope.go:117] "RemoveContainer" containerID="d082d80464ac9f674631393157dd495ce63a104126f229ff7587ce9898f93daa"
Jul 30 19:42:06.296258 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.296240    2568 scope.go:117] "RemoveContainer" containerID="80829635f3590b79f373d666c95a1f17c9f355406ee0fa401490e828355e7911"
Jul 30 19:42:06.296503 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:42:06.296474    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80829635f3590b79f373d666c95a1f17c9f355406ee0fa401490e828355e7911\": container with ID starting with 80829635f3590b79f373d666c95a1f17c9f355406ee0fa401490e828355e7911 not found: ID does not exist" containerID="80829635f3590b79f373d666c95a1f17c9f355406ee0fa401490e828355e7911"
Jul 30 19:42:06.296559 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.296511    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80829635f3590b79f373d666c95a1f17c9f355406ee0fa401490e828355e7911"} err="failed to get container status \"80829635f3590b79f373d666c95a1f17c9f355406ee0fa401490e828355e7911\": rpc error: code = NotFound desc = could not find container \"80829635f3590b79f373d666c95a1f17c9f355406ee0fa401490e828355e7911\": container with ID starting with 80829635f3590b79f373d666c95a1f17c9f355406ee0fa401490e828355e7911 not found: ID does not exist"
Jul 30 19:42:06.296559 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.296529    2568 scope.go:117] "RemoveContainer" containerID="e15654e1de3ca745d1a8382d6a3981fbe13945e1d91873ee95d8480808e80b12"
Jul 30 19:42:06.296858 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:42:06.296827    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e15654e1de3ca745d1a8382d6a3981fbe13945e1d91873ee95d8480808e80b12\": container with ID starting with e15654e1de3ca745d1a8382d6a3981fbe13945e1d91873ee95d8480808e80b12 not found: ID does not exist" containerID="e15654e1de3ca745d1a8382d6a3981fbe13945e1d91873ee95d8480808e80b12"
Jul 30 19:42:06.296932 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.296857    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e15654e1de3ca745d1a8382d6a3981fbe13945e1d91873ee95d8480808e80b12"} err="failed to get container status \"e15654e1de3ca745d1a8382d6a3981fbe13945e1d91873ee95d8480808e80b12\": rpc error: code = NotFound desc = could not find container \"e15654e1de3ca745d1a8382d6a3981fbe13945e1d91873ee95d8480808e80b12\": container with ID starting with e15654e1de3ca745d1a8382d6a3981fbe13945e1d91873ee95d8480808e80b12 not found: ID does not exist"
Jul 30 19:42:06.296932 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.296876    2568 scope.go:117] "RemoveContainer" containerID="702931a74cb63f889254f4c904dcd816465ae16ae419b743bc52529dba74203f"
Jul 30 19:42:06.297172 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:42:06.297155    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"702931a74cb63f889254f4c904dcd816465ae16ae419b743bc52529dba74203f\": container with ID starting with 702931a74cb63f889254f4c904dcd816465ae16ae419b743bc52529dba74203f not found: ID does not exist" containerID="702931a74cb63f889254f4c904dcd816465ae16ae419b743bc52529dba74203f"
Jul 30 19:42:06.297249 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.297175    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"702931a74cb63f889254f4c904dcd816465ae16ae419b743bc52529dba74203f"} err="failed to get container status \"702931a74cb63f889254f4c904dcd816465ae16ae419b743bc52529dba74203f\": rpc error: code = NotFound desc = could not find container \"702931a74cb63f889254f4c904dcd816465ae16ae419b743bc52529dba74203f\": container with ID starting with 702931a74cb63f889254f4c904dcd816465ae16ae419b743bc52529dba74203f not found: ID does not exist"
Jul 30 19:42:06.297249 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.297198    2568 scope.go:117] "RemoveContainer" containerID="9af7a031cfa3fe7ebb9d31161d3e92d5c5f2145bc21c80f10c77b86f391e5df1"
Jul 30 19:42:06.297516 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:42:06.297494    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9af7a031cfa3fe7ebb9d31161d3e92d5c5f2145bc21c80f10c77b86f391e5df1\": container with ID starting with 9af7a031cfa3fe7ebb9d31161d3e92d5c5f2145bc21c80f10c77b86f391e5df1 not found: ID does not exist" containerID="9af7a031cfa3fe7ebb9d31161d3e92d5c5f2145bc21c80f10c77b86f391e5df1"
Jul 30 19:42:06.297741 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.297711    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9af7a031cfa3fe7ebb9d31161d3e92d5c5f2145bc21c80f10c77b86f391e5df1"} err="failed to get container status \"9af7a031cfa3fe7ebb9d31161d3e92d5c5f2145bc21c80f10c77b86f391e5df1\": rpc error: code = NotFound desc = could not find container \"9af7a031cfa3fe7ebb9d31161d3e92d5c5f2145bc21c80f10c77b86f391e5df1\": container with ID starting with 9af7a031cfa3fe7ebb9d31161d3e92d5c5f2145bc21c80f10c77b86f391e5df1 not found: ID does not exist"
Jul 30 19:42:06.297741 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.297741    2568 scope.go:117] "RemoveContainer" containerID="a63e3544ab7b17ce7dcaf6c7e0696bec48a7bfa1d57d134b63fe313a9c880f10"
Jul 30 19:42:06.298083 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:42:06.298062    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a63e3544ab7b17ce7dcaf6c7e0696bec48a7bfa1d57d134b63fe313a9c880f10\": container with ID starting with a63e3544ab7b17ce7dcaf6c7e0696bec48a7bfa1d57d134b63fe313a9c880f10 not found: ID does not exist" containerID="a63e3544ab7b17ce7dcaf6c7e0696bec48a7bfa1d57d134b63fe313a9c880f10"
Jul 30 19:42:06.298178 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.298091    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a63e3544ab7b17ce7dcaf6c7e0696bec48a7bfa1d57d134b63fe313a9c880f10"} err="failed to get container status \"a63e3544ab7b17ce7dcaf6c7e0696bec48a7bfa1d57d134b63fe313a9c880f10\": rpc error: code = NotFound desc = could not find container \"a63e3544ab7b17ce7dcaf6c7e0696bec48a7bfa1d57d134b63fe313a9c880f10\": container with ID starting with a63e3544ab7b17ce7dcaf6c7e0696bec48a7bfa1d57d134b63fe313a9c880f10 not found: ID does not exist"
Jul 30 19:42:06.298178 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.298111    2568 scope.go:117] "RemoveContainer" containerID="3c37f3e900a72c8cd47c060014538cb27e7989fb6b86f5b43054217fb8f05a20"
Jul 30 19:42:06.298425 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:42:06.298387    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c37f3e900a72c8cd47c060014538cb27e7989fb6b86f5b43054217fb8f05a20\": container with ID starting with 3c37f3e900a72c8cd47c060014538cb27e7989fb6b86f5b43054217fb8f05a20 not found: ID does not exist" containerID="3c37f3e900a72c8cd47c060014538cb27e7989fb6b86f5b43054217fb8f05a20"
Jul 30 19:42:06.298425 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.298414    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c37f3e900a72c8cd47c060014538cb27e7989fb6b86f5b43054217fb8f05a20"} err="failed to get container status \"3c37f3e900a72c8cd47c060014538cb27e7989fb6b86f5b43054217fb8f05a20\": rpc error: code = NotFound desc = could not find container \"3c37f3e900a72c8cd47c060014538cb27e7989fb6b86f5b43054217fb8f05a20\": container with ID starting with 3c37f3e900a72c8cd47c060014538cb27e7989fb6b86f5b43054217fb8f05a20 not found: ID does not exist"
Jul 30 19:42:06.298551 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.298433    2568 scope.go:117] "RemoveContainer" containerID="d082d80464ac9f674631393157dd495ce63a104126f229ff7587ce9898f93daa"
Jul 30 19:42:06.298706 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:42:06.298686    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d082d80464ac9f674631393157dd495ce63a104126f229ff7587ce9898f93daa\": container with ID starting with d082d80464ac9f674631393157dd495ce63a104126f229ff7587ce9898f93daa not found: ID does not exist" containerID="d082d80464ac9f674631393157dd495ce63a104126f229ff7587ce9898f93daa"
Jul 30 19:42:06.298751 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.298711    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d082d80464ac9f674631393157dd495ce63a104126f229ff7587ce9898f93daa"} err="failed to get container status \"d082d80464ac9f674631393157dd495ce63a104126f229ff7587ce9898f93daa\": rpc error: code = NotFound desc = could not find container \"d082d80464ac9f674631393157dd495ce63a104126f229ff7587ce9898f93daa\": container with ID starting with d082d80464ac9f674631393157dd495ce63a104126f229ff7587ce9898f93daa not found: ID does not exist"
Jul 30 19:42:06.299019 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.299003    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 19:42:06.299345 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.299333    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="kube-rbac-proxy-thanos"
Jul 30 19:42:06.299386 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.299348    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="kube-rbac-proxy-thanos"
Jul 30 19:42:06.299386 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.299358    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="kube-rbac-proxy"
Jul 30 19:42:06.299386 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.299364    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="kube-rbac-proxy"
Jul 30 19:42:06.299386 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.299376    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="config-reloader"
Jul 30 19:42:06.299386 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.299381    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="config-reloader"
Jul 30 19:42:06.299521 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.299396    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="prometheus"
Jul 30 19:42:06.299521 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.299403    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="prometheus"
Jul 30 19:42:06.299521 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.299417    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="init-config-reloader"
Jul 30 19:42:06.299521 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.299422    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="init-config-reloader"
Jul 30 19:42:06.299521 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.299428    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="thanos-sidecar"
Jul 30 19:42:06.299521 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.299434    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="thanos-sidecar"
Jul 30 19:42:06.299521 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.299441    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="kube-rbac-proxy-web"
Jul 30 19:42:06.299521 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.299446    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="kube-rbac-proxy-web"
Jul 30 19:42:06.299521 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.299501    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="kube-rbac-proxy"
Jul 30 19:42:06.299521 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.299512    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="kube-rbac-proxy-thanos"
Jul 30 19:42:06.299521 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.299517    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="thanos-sidecar"
Jul 30 19:42:06.299521 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.299523    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="config-reloader"
Jul 30 19:42:06.299862 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.299529    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="kube-rbac-proxy-web"
Jul 30 19:42:06.299862 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.299534    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" containerName="prometheus"
Jul 30 19:42:06.303111 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.303095    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.305533 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.305514    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5j6jg\""
Jul 30 19:42:06.305655 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.305552    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 30 19:42:06.305919 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.305899    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 30 19:42:06.305996 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.305928    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 30 19:42:06.305996 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.305947    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 30 19:42:06.305996 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.305928    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b0dr33db7s495\""
Jul 30 19:42:06.306140 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.305953    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 30 19:42:06.306656 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.306634    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 30 19:42:06.306729 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.306715    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 30 19:42:06.306871 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.306855    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 30 19:42:06.306929 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.306880    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 30 19:42:06.306929 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.306912    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 30 19:42:06.307222 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.307187    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 30 19:42:06.307950 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.307933    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 30 19:42:06.308645 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.308629    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 30 19:42:06.311842 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.311823    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 30 19:42:06.320404 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.320386    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 19:42:06.429172 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.429145    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.429305 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.429176    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50b96075-3c5b-4e0f-901b-1828b4264bd5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.429305 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.429199    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50b96075-3c5b-4e0f-901b-1828b4264bd5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.429305 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.429239    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50b96075-3c5b-4e0f-901b-1828b4264bd5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.429305 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.429263    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/50b96075-3c5b-4e0f-901b-1828b4264bd5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.429305 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.429291    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50b96075-3c5b-4e0f-901b-1828b4264bd5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.429459 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.429334    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g98fz\" (UniqueName: \"kubernetes.io/projected/50b96075-3c5b-4e0f-901b-1828b4264bd5-kube-api-access-g98fz\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.429459 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.429355    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50b96075-3c5b-4e0f-901b-1828b4264bd5-config-out\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.429459 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.429376    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50b96075-3c5b-4e0f-901b-1828b4264bd5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.429459 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.429401    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.429459 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.429417    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.429459 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.429439    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.429640 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.429482    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.429640 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.429497    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-web-config\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.429640 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.429515    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.429640 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.429596    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50b96075-3c5b-4e0f-901b-1828b4264bd5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.429640 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.429634    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/50b96075-3c5b-4e0f-901b-1828b4264bd5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.429790 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.429656    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.429790 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.429682    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50b96075-3c5b-4e0f-901b-1828b4264bd5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.429790 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.429699    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-config\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.530853 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.530797    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50b96075-3c5b-4e0f-901b-1828b4264bd5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.530853 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.530829    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/50b96075-3c5b-4e0f-901b-1828b4264bd5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.530853 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.530846    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.531043 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.530865    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50b96075-3c5b-4e0f-901b-1828b4264bd5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.531043 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.530992    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-config\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.531043 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.531028    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.531185 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.531052    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50b96075-3c5b-4e0f-901b-1828b4264bd5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.531185 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.531077    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50b96075-3c5b-4e0f-901b-1828b4264bd5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.531185 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.531103    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50b96075-3c5b-4e0f-901b-1828b4264bd5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.531185 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.531130    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/50b96075-3c5b-4e0f-901b-1828b4264bd5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.531185 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.531170    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50b96075-3c5b-4e0f-901b-1828b4264bd5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.531433 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.531217    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g98fz\" (UniqueName: \"kubernetes.io/projected/50b96075-3c5b-4e0f-901b-1828b4264bd5-kube-api-access-g98fz\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.531433 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.531252    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50b96075-3c5b-4e0f-901b-1828b4264bd5-config-out\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.531433 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.531276    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50b96075-3c5b-4e0f-901b-1828b4264bd5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.531433 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.531310    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.531433 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.531333    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.531433 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.531364    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.531433 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.531371    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50b96075-3c5b-4e0f-901b-1828b4264bd5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.531433 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.531401    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.531433 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.531428    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-web-config\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.531855 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.531465    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.531855 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.531490    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/50b96075-3c5b-4e0f-901b-1828b4264bd5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.531855 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.531521    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50b96075-3c5b-4e0f-901b-1828b4264bd5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.531855 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.531555    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50b96075-3c5b-4e0f-901b-1828b4264bd5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.533986 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.533923    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.534101 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.534033    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-config\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.534748 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.534318    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50b96075-3c5b-4e0f-901b-1828b4264bd5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.534748 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.534398    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.534748 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.534590    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.534748 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.534658    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.534748 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.534672    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.534748 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.534709    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/50b96075-3c5b-4e0f-901b-1828b4264bd5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.535155 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.534828    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50b96075-3c5b-4e0f-901b-1828b4264bd5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.535155 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.535058    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50b96075-3c5b-4e0f-901b-1828b4264bd5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.535484 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.535460    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-web-config\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.536680 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.536656    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50b96075-3c5b-4e0f-901b-1828b4264bd5-config-out\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.537059 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.537011    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.537129 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.537016    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50b96075-3c5b-4e0f-901b-1828b4264bd5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.537207 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.537188    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50b96075-3c5b-4e0f-901b-1828b4264bd5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.538965 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.538944    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g98fz\" (UniqueName: \"kubernetes.io/projected/50b96075-3c5b-4e0f-901b-1828b4264bd5-kube-api-access-g98fz\") pod \"prometheus-k8s-0\" (UID: \"50b96075-3c5b-4e0f-901b-1828b4264bd5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.614611 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.614592    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:42:06.742634 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:06.742485    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 19:42:06.745080 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:42:06.745052    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50b96075_3c5b_4e0f_901b_1828b4264bd5.slice/crio-6163de5e8de471e21307fa39487d97fa86d480758eefd1f9b03426032016582b WatchSource:0}: Error finding container 6163de5e8de471e21307fa39487d97fa86d480758eefd1f9b03426032016582b: Status 404 returned error can't find the container with id 6163de5e8de471e21307fa39487d97fa86d480758eefd1f9b03426032016582b
Jul 30 19:42:07.252576 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:07.252540    2568 generic.go:356] "Generic (PLEG): container finished" podID="50b96075-3c5b-4e0f-901b-1828b4264bd5" containerID="42b50c5dcbf12d5914f78a9357c613add9aee6780fb3c26d9cff2b25c6826614" exitCode=0
Jul 30 19:42:07.253011 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:07.252623    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50b96075-3c5b-4e0f-901b-1828b4264bd5","Type":"ContainerDied","Data":"42b50c5dcbf12d5914f78a9357c613add9aee6780fb3c26d9cff2b25c6826614"}
Jul 30 19:42:07.253011 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:07.252691    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50b96075-3c5b-4e0f-901b-1828b4264bd5","Type":"ContainerStarted","Data":"6163de5e8de471e21307fa39487d97fa86d480758eefd1f9b03426032016582b"}
Jul 30 19:42:07.487452 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:07.487418    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2" path="/var/lib/kubelet/pods/36ac7ed8-2a0f-4524-9bf1-1e55dce4f4d2/volumes"
Jul 30 19:42:08.261528 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:08.261495    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50b96075-3c5b-4e0f-901b-1828b4264bd5","Type":"ContainerStarted","Data":"8cf6f31c866f8d329e384fb7c01d1afcc09a9b6529c3ce78d68d1c94956cdfbd"}
Jul 30 19:42:08.261918 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:08.261577    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50b96075-3c5b-4e0f-901b-1828b4264bd5","Type":"ContainerStarted","Data":"c0d23d452d0dc2b8c08ec9752b498ff77ab2fe90072f9d63d926291d5db8fb26"}
Jul 30 19:42:08.261918 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:08.261605    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50b96075-3c5b-4e0f-901b-1828b4264bd5","Type":"ContainerStarted","Data":"675d225c76c66d2eb2653b2bd0e57fabb6d89019937582425bb8201e97a719e2"}
Jul 30 19:42:08.261918 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:08.261629    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50b96075-3c5b-4e0f-901b-1828b4264bd5","Type":"ContainerStarted","Data":"a8cfb94c543cdd91455fa14f729821f9450d754df96b285038d70d0e45c9286a"}
Jul 30 19:42:08.261918 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:08.261653    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50b96075-3c5b-4e0f-901b-1828b4264bd5","Type":"ContainerStarted","Data":"88f3ca198b0d79bb32e86a6492fa660c0004231eb068b5678faa3cf6d1b1d10e"}
Jul 30 19:42:08.261918 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:08.261676    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50b96075-3c5b-4e0f-901b-1828b4264bd5","Type":"ContainerStarted","Data":"40ecfe75eb2033f1485ba6061b8785281d23b0a26d0762953b3152f05ae8de55"}
Jul 30 19:42:08.291604 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:08.291532    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.269719512 podStartE2EDuration="2.291516147s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.796635ms" isStatefulPod=false podCreationTimestamp="2026-07-30 19:42:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:42:08.289963348 +0000 UTC m=+149.390044534" watchObservedRunningTime="2026-07-30 19:42:08.291516147 +0000 UTC m=+149.391597334"
Jul 30 19:42:11.615368 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:42:11.615337    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:43:06.615594 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:06.615549    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:43:06.630331 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:06.630309    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:43:07.516967 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:07.516933    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 19:43:26.868905 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:26.868873    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9px5k"]
Jul 30 19:43:26.871778 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:26.871763    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9px5k"
Jul 30 19:43:26.874172 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:26.874125    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 30 19:43:26.874295 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:26.874173    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 30 19:43:26.874295 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:26.874193    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9x2sh\""
Jul 30 19:43:26.881007 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:26.880985    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9px5k"]
Jul 30 19:43:27.019314 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:27.019282    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzt5q\" (UniqueName: \"kubernetes.io/projected/ee8043ce-912f-4c14-970a-58622bde15f1-kube-api-access-bzt5q\") pod \"cert-manager-cainjector-559cdd8c87-9px5k\" (UID: \"ee8043ce-912f-4c14-970a-58622bde15f1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9px5k"
Jul 30 19:43:27.019476 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:27.019346    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee8043ce-912f-4c14-970a-58622bde15f1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9px5k\" (UID: \"ee8043ce-912f-4c14-970a-58622bde15f1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9px5k"
Jul 30 19:43:27.120450 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:27.120370    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzt5q\" (UniqueName: \"kubernetes.io/projected/ee8043ce-912f-4c14-970a-58622bde15f1-kube-api-access-bzt5q\") pod \"cert-manager-cainjector-559cdd8c87-9px5k\" (UID: \"ee8043ce-912f-4c14-970a-58622bde15f1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9px5k"
Jul 30 19:43:27.120450 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:27.120435    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee8043ce-912f-4c14-970a-58622bde15f1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9px5k\" (UID: \"ee8043ce-912f-4c14-970a-58622bde15f1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9px5k"
Jul 30 19:43:27.129494 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:27.129471    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee8043ce-912f-4c14-970a-58622bde15f1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9px5k\" (UID: \"ee8043ce-912f-4c14-970a-58622bde15f1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9px5k"
Jul 30 19:43:27.129652 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:27.129632    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzt5q\" (UniqueName: \"kubernetes.io/projected/ee8043ce-912f-4c14-970a-58622bde15f1-kube-api-access-bzt5q\") pod \"cert-manager-cainjector-559cdd8c87-9px5k\" (UID: \"ee8043ce-912f-4c14-970a-58622bde15f1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9px5k"
Jul 30 19:43:27.192554 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:27.192523    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9px5k"
Jul 30 19:43:27.318659 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:27.318635    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9px5k"]
Jul 30 19:43:27.320642 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:43:27.320612    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee8043ce_912f_4c14_970a_58622bde15f1.slice/crio-efed2223c591f432a5d5f901c94daf88e15f4cd2ec6cd0d3850dcf48de0b3ff1 WatchSource:0}: Error finding container efed2223c591f432a5d5f901c94daf88e15f4cd2ec6cd0d3850dcf48de0b3ff1: Status 404 returned error can't find the container with id efed2223c591f432a5d5f901c94daf88e15f4cd2ec6cd0d3850dcf48de0b3ff1
Jul 30 19:43:27.575493 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:27.575459    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9px5k" event={"ID":"ee8043ce-912f-4c14-970a-58622bde15f1","Type":"ContainerStarted","Data":"efed2223c591f432a5d5f901c94daf88e15f4cd2ec6cd0d3850dcf48de0b3ff1"}
Jul 30 19:43:30.594486 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:30.594447    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9px5k" event={"ID":"ee8043ce-912f-4c14-970a-58622bde15f1","Type":"ContainerStarted","Data":"d9a7d9ebcc42047b8c31b8a91e1a588d9349b3895dd43bbbda090a10bad36832"}
Jul 30 19:43:30.612434 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:30.612391    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9px5k" podStartSLOduration=1.468942315 podStartE2EDuration="4.612377556s" totalImagesPullingTime="3.143435241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:43:30.610848246 +0000 UTC m=+231.710929458" watchObservedRunningTime="2026-07-30 19:43:30.612377556 +0000 UTC m=+231.712458743"
Jul 30 19:43:34.873047 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:34.873016    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-czbrs"]
Jul 30 19:43:34.876321 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:34.876303    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-czbrs"
Jul 30 19:43:34.878806 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:34.878789    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-nc9vx\""
Jul 30 19:43:34.880174 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:34.880152    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96813f69-85cb-4dd8-9bc7-1a9031f98d9f-bound-sa-token\") pod \"cert-manager-55b4d954d5-czbrs\" (UID: \"96813f69-85cb-4dd8-9bc7-1a9031f98d9f\") " pod="cert-manager/cert-manager-55b4d954d5-czbrs"
Jul 30 19:43:34.880258 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:34.880243    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlwk2\" (UniqueName: \"kubernetes.io/projected/96813f69-85cb-4dd8-9bc7-1a9031f98d9f-kube-api-access-qlwk2\") pod \"cert-manager-55b4d954d5-czbrs\" (UID: \"96813f69-85cb-4dd8-9bc7-1a9031f98d9f\") " pod="cert-manager/cert-manager-55b4d954d5-czbrs"
Jul 30 19:43:34.885739 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:34.885718    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-czbrs"]
Jul 30 19:43:34.980678 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:34.980649    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlwk2\" (UniqueName: \"kubernetes.io/projected/96813f69-85cb-4dd8-9bc7-1a9031f98d9f-kube-api-access-qlwk2\") pod \"cert-manager-55b4d954d5-czbrs\" (UID: \"96813f69-85cb-4dd8-9bc7-1a9031f98d9f\") " pod="cert-manager/cert-manager-55b4d954d5-czbrs"
Jul 30 19:43:34.980813 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:34.980692    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96813f69-85cb-4dd8-9bc7-1a9031f98d9f-bound-sa-token\") pod \"cert-manager-55b4d954d5-czbrs\" (UID: \"96813f69-85cb-4dd8-9bc7-1a9031f98d9f\") " pod="cert-manager/cert-manager-55b4d954d5-czbrs"
Jul 30 19:43:34.988078 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:34.988051    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96813f69-85cb-4dd8-9bc7-1a9031f98d9f-bound-sa-token\") pod \"cert-manager-55b4d954d5-czbrs\" (UID: \"96813f69-85cb-4dd8-9bc7-1a9031f98d9f\") " pod="cert-manager/cert-manager-55b4d954d5-czbrs"
Jul 30 19:43:34.988166 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:34.988117    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlwk2\" (UniqueName: \"kubernetes.io/projected/96813f69-85cb-4dd8-9bc7-1a9031f98d9f-kube-api-access-qlwk2\") pod \"cert-manager-55b4d954d5-czbrs\" (UID: \"96813f69-85cb-4dd8-9bc7-1a9031f98d9f\") " pod="cert-manager/cert-manager-55b4d954d5-czbrs"
Jul 30 19:43:35.184537 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:35.184454    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-czbrs"
Jul 30 19:43:35.318102 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:35.318080    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-czbrs"]
Jul 30 19:43:35.319930 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:43:35.319906    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96813f69_85cb_4dd8_9bc7_1a9031f98d9f.slice/crio-26626a089a4015290bff370c5d5b633a956ed370ff470ef30f07da0cdea3133b WatchSource:0}: Error finding container 26626a089a4015290bff370c5d5b633a956ed370ff470ef30f07da0cdea3133b: Status 404 returned error can't find the container with id 26626a089a4015290bff370c5d5b633a956ed370ff470ef30f07da0cdea3133b
Jul 30 19:43:35.613839 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:35.613810    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-czbrs" event={"ID":"96813f69-85cb-4dd8-9bc7-1a9031f98d9f","Type":"ContainerStarted","Data":"24996bcd3105cd50b0822d3b2795bc0c4a227d9388d9170090df038938e1b5f2"}
Jul 30 19:43:35.613839 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:35.613843    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-czbrs" event={"ID":"96813f69-85cb-4dd8-9bc7-1a9031f98d9f","Type":"ContainerStarted","Data":"26626a089a4015290bff370c5d5b633a956ed370ff470ef30f07da0cdea3133b"}
Jul 30 19:43:35.632110 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:35.632063    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-czbrs" podStartSLOduration=1.632048202 podStartE2EDuration="1.632048202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:43:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:43:35.630614475 +0000 UTC m=+236.730695663" watchObservedRunningTime="2026-07-30 19:43:35.632048202 +0000 UTC m=+236.732129389"
Jul 30 19:43:56.965923 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:56.965879    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"]
Jul 30 19:43:56.969889 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:56.969866    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"
Jul 30 19:43:56.973112 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:56.973075    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 30 19:43:56.973249 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:56.973091    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 30 19:43:56.973249 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:56.973152    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-t962t\""
Jul 30 19:43:56.973249 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:56.973204    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 30 19:43:56.973249 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:56.973122    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 30 19:43:56.985759 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:56.985738    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"]
Jul 30 19:43:57.044382 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:57.044361    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9db0278-056c-47ac-8575-d3183a8cb549-tmp\") pod \"opendatahub-operator-controller-manager-d686446bf-vvf7q\" (UID: \"a9db0278-056c-47ac-8575-d3183a8cb549\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"
Jul 30 19:43:57.044474 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:57.044394    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nxcv\" (UniqueName: \"kubernetes.io/projected/a9db0278-056c-47ac-8575-d3183a8cb549-kube-api-access-4nxcv\") pod \"opendatahub-operator-controller-manager-d686446bf-vvf7q\" (UID: \"a9db0278-056c-47ac-8575-d3183a8cb549\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"
Jul 30 19:43:57.044474 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:57.044423    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a9db0278-056c-47ac-8575-d3183a8cb549-manifests\") pod \"opendatahub-operator-controller-manager-d686446bf-vvf7q\" (UID: \"a9db0278-056c-47ac-8575-d3183a8cb549\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"
Jul 30 19:43:57.044550 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:57.044516    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a9db0278-056c-47ac-8575-d3183a8cb549-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d686446bf-vvf7q\" (UID: \"a9db0278-056c-47ac-8575-d3183a8cb549\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"
Jul 30 19:43:57.044550 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:57.044541    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9db0278-056c-47ac-8575-d3183a8cb549-webhook-cert\") pod \"opendatahub-operator-controller-manager-d686446bf-vvf7q\" (UID: \"a9db0278-056c-47ac-8575-d3183a8cb549\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"
Jul 30 19:43:57.145788 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:57.145762    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9db0278-056c-47ac-8575-d3183a8cb549-tmp\") pod \"opendatahub-operator-controller-manager-d686446bf-vvf7q\" (UID: \"a9db0278-056c-47ac-8575-d3183a8cb549\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"
Jul 30 19:43:57.145908 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:57.145796    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nxcv\" (UniqueName: \"kubernetes.io/projected/a9db0278-056c-47ac-8575-d3183a8cb549-kube-api-access-4nxcv\") pod \"opendatahub-operator-controller-manager-d686446bf-vvf7q\" (UID: \"a9db0278-056c-47ac-8575-d3183a8cb549\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"
Jul 30 19:43:57.145908 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:57.145838    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a9db0278-056c-47ac-8575-d3183a8cb549-manifests\") pod \"opendatahub-operator-controller-manager-d686446bf-vvf7q\" (UID: \"a9db0278-056c-47ac-8575-d3183a8cb549\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"
Jul 30 19:43:57.146030 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:57.145921    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a9db0278-056c-47ac-8575-d3183a8cb549-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d686446bf-vvf7q\" (UID: \"a9db0278-056c-47ac-8575-d3183a8cb549\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"
Jul 30 19:43:57.146030 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:57.145946    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9db0278-056c-47ac-8575-d3183a8cb549-webhook-cert\") pod \"opendatahub-operator-controller-manager-d686446bf-vvf7q\" (UID: \"a9db0278-056c-47ac-8575-d3183a8cb549\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"
Jul 30 19:43:57.146214 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:57.146192    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a9db0278-056c-47ac-8575-d3183a8cb549-manifests\") pod \"opendatahub-operator-controller-manager-d686446bf-vvf7q\" (UID: \"a9db0278-056c-47ac-8575-d3183a8cb549\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"
Jul 30 19:43:57.147938 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:57.147917    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9db0278-056c-47ac-8575-d3183a8cb549-tmp\") pod \"opendatahub-operator-controller-manager-d686446bf-vvf7q\" (UID: \"a9db0278-056c-47ac-8575-d3183a8cb549\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"
Jul 30 19:43:57.148176 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:57.148158    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a9db0278-056c-47ac-8575-d3183a8cb549-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d686446bf-vvf7q\" (UID: \"a9db0278-056c-47ac-8575-d3183a8cb549\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"
Jul 30 19:43:57.148238 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:57.148193    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9db0278-056c-47ac-8575-d3183a8cb549-webhook-cert\") pod \"opendatahub-operator-controller-manager-d686446bf-vvf7q\" (UID: \"a9db0278-056c-47ac-8575-d3183a8cb549\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"
Jul 30 19:43:57.156852 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:57.156829    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nxcv\" (UniqueName: \"kubernetes.io/projected/a9db0278-056c-47ac-8575-d3183a8cb549-kube-api-access-4nxcv\") pod \"opendatahub-operator-controller-manager-d686446bf-vvf7q\" (UID: \"a9db0278-056c-47ac-8575-d3183a8cb549\") " pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"
Jul 30 19:43:57.281740 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:57.281685    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"
Jul 30 19:43:57.426919 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:57.426896    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"]
Jul 30 19:43:57.429611 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:43:57.429584    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9db0278_056c_47ac_8575_d3183a8cb549.slice/crio-254c485f5301d3789104923f5bb2763561623b9c1a6da355776275dd1a38736e WatchSource:0}: Error finding container 254c485f5301d3789104923f5bb2763561623b9c1a6da355776275dd1a38736e: Status 404 returned error can't find the container with id 254c485f5301d3789104923f5bb2763561623b9c1a6da355776275dd1a38736e
Jul 30 19:43:57.699344 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:43:57.699306    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q" event={"ID":"a9db0278-056c-47ac-8575-d3183a8cb549","Type":"ContainerStarted","Data":"254c485f5301d3789104923f5bb2763561623b9c1a6da355776275dd1a38736e"}
Jul 30 19:44:00.714909 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:00.714835    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q" event={"ID":"a9db0278-056c-47ac-8575-d3183a8cb549","Type":"ContainerStarted","Data":"8102be5962dd0829c79e777a2657229096d7bda709d657e4767efbd0d90de633"}
Jul 30 19:44:01.721248 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:01.721214    2568 generic.go:356] "Generic (PLEG): container finished" podID="a9db0278-056c-47ac-8575-d3183a8cb549" containerID="8102be5962dd0829c79e777a2657229096d7bda709d657e4767efbd0d90de633" exitCode=0
Jul 30 19:44:01.721587 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:01.721303    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q" event={"ID":"a9db0278-056c-47ac-8575-d3183a8cb549","Type":"ContainerDied","Data":"8102be5962dd0829c79e777a2657229096d7bda709d657e4767efbd0d90de633"}
Jul 30 19:44:02.728721 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:02.728684    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q" event={"ID":"a9db0278-056c-47ac-8575-d3183a8cb549","Type":"ContainerStarted","Data":"9fa5f880a1c007404a951358c8bb6188f9ca0527cf9514607c78a9b67645ed0f"}
Jul 30 19:44:02.729160 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:02.728794    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"
Jul 30 19:44:02.753165 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:02.753124    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q" podStartSLOduration=2.201765508 podStartE2EDuration="6.75310987s" totalImagesPullingTime="3.504181356s" totalInitContainerRuntime="1.047163006s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:43:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:44:02.751736017 +0000 UTC m=+263.851817205" watchObservedRunningTime="2026-07-30 19:44:02.75310987 +0000 UTC m=+263.853191057"
Jul 30 19:44:13.739329 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:13.739296    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d686446bf-vvf7q"
Jul 30 19:44:24.151689 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.151654    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"]
Jul 30 19:44:24.163196 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.163170    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.167728 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.166518    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 19:44:24.167728 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.167128    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 30 19:44:24.167728 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.167325    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 30 19:44:24.167728 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.167513    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5vfqk\""
Jul 30 19:44:24.168060 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.168039    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"]
Jul 30 19:44:24.283417 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.283390    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1eb677b-07ad-4579-990a-84128090a91c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.283550 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.283441    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1eb677b-07ad-4579-990a-84128090a91c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.283550 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.283498    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1eb677b-07ad-4579-990a-84128090a91c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.283550 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.283526    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1eb677b-07ad-4579-990a-84128090a91c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.283713 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.283593    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1eb677b-07ad-4579-990a-84128090a91c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.283713 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.283623    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1eb677b-07ad-4579-990a-84128090a91c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.283713 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.283643    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwc9x\" (UniqueName: \"kubernetes.io/projected/e1eb677b-07ad-4579-990a-84128090a91c-kube-api-access-qwc9x\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.283861 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.283757    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1eb677b-07ad-4579-990a-84128090a91c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.283861 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.283791    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1eb677b-07ad-4579-990a-84128090a91c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.384620 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.384600    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1eb677b-07ad-4579-990a-84128090a91c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.384753 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.384628    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1eb677b-07ad-4579-990a-84128090a91c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.384753 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.384649    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1eb677b-07ad-4579-990a-84128090a91c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.384753 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.384665    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwc9x\" (UniqueName: \"kubernetes.io/projected/e1eb677b-07ad-4579-990a-84128090a91c-kube-api-access-qwc9x\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.384888 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.384817    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1eb677b-07ad-4579-990a-84128090a91c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.384888 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.384862    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1eb677b-07ad-4579-990a-84128090a91c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.384990 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.384899    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1eb677b-07ad-4579-990a-84128090a91c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.384990 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.384951    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1eb677b-07ad-4579-990a-84128090a91c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.384990 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.384976    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1eb677b-07ad-4579-990a-84128090a91c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.385139 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.384989    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1eb677b-07ad-4579-990a-84128090a91c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.385223 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.385205    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1eb677b-07ad-4579-990a-84128090a91c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.385295 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.385278    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1eb677b-07ad-4579-990a-84128090a91c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.385346 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.385324    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1eb677b-07ad-4579-990a-84128090a91c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.385474 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.385449    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1eb677b-07ad-4579-990a-84128090a91c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.387090 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.387072    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1eb677b-07ad-4579-990a-84128090a91c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.387421 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.387390    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1eb677b-07ad-4579-990a-84128090a91c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.395555 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.395535    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1eb677b-07ad-4579-990a-84128090a91c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.395767 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.395749    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwc9x\" (UniqueName: \"kubernetes.io/projected/e1eb677b-07ad-4579-990a-84128090a91c-kube-api-access-qwc9x\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj\" (UID: \"e1eb677b-07ad-4579-990a-84128090a91c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.476723 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.476642    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:24.631962 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.631938    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"]
Jul 30 19:44:24.634055 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:44:24.634032    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1eb677b_07ad_4579_990a_84128090a91c.slice/crio-eba2252ffe93bdea5f1f7374ee24a5ca230b5ca244e9389ceeebee0c9ca6f575 WatchSource:0}: Error finding container eba2252ffe93bdea5f1f7374ee24a5ca230b5ca244e9389ceeebee0c9ca6f575: Status 404 returned error can't find the container with id eba2252ffe93bdea5f1f7374ee24a5ca230b5ca244e9389ceeebee0c9ca6f575
Jul 30 19:44:24.837791 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:24.837760    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj" event={"ID":"e1eb677b-07ad-4579-990a-84128090a91c","Type":"ContainerStarted","Data":"eba2252ffe93bdea5f1f7374ee24a5ca230b5ca244e9389ceeebee0c9ca6f575"}
Jul 30 19:44:25.552886 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.552847    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-996655b6d-ngctb"]
Jul 30 19:44:25.556788 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.556721    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-996655b6d-ngctb"
Jul 30 19:44:25.560580 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.560539    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 30 19:44:25.560782 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.560548    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 30 19:44:25.560782 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.560595    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 30 19:44:25.560782 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.560607    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 30 19:44:25.560782 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.560704    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 30 19:44:25.560782 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.560779    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-s2cxg\""
Jul 30 19:44:25.571421 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.571400    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-996655b6d-ngctb"]
Jul 30 19:44:25.698272 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.698234    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d3cfe10-0e72-4219-a912-f805302ec836-cert\") pod \"lws-controller-manager-996655b6d-ngctb\" (UID: \"7d3cfe10-0e72-4219-a912-f805302ec836\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-ngctb"
Jul 30 19:44:25.698421 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.698364    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7d3cfe10-0e72-4219-a912-f805302ec836-manager-config\") pod \"lws-controller-manager-996655b6d-ngctb\" (UID: \"7d3cfe10-0e72-4219-a912-f805302ec836\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-ngctb"
Jul 30 19:44:25.698484 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.698444    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7d3cfe10-0e72-4219-a912-f805302ec836-metrics-cert\") pod \"lws-controller-manager-996655b6d-ngctb\" (UID: \"7d3cfe10-0e72-4219-a912-f805302ec836\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-ngctb"
Jul 30 19:44:25.698527 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.698490    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwnjl\" (UniqueName: \"kubernetes.io/projected/7d3cfe10-0e72-4219-a912-f805302ec836-kube-api-access-mwnjl\") pod \"lws-controller-manager-996655b6d-ngctb\" (UID: \"7d3cfe10-0e72-4219-a912-f805302ec836\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-ngctb"
Jul 30 19:44:25.799384 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.799349    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d3cfe10-0e72-4219-a912-f805302ec836-cert\") pod \"lws-controller-manager-996655b6d-ngctb\" (UID: \"7d3cfe10-0e72-4219-a912-f805302ec836\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-ngctb"
Jul 30 19:44:25.799546 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.799431    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7d3cfe10-0e72-4219-a912-f805302ec836-manager-config\") pod \"lws-controller-manager-996655b6d-ngctb\" (UID: \"7d3cfe10-0e72-4219-a912-f805302ec836\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-ngctb"
Jul 30 19:44:25.799546 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.799491    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7d3cfe10-0e72-4219-a912-f805302ec836-metrics-cert\") pod \"lws-controller-manager-996655b6d-ngctb\" (UID: \"7d3cfe10-0e72-4219-a912-f805302ec836\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-ngctb"
Jul 30 19:44:25.799546 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.799520    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwnjl\" (UniqueName: \"kubernetes.io/projected/7d3cfe10-0e72-4219-a912-f805302ec836-kube-api-access-mwnjl\") pod \"lws-controller-manager-996655b6d-ngctb\" (UID: \"7d3cfe10-0e72-4219-a912-f805302ec836\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-ngctb"
Jul 30 19:44:25.800264 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.800240    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7d3cfe10-0e72-4219-a912-f805302ec836-manager-config\") pod \"lws-controller-manager-996655b6d-ngctb\" (UID: \"7d3cfe10-0e72-4219-a912-f805302ec836\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-ngctb"
Jul 30 19:44:25.802586 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.802524    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d3cfe10-0e72-4219-a912-f805302ec836-cert\") pod \"lws-controller-manager-996655b6d-ngctb\" (UID: \"7d3cfe10-0e72-4219-a912-f805302ec836\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-ngctb"
Jul 30 19:44:25.802713 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.802611    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7d3cfe10-0e72-4219-a912-f805302ec836-metrics-cert\") pod \"lws-controller-manager-996655b6d-ngctb\" (UID: \"7d3cfe10-0e72-4219-a912-f805302ec836\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-ngctb"
Jul 30 19:44:25.814028 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.814006    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwnjl\" (UniqueName: \"kubernetes.io/projected/7d3cfe10-0e72-4219-a912-f805302ec836-kube-api-access-mwnjl\") pod \"lws-controller-manager-996655b6d-ngctb\" (UID: \"7d3cfe10-0e72-4219-a912-f805302ec836\") " pod="openshift-lws-operator/lws-controller-manager-996655b6d-ngctb"
Jul 30 19:44:25.868923 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:25.868897    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-996655b6d-ngctb"
Jul 30 19:44:26.135833 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.135805    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-996655b6d-ngctb"]
Jul 30 19:44:26.137729 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:44:26.137693    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d3cfe10_0e72_4219_a912_f805302ec836.slice/crio-4ac5a4d637cfcd38307e87144d697f33a1cfd9bab00f760910590cc08c34990b WatchSource:0}: Error finding container 4ac5a4d637cfcd38307e87144d697f33a1cfd9bab00f760910590cc08c34990b: Status 404 returned error can't find the container with id 4ac5a4d637cfcd38307e87144d697f33a1cfd9bab00f760910590cc08c34990b
Jul 30 19:44:26.329006 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.328974    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-75t4z"]
Jul 30 19:44:26.333170 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.333148    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-75t4z"
Jul 30 19:44:26.335717 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.335693    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-96dsb\""
Jul 30 19:44:26.336044 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.336023    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 30 19:44:26.345514 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.345494    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wf9rx"]
Jul 30 19:44:26.349314 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.349292    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-75t4z"]
Jul 30 19:44:26.349415 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.349305    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wf9rx"
Jul 30 19:44:26.352867 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.352730    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-zrndk\""
Jul 30 19:44:26.352867 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.352742    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 30 19:44:26.358751 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.358732    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wf9rx"]
Jul 30 19:44:26.405591 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.405514    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4984952-9dfd-4305-9954-1dd28ddc83f0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wf9rx\" (UID: \"e4984952-9dfd-4305-9954-1dd28ddc83f0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wf9rx"
Jul 30 19:44:26.405714 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.405589    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fqhc\" (UniqueName: \"kubernetes.io/projected/ed838cb5-ae93-4f33-9e11-0d1145fb603b-kube-api-access-5fqhc\") pod \"kserve-controller-manager-d6f4b65b8-75t4z\" (UID: \"ed838cb5-ae93-4f33-9e11-0d1145fb603b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-75t4z"
Jul 30 19:44:26.405714 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.405680    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed838cb5-ae93-4f33-9e11-0d1145fb603b-cert\") pod \"kserve-controller-manager-d6f4b65b8-75t4z\" (UID: \"ed838cb5-ae93-4f33-9e11-0d1145fb603b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-75t4z"
Jul 30 19:44:26.405850 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.405762    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg9b7\" (UniqueName: \"kubernetes.io/projected/e4984952-9dfd-4305-9954-1dd28ddc83f0-kube-api-access-lg9b7\") pod \"llmisvc-controller-manager-777c6bd7d5-wf9rx\" (UID: \"e4984952-9dfd-4305-9954-1dd28ddc83f0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wf9rx"
Jul 30 19:44:26.506261 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.506232    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4984952-9dfd-4305-9954-1dd28ddc83f0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wf9rx\" (UID: \"e4984952-9dfd-4305-9954-1dd28ddc83f0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wf9rx"
Jul 30 19:44:26.506435 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.506283    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fqhc\" (UniqueName: \"kubernetes.io/projected/ed838cb5-ae93-4f33-9e11-0d1145fb603b-kube-api-access-5fqhc\") pod \"kserve-controller-manager-d6f4b65b8-75t4z\" (UID: \"ed838cb5-ae93-4f33-9e11-0d1145fb603b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-75t4z"
Jul 30 19:44:26.506435 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.506359    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed838cb5-ae93-4f33-9e11-0d1145fb603b-cert\") pod \"kserve-controller-manager-d6f4b65b8-75t4z\" (UID: \"ed838cb5-ae93-4f33-9e11-0d1145fb603b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-75t4z"
Jul 30 19:44:26.506435 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:44:26.506388    2568 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 30 19:44:26.506435 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.506401    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg9b7\" (UniqueName: \"kubernetes.io/projected/e4984952-9dfd-4305-9954-1dd28ddc83f0-kube-api-access-lg9b7\") pod \"llmisvc-controller-manager-777c6bd7d5-wf9rx\" (UID: \"e4984952-9dfd-4305-9954-1dd28ddc83f0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wf9rx"
Jul 30 19:44:26.506680 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:44:26.506451    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4984952-9dfd-4305-9954-1dd28ddc83f0-cert podName:e4984952-9dfd-4305-9954-1dd28ddc83f0 nodeName:}" failed. No retries permitted until 2026-07-30 19:44:27.006429885 +0000 UTC m=+288.106511070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e4984952-9dfd-4305-9954-1dd28ddc83f0-cert") pod "llmisvc-controller-manager-777c6bd7d5-wf9rx" (UID: "e4984952-9dfd-4305-9954-1dd28ddc83f0") : secret "llmisvc-webhook-server-cert" not found
Jul 30 19:44:26.506680 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:44:26.506620    2568 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 30 19:44:26.506680 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:44:26.506676    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed838cb5-ae93-4f33-9e11-0d1145fb603b-cert podName:ed838cb5-ae93-4f33-9e11-0d1145fb603b nodeName:}" failed. No retries permitted until 2026-07-30 19:44:27.006657921 +0000 UTC m=+288.106739093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ed838cb5-ae93-4f33-9e11-0d1145fb603b-cert") pod "kserve-controller-manager-d6f4b65b8-75t4z" (UID: "ed838cb5-ae93-4f33-9e11-0d1145fb603b") : secret "kserve-webhook-server-cert" not found
Jul 30 19:44:26.527807 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.527780    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg9b7\" (UniqueName: \"kubernetes.io/projected/e4984952-9dfd-4305-9954-1dd28ddc83f0-kube-api-access-lg9b7\") pod \"llmisvc-controller-manager-777c6bd7d5-wf9rx\" (UID: \"e4984952-9dfd-4305-9954-1dd28ddc83f0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wf9rx"
Jul 30 19:44:26.532896 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.532869    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fqhc\" (UniqueName: \"kubernetes.io/projected/ed838cb5-ae93-4f33-9e11-0d1145fb603b-kube-api-access-5fqhc\") pod \"kserve-controller-manager-d6f4b65b8-75t4z\" (UID: \"ed838cb5-ae93-4f33-9e11-0d1145fb603b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-75t4z"
Jul 30 19:44:26.849623 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:26.849583    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-996655b6d-ngctb" event={"ID":"7d3cfe10-0e72-4219-a912-f805302ec836","Type":"ContainerStarted","Data":"4ac5a4d637cfcd38307e87144d697f33a1cfd9bab00f760910590cc08c34990b"}
Jul 30 19:44:27.010720 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:27.010687    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4984952-9dfd-4305-9954-1dd28ddc83f0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wf9rx\" (UID: \"e4984952-9dfd-4305-9954-1dd28ddc83f0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wf9rx"
Jul 30 19:44:27.010923 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:27.010787    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed838cb5-ae93-4f33-9e11-0d1145fb603b-cert\") pod \"kserve-controller-manager-d6f4b65b8-75t4z\" (UID: \"ed838cb5-ae93-4f33-9e11-0d1145fb603b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-75t4z"
Jul 30 19:44:27.013313 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:27.013285    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed838cb5-ae93-4f33-9e11-0d1145fb603b-cert\") pod \"kserve-controller-manager-d6f4b65b8-75t4z\" (UID: \"ed838cb5-ae93-4f33-9e11-0d1145fb603b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-75t4z"
Jul 30 19:44:27.013950 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:27.013925    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4984952-9dfd-4305-9954-1dd28ddc83f0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wf9rx\" (UID: \"e4984952-9dfd-4305-9954-1dd28ddc83f0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wf9rx"
Jul 30 19:44:27.249265 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:27.249186    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-75t4z"
Jul 30 19:44:27.262813 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:27.262789    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wf9rx"
Jul 30 19:44:27.711313 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:27.711267    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 19:44:27.711427 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:27.711361    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 19:44:27.711482 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:27.711423    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 19:44:27.807856 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:27.807758    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wf9rx"]
Jul 30 19:44:27.810965 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:44:27.810931    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode4984952_9dfd_4305_9954_1dd28ddc83f0.slice/crio-5d1a5c722cd7184e4893f2e052d57fccb8ceb5a8f0b9275a4533a752a877aff6 WatchSource:0}: Error finding container 5d1a5c722cd7184e4893f2e052d57fccb8ceb5a8f0b9275a4533a752a877aff6: Status 404 returned error can't find the container with id 5d1a5c722cd7184e4893f2e052d57fccb8ceb5a8f0b9275a4533a752a877aff6
Jul 30 19:44:27.859653 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:27.859067    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj" event={"ID":"e1eb677b-07ad-4579-990a-84128090a91c","Type":"ContainerStarted","Data":"8fecd32d2bb51331e3d63ae31f5ba610360045e48ef67d1cde21ee9aa5b52bb0"}
Jul 30 19:44:27.861811 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:27.861757    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wf9rx" event={"ID":"e4984952-9dfd-4305-9954-1dd28ddc83f0","Type":"ContainerStarted","Data":"5d1a5c722cd7184e4893f2e052d57fccb8ceb5a8f0b9275a4533a752a877aff6"}
Jul 30 19:44:27.882782 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:27.882614    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj" podStartSLOduration=0.807737579 podStartE2EDuration="3.882595013s" totalImagesPullingTime="3.074857434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:44:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:44:27.881038818 +0000 UTC m=+288.981120000" watchObservedRunningTime="2026-07-30 19:44:27.882595013 +0000 UTC m=+288.982676200"
Jul 30 19:44:27.992456 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:27.990799    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-75t4z"]
Jul 30 19:44:27.992456 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:44:27.992156    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded838cb5_ae93_4f33_9e11_0d1145fb603b.slice/crio-c9975829cc9e3346e7b789c9792a5ce43c830530fc29109488351cb3fd5f0735 WatchSource:0}: Error finding container c9975829cc9e3346e7b789c9792a5ce43c830530fc29109488351cb3fd5f0735: Status 404 returned error can't find the container with id c9975829cc9e3346e7b789c9792a5ce43c830530fc29109488351cb3fd5f0735
Jul 30 19:44:28.477035 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:28.477003    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:28.482589 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:28.482551    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:28.870618 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:28.870516    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-75t4z" event={"ID":"ed838cb5-ae93-4f33-9e11-0d1145fb603b","Type":"ContainerStarted","Data":"c9975829cc9e3346e7b789c9792a5ce43c830530fc29109488351cb3fd5f0735"}
Jul 30 19:44:28.872020 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:28.870797    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:28.872666 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:28.872431    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj"
Jul 30 19:44:30.882592 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:30.882496    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-996655b6d-ngctb" event={"ID":"7d3cfe10-0e72-4219-a912-f805302ec836","Type":"ContainerStarted","Data":"292f4260305c0db237eab87a7d9849032462ca8a3ad383f328d4a472cf699469"}
Jul 30 19:44:30.920264 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:30.920216    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-996655b6d-ngctb" podStartSLOduration=1.7826447330000001 podStartE2EDuration="5.920200675s" totalImagesPullingTime="4.137555942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:44:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:44:30.918054922 +0000 UTC m=+292.018136110" watchObservedRunningTime="2026-07-30 19:44:30.920200675 +0000 UTC m=+292.020281863"
Jul 30 19:44:31.889917 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:31.889873    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-75t4z" event={"ID":"ed838cb5-ae93-4f33-9e11-0d1145fb603b","Type":"ContainerStarted","Data":"1351039ea2df570f07c1c683784486547eb14af69423d2094a6edee80a26dcc7"}
Jul 30 19:44:31.890347 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:31.890211    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-996655b6d-ngctb"
Jul 30 19:44:31.905494 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:31.905365    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-75t4z" podStartSLOduration=3.30825481 podStartE2EDuration="5.905349217s" totalImagesPullingTime="2.597094407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:44:31.904878356 +0000 UTC m=+293.004959534" watchObservedRunningTime="2026-07-30 19:44:31.905349217 +0000 UTC m=+293.005430406"
Jul 30 19:44:32.896138 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:32.896107    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wf9rx" event={"ID":"e4984952-9dfd-4305-9954-1dd28ddc83f0","Type":"ContainerStarted","Data":"b7bf76f2cc0922f5844c0e2846372eecee5ed430846a85964fc046d0e877805c"}
Jul 30 19:44:32.896499 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:32.896269    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-75t4z"
Jul 30 19:44:32.896499 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:32.896312    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wf9rx"
Jul 30 19:44:32.912987 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:32.912949    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wf9rx" podStartSLOduration=2.236411341 podStartE2EDuration="6.912925508s" totalImagesPullingTime="4.676514167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:44:32.911174334 +0000 UTC m=+294.011255521" watchObservedRunningTime="2026-07-30 19:44:32.912925508 +0000 UTC m=+294.013006695"
Jul 30 19:44:39.357758 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:39.357718    2568 kubelet.go:1648] "Image garbage collection succeeded"
Jul 30 19:44:42.898277 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:44:42.898241    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-996655b6d-ngctb"
Jul 30 19:45:03.902341 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:03.902298    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wf9rx"
Jul 30 19:45:03.905588 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:03.905555    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-75t4z"
Jul 30 19:45:18.169527 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:18.169493    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fb9tr"]
Jul 30 19:45:18.175789 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:18.175770    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fb9tr"
Jul 30 19:45:18.178775 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:18.178742    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-hsfjv\""
Jul 30 19:45:18.178893 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:18.178878    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 30 19:45:18.178959 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:18.178943    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 30 19:45:18.180100 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:18.180077    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fb9tr"]
Jul 30 19:45:18.245830 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:18.245803    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5blc\" (UniqueName: \"kubernetes.io/projected/cb7c0759-bb4d-4591-bf48-f7c2f208ce76-kube-api-access-g5blc\") pod \"kuadrant-operator-catalog-fb9tr\" (UID: \"cb7c0759-bb4d-4591-bf48-f7c2f208ce76\") " pod="kuadrant-system/kuadrant-operator-catalog-fb9tr"
Jul 30 19:45:18.346809 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:18.346788    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5blc\" (UniqueName: \"kubernetes.io/projected/cb7c0759-bb4d-4591-bf48-f7c2f208ce76-kube-api-access-g5blc\") pod \"kuadrant-operator-catalog-fb9tr\" (UID: \"cb7c0759-bb4d-4591-bf48-f7c2f208ce76\") " pod="kuadrant-system/kuadrant-operator-catalog-fb9tr"
Jul 30 19:45:18.355305 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:18.355280    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5blc\" (UniqueName: \"kubernetes.io/projected/cb7c0759-bb4d-4591-bf48-f7c2f208ce76-kube-api-access-g5blc\") pod \"kuadrant-operator-catalog-fb9tr\" (UID: \"cb7c0759-bb4d-4591-bf48-f7c2f208ce76\") " pod="kuadrant-system/kuadrant-operator-catalog-fb9tr"
Jul 30 19:45:18.485904 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:18.485839    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fb9tr"
Jul 30 19:45:18.617377 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:18.617284    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fb9tr"]
Jul 30 19:45:18.619761 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:45:18.619737    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb7c0759_bb4d_4591_bf48_f7c2f208ce76.slice/crio-62e92e5eb35dbc8d9a56f8c7e2a4c61914c79807e41afaabfa30f140b5404f5c WatchSource:0}: Error finding container 62e92e5eb35dbc8d9a56f8c7e2a4c61914c79807e41afaabfa30f140b5404f5c: Status 404 returned error can't find the container with id 62e92e5eb35dbc8d9a56f8c7e2a4c61914c79807e41afaabfa30f140b5404f5c
Jul 30 19:45:18.621439 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:18.621422    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 19:45:19.109090 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:19.109051    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fb9tr" event={"ID":"cb7c0759-bb4d-4591-bf48-f7c2f208ce76","Type":"ContainerStarted","Data":"62e92e5eb35dbc8d9a56f8c7e2a4c61914c79807e41afaabfa30f140b5404f5c"}
Jul 30 19:45:21.121490 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:21.121454    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fb9tr" event={"ID":"cb7c0759-bb4d-4591-bf48-f7c2f208ce76","Type":"ContainerStarted","Data":"608ed8812d5216be1d52c4e4a140fa58c73129b551f074533c84986cd26ca762"}
Jul 30 19:45:21.137266 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:21.137220    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fb9tr" podStartSLOduration=1.384315812 podStartE2EDuration="3.137205262s" totalImagesPullingTime="1.75288945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:45:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:45:21.136255661 +0000 UTC m=+342.236336860" watchObservedRunningTime="2026-07-30 19:45:21.137205262 +0000 UTC m=+342.237286448"
Jul 30 19:45:28.486147 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:28.486112    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-fb9tr"
Jul 30 19:45:28.486682 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:28.486162    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-fb9tr"
Jul 30 19:45:28.507990 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:28.507967    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-fb9tr"
Jul 30 19:45:29.180321 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:29.180294    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-fb9tr"
Jul 30 19:45:48.573336 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:48.573300    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"]
Jul 30 19:45:48.575921 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:48.575903    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"
Jul 30 19:45:48.578926 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:48.578904    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jfscx\""
Jul 30 19:45:48.590621 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:48.590601    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"]
Jul 30 19:45:48.704794 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:48.704772    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vncm\" (UniqueName: \"kubernetes.io/projected/65ec61a2-4182-469b-8cb4-16a0905c96e1-kube-api-access-2vncm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kv7bn\" (UID: \"65ec61a2-4182-469b-8cb4-16a0905c96e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"
Jul 30 19:45:48.704887 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:48.704817    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65ec61a2-4182-469b-8cb4-16a0905c96e1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kv7bn\" (UID: \"65ec61a2-4182-469b-8cb4-16a0905c96e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"
Jul 30 19:45:48.805703 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:48.805667    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vncm\" (UniqueName: \"kubernetes.io/projected/65ec61a2-4182-469b-8cb4-16a0905c96e1-kube-api-access-2vncm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kv7bn\" (UID: \"65ec61a2-4182-469b-8cb4-16a0905c96e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"
Jul 30 19:45:48.805822 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:48.805758    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65ec61a2-4182-469b-8cb4-16a0905c96e1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kv7bn\" (UID: \"65ec61a2-4182-469b-8cb4-16a0905c96e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"
Jul 30 19:45:48.806127 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:48.806109    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65ec61a2-4182-469b-8cb4-16a0905c96e1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kv7bn\" (UID: \"65ec61a2-4182-469b-8cb4-16a0905c96e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"
Jul 30 19:45:48.820811 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:48.820791    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vncm\" (UniqueName: \"kubernetes.io/projected/65ec61a2-4182-469b-8cb4-16a0905c96e1-kube-api-access-2vncm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kv7bn\" (UID: \"65ec61a2-4182-469b-8cb4-16a0905c96e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"
Jul 30 19:45:48.886325 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:48.886271    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"
Jul 30 19:45:49.051765 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:49.051742    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"]
Jul 30 19:45:49.054808 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:45:49.054773    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ec61a2_4182_469b_8cb4_16a0905c96e1.slice/crio-5fbdecbe6627effc898a5a09a6e335e158c119865ead718e407517528cb5a0fd WatchSource:0}: Error finding container 5fbdecbe6627effc898a5a09a6e335e158c119865ead718e407517528cb5a0fd: Status 404 returned error can't find the container with id 5fbdecbe6627effc898a5a09a6e335e158c119865ead718e407517528cb5a0fd
Jul 30 19:45:49.263368 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:49.263300    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn" event={"ID":"65ec61a2-4182-469b-8cb4-16a0905c96e1","Type":"ContainerStarted","Data":"5fbdecbe6627effc898a5a09a6e335e158c119865ead718e407517528cb5a0fd"}
Jul 30 19:45:54.289644 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:54.289551    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn" event={"ID":"65ec61a2-4182-469b-8cb4-16a0905c96e1","Type":"ContainerStarted","Data":"ce2fd52fc95d3495ce627dcfac785c720f3d564671f3baec9b9df97b0d864e7d"}
Jul 30 19:45:54.290001 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:54.289661    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"
Jul 30 19:45:54.307982 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:54.307936    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn" podStartSLOduration=1.456458493 podStartE2EDuration="6.307922115s" totalImagesPullingTime="4.851463622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:45:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:45:54.306057885 +0000 UTC m=+375.406139073" watchObservedRunningTime="2026-07-30 19:45:54.307922115 +0000 UTC m=+375.408003301"
Jul 30 19:45:54.670733 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:54.670694    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8fsqv"]
Jul 30 19:45:54.675909 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:54.675881    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8fsqv"
Jul 30 19:45:54.678446 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:54.678408    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 30 19:45:54.678446 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:54.678433    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-kg6mm\""
Jul 30 19:45:54.681834 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:54.681811    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8fsqv"]
Jul 30 19:45:54.859276 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:54.859240    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrvfb\" (UniqueName: \"kubernetes.io/projected/95594a2c-7312-4ff5-a6a7-86dc8ba30afb-kube-api-access-zrvfb\") pod \"dns-operator-controller-manager-864dd78c4c-8fsqv\" (UID: \"95594a2c-7312-4ff5-a6a7-86dc8ba30afb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8fsqv"
Jul 30 19:45:54.960343 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:54.960261    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrvfb\" (UniqueName: \"kubernetes.io/projected/95594a2c-7312-4ff5-a6a7-86dc8ba30afb-kube-api-access-zrvfb\") pod \"dns-operator-controller-manager-864dd78c4c-8fsqv\" (UID: \"95594a2c-7312-4ff5-a6a7-86dc8ba30afb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8fsqv"
Jul 30 19:45:54.974950 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:54.974924    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrvfb\" (UniqueName: \"kubernetes.io/projected/95594a2c-7312-4ff5-a6a7-86dc8ba30afb-kube-api-access-zrvfb\") pod \"dns-operator-controller-manager-864dd78c4c-8fsqv\" (UID: \"95594a2c-7312-4ff5-a6a7-86dc8ba30afb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8fsqv"
Jul 30 19:45:54.988744 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:54.988724    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8fsqv"
Jul 30 19:45:55.115434 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:55.115409    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8fsqv"]
Jul 30 19:45:55.117401 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:45:55.117375    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95594a2c_7312_4ff5_a6a7_86dc8ba30afb.slice/crio-6ce84daca13676fac0ecda76987bb19df060026f8dbd4e7331b2e7e6212ea3f0 WatchSource:0}: Error finding container 6ce84daca13676fac0ecda76987bb19df060026f8dbd4e7331b2e7e6212ea3f0: Status 404 returned error can't find the container with id 6ce84daca13676fac0ecda76987bb19df060026f8dbd4e7331b2e7e6212ea3f0
Jul 30 19:45:55.295410 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:55.295345    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8fsqv" event={"ID":"95594a2c-7312-4ff5-a6a7-86dc8ba30afb","Type":"ContainerStarted","Data":"6ce84daca13676fac0ecda76987bb19df060026f8dbd4e7331b2e7e6212ea3f0"}
Jul 30 19:45:57.308468 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:57.308435    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8fsqv" event={"ID":"95594a2c-7312-4ff5-a6a7-86dc8ba30afb","Type":"ContainerStarted","Data":"d44d3ef209061a23bae176c45b11cc675835a989ca5cebb98fa99f2af9af2059"}
Jul 30 19:45:57.308833 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:57.308494    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8fsqv"
Jul 30 19:45:57.333897 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:45:57.333855    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8fsqv" podStartSLOduration=1.431376921 podStartE2EDuration="3.333840298s" totalImagesPullingTime="1.902463377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:45:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:45:57.331481895 +0000 UTC m=+378.431563083" watchObservedRunningTime="2026-07-30 19:45:57.333840298 +0000 UTC m=+378.433921484"
Jul 30 19:46:05.297521 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:05.297490    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"
Jul 30 19:46:06.485067 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:06.485035    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2"]
Jul 30 19:46:06.488435 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:06.488420    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2"
Jul 30 19:46:06.501533 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:06.501514    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2"]
Jul 30 19:46:06.553977 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:06.553956    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5270ab3d-80aa-44e7-ba1c-596824657217-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ktpm2\" (UID: \"5270ab3d-80aa-44e7-ba1c-596824657217\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2"
Jul 30 19:46:06.554086 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:06.553995    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2fsz\" (UniqueName: \"kubernetes.io/projected/5270ab3d-80aa-44e7-ba1c-596824657217-kube-api-access-r2fsz\") pod \"kuadrant-operator-controller-manager-55467d9f7-ktpm2\" (UID: \"5270ab3d-80aa-44e7-ba1c-596824657217\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2"
Jul 30 19:46:06.655242 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:06.655218    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5270ab3d-80aa-44e7-ba1c-596824657217-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ktpm2\" (UID: \"5270ab3d-80aa-44e7-ba1c-596824657217\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2"
Jul 30 19:46:06.655343 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:06.655256    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2fsz\" (UniqueName: \"kubernetes.io/projected/5270ab3d-80aa-44e7-ba1c-596824657217-kube-api-access-r2fsz\") pod \"kuadrant-operator-controller-manager-55467d9f7-ktpm2\" (UID: \"5270ab3d-80aa-44e7-ba1c-596824657217\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2"
Jul 30 19:46:06.655543 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:06.655524    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5270ab3d-80aa-44e7-ba1c-596824657217-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ktpm2\" (UID: \"5270ab3d-80aa-44e7-ba1c-596824657217\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2"
Jul 30 19:46:06.664650 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:06.664627    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2fsz\" (UniqueName: \"kubernetes.io/projected/5270ab3d-80aa-44e7-ba1c-596824657217-kube-api-access-r2fsz\") pod \"kuadrant-operator-controller-manager-55467d9f7-ktpm2\" (UID: \"5270ab3d-80aa-44e7-ba1c-596824657217\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2"
Jul 30 19:46:06.798320 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:06.798264    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2"
Jul 30 19:46:06.942003 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:06.941976    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2"]
Jul 30 19:46:06.943749 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:46:06.943726    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5270ab3d_80aa_44e7_ba1c_596824657217.slice/crio-2119cfdc0a12870b18911e73ad863f81558b9129c460c683326f8bc2b68e39a8 WatchSource:0}: Error finding container 2119cfdc0a12870b18911e73ad863f81558b9129c460c683326f8bc2b68e39a8: Status 404 returned error can't find the container with id 2119cfdc0a12870b18911e73ad863f81558b9129c460c683326f8bc2b68e39a8
Jul 30 19:46:06.972320 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:06.972299    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2"]
Jul 30 19:46:06.985221 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:06.985198    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2"]
Jul 30 19:46:07.004522 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.004500    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"]
Jul 30 19:46:07.004717 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.004696    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn" podUID="65ec61a2-4182-469b-8cb4-16a0905c96e1" containerName="manager" containerID="cri-o://ce2fd52fc95d3495ce627dcfac785c720f3d564671f3baec9b9df97b0d864e7d" gracePeriod=2
Jul 30 19:46:07.029934 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:46:07.029892    2568 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"65ec61a2-4182-469b-8cb4-16a0905c96e1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-kv7bn\": pods \"kuadrant-operator-controller-manager-8684c9ff49-kv7bn\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"
Jul 30 19:46:07.030526 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.030504    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"]
Jul 30 19:46:07.032128 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.032098    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5"]
Jul 30 19:46:07.032700 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.032680    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65ec61a2-4182-469b-8cb4-16a0905c96e1" containerName="manager"
Jul 30 19:46:07.032770 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.032703    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="65ec61a2-4182-469b-8cb4-16a0905c96e1" containerName="manager"
Jul 30 19:46:07.032770 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.032718    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5270ab3d-80aa-44e7-ba1c-596824657217" containerName="manager"
Jul 30 19:46:07.032770 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.032726    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5270ab3d-80aa-44e7-ba1c-596824657217" containerName="manager"
Jul 30 19:46:07.032889 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.032806    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="65ec61a2-4182-469b-8cb4-16a0905c96e1" containerName="manager"
Jul 30 19:46:07.032889 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.032817    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5270ab3d-80aa-44e7-ba1c-596824657217" containerName="manager"
Jul 30 19:46:07.035447 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.035431    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5"
Jul 30 19:46:07.039307 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:46:07.039281    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kv7bn\" is forbidden: User \"system:node:ip-10-0-134-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-200.ec2.internal' and this object" podUID="65ec61a2-4182-469b-8cb4-16a0905c96e1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"
Jul 30 19:46:07.050737 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.050688    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77"]
Jul 30 19:46:07.056426 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.056404    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5"]
Jul 30 19:46:07.056543 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.056509    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77"
Jul 30 19:46:07.059611 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.059590    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2p54\" (UniqueName: \"kubernetes.io/projected/cb67ee32-c1d5-4f7b-b6ee-5862352b3e29-kube-api-access-z2p54\") pod \"kuadrant-operator-controller-manager-55467d9f7-d9qh5\" (UID: \"cb67ee32-c1d5-4f7b-b6ee-5862352b3e29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5"
Jul 30 19:46:07.059708 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.059642    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb67ee32-c1d5-4f7b-b6ee-5862352b3e29-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-d9qh5\" (UID: \"cb67ee32-c1d5-4f7b-b6ee-5862352b3e29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5"
Jul 30 19:46:07.081522 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.081500    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77"]
Jul 30 19:46:07.108504 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:46:07.108469    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kv7bn\" is forbidden: User \"system:node:ip-10-0-134-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-200.ec2.internal' and this object" podUID="65ec61a2-4182-469b-8cb4-16a0905c96e1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"
Jul 30 19:46:07.160358 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.160328    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca9adf7d-03ab-4021-bbe1-b64914a71849-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s5x77\" (UID: \"ca9adf7d-03ab-4021-bbe1-b64914a71849\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77"
Jul 30 19:46:07.160493 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.160382    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2p54\" (UniqueName: \"kubernetes.io/projected/cb67ee32-c1d5-4f7b-b6ee-5862352b3e29-kube-api-access-z2p54\") pod \"kuadrant-operator-controller-manager-55467d9f7-d9qh5\" (UID: \"cb67ee32-c1d5-4f7b-b6ee-5862352b3e29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5"
Jul 30 19:46:07.160493 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.160401    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4c2t\" (UniqueName: \"kubernetes.io/projected/ca9adf7d-03ab-4021-bbe1-b64914a71849-kube-api-access-x4c2t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s5x77\" (UID: \"ca9adf7d-03ab-4021-bbe1-b64914a71849\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77"
Jul 30 19:46:07.160493 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.160429    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb67ee32-c1d5-4f7b-b6ee-5862352b3e29-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-d9qh5\" (UID: \"cb67ee32-c1d5-4f7b-b6ee-5862352b3e29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5"
Jul 30 19:46:07.160796 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.160779    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb67ee32-c1d5-4f7b-b6ee-5862352b3e29-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-d9qh5\" (UID: \"cb67ee32-c1d5-4f7b-b6ee-5862352b3e29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5"
Jul 30 19:46:07.171954 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.171926    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2p54\" (UniqueName: \"kubernetes.io/projected/cb67ee32-c1d5-4f7b-b6ee-5862352b3e29-kube-api-access-z2p54\") pod \"kuadrant-operator-controller-manager-55467d9f7-d9qh5\" (UID: \"cb67ee32-c1d5-4f7b-b6ee-5862352b3e29\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5"
Jul 30 19:46:07.229260 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.229239    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"
Jul 30 19:46:07.233122 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:46:07.233098    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kv7bn\" is forbidden: User \"system:node:ip-10-0-134-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-200.ec2.internal' and this object" podUID="65ec61a2-4182-469b-8cb4-16a0905c96e1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"
Jul 30 19:46:07.261190 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.261168    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65ec61a2-4182-469b-8cb4-16a0905c96e1-extensions-socket-volume\") pod \"65ec61a2-4182-469b-8cb4-16a0905c96e1\" (UID: \"65ec61a2-4182-469b-8cb4-16a0905c96e1\") "
Jul 30 19:46:07.261284 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.261271    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vncm\" (UniqueName: \"kubernetes.io/projected/65ec61a2-4182-469b-8cb4-16a0905c96e1-kube-api-access-2vncm\") pod \"65ec61a2-4182-469b-8cb4-16a0905c96e1\" (UID: \"65ec61a2-4182-469b-8cb4-16a0905c96e1\") "
Jul 30 19:46:07.261371 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.261358    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4c2t\" (UniqueName: \"kubernetes.io/projected/ca9adf7d-03ab-4021-bbe1-b64914a71849-kube-api-access-x4c2t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s5x77\" (UID: \"ca9adf7d-03ab-4021-bbe1-b64914a71849\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77"
Jul 30 19:46:07.261449 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.261436    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca9adf7d-03ab-4021-bbe1-b64914a71849-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s5x77\" (UID: \"ca9adf7d-03ab-4021-bbe1-b64914a71849\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77"
Jul 30 19:46:07.261712 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.261683    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65ec61a2-4182-469b-8cb4-16a0905c96e1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "65ec61a2-4182-469b-8cb4-16a0905c96e1" (UID: "65ec61a2-4182-469b-8cb4-16a0905c96e1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:46:07.261795 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.261778    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca9adf7d-03ab-4021-bbe1-b64914a71849-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s5x77\" (UID: \"ca9adf7d-03ab-4021-bbe1-b64914a71849\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77"
Jul 30 19:46:07.263247 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.263219    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65ec61a2-4182-469b-8cb4-16a0905c96e1-kube-api-access-2vncm" (OuterVolumeSpecName: "kube-api-access-2vncm") pod "65ec61a2-4182-469b-8cb4-16a0905c96e1" (UID: "65ec61a2-4182-469b-8cb4-16a0905c96e1"). InnerVolumeSpecName "kube-api-access-2vncm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:46:07.273479 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.273458    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4c2t\" (UniqueName: \"kubernetes.io/projected/ca9adf7d-03ab-4021-bbe1-b64914a71849-kube-api-access-x4c2t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s5x77\" (UID: \"ca9adf7d-03ab-4021-bbe1-b64914a71849\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77"
Jul 30 19:46:07.355449 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.355420    2568 generic.go:356] "Generic (PLEG): container finished" podID="65ec61a2-4182-469b-8cb4-16a0905c96e1" containerID="ce2fd52fc95d3495ce627dcfac785c720f3d564671f3baec9b9df97b0d864e7d" exitCode=0
Jul 30 19:46:07.355544 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.355469    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"
Jul 30 19:46:07.355544 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.355520    2568 scope.go:117] "RemoveContainer" containerID="ce2fd52fc95d3495ce627dcfac785c720f3d564671f3baec9b9df97b0d864e7d"
Jul 30 19:46:07.357354 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.357325    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2" podUID="5270ab3d-80aa-44e7-ba1c-596824657217" containerName="manager" containerID="cri-o://5a661f0f7c12b6d51266644258bfed2fc8a971e5f65528f148313d8de27a7347" gracePeriod=2
Jul 30 19:46:07.358019 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:46:07.357991    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kv7bn\" is forbidden: User \"system:node:ip-10-0-134-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-200.ec2.internal' and this object" podUID="65ec61a2-4182-469b-8cb4-16a0905c96e1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"
Jul 30 19:46:07.360137 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:46:07.360109    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-ktpm2\" is forbidden: User \"system:node:ip-10-0-134-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-200.ec2.internal' and this object" podUID="5270ab3d-80aa-44e7-ba1c-596824657217" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2"
Jul 30 19:46:07.362029 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.362009    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vncm\" (UniqueName: \"kubernetes.io/projected/65ec61a2-4182-469b-8cb4-16a0905c96e1-kube-api-access-2vncm\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:46:07.362157 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.362032    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65ec61a2-4182-469b-8cb4-16a0905c96e1-extensions-socket-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:46:07.362157 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:46:07.362117    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kv7bn\" is forbidden: User \"system:node:ip-10-0-134-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-200.ec2.internal' and this object" podUID="65ec61a2-4182-469b-8cb4-16a0905c96e1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"
Jul 30 19:46:07.365698 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.365555    2568 scope.go:117] "RemoveContainer" containerID="ce2fd52fc95d3495ce627dcfac785c720f3d564671f3baec9b9df97b0d864e7d"
Jul 30 19:46:07.365983 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:46:07.365965    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce2fd52fc95d3495ce627dcfac785c720f3d564671f3baec9b9df97b0d864e7d\": container with ID starting with ce2fd52fc95d3495ce627dcfac785c720f3d564671f3baec9b9df97b0d864e7d not found: ID does not exist" containerID="ce2fd52fc95d3495ce627dcfac785c720f3d564671f3baec9b9df97b0d864e7d"
Jul 30 19:46:07.366039 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.365994    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce2fd52fc95d3495ce627dcfac785c720f3d564671f3baec9b9df97b0d864e7d"} err="failed to get container status \"ce2fd52fc95d3495ce627dcfac785c720f3d564671f3baec9b9df97b0d864e7d\": rpc error: code = NotFound desc = could not find container \"ce2fd52fc95d3495ce627dcfac785c720f3d564671f3baec9b9df97b0d864e7d\": container with ID starting with ce2fd52fc95d3495ce627dcfac785c720f3d564671f3baec9b9df97b0d864e7d not found: ID does not exist"
Jul 30 19:46:07.366631 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:46:07.366612    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-kv7bn\" is forbidden: User \"system:node:ip-10-0-134-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-200.ec2.internal' and this object" podUID="65ec61a2-4182-469b-8cb4-16a0905c96e1" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kv7bn"
Jul 30 19:46:07.372787 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:46:07.372761    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-ktpm2\" is forbidden: User \"system:node:ip-10-0-134-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-200.ec2.internal' and this object" podUID="5270ab3d-80aa-44e7-ba1c-596824657217" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2"
Jul 30 19:46:07.381424 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.381406    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5"
Jul 30 19:46:07.391293 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.391271    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77"
Jul 30 19:46:07.485278 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.485243    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65ec61a2-4182-469b-8cb4-16a0905c96e1" path="/var/lib/kubelet/pods/65ec61a2-4182-469b-8cb4-16a0905c96e1/volumes"
Jul 30 19:46:07.530851 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.530803    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5"]
Jul 30 19:46:07.533244 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:46:07.533193    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb67ee32_c1d5_4f7b_b6ee_5862352b3e29.slice/crio-b050d8f24d8670eab95fbbe752a7f711e746d8f5e07b607c43d8a8ee5f81b367 WatchSource:0}: Error finding container b050d8f24d8670eab95fbbe752a7f711e746d8f5e07b607c43d8a8ee5f81b367: Status 404 returned error can't find the container with id b050d8f24d8670eab95fbbe752a7f711e746d8f5e07b607c43d8a8ee5f81b367
Jul 30 19:46:07.558434 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.558403    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77"]
Jul 30 19:46:07.563752 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:46:07.562971    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca9adf7d_03ab_4021_bbe1_b64914a71849.slice/crio-95c3716d70ddda75a6158a8c0e86e2810b53ac31a1cdbafc8b59be0a9bed8142 WatchSource:0}: Error finding container 95c3716d70ddda75a6158a8c0e86e2810b53ac31a1cdbafc8b59be0a9bed8142: Status 404 returned error can't find the container with id 95c3716d70ddda75a6158a8c0e86e2810b53ac31a1cdbafc8b59be0a9bed8142
Jul 30 19:46:07.648509 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.648392    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2"
Jul 30 19:46:07.664934 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.664909    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5270ab3d-80aa-44e7-ba1c-596824657217-extensions-socket-volume\") pod \"5270ab3d-80aa-44e7-ba1c-596824657217\" (UID: \"5270ab3d-80aa-44e7-ba1c-596824657217\") "
Jul 30 19:46:07.665040 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.664986    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2fsz\" (UniqueName: \"kubernetes.io/projected/5270ab3d-80aa-44e7-ba1c-596824657217-kube-api-access-r2fsz\") pod \"5270ab3d-80aa-44e7-ba1c-596824657217\" (UID: \"5270ab3d-80aa-44e7-ba1c-596824657217\") "
Jul 30 19:46:07.665161 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.665121    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5270ab3d-80aa-44e7-ba1c-596824657217-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5270ab3d-80aa-44e7-ba1c-596824657217" (UID: "5270ab3d-80aa-44e7-ba1c-596824657217"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:46:07.665253 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.665238    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5270ab3d-80aa-44e7-ba1c-596824657217-extensions-socket-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:46:07.667362 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.667340    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5270ab3d-80aa-44e7-ba1c-596824657217-kube-api-access-r2fsz" (OuterVolumeSpecName: "kube-api-access-r2fsz") pod "5270ab3d-80aa-44e7-ba1c-596824657217" (UID: "5270ab3d-80aa-44e7-ba1c-596824657217"). InnerVolumeSpecName "kube-api-access-r2fsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:46:07.766220 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:07.766180    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2fsz\" (UniqueName: \"kubernetes.io/projected/5270ab3d-80aa-44e7-ba1c-596824657217-kube-api-access-r2fsz\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:46:08.315656 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:08.315624    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8fsqv"
Jul 30 19:46:08.364602 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:08.364547    2568 generic.go:356] "Generic (PLEG): container finished" podID="5270ab3d-80aa-44e7-ba1c-596824657217" containerID="5a661f0f7c12b6d51266644258bfed2fc8a971e5f65528f148313d8de27a7347" exitCode=2
Jul 30 19:46:08.364777 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:08.364609    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2"
Jul 30 19:46:08.364777 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:08.364629    2568 scope.go:117] "RemoveContainer" containerID="5a661f0f7c12b6d51266644258bfed2fc8a971e5f65528f148313d8de27a7347"
Jul 30 19:46:08.366642 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:08.366614    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5" event={"ID":"cb67ee32-c1d5-4f7b-b6ee-5862352b3e29","Type":"ContainerStarted","Data":"a4d251e351b486b64eff3e513e48420a330a13814a94045c6d27087bd26a1dae"}
Jul 30 19:46:08.366776 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:08.366668    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5" event={"ID":"cb67ee32-c1d5-4f7b-b6ee-5862352b3e29","Type":"ContainerStarted","Data":"b050d8f24d8670eab95fbbe752a7f711e746d8f5e07b607c43d8a8ee5f81b367"}
Jul 30 19:46:08.366776 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:08.366761    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5"
Jul 30 19:46:08.367071 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:46:08.367045    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-ktpm2\" is forbidden: User \"system:node:ip-10-0-134-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-200.ec2.internal' and this object" podUID="5270ab3d-80aa-44e7-ba1c-596824657217" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2"
Jul 30 19:46:08.369343 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:08.369319    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77" event={"ID":"ca9adf7d-03ab-4021-bbe1-b64914a71849","Type":"ContainerStarted","Data":"75a6c9d5a2c0bc11dd8f11b345e9902974728cf98b5eb8c2b12a53695363f3f0"}
Jul 30 19:46:08.369639 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:46:08.369360    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-ktpm2\" is forbidden: User \"system:node:ip-10-0-134-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-200.ec2.internal' and this object" podUID="5270ab3d-80aa-44e7-ba1c-596824657217" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2"
Jul 30 19:46:08.369733 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:08.369365    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77" event={"ID":"ca9adf7d-03ab-4021-bbe1-b64914a71849","Type":"ContainerStarted","Data":"95c3716d70ddda75a6158a8c0e86e2810b53ac31a1cdbafc8b59be0a9bed8142"}
Jul 30 19:46:08.369790 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:08.369765    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77"
Jul 30 19:46:08.376631 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:08.376615    2568 scope.go:117] "RemoveContainer" containerID="5a661f0f7c12b6d51266644258bfed2fc8a971e5f65528f148313d8de27a7347"
Jul 30 19:46:08.376869 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:46:08.376849    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a661f0f7c12b6d51266644258bfed2fc8a971e5f65528f148313d8de27a7347\": container with ID starting with 5a661f0f7c12b6d51266644258bfed2fc8a971e5f65528f148313d8de27a7347 not found: ID does not exist" containerID="5a661f0f7c12b6d51266644258bfed2fc8a971e5f65528f148313d8de27a7347"
Jul 30 19:46:08.376930 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:08.376876    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a661f0f7c12b6d51266644258bfed2fc8a971e5f65528f148313d8de27a7347"} err="failed to get container status \"5a661f0f7c12b6d51266644258bfed2fc8a971e5f65528f148313d8de27a7347\": rpc error: code = NotFound desc = could not find container \"5a661f0f7c12b6d51266644258bfed2fc8a971e5f65528f148313d8de27a7347\": container with ID starting with 5a661f0f7c12b6d51266644258bfed2fc8a971e5f65528f148313d8de27a7347 not found: ID does not exist"
Jul 30 19:46:08.391204 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:08.391166    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5" podStartSLOduration=2.391154621 podStartE2EDuration="2.391154621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:46:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:46:08.389470888 +0000 UTC m=+389.489552059" watchObservedRunningTime="2026-07-30 19:46:08.391154621 +0000 UTC m=+389.491235858"
Jul 30 19:46:08.393248 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:46:08.393225    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-ktpm2\" is forbidden: User \"system:node:ip-10-0-134-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-200.ec2.internal' and this object" podUID="5270ab3d-80aa-44e7-ba1c-596824657217" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2"
Jul 30 19:46:08.438583 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:08.438527    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77" podStartSLOduration=1.438514916 podStartE2EDuration="1.438514916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:46:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:46:08.430999759 +0000 UTC m=+389.531080959" watchObservedRunningTime="2026-07-30 19:46:08.438514916 +0000 UTC m=+389.538596103"
Jul 30 19:46:09.479530 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:46:09.479496    2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-ktpm2\" is forbidden: User \"system:node:ip-10-0-134-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-200.ec2.internal' and this object" podUID="5270ab3d-80aa-44e7-ba1c-596824657217" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ktpm2"
Jul 30 19:46:09.480716 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:09.480691    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5270ab3d-80aa-44e7-ba1c-596824657217" path="/var/lib/kubelet/pods/5270ab3d-80aa-44e7-ba1c-596824657217/volumes"
Jul 30 19:46:19.378940 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.378911    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5"
Jul 30 19:46:19.379288 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.378984    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77"
Jul 30 19:46:19.458798 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.458764    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77"]
Jul 30 19:46:19.458974 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.458919    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77" podUID="ca9adf7d-03ab-4021-bbe1-b64914a71849" containerName="manager" containerID="cri-o://75a6c9d5a2c0bc11dd8f11b345e9902974728cf98b5eb8c2b12a53695363f3f0" gracePeriod=10
Jul 30 19:46:19.709355 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.709275    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77"
Jul 30 19:46:19.718712 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.718689    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf"]
Jul 30 19:46:19.719068 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.719057    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca9adf7d-03ab-4021-bbe1-b64914a71849" containerName="manager"
Jul 30 19:46:19.719107 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.719070    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca9adf7d-03ab-4021-bbe1-b64914a71849" containerName="manager"
Jul 30 19:46:19.719147 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.719139    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca9adf7d-03ab-4021-bbe1-b64914a71849" containerName="manager"
Jul 30 19:46:19.724526 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.724002    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf"
Jul 30 19:46:19.742189 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.742166    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf"]
Jul 30 19:46:19.765374 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.765350    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca9adf7d-03ab-4021-bbe1-b64914a71849-extensions-socket-volume\") pod \"ca9adf7d-03ab-4021-bbe1-b64914a71849\" (UID: \"ca9adf7d-03ab-4021-bbe1-b64914a71849\") "
Jul 30 19:46:19.765498 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.765401    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4c2t\" (UniqueName: \"kubernetes.io/projected/ca9adf7d-03ab-4021-bbe1-b64914a71849-kube-api-access-x4c2t\") pod \"ca9adf7d-03ab-4021-bbe1-b64914a71849\" (UID: \"ca9adf7d-03ab-4021-bbe1-b64914a71849\") "
Jul 30 19:46:19.765743 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.765722    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln25q\" (UniqueName: \"kubernetes.io/projected/7a06a2c1-dea4-4eb3-9708-cd08c0289386-kube-api-access-ln25q\") pod \"kuadrant-operator-controller-manager-86878c769f-8pjqf\" (UID: \"7a06a2c1-dea4-4eb3-9708-cd08c0289386\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf"
Jul 30 19:46:19.765843 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.765778    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca9adf7d-03ab-4021-bbe1-b64914a71849-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ca9adf7d-03ab-4021-bbe1-b64914a71849" (UID: "ca9adf7d-03ab-4021-bbe1-b64914a71849"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:46:19.765843 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.765822    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a06a2c1-dea4-4eb3-9708-cd08c0289386-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8pjqf\" (UID: \"7a06a2c1-dea4-4eb3-9708-cd08c0289386\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf"
Jul 30 19:46:19.765952 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.765890    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca9adf7d-03ab-4021-bbe1-b64914a71849-extensions-socket-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:46:19.767646 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.767609    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca9adf7d-03ab-4021-bbe1-b64914a71849-kube-api-access-x4c2t" (OuterVolumeSpecName: "kube-api-access-x4c2t") pod "ca9adf7d-03ab-4021-bbe1-b64914a71849" (UID: "ca9adf7d-03ab-4021-bbe1-b64914a71849"). InnerVolumeSpecName "kube-api-access-x4c2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:46:19.866928 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.866897    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a06a2c1-dea4-4eb3-9708-cd08c0289386-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8pjqf\" (UID: \"7a06a2c1-dea4-4eb3-9708-cd08c0289386\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf"
Jul 30 19:46:19.867041 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.867005    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln25q\" (UniqueName: \"kubernetes.io/projected/7a06a2c1-dea4-4eb3-9708-cd08c0289386-kube-api-access-ln25q\") pod \"kuadrant-operator-controller-manager-86878c769f-8pjqf\" (UID: \"7a06a2c1-dea4-4eb3-9708-cd08c0289386\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf"
Jul 30 19:46:19.867107 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.867087    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4c2t\" (UniqueName: \"kubernetes.io/projected/ca9adf7d-03ab-4021-bbe1-b64914a71849-kube-api-access-x4c2t\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:46:19.867235 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.867217    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a06a2c1-dea4-4eb3-9708-cd08c0289386-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8pjqf\" (UID: \"7a06a2c1-dea4-4eb3-9708-cd08c0289386\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf"
Jul 30 19:46:19.875247 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:19.875227    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln25q\" (UniqueName: \"kubernetes.io/projected/7a06a2c1-dea4-4eb3-9708-cd08c0289386-kube-api-access-ln25q\") pod \"kuadrant-operator-controller-manager-86878c769f-8pjqf\" (UID: \"7a06a2c1-dea4-4eb3-9708-cd08c0289386\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf"
Jul 30 19:46:20.034126 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:20.034068    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf"
Jul 30 19:46:20.162609 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:20.162581    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf"]
Jul 30 19:46:20.164221 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:46:20.164196    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a06a2c1_dea4_4eb3_9708_cd08c0289386.slice/crio-645e96b0c5f2affe20295ebfc74fdf8e6bfd82fefe8bde172d8dfbe969254fd0 WatchSource:0}: Error finding container 645e96b0c5f2affe20295ebfc74fdf8e6bfd82fefe8bde172d8dfbe969254fd0: Status 404 returned error can't find the container with id 645e96b0c5f2affe20295ebfc74fdf8e6bfd82fefe8bde172d8dfbe969254fd0
Jul 30 19:46:20.437251 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:20.437217    2568 generic.go:356] "Generic (PLEG): container finished" podID="ca9adf7d-03ab-4021-bbe1-b64914a71849" containerID="75a6c9d5a2c0bc11dd8f11b345e9902974728cf98b5eb8c2b12a53695363f3f0" exitCode=0
Jul 30 19:46:20.437752 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:20.437270    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77"
Jul 30 19:46:20.437752 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:20.437307    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77" event={"ID":"ca9adf7d-03ab-4021-bbe1-b64914a71849","Type":"ContainerDied","Data":"75a6c9d5a2c0bc11dd8f11b345e9902974728cf98b5eb8c2b12a53695363f3f0"}
Jul 30 19:46:20.437752 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:20.437365    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77" event={"ID":"ca9adf7d-03ab-4021-bbe1-b64914a71849","Type":"ContainerDied","Data":"95c3716d70ddda75a6158a8c0e86e2810b53ac31a1cdbafc8b59be0a9bed8142"}
Jul 30 19:46:20.437752 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:20.437392    2568 scope.go:117] "RemoveContainer" containerID="75a6c9d5a2c0bc11dd8f11b345e9902974728cf98b5eb8c2b12a53695363f3f0"
Jul 30 19:46:20.438944 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:20.438923    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf" event={"ID":"7a06a2c1-dea4-4eb3-9708-cd08c0289386","Type":"ContainerStarted","Data":"5ebbdb9b6b43a7bdb67a6ed81b1e865c7fadd1a31fa54077273b7bda88e041d5"}
Jul 30 19:46:20.439081 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:20.438958    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf" event={"ID":"7a06a2c1-dea4-4eb3-9708-cd08c0289386","Type":"ContainerStarted","Data":"645e96b0c5f2affe20295ebfc74fdf8e6bfd82fefe8bde172d8dfbe969254fd0"}
Jul 30 19:46:20.439081 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:20.438983    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf"
Jul 30 19:46:20.446657 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:20.446641    2568 scope.go:117] "RemoveContainer" containerID="75a6c9d5a2c0bc11dd8f11b345e9902974728cf98b5eb8c2b12a53695363f3f0"
Jul 30 19:46:20.446913 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:46:20.446896    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75a6c9d5a2c0bc11dd8f11b345e9902974728cf98b5eb8c2b12a53695363f3f0\": container with ID starting with 75a6c9d5a2c0bc11dd8f11b345e9902974728cf98b5eb8c2b12a53695363f3f0 not found: ID does not exist" containerID="75a6c9d5a2c0bc11dd8f11b345e9902974728cf98b5eb8c2b12a53695363f3f0"
Jul 30 19:46:20.446990 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:20.446923    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75a6c9d5a2c0bc11dd8f11b345e9902974728cf98b5eb8c2b12a53695363f3f0"} err="failed to get container status \"75a6c9d5a2c0bc11dd8f11b345e9902974728cf98b5eb8c2b12a53695363f3f0\": rpc error: code = NotFound desc = could not find container \"75a6c9d5a2c0bc11dd8f11b345e9902974728cf98b5eb8c2b12a53695363f3f0\": container with ID starting with 75a6c9d5a2c0bc11dd8f11b345e9902974728cf98b5eb8c2b12a53695363f3f0 not found: ID does not exist"
Jul 30 19:46:20.459583 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:20.459519    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf" podStartSLOduration=1.459506306 podStartE2EDuration="1.459506306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:46:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:46:20.457838334 +0000 UTC m=+401.557919522" watchObservedRunningTime="2026-07-30 19:46:20.459506306 +0000 UTC m=+401.559587493"
Jul 30 19:46:20.473165 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:20.473143    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77"]
Jul 30 19:46:20.479332 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:20.479314    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s5x77"]
Jul 30 19:46:21.481043 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:21.481009    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca9adf7d-03ab-4021-bbe1-b64914a71849" path="/var/lib/kubelet/pods/ca9adf7d-03ab-4021-bbe1-b64914a71849/volumes"
Jul 30 19:46:31.447111 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:31.447079    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf"
Jul 30 19:46:31.494235 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:31.494200    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5"]
Jul 30 19:46:31.494413 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:31.494376    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5" podUID="cb67ee32-c1d5-4f7b-b6ee-5862352b3e29" containerName="manager" containerID="cri-o://a4d251e351b486b64eff3e513e48420a330a13814a94045c6d27087bd26a1dae" gracePeriod=10
Jul 30 19:46:31.746206 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:31.746181    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5"
Jul 30 19:46:31.870869 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:31.870838    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb67ee32-c1d5-4f7b-b6ee-5862352b3e29-extensions-socket-volume\") pod \"cb67ee32-c1d5-4f7b-b6ee-5862352b3e29\" (UID: \"cb67ee32-c1d5-4f7b-b6ee-5862352b3e29\") "
Jul 30 19:46:31.871027 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:31.870950    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2p54\" (UniqueName: \"kubernetes.io/projected/cb67ee32-c1d5-4f7b-b6ee-5862352b3e29-kube-api-access-z2p54\") pod \"cb67ee32-c1d5-4f7b-b6ee-5862352b3e29\" (UID: \"cb67ee32-c1d5-4f7b-b6ee-5862352b3e29\") "
Jul 30 19:46:31.871213 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:31.871182    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb67ee32-c1d5-4f7b-b6ee-5862352b3e29-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cb67ee32-c1d5-4f7b-b6ee-5862352b3e29" (UID: "cb67ee32-c1d5-4f7b-b6ee-5862352b3e29"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:46:31.872822 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:31.872799    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb67ee32-c1d5-4f7b-b6ee-5862352b3e29-kube-api-access-z2p54" (OuterVolumeSpecName: "kube-api-access-z2p54") pod "cb67ee32-c1d5-4f7b-b6ee-5862352b3e29" (UID: "cb67ee32-c1d5-4f7b-b6ee-5862352b3e29"). InnerVolumeSpecName "kube-api-access-z2p54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:46:31.971799 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:31.971768    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2p54\" (UniqueName: \"kubernetes.io/projected/cb67ee32-c1d5-4f7b-b6ee-5862352b3e29-kube-api-access-z2p54\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:46:31.971799 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:31.971797    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb67ee32-c1d5-4f7b-b6ee-5862352b3e29-extensions-socket-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:46:32.510054 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:32.510023    2568 generic.go:356] "Generic (PLEG): container finished" podID="cb67ee32-c1d5-4f7b-b6ee-5862352b3e29" containerID="a4d251e351b486b64eff3e513e48420a330a13814a94045c6d27087bd26a1dae" exitCode=0
Jul 30 19:46:32.510450 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:32.510061    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5"
Jul 30 19:46:32.510450 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:32.510113    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5" event={"ID":"cb67ee32-c1d5-4f7b-b6ee-5862352b3e29","Type":"ContainerDied","Data":"a4d251e351b486b64eff3e513e48420a330a13814a94045c6d27087bd26a1dae"}
Jul 30 19:46:32.510450 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:32.510160    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5" event={"ID":"cb67ee32-c1d5-4f7b-b6ee-5862352b3e29","Type":"ContainerDied","Data":"b050d8f24d8670eab95fbbe752a7f711e746d8f5e07b607c43d8a8ee5f81b367"}
Jul 30 19:46:32.510450 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:32.510185    2568 scope.go:117] "RemoveContainer" containerID="a4d251e351b486b64eff3e513e48420a330a13814a94045c6d27087bd26a1dae"
Jul 30 19:46:32.519754 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:32.519737    2568 scope.go:117] "RemoveContainer" containerID="a4d251e351b486b64eff3e513e48420a330a13814a94045c6d27087bd26a1dae"
Jul 30 19:46:32.519999 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:46:32.519981    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4d251e351b486b64eff3e513e48420a330a13814a94045c6d27087bd26a1dae\": container with ID starting with a4d251e351b486b64eff3e513e48420a330a13814a94045c6d27087bd26a1dae not found: ID does not exist" containerID="a4d251e351b486b64eff3e513e48420a330a13814a94045c6d27087bd26a1dae"
Jul 30 19:46:32.520065 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:32.520011    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4d251e351b486b64eff3e513e48420a330a13814a94045c6d27087bd26a1dae"} err="failed to get container status \"a4d251e351b486b64eff3e513e48420a330a13814a94045c6d27087bd26a1dae\": rpc error: code = NotFound desc = could not find container \"a4d251e351b486b64eff3e513e48420a330a13814a94045c6d27087bd26a1dae\": container with ID starting with a4d251e351b486b64eff3e513e48420a330a13814a94045c6d27087bd26a1dae not found: ID does not exist"
Jul 30 19:46:32.534880 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:32.534859    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5"]
Jul 30 19:46:32.538748 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:32.538730    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d9qh5"]
Jul 30 19:46:33.481201 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:33.481161    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb67ee32-c1d5-4f7b-b6ee-5862352b3e29" path="/var/lib/kubelet/pods/cb67ee32-c1d5-4f7b-b6ee-5862352b3e29/volumes"
Jul 30 19:46:35.744151 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:35.744116    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"]
Jul 30 19:46:35.744629 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:35.744501    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb67ee32-c1d5-4f7b-b6ee-5862352b3e29" containerName="manager"
Jul 30 19:46:35.744629 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:35.744511    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb67ee32-c1d5-4f7b-b6ee-5862352b3e29" containerName="manager"
Jul 30 19:46:35.744629 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:35.744581    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb67ee32-c1d5-4f7b-b6ee-5862352b3e29" containerName="manager"
Jul 30 19:46:35.747254 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:35.747233    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:35.750054 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:35.750030    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-s76pw\""
Jul 30 19:46:35.758709 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:35.758689    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"]
Jul 30 19:46:35.909053 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:35.909005    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfbhg\" (UniqueName: \"kubernetes.io/projected/9b6b4a26-6f99-4420-ba66-a35acba56cb9-kube-api-access-cfbhg\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:35.909053 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:35.909065    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b6b4a26-6f99-4420-ba66-a35acba56cb9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:35.909288 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:35.909131    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6b4a26-6f99-4420-ba66-a35acba56cb9-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:35.909288 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:35.909181    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6b4a26-6f99-4420-ba66-a35acba56cb9-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:35.909288 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:35.909221    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b6b4a26-6f99-4420-ba66-a35acba56cb9-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:35.909288 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:35.909243    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b6b4a26-6f99-4420-ba66-a35acba56cb9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:35.909288 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:35.909260    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b6b4a26-6f99-4420-ba66-a35acba56cb9-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:35.909528 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:35.909373    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b6b4a26-6f99-4420-ba66-a35acba56cb9-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:35.909528 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:35.909408    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b6b4a26-6f99-4420-ba66-a35acba56cb9-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:36.010920 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.010833    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfbhg\" (UniqueName: \"kubernetes.io/projected/9b6b4a26-6f99-4420-ba66-a35acba56cb9-kube-api-access-cfbhg\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:36.010920 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.010880    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b6b4a26-6f99-4420-ba66-a35acba56cb9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:36.011140 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.010941    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6b4a26-6f99-4420-ba66-a35acba56cb9-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:36.011140 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.010970    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6b4a26-6f99-4420-ba66-a35acba56cb9-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:36.011140 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.011001    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b6b4a26-6f99-4420-ba66-a35acba56cb9-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:36.011140 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.011029    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b6b4a26-6f99-4420-ba66-a35acba56cb9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:36.011140 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.011055    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b6b4a26-6f99-4420-ba66-a35acba56cb9-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:36.011140 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.011102    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b6b4a26-6f99-4420-ba66-a35acba56cb9-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:36.011140 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.011126    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b6b4a26-6f99-4420-ba66-a35acba56cb9-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:36.011473 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.011386    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6b4a26-6f99-4420-ba66-a35acba56cb9-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:36.011473 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.011458    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b6b4a26-6f99-4420-ba66-a35acba56cb9-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:36.011610 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.011560    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b6b4a26-6f99-4420-ba66-a35acba56cb9-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:36.011673 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.011605    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6b4a26-6f99-4420-ba66-a35acba56cb9-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:36.011870 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.011850    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b6b4a26-6f99-4420-ba66-a35acba56cb9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:36.013315 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.013295    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b6b4a26-6f99-4420-ba66-a35acba56cb9-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:36.013396 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.013378    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b6b4a26-6f99-4420-ba66-a35acba56cb9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:36.018535 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.018508    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b6b4a26-6f99-4420-ba66-a35acba56cb9-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:36.018840 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.018824    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfbhg\" (UniqueName: \"kubernetes.io/projected/9b6b4a26-6f99-4420-ba66-a35acba56cb9-kube-api-access-cfbhg\") pod \"maas-default-gateway-openshift-default-78bb78ff78-smgm7\" (UID: \"9b6b4a26-6f99-4420-ba66-a35acba56cb9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:36.058862 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.058837    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:36.194350 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.194325    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"]
Jul 30 19:46:36.196273 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:46:36.196247    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b6b4a26_6f99_4420_ba66_a35acba56cb9.slice/crio-69731b92761cf38437ede403fa3b225bd0e1ecc54441e92d1cff1a35d4100adf WatchSource:0}: Error finding container 69731b92761cf38437ede403fa3b225bd0e1ecc54441e92d1cff1a35d4100adf: Status 404 returned error can't find the container with id 69731b92761cf38437ede403fa3b225bd0e1ecc54441e92d1cff1a35d4100adf
Jul 30 19:46:36.198364 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.198323    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 19:46:36.198439 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.198417    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 19:46:36.198491 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.198461    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 19:46:36.532472 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.532440    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7" event={"ID":"9b6b4a26-6f99-4420-ba66-a35acba56cb9","Type":"ContainerStarted","Data":"e2bff269500434f46092188a2ff242817605eccbdc80e7e6fbe11585f2cc42a5"}
Jul 30 19:46:36.532655 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.532517    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7" event={"ID":"9b6b4a26-6f99-4420-ba66-a35acba56cb9","Type":"ContainerStarted","Data":"69731b92761cf38437ede403fa3b225bd0e1ecc54441e92d1cff1a35d4100adf"}
Jul 30 19:46:36.552828 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:36.552780    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7" podStartSLOduration=1.552765236 podStartE2EDuration="1.552765236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:46:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:46:36.550866919 +0000 UTC m=+417.650948143" watchObservedRunningTime="2026-07-30 19:46:36.552765236 +0000 UTC m=+417.652846422"
Jul 30 19:46:37.059697 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:37.059664    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:37.064399 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:37.064367    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:37.537986 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:37.537916    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:37.538867 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:37.538847    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:46:48.264108 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:48.264074    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ld49h"]
Jul 30 19:46:48.269512 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:48.269491    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ld49h"
Jul 30 19:46:48.272087 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:48.272061    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-v42rg\""
Jul 30 19:46:48.272692 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:48.272672    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 30 19:46:48.274679 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:48.274660    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ld49h"]
Jul 30 19:46:48.320938 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:48.320914    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czj4m\" (UniqueName: \"kubernetes.io/projected/a69c3183-fe52-4731-bb79-b565d3660713-kube-api-access-czj4m\") pod \"limitador-limitador-64c94fd64f-ld49h\" (UID: \"a69c3183-fe52-4731-bb79-b565d3660713\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ld49h"
Jul 30 19:46:48.321033 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:48.320988    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a69c3183-fe52-4731-bb79-b565d3660713-config-file\") pod \"limitador-limitador-64c94fd64f-ld49h\" (UID: \"a69c3183-fe52-4731-bb79-b565d3660713\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ld49h"
Jul 30 19:46:48.373404 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:48.373365    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ld49h"]
Jul 30 19:46:48.422027 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:48.421999    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a69c3183-fe52-4731-bb79-b565d3660713-config-file\") pod \"limitador-limitador-64c94fd64f-ld49h\" (UID: \"a69c3183-fe52-4731-bb79-b565d3660713\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ld49h"
Jul 30 19:46:48.422195 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:48.422054    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czj4m\" (UniqueName: \"kubernetes.io/projected/a69c3183-fe52-4731-bb79-b565d3660713-kube-api-access-czj4m\") pod \"limitador-limitador-64c94fd64f-ld49h\" (UID: \"a69c3183-fe52-4731-bb79-b565d3660713\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ld49h"
Jul 30 19:46:48.422693 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:48.422671    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a69c3183-fe52-4731-bb79-b565d3660713-config-file\") pod \"limitador-limitador-64c94fd64f-ld49h\" (UID: \"a69c3183-fe52-4731-bb79-b565d3660713\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ld49h"
Jul 30 19:46:48.429741 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:48.429721    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czj4m\" (UniqueName: \"kubernetes.io/projected/a69c3183-fe52-4731-bb79-b565d3660713-kube-api-access-czj4m\") pod \"limitador-limitador-64c94fd64f-ld49h\" (UID: \"a69c3183-fe52-4731-bb79-b565d3660713\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ld49h"
Jul 30 19:46:48.581201 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:48.581167    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ld49h"
Jul 30 19:46:48.716335 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:48.716303    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ld49h"]
Jul 30 19:46:48.719634 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:46:48.719606    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda69c3183_fe52_4731_bb79_b565d3660713.slice/crio-575fff216eecccc254ab42cbe541cec9584c4db92c6a9900002b9b113ab5b132 WatchSource:0}: Error finding container 575fff216eecccc254ab42cbe541cec9584c4db92c6a9900002b9b113ab5b132: Status 404 returned error can't find the container with id 575fff216eecccc254ab42cbe541cec9584c4db92c6a9900002b9b113ab5b132
Jul 30 19:46:49.599629 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:49.599548    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ld49h" event={"ID":"a69c3183-fe52-4731-bb79-b565d3660713","Type":"ContainerStarted","Data":"575fff216eecccc254ab42cbe541cec9584c4db92c6a9900002b9b113ab5b132"}
Jul 30 19:46:51.609764 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:51.609727    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ld49h" event={"ID":"a69c3183-fe52-4731-bb79-b565d3660713","Type":"ContainerStarted","Data":"9533848914d2f1a92b2a3b7fd8dc504040f12417276c0fddcebf9c19f5ac6ca8"}
Jul 30 19:46:51.610096 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:51.609817    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ld49h"
Jul 30 19:46:51.625916 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:46:51.625867    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-ld49h" podStartSLOduration=0.959032026 podStartE2EDuration="3.625853849s" totalImagesPullingTime="2.666821823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:46:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:46:51.624425014 +0000 UTC m=+432.724506205" watchObservedRunningTime="2026-07-30 19:46:51.625853849 +0000 UTC m=+432.725935059"
Jul 30 19:47:02.619295 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:02.619214    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ld49h"
Jul 30 19:47:03.062655 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:03.062623    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ld49h"]
Jul 30 19:47:03.062844 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:03.062800    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-ld49h" podUID="a69c3183-fe52-4731-bb79-b565d3660713" containerName="limitador" containerID="cri-o://9533848914d2f1a92b2a3b7fd8dc504040f12417276c0fddcebf9c19f5ac6ca8" gracePeriod=30
Jul 30 19:47:03.677340 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:03.677253    2568 generic.go:356] "Generic (PLEG): container finished" podID="a69c3183-fe52-4731-bb79-b565d3660713" containerID="9533848914d2f1a92b2a3b7fd8dc504040f12417276c0fddcebf9c19f5ac6ca8" exitCode=0
Jul 30 19:47:03.677340 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:03.677326    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ld49h" event={"ID":"a69c3183-fe52-4731-bb79-b565d3660713","Type":"ContainerDied","Data":"9533848914d2f1a92b2a3b7fd8dc504040f12417276c0fddcebf9c19f5ac6ca8"}
Jul 30 19:47:04.017032 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:04.017005    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ld49h"
Jul 30 19:47:04.065287 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:04.065255    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czj4m\" (UniqueName: \"kubernetes.io/projected/a69c3183-fe52-4731-bb79-b565d3660713-kube-api-access-czj4m\") pod \"a69c3183-fe52-4731-bb79-b565d3660713\" (UID: \"a69c3183-fe52-4731-bb79-b565d3660713\") "
Jul 30 19:47:04.065426 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:04.065317    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a69c3183-fe52-4731-bb79-b565d3660713-config-file\") pod \"a69c3183-fe52-4731-bb79-b565d3660713\" (UID: \"a69c3183-fe52-4731-bb79-b565d3660713\") "
Jul 30 19:47:04.065627 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:04.065608    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a69c3183-fe52-4731-bb79-b565d3660713-config-file" (OuterVolumeSpecName: "config-file") pod "a69c3183-fe52-4731-bb79-b565d3660713" (UID: "a69c3183-fe52-4731-bb79-b565d3660713"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 19:47:04.067293 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:04.067270    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a69c3183-fe52-4731-bb79-b565d3660713-kube-api-access-czj4m" (OuterVolumeSpecName: "kube-api-access-czj4m") pod "a69c3183-fe52-4731-bb79-b565d3660713" (UID: "a69c3183-fe52-4731-bb79-b565d3660713"). InnerVolumeSpecName "kube-api-access-czj4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:47:04.166298 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:04.166264    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czj4m\" (UniqueName: \"kubernetes.io/projected/a69c3183-fe52-4731-bb79-b565d3660713-kube-api-access-czj4m\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:47:04.166298 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:04.166294    2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a69c3183-fe52-4731-bb79-b565d3660713-config-file\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:47:04.683324 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:04.683294    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ld49h"
Jul 30 19:47:04.683797 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:04.683324    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ld49h" event={"ID":"a69c3183-fe52-4731-bb79-b565d3660713","Type":"ContainerDied","Data":"575fff216eecccc254ab42cbe541cec9584c4db92c6a9900002b9b113ab5b132"}
Jul 30 19:47:04.683797 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:04.683377    2568 scope.go:117] "RemoveContainer" containerID="9533848914d2f1a92b2a3b7fd8dc504040f12417276c0fddcebf9c19f5ac6ca8"
Jul 30 19:47:04.703387 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:04.703358    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ld49h"]
Jul 30 19:47:04.708760 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:04.708739    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ld49h"]
Jul 30 19:47:05.480641 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:05.480610    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a69c3183-fe52-4731-bb79-b565d3660713" path="/var/lib/kubelet/pods/a69c3183-fe52-4731-bb79-b565d3660713/volumes"
Jul 30 19:47:09.396777 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:09.396747    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-sctjv"]
Jul 30 19:47:09.397167 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:09.397154    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a69c3183-fe52-4731-bb79-b565d3660713" containerName="limitador"
Jul 30 19:47:09.397213 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:09.397168    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a69c3183-fe52-4731-bb79-b565d3660713" containerName="limitador"
Jul 30 19:47:09.397255 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:09.397245    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a69c3183-fe52-4731-bb79-b565d3660713" containerName="limitador"
Jul 30 19:47:09.403580 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:09.403551    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sctjv"
Jul 30 19:47:09.406872 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:09.406459    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 30 19:47:09.406872 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:09.406690    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 30 19:47:09.406872 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:09.406695    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 19:47:09.406872 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:09.406850    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-zznt9\""
Jul 30 19:47:09.407839 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:09.407820    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-sctjv"]
Jul 30 19:47:09.516310 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:09.516276    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxk4w\" (UniqueName: \"kubernetes.io/projected/ae346908-019b-4da8-9c34-eb5b51a0ac79-kube-api-access-mxk4w\") pod \"postgres-69fb4594cf-sctjv\" (UID: \"ae346908-019b-4da8-9c34-eb5b51a0ac79\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sctjv"
Jul 30 19:47:09.516490 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:09.516359    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ae346908-019b-4da8-9c34-eb5b51a0ac79-data\") pod \"postgres-69fb4594cf-sctjv\" (UID: \"ae346908-019b-4da8-9c34-eb5b51a0ac79\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sctjv"
Jul 30 19:47:09.617333 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:09.617295    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ae346908-019b-4da8-9c34-eb5b51a0ac79-data\") pod \"postgres-69fb4594cf-sctjv\" (UID: \"ae346908-019b-4da8-9c34-eb5b51a0ac79\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sctjv"
Jul 30 19:47:09.617500 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:09.617418    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxk4w\" (UniqueName: \"kubernetes.io/projected/ae346908-019b-4da8-9c34-eb5b51a0ac79-kube-api-access-mxk4w\") pod \"postgres-69fb4594cf-sctjv\" (UID: \"ae346908-019b-4da8-9c34-eb5b51a0ac79\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sctjv"
Jul 30 19:47:09.617673 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:09.617654    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ae346908-019b-4da8-9c34-eb5b51a0ac79-data\") pod \"postgres-69fb4594cf-sctjv\" (UID: \"ae346908-019b-4da8-9c34-eb5b51a0ac79\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sctjv"
Jul 30 19:47:09.640318 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:09.640291    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxk4w\" (UniqueName: \"kubernetes.io/projected/ae346908-019b-4da8-9c34-eb5b51a0ac79-kube-api-access-mxk4w\") pod \"postgres-69fb4594cf-sctjv\" (UID: \"ae346908-019b-4da8-9c34-eb5b51a0ac79\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sctjv"
Jul 30 19:47:09.716843 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:09.716764    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sctjv"
Jul 30 19:47:09.844159 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:09.844133    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-sctjv"]
Jul 30 19:47:09.846618 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:47:09.846590    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae346908_019b_4da8_9c34_eb5b51a0ac79.slice/crio-46e64ca8ae75cfb4cff3fa4dca0b6bd156922476ccee81988467000b0562300e WatchSource:0}: Error finding container 46e64ca8ae75cfb4cff3fa4dca0b6bd156922476ccee81988467000b0562300e: Status 404 returned error can't find the container with id 46e64ca8ae75cfb4cff3fa4dca0b6bd156922476ccee81988467000b0562300e
Jul 30 19:47:10.716669 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:10.716630    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sctjv" event={"ID":"ae346908-019b-4da8-9c34-eb5b51a0ac79","Type":"ContainerStarted","Data":"46e64ca8ae75cfb4cff3fa4dca0b6bd156922476ccee81988467000b0562300e"}
Jul 30 19:47:14.738383 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:14.738350    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sctjv" event={"ID":"ae346908-019b-4da8-9c34-eb5b51a0ac79","Type":"ContainerStarted","Data":"3005303fc289eafe5332ce8baf8b6f76b9a150b8a97a17892a6662672a720a73"}
Jul 30 19:47:14.738735 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:14.738476    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sctjv"
Jul 30 19:47:14.755375 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:14.755331    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sctjv" podStartSLOduration=1.073012324 podStartE2EDuration="5.755315955s" totalImagesPullingTime="4.682303631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:47:14.753359484 +0000 UTC m=+455.853440672" watchObservedRunningTime="2026-07-30 19:47:14.755315955 +0000 UTC m=+455.855397144"
Jul 30 19:47:20.773884 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:20.773850    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sctjv"
Jul 30 19:47:28.070560 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.070532    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-64655f7749-mkgc2"]
Jul 30 19:47:28.078337 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.075718    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64655f7749-mkgc2"
Jul 30 19:47:28.080614 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.080588    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 30 19:47:28.080732 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.080596    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 30 19:47:28.081608 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.081590    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4hh2q\""
Jul 30 19:47:28.085602 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.085559    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64655f7749-mkgc2"]
Jul 30 19:47:28.183211 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.183179    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twbg2\" (UniqueName: \"kubernetes.io/projected/e1914966-478d-4fa7-b09a-21432a2965d4-kube-api-access-twbg2\") pod \"maas-controller-64655f7749-mkgc2\" (UID: \"e1914966-478d-4fa7-b09a-21432a2965d4\") " pod="opendatahub/maas-controller-64655f7749-mkgc2"
Jul 30 19:47:28.183367 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.183228    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1914966-478d-4fa7-b09a-21432a2965d4-webhook-cert\") pod \"maas-controller-64655f7749-mkgc2\" (UID: \"e1914966-478d-4fa7-b09a-21432a2965d4\") " pod="opendatahub/maas-controller-64655f7749-mkgc2"
Jul 30 19:47:28.229208 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.229178    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-699f5fd477-bbq5j"]
Jul 30 19:47:28.232809 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.232790    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-699f5fd477-bbq5j"
Jul 30 19:47:28.244082 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.244061    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-699f5fd477-bbq5j"]
Jul 30 19:47:28.284077 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.284049    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twbg2\" (UniqueName: \"kubernetes.io/projected/e1914966-478d-4fa7-b09a-21432a2965d4-kube-api-access-twbg2\") pod \"maas-controller-64655f7749-mkgc2\" (UID: \"e1914966-478d-4fa7-b09a-21432a2965d4\") " pod="opendatahub/maas-controller-64655f7749-mkgc2"
Jul 30 19:47:28.284184 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.284098    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1914966-478d-4fa7-b09a-21432a2965d4-webhook-cert\") pod \"maas-controller-64655f7749-mkgc2\" (UID: \"e1914966-478d-4fa7-b09a-21432a2965d4\") " pod="opendatahub/maas-controller-64655f7749-mkgc2"
Jul 30 19:47:28.286461 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.286430    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1914966-478d-4fa7-b09a-21432a2965d4-webhook-cert\") pod \"maas-controller-64655f7749-mkgc2\" (UID: \"e1914966-478d-4fa7-b09a-21432a2965d4\") " pod="opendatahub/maas-controller-64655f7749-mkgc2"
Jul 30 19:47:28.292747 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.292729    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twbg2\" (UniqueName: \"kubernetes.io/projected/e1914966-478d-4fa7-b09a-21432a2965d4-kube-api-access-twbg2\") pod \"maas-controller-64655f7749-mkgc2\" (UID: \"e1914966-478d-4fa7-b09a-21432a2965d4\") " pod="opendatahub/maas-controller-64655f7749-mkgc2"
Jul 30 19:47:28.385261 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.385201    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/550498f8-b30f-48fe-910b-22dbca6d2068-webhook-cert\") pod \"maas-controller-699f5fd477-bbq5j\" (UID: \"550498f8-b30f-48fe-910b-22dbca6d2068\") " pod="opendatahub/maas-controller-699f5fd477-bbq5j"
Jul 30 19:47:28.385261 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.385244    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7crs7\" (UniqueName: \"kubernetes.io/projected/550498f8-b30f-48fe-910b-22dbca6d2068-kube-api-access-7crs7\") pod \"maas-controller-699f5fd477-bbq5j\" (UID: \"550498f8-b30f-48fe-910b-22dbca6d2068\") " pod="opendatahub/maas-controller-699f5fd477-bbq5j"
Jul 30 19:47:28.388071 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.388053    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64655f7749-mkgc2"
Jul 30 19:47:28.486723 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.486690    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/550498f8-b30f-48fe-910b-22dbca6d2068-webhook-cert\") pod \"maas-controller-699f5fd477-bbq5j\" (UID: \"550498f8-b30f-48fe-910b-22dbca6d2068\") " pod="opendatahub/maas-controller-699f5fd477-bbq5j"
Jul 30 19:47:28.486880 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.486755    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7crs7\" (UniqueName: \"kubernetes.io/projected/550498f8-b30f-48fe-910b-22dbca6d2068-kube-api-access-7crs7\") pod \"maas-controller-699f5fd477-bbq5j\" (UID: \"550498f8-b30f-48fe-910b-22dbca6d2068\") " pod="opendatahub/maas-controller-699f5fd477-bbq5j"
Jul 30 19:47:28.490813 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.490789    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/550498f8-b30f-48fe-910b-22dbca6d2068-webhook-cert\") pod \"maas-controller-699f5fd477-bbq5j\" (UID: \"550498f8-b30f-48fe-910b-22dbca6d2068\") " pod="opendatahub/maas-controller-699f5fd477-bbq5j"
Jul 30 19:47:28.495411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.495388    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7crs7\" (UniqueName: \"kubernetes.io/projected/550498f8-b30f-48fe-910b-22dbca6d2068-kube-api-access-7crs7\") pod \"maas-controller-699f5fd477-bbq5j\" (UID: \"550498f8-b30f-48fe-910b-22dbca6d2068\") " pod="opendatahub/maas-controller-699f5fd477-bbq5j"
Jul 30 19:47:28.518702 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.518683    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64655f7749-mkgc2"]
Jul 30 19:47:28.519877 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:47:28.519857    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1914966_478d_4fa7_b09a_21432a2965d4.slice/crio-a5516691895b318c8c41dd5ff37807d25acc4be9af19060a054274cf922379de WatchSource:0}: Error finding container a5516691895b318c8c41dd5ff37807d25acc4be9af19060a054274cf922379de: Status 404 returned error can't find the container with id a5516691895b318c8c41dd5ff37807d25acc4be9af19060a054274cf922379de
Jul 30 19:47:28.542875 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.542851    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-699f5fd477-bbq5j"
Jul 30 19:47:28.666962 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.666936    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-699f5fd477-bbq5j"]
Jul 30 19:47:28.668146 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:47:28.668126    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod550498f8_b30f_48fe_910b_22dbca6d2068.slice/crio-60c5cf3965680e1de0a6439bc4c6e3030cc5e98fe3e450869c7e6e8f138731bb WatchSource:0}: Error finding container 60c5cf3965680e1de0a6439bc4c6e3030cc5e98fe3e450869c7e6e8f138731bb: Status 404 returned error can't find the container with id 60c5cf3965680e1de0a6439bc4c6e3030cc5e98fe3e450869c7e6e8f138731bb
Jul 30 19:47:28.807814 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.807784    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64655f7749-mkgc2" event={"ID":"e1914966-478d-4fa7-b09a-21432a2965d4","Type":"ContainerStarted","Data":"a5516691895b318c8c41dd5ff37807d25acc4be9af19060a054274cf922379de"}
Jul 30 19:47:28.808799 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:28.808779    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-699f5fd477-bbq5j" event={"ID":"550498f8-b30f-48fe-910b-22dbca6d2068","Type":"ContainerStarted","Data":"60c5cf3965680e1de0a6439bc4c6e3030cc5e98fe3e450869c7e6e8f138731bb"}
Jul 30 19:47:31.828518 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:31.828483    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64655f7749-mkgc2" event={"ID":"e1914966-478d-4fa7-b09a-21432a2965d4","Type":"ContainerStarted","Data":"438b70d00a175e2ba925cd648be7f76b1956598db7fe55245f93ffc8c33fdade"}
Jul 30 19:47:31.828980 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:31.828539    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-64655f7749-mkgc2"
Jul 30 19:47:31.829960 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:31.829934    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-699f5fd477-bbq5j" event={"ID":"550498f8-b30f-48fe-910b-22dbca6d2068","Type":"ContainerStarted","Data":"493af383cbcd8f4dc03ca58b41f1ed42150cf0d604394c240ac89d19de9442b3"}
Jul 30 19:47:31.830096 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:31.830071    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-699f5fd477-bbq5j"
Jul 30 19:47:31.885469 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:31.885416    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-64655f7749-mkgc2" podStartSLOduration=1.414514628 podStartE2EDuration="3.88539781s" totalImagesPullingTime="2.470883182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:47:31.884723109 +0000 UTC m=+472.984804296" watchObservedRunningTime="2026-07-30 19:47:31.88539781 +0000 UTC m=+472.985478998"
Jul 30 19:47:31.904890 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:31.904845    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-699f5fd477-bbq5j" podStartSLOduration=1.575811809 podStartE2EDuration="3.904832329s" totalImagesPullingTime="2.32902052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:47:31.903087501 +0000 UTC m=+473.003168687" watchObservedRunningTime="2026-07-30 19:47:31.904832329 +0000 UTC m=+473.004913550"
Jul 30 19:47:42.836699 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:42.836667    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-64655f7749-mkgc2"
Jul 30 19:47:42.837196 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:42.836745    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-699f5fd477-bbq5j"
Jul 30 19:47:42.891538 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:42.891505    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64655f7749-mkgc2"]
Jul 30 19:47:42.891794 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:42.891725    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-64655f7749-mkgc2" podUID="e1914966-478d-4fa7-b09a-21432a2965d4" containerName="manager" containerID="cri-o://438b70d00a175e2ba925cd648be7f76b1956598db7fe55245f93ffc8c33fdade" gracePeriod=30
Jul 30 19:47:43.137455 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:43.137431    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64655f7749-mkgc2"
Jul 30 19:47:43.240541 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:43.240512    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twbg2\" (UniqueName: \"kubernetes.io/projected/e1914966-478d-4fa7-b09a-21432a2965d4-kube-api-access-twbg2\") pod \"e1914966-478d-4fa7-b09a-21432a2965d4\" (UID: \"e1914966-478d-4fa7-b09a-21432a2965d4\") "
Jul 30 19:47:43.240706 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:43.240624    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1914966-478d-4fa7-b09a-21432a2965d4-webhook-cert\") pod \"e1914966-478d-4fa7-b09a-21432a2965d4\" (UID: \"e1914966-478d-4fa7-b09a-21432a2965d4\") "
Jul 30 19:47:43.242740 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:43.242714    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1914966-478d-4fa7-b09a-21432a2965d4-kube-api-access-twbg2" (OuterVolumeSpecName: "kube-api-access-twbg2") pod "e1914966-478d-4fa7-b09a-21432a2965d4" (UID: "e1914966-478d-4fa7-b09a-21432a2965d4"). InnerVolumeSpecName "kube-api-access-twbg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:47:43.242847 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:43.242766    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1914966-478d-4fa7-b09a-21432a2965d4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e1914966-478d-4fa7-b09a-21432a2965d4" (UID: "e1914966-478d-4fa7-b09a-21432a2965d4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:47:43.342092 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:43.342066    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twbg2\" (UniqueName: \"kubernetes.io/projected/e1914966-478d-4fa7-b09a-21432a2965d4-kube-api-access-twbg2\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:47:43.342092 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:43.342088    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1914966-478d-4fa7-b09a-21432a2965d4-webhook-cert\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:47:43.889542 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:43.889506    2568 generic.go:356] "Generic (PLEG): container finished" podID="e1914966-478d-4fa7-b09a-21432a2965d4" containerID="438b70d00a175e2ba925cd648be7f76b1956598db7fe55245f93ffc8c33fdade" exitCode=0
Jul 30 19:47:43.889934 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:43.889582    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64655f7749-mkgc2"
Jul 30 19:47:43.889934 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:43.889593    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64655f7749-mkgc2" event={"ID":"e1914966-478d-4fa7-b09a-21432a2965d4","Type":"ContainerDied","Data":"438b70d00a175e2ba925cd648be7f76b1956598db7fe55245f93ffc8c33fdade"}
Jul 30 19:47:43.889934 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:43.889647    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64655f7749-mkgc2" event={"ID":"e1914966-478d-4fa7-b09a-21432a2965d4","Type":"ContainerDied","Data":"a5516691895b318c8c41dd5ff37807d25acc4be9af19060a054274cf922379de"}
Jul 30 19:47:43.889934 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:43.889675    2568 scope.go:117] "RemoveContainer" containerID="438b70d00a175e2ba925cd648be7f76b1956598db7fe55245f93ffc8c33fdade"
Jul 30 19:47:43.898225 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:43.898057    2568 scope.go:117] "RemoveContainer" containerID="438b70d00a175e2ba925cd648be7f76b1956598db7fe55245f93ffc8c33fdade"
Jul 30 19:47:43.898334 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:47:43.898315    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"438b70d00a175e2ba925cd648be7f76b1956598db7fe55245f93ffc8c33fdade\": container with ID starting with 438b70d00a175e2ba925cd648be7f76b1956598db7fe55245f93ffc8c33fdade not found: ID does not exist" containerID="438b70d00a175e2ba925cd648be7f76b1956598db7fe55245f93ffc8c33fdade"
Jul 30 19:47:43.898380 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:43.898341    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"438b70d00a175e2ba925cd648be7f76b1956598db7fe55245f93ffc8c33fdade"} err="failed to get container status \"438b70d00a175e2ba925cd648be7f76b1956598db7fe55245f93ffc8c33fdade\": rpc error: code = NotFound desc = could not find container \"438b70d00a175e2ba925cd648be7f76b1956598db7fe55245f93ffc8c33fdade\": container with ID starting with 438b70d00a175e2ba925cd648be7f76b1956598db7fe55245f93ffc8c33fdade not found: ID does not exist"
Jul 30 19:47:43.908517 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:43.908496    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64655f7749-mkgc2"]
Jul 30 19:47:43.910387 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:43.910369    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-64655f7749-mkgc2"]
Jul 30 19:47:45.481546 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:47:45.481512    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1914966-478d-4fa7-b09a-21432a2965d4" path="/var/lib/kubelet/pods/e1914966-478d-4fa7-b09a-21432a2965d4/volumes"
Jul 30 19:48:04.527082 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.527047    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-864bc7fb5b-kml4s"]
Jul 30 19:48:04.527600 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.527492    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1914966-478d-4fa7-b09a-21432a2965d4" containerName="manager"
Jul 30 19:48:04.527600 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.527506    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1914966-478d-4fa7-b09a-21432a2965d4" containerName="manager"
Jul 30 19:48:04.527600 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.527603    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1914966-478d-4fa7-b09a-21432a2965d4" containerName="manager"
Jul 30 19:48:04.535880 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.535860    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-864bc7fb5b-kml4s"
Jul 30 19:48:04.536643 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.536617    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/235618b5-f895-49bf-a8e4-e4a179b65ab5-openshift-service-ca\") pod \"maas-api-864bc7fb5b-kml4s\" (UID: \"235618b5-f895-49bf-a8e4-e4a179b65ab5\") " pod="odh-ai-gateway-infra/maas-api-864bc7fb5b-kml4s"
Jul 30 19:48:04.536773 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.536663    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/235618b5-f895-49bf-a8e4-e4a179b65ab5-maas-api-tls\") pod \"maas-api-864bc7fb5b-kml4s\" (UID: \"235618b5-f895-49bf-a8e4-e4a179b65ab5\") " pod="odh-ai-gateway-infra/maas-api-864bc7fb5b-kml4s"
Jul 30 19:48:04.536839 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.536770    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5kvc\" (UniqueName: \"kubernetes.io/projected/235618b5-f895-49bf-a8e4-e4a179b65ab5-kube-api-access-m5kvc\") pod \"maas-api-864bc7fb5b-kml4s\" (UID: \"235618b5-f895-49bf-a8e4-e4a179b65ab5\") " pod="odh-ai-gateway-infra/maas-api-864bc7fb5b-kml4s"
Jul 30 19:48:04.538700 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.538681    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 30 19:48:04.539181 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.539157    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fl9xt\""
Jul 30 19:48:04.540332 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.540301    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-864bc7fb5b-kml4s"]
Jul 30 19:48:04.637294 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.637263    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/235618b5-f895-49bf-a8e4-e4a179b65ab5-openshift-service-ca\") pod \"maas-api-864bc7fb5b-kml4s\" (UID: \"235618b5-f895-49bf-a8e4-e4a179b65ab5\") " pod="odh-ai-gateway-infra/maas-api-864bc7fb5b-kml4s"
Jul 30 19:48:04.637460 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.637324    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/235618b5-f895-49bf-a8e4-e4a179b65ab5-maas-api-tls\") pod \"maas-api-864bc7fb5b-kml4s\" (UID: \"235618b5-f895-49bf-a8e4-e4a179b65ab5\") " pod="odh-ai-gateway-infra/maas-api-864bc7fb5b-kml4s"
Jul 30 19:48:04.637460 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.637380    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5kvc\" (UniqueName: \"kubernetes.io/projected/235618b5-f895-49bf-a8e4-e4a179b65ab5-kube-api-access-m5kvc\") pod \"maas-api-864bc7fb5b-kml4s\" (UID: \"235618b5-f895-49bf-a8e4-e4a179b65ab5\") " pod="odh-ai-gateway-infra/maas-api-864bc7fb5b-kml4s"
Jul 30 19:48:04.638085 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.638061    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/235618b5-f895-49bf-a8e4-e4a179b65ab5-openshift-service-ca\") pod \"maas-api-864bc7fb5b-kml4s\" (UID: \"235618b5-f895-49bf-a8e4-e4a179b65ab5\") " pod="odh-ai-gateway-infra/maas-api-864bc7fb5b-kml4s"
Jul 30 19:48:04.640007 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.639981    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/235618b5-f895-49bf-a8e4-e4a179b65ab5-maas-api-tls\") pod \"maas-api-864bc7fb5b-kml4s\" (UID: \"235618b5-f895-49bf-a8e4-e4a179b65ab5\") " pod="odh-ai-gateway-infra/maas-api-864bc7fb5b-kml4s"
Jul 30 19:48:04.647966 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.647941    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5kvc\" (UniqueName: \"kubernetes.io/projected/235618b5-f895-49bf-a8e4-e4a179b65ab5-kube-api-access-m5kvc\") pod \"maas-api-864bc7fb5b-kml4s\" (UID: \"235618b5-f895-49bf-a8e4-e4a179b65ab5\") " pod="odh-ai-gateway-infra/maas-api-864bc7fb5b-kml4s"
Jul 30 19:48:04.847755 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.847721    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-864bc7fb5b-kml4s"
Jul 30 19:48:04.948410 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.948381    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-h2ldz"]
Jul 30 19:48:04.952782 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.952761    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-h2ldz"
Jul 30 19:48:04.956405 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.956247    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-m6h8r\""
Jul 30 19:48:04.956591 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.956543    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 30 19:48:04.963151 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.963084    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-h2ldz"]
Jul 30 19:48:04.990461 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:04.990441    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-864bc7fb5b-kml4s"]
Jul 30 19:48:04.992909 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:48:04.992880    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod235618b5_f895_49bf_a8e4_e4a179b65ab5.slice/crio-20f32439823f9018804391bb10ed641f7c0110a793313b20d4fbc0ed2a06ea44 WatchSource:0}: Error finding container 20f32439823f9018804391bb10ed641f7c0110a793313b20d4fbc0ed2a06ea44: Status 404 returned error can't find the container with id 20f32439823f9018804391bb10ed641f7c0110a793313b20d4fbc0ed2a06ea44
Jul 30 19:48:05.041069 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:05.041040    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmt5h\" (UniqueName: \"kubernetes.io/projected/e0a217c8-b65d-4969-b065-e411d5be06f9-kube-api-access-wmt5h\") pod \"payload-processing-5cc6cd444b-h2ldz\" (UID: \"e0a217c8-b65d-4969-b065-e411d5be06f9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-h2ldz"
Jul 30 19:48:05.041389 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:05.041122    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0a217c8-b65d-4969-b065-e411d5be06f9-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-h2ldz\" (UID: \"e0a217c8-b65d-4969-b065-e411d5be06f9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-h2ldz"
Jul 30 19:48:05.142133 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:05.142057    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmt5h\" (UniqueName: \"kubernetes.io/projected/e0a217c8-b65d-4969-b065-e411d5be06f9-kube-api-access-wmt5h\") pod \"payload-processing-5cc6cd444b-h2ldz\" (UID: \"e0a217c8-b65d-4969-b065-e411d5be06f9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-h2ldz"
Jul 30 19:48:05.142133 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:05.142112    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0a217c8-b65d-4969-b065-e411d5be06f9-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-h2ldz\" (UID: \"e0a217c8-b65d-4969-b065-e411d5be06f9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-h2ldz"
Jul 30 19:48:05.142898 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:05.142880    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0a217c8-b65d-4969-b065-e411d5be06f9-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-h2ldz\" (UID: \"e0a217c8-b65d-4969-b065-e411d5be06f9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-h2ldz"
Jul 30 19:48:05.150140 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:05.150116    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmt5h\" (UniqueName: \"kubernetes.io/projected/e0a217c8-b65d-4969-b065-e411d5be06f9-kube-api-access-wmt5h\") pod \"payload-processing-5cc6cd444b-h2ldz\" (UID: \"e0a217c8-b65d-4969-b065-e411d5be06f9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-h2ldz"
Jul 30 19:48:05.268923 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:05.268897    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-h2ldz"
Jul 30 19:48:05.399249 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:05.399227    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-h2ldz"]
Jul 30 19:48:05.400756 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:48:05.400720    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0a217c8_b65d_4969_b065_e411d5be06f9.slice/crio-c69e54ddfc9eb3d41701b23cf3f0148a41ed02ce944ba544f956145b24c60f75 WatchSource:0}: Error finding container c69e54ddfc9eb3d41701b23cf3f0148a41ed02ce944ba544f956145b24c60f75: Status 404 returned error can't find the container with id c69e54ddfc9eb3d41701b23cf3f0148a41ed02ce944ba544f956145b24c60f75
Jul 30 19:48:05.999707 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:05.999668    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-864bc7fb5b-kml4s" event={"ID":"235618b5-f895-49bf-a8e4-e4a179b65ab5","Type":"ContainerStarted","Data":"20f32439823f9018804391bb10ed641f7c0110a793313b20d4fbc0ed2a06ea44"}
Jul 30 19:48:06.001076 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:06.001047    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-h2ldz" event={"ID":"e0a217c8-b65d-4969-b065-e411d5be06f9","Type":"ContainerStarted","Data":"c69e54ddfc9eb3d41701b23cf3f0148a41ed02ce944ba544f956145b24c60f75"}
Jul 30 19:48:08.014453 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:08.014416    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-h2ldz" event={"ID":"e0a217c8-b65d-4969-b065-e411d5be06f9","Type":"ContainerStarted","Data":"02ba09d1d19f5c9f16cfdb7e4ee7baec22088ff373189ff57d81cd5ae86aaf00"}
Jul 30 19:48:08.014939 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:08.014511    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-h2ldz"
Jul 30 19:48:08.016141 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:08.016115    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-864bc7fb5b-kml4s" event={"ID":"235618b5-f895-49bf-a8e4-e4a179b65ab5","Type":"ContainerStarted","Data":"fa877a816b7fc80db3500de05f5b48a4723ad950258940a8dd57e2547f6c274a"}
Jul 30 19:48:08.016274 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:08.016259    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-864bc7fb5b-kml4s"
Jul 30 19:48:08.029942 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:08.029901    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-h2ldz" podStartSLOduration=1.84978658 podStartE2EDuration="4.029889463s" totalImagesPullingTime="2.180102883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:48:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:48:08.028737413 +0000 UTC m=+509.128818601" watchObservedRunningTime="2026-07-30 19:48:08.029889463 +0000 UTC m=+509.129970649"
Jul 30 19:48:08.044312 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:08.044243    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-864bc7fb5b-kml4s" podStartSLOduration=1.529637787 podStartE2EDuration="4.044223556s" totalImagesPullingTime="2.514585769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:48:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:48:08.042930565 +0000 UTC m=+509.143011753" watchObservedRunningTime="2026-07-30 19:48:08.044223556 +0000 UTC m=+509.144304744"
Jul 30 19:48:13.042541 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:13.042503    2568 generic.go:356] "Generic (PLEG): container finished" podID="9b6b4a26-6f99-4420-ba66-a35acba56cb9" containerID="e2bff269500434f46092188a2ff242817605eccbdc80e7e6fbe11585f2cc42a5" exitCode=0
Jul 30 19:48:13.042983 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:13.042553    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7" event={"ID":"9b6b4a26-6f99-4420-ba66-a35acba56cb9","Type":"ContainerDied","Data":"e2bff269500434f46092188a2ff242817605eccbdc80e7e6fbe11585f2cc42a5"}
Jul 30 19:48:13.042983 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:13.042927    2568 scope.go:117] "RemoveContainer" containerID="e2bff269500434f46092188a2ff242817605eccbdc80e7e6fbe11585f2cc42a5"
Jul 30 19:48:13.043958 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:13.043930    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 19:48:13.044026 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:13.044008    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 19:48:13.044072 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:13.044057    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 19:48:14.026898 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:14.026863    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-864bc7fb5b-kml4s"
Jul 30 19:48:14.055088 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:14.055041    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7" event={"ID":"9b6b4a26-6f99-4420-ba66-a35acba56cb9","Type":"ContainerStarted","Data":"51c8762ef2bfa150c8275ab2ae1170271504b1ee5f3672de8591a7bcd3e04347"}
Jul 30 19:48:14.059359 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:14.059337    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:48:14.059711 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:14.059683    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-smgm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 30 19:48:14.059929 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:14.059883    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7" podUID="9b6b4a26-6f99-4420-ba66-a35acba56cb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 30 19:48:15.060701 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:15.060660    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-smgm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 30 19:48:15.061194 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:15.060738    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7" podUID="9b6b4a26-6f99-4420-ba66-a35acba56cb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 30 19:48:16.059656 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:16.059616    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-smgm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 30 19:48:16.059853 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:16.059700    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7" podUID="9b6b4a26-6f99-4420-ba66-a35acba56cb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 30 19:48:17.059657 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:17.059526    2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-smgm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 30 19:48:17.059657 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:17.059613    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7" podUID="9b6b4a26-6f99-4420-ba66-a35acba56cb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 30 19:48:18.064904 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:18.064869    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:48:18.065359 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:18.065225    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:48:18.066690 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:18.066671    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-smgm7"
Jul 30 19:48:19.023305 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:19.023278    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-h2ldz"
Jul 30 19:48:53.905532 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:53.905500    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"]
Jul 30 19:48:53.909048 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:53.909025    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:48:53.913225 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:53.913201    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 30 19:48:53.913351 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:53.913203    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 30 19:48:53.913351 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:53.913245    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 30 19:48:53.913351 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:53.913314    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-866sb\""
Jul 30 19:48:53.917710 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:53.917686    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"]
Jul 30 19:48:54.085635 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:54.085600    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7657a3a3-5d3d-471d-acff-158272bc746a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rgs7\" (UID: \"7657a3a3-5d3d-471d-acff-158272bc746a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:48:54.085797 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:54.085639    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khktw\" (UniqueName: \"kubernetes.io/projected/7657a3a3-5d3d-471d-acff-158272bc746a-kube-api-access-khktw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rgs7\" (UID: \"7657a3a3-5d3d-471d-acff-158272bc746a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:48:54.085797 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:54.085752    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7657a3a3-5d3d-471d-acff-158272bc746a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rgs7\" (UID: \"7657a3a3-5d3d-471d-acff-158272bc746a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:48:54.085797 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:54.085781    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7657a3a3-5d3d-471d-acff-158272bc746a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rgs7\" (UID: \"7657a3a3-5d3d-471d-acff-158272bc746a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:48:54.085906 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:54.085798    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7657a3a3-5d3d-471d-acff-158272bc746a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rgs7\" (UID: \"7657a3a3-5d3d-471d-acff-158272bc746a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:48:54.085906 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:54.085819    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7657a3a3-5d3d-471d-acff-158272bc746a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rgs7\" (UID: \"7657a3a3-5d3d-471d-acff-158272bc746a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:48:54.186660 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:54.186583    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7657a3a3-5d3d-471d-acff-158272bc746a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rgs7\" (UID: \"7657a3a3-5d3d-471d-acff-158272bc746a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:48:54.186660 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:54.186615    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7657a3a3-5d3d-471d-acff-158272bc746a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rgs7\" (UID: \"7657a3a3-5d3d-471d-acff-158272bc746a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:48:54.186660 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:54.186638    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7657a3a3-5d3d-471d-acff-158272bc746a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rgs7\" (UID: \"7657a3a3-5d3d-471d-acff-158272bc746a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:48:54.186914 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:54.186673    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7657a3a3-5d3d-471d-acff-158272bc746a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rgs7\" (UID: \"7657a3a3-5d3d-471d-acff-158272bc746a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:48:54.186914 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:54.186692    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khktw\" (UniqueName: \"kubernetes.io/projected/7657a3a3-5d3d-471d-acff-158272bc746a-kube-api-access-khktw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rgs7\" (UID: \"7657a3a3-5d3d-471d-acff-158272bc746a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:48:54.186914 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:54.186779    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7657a3a3-5d3d-471d-acff-158272bc746a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rgs7\" (UID: \"7657a3a3-5d3d-471d-acff-158272bc746a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:48:54.187132 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:54.187111    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7657a3a3-5d3d-471d-acff-158272bc746a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rgs7\" (UID: \"7657a3a3-5d3d-471d-acff-158272bc746a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:48:54.187194 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:54.187114    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7657a3a3-5d3d-471d-acff-158272bc746a-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rgs7\" (UID: \"7657a3a3-5d3d-471d-acff-158272bc746a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:48:54.187242 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:54.187202    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7657a3a3-5d3d-471d-acff-158272bc746a-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rgs7\" (UID: \"7657a3a3-5d3d-471d-acff-158272bc746a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:48:54.189302 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:54.189286    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7657a3a3-5d3d-471d-acff-158272bc746a-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rgs7\" (UID: \"7657a3a3-5d3d-471d-acff-158272bc746a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:48:54.189730 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:54.189709    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7657a3a3-5d3d-471d-acff-158272bc746a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rgs7\" (UID: \"7657a3a3-5d3d-471d-acff-158272bc746a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:48:54.202932 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:54.202909    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khktw\" (UniqueName: \"kubernetes.io/projected/7657a3a3-5d3d-471d-acff-158272bc746a-kube-api-access-khktw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rgs7\" (UID: \"7657a3a3-5d3d-471d-acff-158272bc746a\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:48:54.221673 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:54.221642    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:48:54.355212 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:54.352361    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"]
Jul 30 19:48:54.356947 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:48:54.356916    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7657a3a3_5d3d_471d_acff_158272bc746a.slice/crio-228ff717814e5c65400078c904b73772ffb82fad7b84c326646a8623f104fa0c WatchSource:0}: Error finding container 228ff717814e5c65400078c904b73772ffb82fad7b84c326646a8623f104fa0c: Status 404 returned error can't find the container with id 228ff717814e5c65400078c904b73772ffb82fad7b84c326646a8623f104fa0c
Jul 30 19:48:55.270810 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:55.270777    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7" event={"ID":"7657a3a3-5d3d-471d-acff-158272bc746a","Type":"ContainerStarted","Data":"228ff717814e5c65400078c904b73772ffb82fad7b84c326646a8623f104fa0c"}
Jul 30 19:48:56.277266 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:56.277225    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7" event={"ID":"7657a3a3-5d3d-471d-acff-158272bc746a","Type":"ContainerStarted","Data":"5368a0b393258c20ed9e6ec282cd506d1c83613354f51864cbd3c24b550dcd54"}
Jul 30 19:48:56.294508 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:48:56.294454    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7" podStartSLOduration=2.347387838 podStartE2EDuration="3.294439119s" totalImagesPullingTime="947.051281ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:48:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:48:56.29259627 +0000 UTC m=+557.392677459" watchObservedRunningTime="2026-07-30 19:48:56.294439119 +0000 UTC m=+557.394520305"
Jul 30 19:49:04.221999 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:49:04.221959    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:49:04.222392 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:49:04.222033    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:49:04.235017 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:49:04.234991    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:49:04.334004 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:49:04.333980    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rgs7"
Jul 30 19:51:08.674516 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:51:08.674472    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-699f5fd477-bbq5j"]
Jul 30 19:51:08.675162 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:51:08.674689    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-699f5fd477-bbq5j" podUID="550498f8-b30f-48fe-910b-22dbca6d2068" containerName="manager" containerID="cri-o://493af383cbcd8f4dc03ca58b41f1ed42150cf0d604394c240ac89d19de9442b3" gracePeriod=30
Jul 30 19:51:08.935429 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:51:08.935408    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-699f5fd477-bbq5j"
Jul 30 19:51:08.950357 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:51:08.950323    2568 generic.go:356] "Generic (PLEG): container finished" podID="550498f8-b30f-48fe-910b-22dbca6d2068" containerID="493af383cbcd8f4dc03ca58b41f1ed42150cf0d604394c240ac89d19de9442b3" exitCode=0
Jul 30 19:51:08.950485 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:51:08.950371    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-699f5fd477-bbq5j"
Jul 30 19:51:08.950485 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:51:08.950405    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-699f5fd477-bbq5j" event={"ID":"550498f8-b30f-48fe-910b-22dbca6d2068","Type":"ContainerDied","Data":"493af383cbcd8f4dc03ca58b41f1ed42150cf0d604394c240ac89d19de9442b3"}
Jul 30 19:51:08.950485 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:51:08.950461    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-699f5fd477-bbq5j" event={"ID":"550498f8-b30f-48fe-910b-22dbca6d2068","Type":"ContainerDied","Data":"60c5cf3965680e1de0a6439bc4c6e3030cc5e98fe3e450869c7e6e8f138731bb"}
Jul 30 19:51:08.950662 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:51:08.950492    2568 scope.go:117] "RemoveContainer" containerID="493af383cbcd8f4dc03ca58b41f1ed42150cf0d604394c240ac89d19de9442b3"
Jul 30 19:51:08.962519 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:51:08.962500    2568 scope.go:117] "RemoveContainer" containerID="493af383cbcd8f4dc03ca58b41f1ed42150cf0d604394c240ac89d19de9442b3"
Jul 30 19:51:08.962875 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:51:08.962846    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"493af383cbcd8f4dc03ca58b41f1ed42150cf0d604394c240ac89d19de9442b3\": container with ID starting with 493af383cbcd8f4dc03ca58b41f1ed42150cf0d604394c240ac89d19de9442b3 not found: ID does not exist" containerID="493af383cbcd8f4dc03ca58b41f1ed42150cf0d604394c240ac89d19de9442b3"
Jul 30 19:51:08.962998 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:51:08.962881    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"493af383cbcd8f4dc03ca58b41f1ed42150cf0d604394c240ac89d19de9442b3"} err="failed to get container status \"493af383cbcd8f4dc03ca58b41f1ed42150cf0d604394c240ac89d19de9442b3\": rpc error: code = NotFound desc = could not find container \"493af383cbcd8f4dc03ca58b41f1ed42150cf0d604394c240ac89d19de9442b3\": container with ID starting with 493af383cbcd8f4dc03ca58b41f1ed42150cf0d604394c240ac89d19de9442b3 not found: ID does not exist"
Jul 30 19:51:09.008481 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:51:09.008459    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/550498f8-b30f-48fe-910b-22dbca6d2068-webhook-cert\") pod \"550498f8-b30f-48fe-910b-22dbca6d2068\" (UID: \"550498f8-b30f-48fe-910b-22dbca6d2068\") "
Jul 30 19:51:09.008634 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:51:09.008492    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7crs7\" (UniqueName: \"kubernetes.io/projected/550498f8-b30f-48fe-910b-22dbca6d2068-kube-api-access-7crs7\") pod \"550498f8-b30f-48fe-910b-22dbca6d2068\" (UID: \"550498f8-b30f-48fe-910b-22dbca6d2068\") "
Jul 30 19:51:09.010367 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:51:09.010344    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/550498f8-b30f-48fe-910b-22dbca6d2068-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "550498f8-b30f-48fe-910b-22dbca6d2068" (UID: "550498f8-b30f-48fe-910b-22dbca6d2068"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:51:09.010474 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:51:09.010441    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/550498f8-b30f-48fe-910b-22dbca6d2068-kube-api-access-7crs7" (OuterVolumeSpecName: "kube-api-access-7crs7") pod "550498f8-b30f-48fe-910b-22dbca6d2068" (UID: "550498f8-b30f-48fe-910b-22dbca6d2068"). InnerVolumeSpecName "kube-api-access-7crs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:51:09.109727 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:51:09.109693    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/550498f8-b30f-48fe-910b-22dbca6d2068-webhook-cert\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:51:09.109727 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:51:09.109723    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7crs7\" (UniqueName: \"kubernetes.io/projected/550498f8-b30f-48fe-910b-22dbca6d2068-kube-api-access-7crs7\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:51:09.281477 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:51:09.281446    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-699f5fd477-bbq5j"]
Jul 30 19:51:09.284701 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:51:09.284680    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-699f5fd477-bbq5j"]
Jul 30 19:51:09.482337 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:51:09.482301    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="550498f8-b30f-48fe-910b-22dbca6d2068" path="/var/lib/kubelet/pods/550498f8-b30f-48fe-910b-22dbca6d2068/volumes"
Jul 30 19:52:10.054720 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:10.054684    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-699f5fd477-crqbr"]
Jul 30 19:52:10.055164 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:10.055085    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="550498f8-b30f-48fe-910b-22dbca6d2068" containerName="manager"
Jul 30 19:52:10.055164 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:10.055099    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="550498f8-b30f-48fe-910b-22dbca6d2068" containerName="manager"
Jul 30 19:52:10.055246 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:10.055219    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="550498f8-b30f-48fe-910b-22dbca6d2068" containerName="manager"
Jul 30 19:52:10.058346 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:10.058331    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-699f5fd477-crqbr"
Jul 30 19:52:10.061899 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:10.061873    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4hh2q\""
Jul 30 19:52:10.062034 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:10.061880    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 30 19:52:10.062034 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:10.061952    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 30 19:52:10.067485 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:10.067463    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-699f5fd477-crqbr"]
Jul 30 19:52:10.165940 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:10.165914    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc7rb\" (UniqueName: \"kubernetes.io/projected/fd12396f-7e65-4fc4-b598-3fba91fd42e8-kube-api-access-lc7rb\") pod \"maas-controller-699f5fd477-crqbr\" (UID: \"fd12396f-7e65-4fc4-b598-3fba91fd42e8\") " pod="opendatahub/maas-controller-699f5fd477-crqbr"
Jul 30 19:52:10.166069 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:10.165946    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd12396f-7e65-4fc4-b598-3fba91fd42e8-webhook-cert\") pod \"maas-controller-699f5fd477-crqbr\" (UID: \"fd12396f-7e65-4fc4-b598-3fba91fd42e8\") " pod="opendatahub/maas-controller-699f5fd477-crqbr"
Jul 30 19:52:10.267036 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:10.267005    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc7rb\" (UniqueName: \"kubernetes.io/projected/fd12396f-7e65-4fc4-b598-3fba91fd42e8-kube-api-access-lc7rb\") pod \"maas-controller-699f5fd477-crqbr\" (UID: \"fd12396f-7e65-4fc4-b598-3fba91fd42e8\") " pod="opendatahub/maas-controller-699f5fd477-crqbr"
Jul 30 19:52:10.267166 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:10.267043    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd12396f-7e65-4fc4-b598-3fba91fd42e8-webhook-cert\") pod \"maas-controller-699f5fd477-crqbr\" (UID: \"fd12396f-7e65-4fc4-b598-3fba91fd42e8\") " pod="opendatahub/maas-controller-699f5fd477-crqbr"
Jul 30 19:52:10.269530 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:10.269498    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd12396f-7e65-4fc4-b598-3fba91fd42e8-webhook-cert\") pod \"maas-controller-699f5fd477-crqbr\" (UID: \"fd12396f-7e65-4fc4-b598-3fba91fd42e8\") " pod="opendatahub/maas-controller-699f5fd477-crqbr"
Jul 30 19:52:10.274924 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:10.274903    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc7rb\" (UniqueName: \"kubernetes.io/projected/fd12396f-7e65-4fc4-b598-3fba91fd42e8-kube-api-access-lc7rb\") pod \"maas-controller-699f5fd477-crqbr\" (UID: \"fd12396f-7e65-4fc4-b598-3fba91fd42e8\") " pod="opendatahub/maas-controller-699f5fd477-crqbr"
Jul 30 19:52:10.369783 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:10.369729    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-699f5fd477-crqbr"
Jul 30 19:52:10.501492 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:10.501470    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-699f5fd477-crqbr"]
Jul 30 19:52:10.503499 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:52:10.503469    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd12396f_7e65_4fc4_b598_3fba91fd42e8.slice/crio-18daba5de769645ab88c7f3e480bde21b94ee58b4b213be7abd376a3c545bbc1 WatchSource:0}: Error finding container 18daba5de769645ab88c7f3e480bde21b94ee58b4b213be7abd376a3c545bbc1: Status 404 returned error can't find the container with id 18daba5de769645ab88c7f3e480bde21b94ee58b4b213be7abd376a3c545bbc1
Jul 30 19:52:10.504930 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:10.504906    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 19:52:11.265665 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:11.265542    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-699f5fd477-crqbr" event={"ID":"fd12396f-7e65-4fc4-b598-3fba91fd42e8","Type":"ContainerStarted","Data":"39cc61e2df6163728ca4844eedcdb41504780316e19dae7ea91514a66f398ff2"}
Jul 30 19:52:11.265665 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:11.265647    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-699f5fd477-crqbr"
Jul 30 19:52:11.266103 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:11.265677    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-699f5fd477-crqbr" event={"ID":"fd12396f-7e65-4fc4-b598-3fba91fd42e8","Type":"ContainerStarted","Data":"18daba5de769645ab88c7f3e480bde21b94ee58b4b213be7abd376a3c545bbc1"}
Jul 30 19:52:11.282771 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:11.282723    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-699f5fd477-crqbr" podStartSLOduration=0.834577706 podStartE2EDuration="1.28270726s" totalImagesPullingTime="448.129554ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:52:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:52:11.281440302 +0000 UTC m=+752.381521490" watchObservedRunningTime="2026-07-30 19:52:11.28270726 +0000 UTC m=+752.382788447"
Jul 30 19:52:22.272452 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:22.272421    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-699f5fd477-crqbr"
Jul 30 19:52:26.893625 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:26.893587    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-699f5fd477-crqbr"]
Jul 30 19:52:26.894027 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:26.893796    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-699f5fd477-crqbr" podUID="fd12396f-7e65-4fc4-b598-3fba91fd42e8" containerName="manager" containerID="cri-o://39cc61e2df6163728ca4844eedcdb41504780316e19dae7ea91514a66f398ff2" gracePeriod=30
Jul 30 19:52:27.148994 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:27.148926    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-699f5fd477-crqbr"
Jul 30 19:52:27.231210 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:27.231179    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lc7rb\" (UniqueName: \"kubernetes.io/projected/fd12396f-7e65-4fc4-b598-3fba91fd42e8-kube-api-access-lc7rb\") pod \"fd12396f-7e65-4fc4-b598-3fba91fd42e8\" (UID: \"fd12396f-7e65-4fc4-b598-3fba91fd42e8\") "
Jul 30 19:52:27.231406 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:27.231261    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd12396f-7e65-4fc4-b598-3fba91fd42e8-webhook-cert\") pod \"fd12396f-7e65-4fc4-b598-3fba91fd42e8\" (UID: \"fd12396f-7e65-4fc4-b598-3fba91fd42e8\") "
Jul 30 19:52:27.233209 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:27.233175    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd12396f-7e65-4fc4-b598-3fba91fd42e8-kube-api-access-lc7rb" (OuterVolumeSpecName: "kube-api-access-lc7rb") pod "fd12396f-7e65-4fc4-b598-3fba91fd42e8" (UID: "fd12396f-7e65-4fc4-b598-3fba91fd42e8"). InnerVolumeSpecName "kube-api-access-lc7rb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:52:27.233366 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:27.233345    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd12396f-7e65-4fc4-b598-3fba91fd42e8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fd12396f-7e65-4fc4-b598-3fba91fd42e8" (UID: "fd12396f-7e65-4fc4-b598-3fba91fd42e8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 19:52:27.332368 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:27.332329    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lc7rb\" (UniqueName: \"kubernetes.io/projected/fd12396f-7e65-4fc4-b598-3fba91fd42e8-kube-api-access-lc7rb\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:52:27.332368 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:27.332362    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd12396f-7e65-4fc4-b598-3fba91fd42e8-webhook-cert\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:52:27.347276 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:27.347239    2568 generic.go:356] "Generic (PLEG): container finished" podID="fd12396f-7e65-4fc4-b598-3fba91fd42e8" containerID="39cc61e2df6163728ca4844eedcdb41504780316e19dae7ea91514a66f398ff2" exitCode=0
Jul 30 19:52:27.347441 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:27.347291    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-699f5fd477-crqbr"
Jul 30 19:52:27.347441 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:27.347324    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-699f5fd477-crqbr" event={"ID":"fd12396f-7e65-4fc4-b598-3fba91fd42e8","Type":"ContainerDied","Data":"39cc61e2df6163728ca4844eedcdb41504780316e19dae7ea91514a66f398ff2"}
Jul 30 19:52:27.347441 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:27.347379    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-699f5fd477-crqbr" event={"ID":"fd12396f-7e65-4fc4-b598-3fba91fd42e8","Type":"ContainerDied","Data":"18daba5de769645ab88c7f3e480bde21b94ee58b4b213be7abd376a3c545bbc1"}
Jul 30 19:52:27.347441 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:27.347401    2568 scope.go:117] "RemoveContainer" containerID="39cc61e2df6163728ca4844eedcdb41504780316e19dae7ea91514a66f398ff2"
Jul 30 19:52:27.356529 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:27.356509    2568 scope.go:117] "RemoveContainer" containerID="39cc61e2df6163728ca4844eedcdb41504780316e19dae7ea91514a66f398ff2"
Jul 30 19:52:27.356830 ip-10-0-134-200 kubenswrapper[2568]: E0730 19:52:27.356806    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39cc61e2df6163728ca4844eedcdb41504780316e19dae7ea91514a66f398ff2\": container with ID starting with 39cc61e2df6163728ca4844eedcdb41504780316e19dae7ea91514a66f398ff2 not found: ID does not exist" containerID="39cc61e2df6163728ca4844eedcdb41504780316e19dae7ea91514a66f398ff2"
Jul 30 19:52:27.356883 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:27.356841    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39cc61e2df6163728ca4844eedcdb41504780316e19dae7ea91514a66f398ff2"} err="failed to get container status \"39cc61e2df6163728ca4844eedcdb41504780316e19dae7ea91514a66f398ff2\": rpc error: code = NotFound desc = could not find container \"39cc61e2df6163728ca4844eedcdb41504780316e19dae7ea91514a66f398ff2\": container with ID starting with 39cc61e2df6163728ca4844eedcdb41504780316e19dae7ea91514a66f398ff2 not found: ID does not exist"
Jul 30 19:52:27.368640 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:27.368614    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-699f5fd477-crqbr"]
Jul 30 19:52:27.372688 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:27.372667    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-699f5fd477-crqbr"]
Jul 30 19:52:27.482411 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:27.482335    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd12396f-7e65-4fc4-b598-3fba91fd42e8" path="/var/lib/kubelet/pods/fd12396f-7e65-4fc4-b598-3fba91fd42e8/volumes"
Jul 30 19:52:28.161776 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:28.161740    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-699f5fd477-bhrcr"]
Jul 30 19:52:28.162183 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:28.162169    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd12396f-7e65-4fc4-b598-3fba91fd42e8" containerName="manager"
Jul 30 19:52:28.162183 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:28.162182    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd12396f-7e65-4fc4-b598-3fba91fd42e8" containerName="manager"
Jul 30 19:52:28.162275 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:28.162251    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd12396f-7e65-4fc4-b598-3fba91fd42e8" containerName="manager"
Jul 30 19:52:28.166775 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:28.166759    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-699f5fd477-bhrcr"
Jul 30 19:52:28.169491 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:28.169464    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4hh2q\""
Jul 30 19:52:28.170654 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:28.170611    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 30 19:52:28.170752 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:28.170695    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 30 19:52:28.175843 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:28.175764    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-699f5fd477-bhrcr"]
Jul 30 19:52:28.240549 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:28.240499    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51789d5b-c60e-41cc-b2e6-c50eb239199d-webhook-cert\") pod \"maas-controller-699f5fd477-bhrcr\" (UID: \"51789d5b-c60e-41cc-b2e6-c50eb239199d\") " pod="opendatahub/maas-controller-699f5fd477-bhrcr"
Jul 30 19:52:28.240753 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:28.240660    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6qkw\" (UniqueName: \"kubernetes.io/projected/51789d5b-c60e-41cc-b2e6-c50eb239199d-kube-api-access-z6qkw\") pod \"maas-controller-699f5fd477-bhrcr\" (UID: \"51789d5b-c60e-41cc-b2e6-c50eb239199d\") " pod="opendatahub/maas-controller-699f5fd477-bhrcr"
Jul 30 19:52:28.342005 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:28.341965    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51789d5b-c60e-41cc-b2e6-c50eb239199d-webhook-cert\") pod \"maas-controller-699f5fd477-bhrcr\" (UID: \"51789d5b-c60e-41cc-b2e6-c50eb239199d\") " pod="opendatahub/maas-controller-699f5fd477-bhrcr"
Jul 30 19:52:28.342203 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:28.342046    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6qkw\" (UniqueName: \"kubernetes.io/projected/51789d5b-c60e-41cc-b2e6-c50eb239199d-kube-api-access-z6qkw\") pod \"maas-controller-699f5fd477-bhrcr\" (UID: \"51789d5b-c60e-41cc-b2e6-c50eb239199d\") " pod="opendatahub/maas-controller-699f5fd477-bhrcr"
Jul 30 19:52:28.344670 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:28.344636    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51789d5b-c60e-41cc-b2e6-c50eb239199d-webhook-cert\") pod \"maas-controller-699f5fd477-bhrcr\" (UID: \"51789d5b-c60e-41cc-b2e6-c50eb239199d\") " pod="opendatahub/maas-controller-699f5fd477-bhrcr"
Jul 30 19:52:28.351863 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:28.351835    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6qkw\" (UniqueName: \"kubernetes.io/projected/51789d5b-c60e-41cc-b2e6-c50eb239199d-kube-api-access-z6qkw\") pod \"maas-controller-699f5fd477-bhrcr\" (UID: \"51789d5b-c60e-41cc-b2e6-c50eb239199d\") " pod="opendatahub/maas-controller-699f5fd477-bhrcr"
Jul 30 19:52:28.478491 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:28.478390    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-699f5fd477-bhrcr"
Jul 30 19:52:28.614807 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:28.614778    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-699f5fd477-bhrcr"]
Jul 30 19:52:28.616406 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:52:28.616380    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51789d5b_c60e_41cc_b2e6_c50eb239199d.slice/crio-b53aa47405d415551b6107336f9b0298eec12ab17ee56b21ef89751980c5254c WatchSource:0}: Error finding container b53aa47405d415551b6107336f9b0298eec12ab17ee56b21ef89751980c5254c: Status 404 returned error can't find the container with id b53aa47405d415551b6107336f9b0298eec12ab17ee56b21ef89751980c5254c
Jul 30 19:52:29.361247 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:29.361211    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-699f5fd477-bhrcr" event={"ID":"51789d5b-c60e-41cc-b2e6-c50eb239199d","Type":"ContainerStarted","Data":"e6850d613b6af88073888b9c817e7bdc68031083055ac9b82b8add4dba14e1d8"}
Jul 30 19:52:29.361654 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:29.361262    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-699f5fd477-bhrcr" event={"ID":"51789d5b-c60e-41cc-b2e6-c50eb239199d","Type":"ContainerStarted","Data":"b53aa47405d415551b6107336f9b0298eec12ab17ee56b21ef89751980c5254c"}
Jul 30 19:52:29.361654 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:29.361308    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-699f5fd477-bhrcr"
Jul 30 19:52:29.378672 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:29.378623    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-699f5fd477-bhrcr" podStartSLOduration=0.980446706 podStartE2EDuration="1.378607903s" totalImagesPullingTime="398.161197ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:52:29.376623299 +0000 UTC m=+770.476704485" watchObservedRunningTime="2026-07-30 19:52:29.378607903 +0000 UTC m=+770.478689090"
Jul 30 19:52:40.368307 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:52:40.368271    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-699f5fd477-bhrcr"
Jul 30 19:58:57.167847 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:58:57.167810    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf"]
Jul 30 19:58:57.170674 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:58:57.168079    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf" podUID="7a06a2c1-dea4-4eb3-9708-cd08c0289386" containerName="manager" containerID="cri-o://5ebbdb9b6b43a7bdb67a6ed81b1e865c7fadd1a31fa54077273b7bda88e041d5" gracePeriod=10
Jul 30 19:58:57.312955 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:58:57.312921    2568 generic.go:356] "Generic (PLEG): container finished" podID="7a06a2c1-dea4-4eb3-9708-cd08c0289386" containerID="5ebbdb9b6b43a7bdb67a6ed81b1e865c7fadd1a31fa54077273b7bda88e041d5" exitCode=0
Jul 30 19:58:57.313114 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:58:57.312991    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf" event={"ID":"7a06a2c1-dea4-4eb3-9708-cd08c0289386","Type":"ContainerDied","Data":"5ebbdb9b6b43a7bdb67a6ed81b1e865c7fadd1a31fa54077273b7bda88e041d5"}
Jul 30 19:58:57.418327 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:58:57.418264    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf"
Jul 30 19:58:57.521606 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:58:57.521574    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a06a2c1-dea4-4eb3-9708-cd08c0289386-extensions-socket-volume\") pod \"7a06a2c1-dea4-4eb3-9708-cd08c0289386\" (UID: \"7a06a2c1-dea4-4eb3-9708-cd08c0289386\") "
Jul 30 19:58:57.521786 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:58:57.521633    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ln25q\" (UniqueName: \"kubernetes.io/projected/7a06a2c1-dea4-4eb3-9708-cd08c0289386-kube-api-access-ln25q\") pod \"7a06a2c1-dea4-4eb3-9708-cd08c0289386\" (UID: \"7a06a2c1-dea4-4eb3-9708-cd08c0289386\") "
Jul 30 19:58:57.521957 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:58:57.521933    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a06a2c1-dea4-4eb3-9708-cd08c0289386-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7a06a2c1-dea4-4eb3-9708-cd08c0289386" (UID: "7a06a2c1-dea4-4eb3-9708-cd08c0289386"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 19:58:57.523445 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:58:57.523418    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a06a2c1-dea4-4eb3-9708-cd08c0289386-kube-api-access-ln25q" (OuterVolumeSpecName: "kube-api-access-ln25q") pod "7a06a2c1-dea4-4eb3-9708-cd08c0289386" (UID: "7a06a2c1-dea4-4eb3-9708-cd08c0289386"). InnerVolumeSpecName "kube-api-access-ln25q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 19:58:57.622635 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:58:57.622609    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ln25q\" (UniqueName: \"kubernetes.io/projected/7a06a2c1-dea4-4eb3-9708-cd08c0289386-kube-api-access-ln25q\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:58:57.622635 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:58:57.622630    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a06a2c1-dea4-4eb3-9708-cd08c0289386-extensions-socket-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 19:58:58.319724 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:58:58.319696    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf"
Jul 30 19:58:58.320180 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:58:58.319732    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf" event={"ID":"7a06a2c1-dea4-4eb3-9708-cd08c0289386","Type":"ContainerDied","Data":"645e96b0c5f2affe20295ebfc74fdf8e6bfd82fefe8bde172d8dfbe969254fd0"}
Jul 30 19:58:58.320180 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:58:58.319801    2568 scope.go:117] "RemoveContainer" containerID="5ebbdb9b6b43a7bdb67a6ed81b1e865c7fadd1a31fa54077273b7bda88e041d5"
Jul 30 19:58:58.343004 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:58:58.342982    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf"]
Jul 30 19:58:58.347719 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:58:58.347698    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pjqf"]
Jul 30 19:58:59.480667 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:58:59.480632    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a06a2c1-dea4-4eb3-9708-cd08c0289386" path="/var/lib/kubelet/pods/7a06a2c1-dea4-4eb3-9708-cd08c0289386/volumes"
Jul 30 19:59:57.834916 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:59:57.834882    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z"]
Jul 30 19:59:57.835518 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:59:57.835498    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a06a2c1-dea4-4eb3-9708-cd08c0289386" containerName="manager"
Jul 30 19:59:57.835624 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:59:57.835521    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a06a2c1-dea4-4eb3-9708-cd08c0289386" containerName="manager"
Jul 30 19:59:57.835686 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:59:57.835650    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a06a2c1-dea4-4eb3-9708-cd08c0289386" containerName="manager"
Jul 30 19:59:57.839897 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:59:57.839877    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z"
Jul 30 19:59:57.842752 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:59:57.842734    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jfscx\""
Jul 30 19:59:57.849277 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:59:57.849256    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z"]
Jul 30 19:59:57.922831 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:59:57.922807    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjk69\" (UniqueName: \"kubernetes.io/projected/4c7a841b-e0c2-49d1-99c6-908485e8da5c-kube-api-access-kjk69\") pod \"kuadrant-operator-controller-manager-86878c769f-4ff8z\" (UID: \"4c7a841b-e0c2-49d1-99c6-908485e8da5c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z"
Jul 30 19:59:57.922953 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:59:57.922839    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c7a841b-e0c2-49d1-99c6-908485e8da5c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4ff8z\" (UID: \"4c7a841b-e0c2-49d1-99c6-908485e8da5c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z"
Jul 30 19:59:58.023391 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:59:58.023365    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjk69\" (UniqueName: \"kubernetes.io/projected/4c7a841b-e0c2-49d1-99c6-908485e8da5c-kube-api-access-kjk69\") pod \"kuadrant-operator-controller-manager-86878c769f-4ff8z\" (UID: \"4c7a841b-e0c2-49d1-99c6-908485e8da5c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z"
Jul 30 19:59:58.023500 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:59:58.023400    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c7a841b-e0c2-49d1-99c6-908485e8da5c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4ff8z\" (UID: \"4c7a841b-e0c2-49d1-99c6-908485e8da5c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z"
Jul 30 19:59:58.023763 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:59:58.023747    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c7a841b-e0c2-49d1-99c6-908485e8da5c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4ff8z\" (UID: \"4c7a841b-e0c2-49d1-99c6-908485e8da5c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z"
Jul 30 19:59:58.033078 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:59:58.033057    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjk69\" (UniqueName: \"kubernetes.io/projected/4c7a841b-e0c2-49d1-99c6-908485e8da5c-kube-api-access-kjk69\") pod \"kuadrant-operator-controller-manager-86878c769f-4ff8z\" (UID: \"4c7a841b-e0c2-49d1-99c6-908485e8da5c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z"
Jul 30 19:59:58.151040 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:59:58.150985    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z"
Jul 30 19:59:58.287202 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:59:58.287179    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z"]
Jul 30 19:59:58.290155 ip-10-0-134-200 kubenswrapper[2568]: W0730 19:59:58.290121    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c7a841b_e0c2_49d1_99c6_908485e8da5c.slice/crio-869e6cfe0f30d1bc271412c7f5091f7904c1a6f0916c2bd0f1a6669e2408aa5c WatchSource:0}: Error finding container 869e6cfe0f30d1bc271412c7f5091f7904c1a6f0916c2bd0f1a6669e2408aa5c: Status 404 returned error can't find the container with id 869e6cfe0f30d1bc271412c7f5091f7904c1a6f0916c2bd0f1a6669e2408aa5c
Jul 30 19:59:58.619907 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:59:58.619874    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z" event={"ID":"4c7a841b-e0c2-49d1-99c6-908485e8da5c","Type":"ContainerStarted","Data":"23fa19a3d3ad9434ccf6180180838f4a7d1fca42e076ce2fd6c8f17066df0204"}
Jul 30 19:59:58.620077 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:59:58.619923    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z" event={"ID":"4c7a841b-e0c2-49d1-99c6-908485e8da5c","Type":"ContainerStarted","Data":"869e6cfe0f30d1bc271412c7f5091f7904c1a6f0916c2bd0f1a6669e2408aa5c"}
Jul 30 19:59:58.620077 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:59:58.619988    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z"
Jul 30 19:59:58.642537 ip-10-0-134-200 kubenswrapper[2568]: I0730 19:59:58.642488    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z" podStartSLOduration=1.6424757410000002 podStartE2EDuration="1.642475741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 19:59:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 19:59:58.640430462 +0000 UTC m=+1219.740511648" watchObservedRunningTime="2026-07-30 19:59:58.642475741 +0000 UTC m=+1219.742556929"
Jul 30 20:00:00.135591 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:00:00.135537    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757360-hfjqm"]
Jul 30 20:00:00.139443 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:00:00.139421    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757360-hfjqm"
Jul 30 20:00:00.142005 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:00:00.141983    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mgdxn\""
Jul 30 20:00:00.145749 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:00:00.145726    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757360-hfjqm"]
Jul 30 20:00:00.150493 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:00:00.150473    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757360-hfjqm"
Jul 30 20:00:00.482837 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:00:00.482814    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757360-hfjqm"]
Jul 30 20:00:00.484871 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:00:00.484843    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee34187_89e4_45bb_9014_9585ede2aee9.slice/crio-3a7ba5ef3fc6810b4bd79e8cc0fd9d0565ec964009d290d7637d1704e9544e0d WatchSource:0}: Error finding container 3a7ba5ef3fc6810b4bd79e8cc0fd9d0565ec964009d290d7637d1704e9544e0d: Status 404 returned error can't find the container with id 3a7ba5ef3fc6810b4bd79e8cc0fd9d0565ec964009d290d7637d1704e9544e0d
Jul 30 20:00:00.486677 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:00:00.486659    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:00:00.630346 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:00:00.630318    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757360-hfjqm" event={"ID":"5ee34187-89e4-45bb-9014-9585ede2aee9","Type":"ContainerStarted","Data":"3a7ba5ef3fc6810b4bd79e8cc0fd9d0565ec964009d290d7637d1704e9544e0d"}
Jul 30 20:00:04.654171 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:00:04.654141    2568 generic.go:356] "Generic (PLEG): container finished" podID="5ee34187-89e4-45bb-9014-9585ede2aee9" containerID="506c0ec8611b1efa3d28de069cfccda7069a5827185f9fb53eb25abf574c01e2" exitCode=0
Jul 30 20:00:04.654469 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:00:04.654228    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757360-hfjqm" event={"ID":"5ee34187-89e4-45bb-9014-9585ede2aee9","Type":"ContainerDied","Data":"506c0ec8611b1efa3d28de069cfccda7069a5827185f9fb53eb25abf574c01e2"}
Jul 30 20:00:05.798371 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:00:05.798343    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757360-hfjqm"
Jul 30 20:00:06.665291 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:00:06.665263    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757360-hfjqm"
Jul 30 20:00:06.665465 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:00:06.665296    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757360-hfjqm" event={"ID":"5ee34187-89e4-45bb-9014-9585ede2aee9","Type":"ContainerDied","Data":"3a7ba5ef3fc6810b4bd79e8cc0fd9d0565ec964009d290d7637d1704e9544e0d"}
Jul 30 20:00:06.665465 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:00:06.665341    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a7ba5ef3fc6810b4bd79e8cc0fd9d0565ec964009d290d7637d1704e9544e0d"
Jul 30 20:00:09.626165 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:00:09.626137    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z"
Jul 30 20:07:45.756855 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.756818    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"]
Jul 30 20:07:45.757503 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.757481    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ee34187-89e4-45bb-9014-9585ede2aee9" containerName="cleanup"
Jul 30 20:07:45.757606 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.757506    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ee34187-89e4-45bb-9014-9585ede2aee9" containerName="cleanup"
Jul 30 20:07:45.757688 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.757676    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ee34187-89e4-45bb-9014-9585ede2aee9" containerName="cleanup"
Jul 30 20:07:45.760519 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.760498    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.763775 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.763754    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-16079fbb-openshift-default-dockercfg-qf5rd\""
Jul 30 20:07:45.794339 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.794306    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"]
Jul 30 20:07:45.864997 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.864962    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-data\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.865188 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.865023    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istiod-ca-cert\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.865188 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.865058    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-podinfo\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.865188 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.865104    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-workload-certs\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.865188 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.865142    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-workload-socket\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.865353 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.865208    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-token\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.865353 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.865230    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2v6t\" (UniqueName: \"kubernetes.io/projected/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-kube-api-access-m2v6t\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.865353 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.865247    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-credential-socket\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.865353 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.865275    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-envoy\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.966206 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.966174    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-token\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.966407 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.966322    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2v6t\" (UniqueName: \"kubernetes.io/projected/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-kube-api-access-m2v6t\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.966407 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.966366    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-credential-socket\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.966407 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.966403    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-envoy\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.966612 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.966507    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-data\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.966612 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.966590    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istiod-ca-cert\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.966728 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.966623    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-podinfo\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.966728 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.966664    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-workload-certs\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.966728 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.966696    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-workload-socket\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.966916 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.966895    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-credential-socket\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.966988 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.966960    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-data\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.967116 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.967067    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-workload-socket\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.967116 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.967100    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-workload-certs\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.967305 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.967288    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istiod-ca-cert\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.968897 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.968877    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-envoy\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.969112 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.969091    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-podinfo\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.974156 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.974132    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-token\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:45.974785 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:45.974766    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2v6t\" (UniqueName: \"kubernetes.io/projected/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-kube-api-access-m2v6t\") pod \"e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") " pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:46.071151 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:46.071121    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:46.215145 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:46.215115    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"]
Jul 30 20:07:46.216352 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:07:46.216325    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42cc58d_7ff5_4b62_a1e0_f28de790a8d6.slice/crio-1ba860b038f2bb17f2c403f801234aba1019cd22aec06a7495636e6b05b78283 WatchSource:0}: Error finding container 1ba860b038f2bb17f2c403f801234aba1019cd22aec06a7495636e6b05b78283: Status 404 returned error can't find the container with id 1ba860b038f2bb17f2c403f801234aba1019cd22aec06a7495636e6b05b78283
Jul 30 20:07:46.218902 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:46.218862    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:07:46.218985 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:46.218954    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:07:46.219029 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:46.218995    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:07:47.067795 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:47.067756    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd" event={"ID":"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6","Type":"ContainerStarted","Data":"a18845123ede235b89ac2f1363a231f92d20210ba95264af0799fa481345ffe0"}
Jul 30 20:07:47.068166 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:47.067825    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd" event={"ID":"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6","Type":"ContainerStarted","Data":"1ba860b038f2bb17f2c403f801234aba1019cd22aec06a7495636e6b05b78283"}
Jul 30 20:07:47.071573 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:47.071539    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:47.077138 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:47.077119    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:47.091222 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:47.091168    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd" podStartSLOduration=2.091147125 podStartE2EDuration="2.091147125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:07:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:07:47.089611216 +0000 UTC m=+1688.189692407" watchObservedRunningTime="2026-07-30 20:07:47.091147125 +0000 UTC m=+1688.191228313"
Jul 30 20:07:48.073036 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:48.072999    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:48.073842 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:48.073824    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:07:49.606875 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:49.606842    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246"]
Jul 30 20:07:49.609843 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:49.609817    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246"
Jul 30 20:07:49.612198 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:49.612172    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-16079fbb-serving-cert\""
Jul 30 20:07:49.622688 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:49.622657    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246"]
Jul 30 20:07:49.704631 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:49.704559    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04a758ae-b65c-4dff-a35f-056011854459-openshift-service-ca\") pod \"maas-api-e2e-ait-16079fbb-65dc7dffd-tf246\" (UID: \"04a758ae-b65c-4dff-a35f-056011854459\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246"
Jul 30 20:07:49.704834 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:49.704664    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjps4\" (UniqueName: \"kubernetes.io/projected/04a758ae-b65c-4dff-a35f-056011854459-kube-api-access-pjps4\") pod \"maas-api-e2e-ait-16079fbb-65dc7dffd-tf246\" (UID: \"04a758ae-b65c-4dff-a35f-056011854459\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246"
Jul 30 20:07:49.704834 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:49.704791    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04a758ae-b65c-4dff-a35f-056011854459-maas-api-tls\") pod \"maas-api-e2e-ait-16079fbb-65dc7dffd-tf246\" (UID: \"04a758ae-b65c-4dff-a35f-056011854459\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246"
Jul 30 20:07:49.805658 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:49.805611    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04a758ae-b65c-4dff-a35f-056011854459-openshift-service-ca\") pod \"maas-api-e2e-ait-16079fbb-65dc7dffd-tf246\" (UID: \"04a758ae-b65c-4dff-a35f-056011854459\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246"
Jul 30 20:07:49.805845 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:49.805673    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjps4\" (UniqueName: \"kubernetes.io/projected/04a758ae-b65c-4dff-a35f-056011854459-kube-api-access-pjps4\") pod \"maas-api-e2e-ait-16079fbb-65dc7dffd-tf246\" (UID: \"04a758ae-b65c-4dff-a35f-056011854459\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246"
Jul 30 20:07:49.805845 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:49.805745    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04a758ae-b65c-4dff-a35f-056011854459-maas-api-tls\") pod \"maas-api-e2e-ait-16079fbb-65dc7dffd-tf246\" (UID: \"04a758ae-b65c-4dff-a35f-056011854459\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246"
Jul 30 20:07:49.806403 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:49.806380    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04a758ae-b65c-4dff-a35f-056011854459-openshift-service-ca\") pod \"maas-api-e2e-ait-16079fbb-65dc7dffd-tf246\" (UID: \"04a758ae-b65c-4dff-a35f-056011854459\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246"
Jul 30 20:07:49.808210 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:49.808183    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04a758ae-b65c-4dff-a35f-056011854459-maas-api-tls\") pod \"maas-api-e2e-ait-16079fbb-65dc7dffd-tf246\" (UID: \"04a758ae-b65c-4dff-a35f-056011854459\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246"
Jul 30 20:07:49.813695 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:49.813664    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjps4\" (UniqueName: \"kubernetes.io/projected/04a758ae-b65c-4dff-a35f-056011854459-kube-api-access-pjps4\") pod \"maas-api-e2e-ait-16079fbb-65dc7dffd-tf246\" (UID: \"04a758ae-b65c-4dff-a35f-056011854459\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246"
Jul 30 20:07:49.925004 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:49.924916    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246"
Jul 30 20:07:50.074734 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.074706    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246"]
Jul 30 20:07:50.077230 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:07:50.077192    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a758ae_b65c_4dff_a35f_056011854459.slice/crio-ef86d54f8ca9fffa6cd7a1a47a940e6f60970172f5e8ea43e761fa67d638514b WatchSource:0}: Error finding container ef86d54f8ca9fffa6cd7a1a47a940e6f60970172f5e8ea43e761fa67d638514b: Status 404 returned error can't find the container with id ef86d54f8ca9fffa6cd7a1a47a940e6f60970172f5e8ea43e761fa67d638514b
Jul 30 20:07:50.079103 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.078783    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:07:50.086412 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.086386    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246" event={"ID":"04a758ae-b65c-4dff-a35f-056011854459","Type":"ContainerStarted","Data":"ef86d54f8ca9fffa6cd7a1a47a940e6f60970172f5e8ea43e761fa67d638514b"}
Jul 30 20:07:50.211916 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.211841    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd"]
Jul 30 20:07:50.215175 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.215153    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd"
Jul 30 20:07:50.219007 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.218981    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-16079fbb-dockercfg-8d5v5\""
Jul 30 20:07:50.219129 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.219078    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-16079fbb\""
Jul 30 20:07:50.236175 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.236151    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd"]
Jul 30 20:07:50.272713 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.272682    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62"]
Jul 30 20:07:50.275286 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.275267    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62"
Jul 30 20:07:50.286244 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.286220    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62"]
Jul 30 20:07:50.310108 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.310066    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhh9q\" (UniqueName: \"kubernetes.io/projected/5a01822b-9846-4e0d-b552-46029a00ca6b-kube-api-access-xhh9q\") pod \"payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd\" (UID: \"5a01822b-9846-4e0d-b552-46029a00ca6b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd"
Jul 30 20:07:50.310304 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.310159    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a01822b-9846-4e0d-b552-46029a00ca6b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd\" (UID: \"5a01822b-9846-4e0d-b552-46029a00ca6b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd"
Jul 30 20:07:50.411015 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.410976    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a01822b-9846-4e0d-b552-46029a00ca6b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd\" (UID: \"5a01822b-9846-4e0d-b552-46029a00ca6b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd"
Jul 30 20:07:50.411015 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.411021    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17f5cbd2-db75-4e31-8795-1429025aa5d5-plugins-config-volume\") pod \"payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62\" (UID: \"17f5cbd2-db75-4e31-8795-1429025aa5d5\") " pod="openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62"
Jul 30 20:07:50.411267 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.411079    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv9nn\" (UniqueName: \"kubernetes.io/projected/17f5cbd2-db75-4e31-8795-1429025aa5d5-kube-api-access-pv9nn\") pod \"payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62\" (UID: \"17f5cbd2-db75-4e31-8795-1429025aa5d5\") " pod="openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62"
Jul 30 20:07:50.411267 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.411124    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhh9q\" (UniqueName: \"kubernetes.io/projected/5a01822b-9846-4e0d-b552-46029a00ca6b-kube-api-access-xhh9q\") pod \"payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd\" (UID: \"5a01822b-9846-4e0d-b552-46029a00ca6b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd"
Jul 30 20:07:50.411778 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.411753    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a01822b-9846-4e0d-b552-46029a00ca6b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd\" (UID: \"5a01822b-9846-4e0d-b552-46029a00ca6b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd"
Jul 30 20:07:50.420006 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.419986    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhh9q\" (UniqueName: \"kubernetes.io/projected/5a01822b-9846-4e0d-b552-46029a00ca6b-kube-api-access-xhh9q\") pod \"payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd\" (UID: \"5a01822b-9846-4e0d-b552-46029a00ca6b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd"
Jul 30 20:07:50.511912 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.511825    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv9nn\" (UniqueName: \"kubernetes.io/projected/17f5cbd2-db75-4e31-8795-1429025aa5d5-kube-api-access-pv9nn\") pod \"payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62\" (UID: \"17f5cbd2-db75-4e31-8795-1429025aa5d5\") " pod="openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62"
Jul 30 20:07:50.512064 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.511918    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17f5cbd2-db75-4e31-8795-1429025aa5d5-plugins-config-volume\") pod \"payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62\" (UID: \"17f5cbd2-db75-4e31-8795-1429025aa5d5\") " pod="openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62"
Jul 30 20:07:50.512621 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.512600    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17f5cbd2-db75-4e31-8795-1429025aa5d5-plugins-config-volume\") pod \"payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62\" (UID: \"17f5cbd2-db75-4e31-8795-1429025aa5d5\") " pod="openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62"
Jul 30 20:07:50.521587 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.521550    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv9nn\" (UniqueName: \"kubernetes.io/projected/17f5cbd2-db75-4e31-8795-1429025aa5d5-kube-api-access-pv9nn\") pod \"payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62\" (UID: \"17f5cbd2-db75-4e31-8795-1429025aa5d5\") " pod="openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62"
Jul 30 20:07:50.526410 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.526393    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd"
Jul 30 20:07:50.587529 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.587503    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62"
Jul 30 20:07:50.687555 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.687503    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd"]
Jul 30 20:07:50.689306 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:07:50.689278    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a01822b_9846_4e0d_b552_46029a00ca6b.slice/crio-f2ac341b1b91d70ff786c59a47ef0ec16040db07db23ef7dd951ca34f96587a2 WatchSource:0}: Error finding container f2ac341b1b91d70ff786c59a47ef0ec16040db07db23ef7dd951ca34f96587a2: Status 404 returned error can't find the container with id f2ac341b1b91d70ff786c59a47ef0ec16040db07db23ef7dd951ca34f96587a2
Jul 30 20:07:50.759967 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:50.759940    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62"]
Jul 30 20:07:50.761379 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:07:50.761354    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f5cbd2_db75_4e31_8795_1429025aa5d5.slice/crio-69628c299cc657737be36ee680fdc4db26b56878313101c447081425b14ee22e WatchSource:0}: Error finding container 69628c299cc657737be36ee680fdc4db26b56878313101c447081425b14ee22e: Status 404 returned error can't find the container with id 69628c299cc657737be36ee680fdc4db26b56878313101c447081425b14ee22e
Jul 30 20:07:51.095085 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:51.095048    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246" event={"ID":"04a758ae-b65c-4dff-a35f-056011854459","Type":"ContainerStarted","Data":"0a99ea2e037fb3e582b75ee8908651a434a41decb8edbce9650f50fd7d051cf4"}
Jul 30 20:07:51.095291 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:51.095157    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246"
Jul 30 20:07:51.096742 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:51.096719    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62" event={"ID":"17f5cbd2-db75-4e31-8795-1429025aa5d5","Type":"ContainerStarted","Data":"6057f82183fed55d1e6929b09dcb901a5f79c6a04db84e073582b64a783e511d"}
Jul 30 20:07:51.096865 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:51.096757    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62" event={"ID":"17f5cbd2-db75-4e31-8795-1429025aa5d5","Type":"ContainerStarted","Data":"69628c299cc657737be36ee680fdc4db26b56878313101c447081425b14ee22e"}
Jul 30 20:07:51.096865 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:51.096797    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62"
Jul 30 20:07:51.098359 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:51.098336    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd" event={"ID":"5a01822b-9846-4e0d-b552-46029a00ca6b","Type":"ContainerStarted","Data":"6ed28652267b089e66e1e70049fb80a3010d2e8a4e499e52ab1731fba69bf09a"}
Jul 30 20:07:51.098486 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:51.098379    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd" event={"ID":"5a01822b-9846-4e0d-b552-46029a00ca6b","Type":"ContainerStarted","Data":"f2ac341b1b91d70ff786c59a47ef0ec16040db07db23ef7dd951ca34f96587a2"}
Jul 30 20:07:51.098486 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:51.098425    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd"
Jul 30 20:07:51.111611 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:51.111548    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246" podStartSLOduration=1.607684152 podStartE2EDuration="2.111535477s" totalImagesPullingTime="503.851325ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:07:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:07:51.109780937 +0000 UTC m=+1692.209862125" watchObservedRunningTime="2026-07-30 20:07:51.111535477 +0000 UTC m=+1692.211616663"
Jul 30 20:07:51.125851 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:51.125806    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd" podStartSLOduration=1.1257942220000001 podStartE2EDuration="1.125794222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:07:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:07:51.123608983 +0000 UTC m=+1692.223690170" watchObservedRunningTime="2026-07-30 20:07:51.125794222 +0000 UTC m=+1692.225875408"
Jul 30 20:07:51.139181 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:51.139139    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62" podStartSLOduration=1.139121939 podStartE2EDuration="1.139121939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:07:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:07:51.137259545 +0000 UTC m=+1692.237340737" watchObservedRunningTime="2026-07-30 20:07:51.139121939 +0000 UTC m=+1692.239203153"
Jul 30 20:07:57.110422 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:07:57.110386    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246"
Jul 30 20:08:02.106902 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:02.106787    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62"
Jul 30 20:08:02.107344 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:02.107137    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd"
Jul 30 20:08:03.668033 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:03.667775    2568 patch_prober.go:28] interesting pod/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": read tcp 10.134.0.2:36504->10.134.0.46:15021: read: connection reset by peer" start-of-body=
Jul 30 20:08:03.668033 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:03.667860    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd" podUID="f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": read tcp 10.134.0.2:36504->10.134.0.46:15021: read: connection reset by peer"
Jul 30 20:08:03.813712 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:03.813678    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16079fbb-xp477"]
Jul 30 20:08:03.816221 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:03.816206    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16079fbb-xp477"
Jul 30 20:08:03.818733 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:03.818712    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mgdxn\""
Jul 30 20:08:03.823018 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:03.822991    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16079fbb-xp477"]
Jul 30 20:08:03.952109 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:03.952005    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4faf6f15-2872-4b36-93d5-62c1d62fe036-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-16079fbb-xp477\" (UID: \"4faf6f15-2872-4b36-93d5-62c1d62fe036\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16079fbb-xp477"
Jul 30 20:08:04.053125 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:04.053088    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4faf6f15-2872-4b36-93d5-62c1d62fe036-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-16079fbb-xp477\" (UID: \"4faf6f15-2872-4b36-93d5-62c1d62fe036\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16079fbb-xp477"
Jul 30 20:08:04.053803 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:04.053784    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4faf6f15-2872-4b36-93d5-62c1d62fe036-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-16079fbb-xp477\" (UID: \"4faf6f15-2872-4b36-93d5-62c1d62fe036\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16079fbb-xp477"
Jul 30 20:08:04.128672 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:04.128637    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16079fbb-xp477"
Jul 30 20:08:04.181113 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:04.181072    2568 generic.go:356] "Generic (PLEG): container finished" podID="f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" containerID="a18845123ede235b89ac2f1363a231f92d20210ba95264af0799fa481345ffe0" exitCode=0
Jul 30 20:08:04.181300 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:04.181193    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd" event={"ID":"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6","Type":"ContainerDied","Data":"a18845123ede235b89ac2f1363a231f92d20210ba95264af0799fa481345ffe0"}
Jul 30 20:08:04.181810 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:04.181790    2568 scope.go:117] "RemoveContainer" containerID="a18845123ede235b89ac2f1363a231f92d20210ba95264af0799fa481345ffe0"
Jul 30 20:08:04.183555 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:04.183410    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:08:04.183555 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:04.183495    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:08:04.183555 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:04.183545    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:08:04.287491 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:04.287448    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16079fbb-xp477"]
Jul 30 20:08:04.288076 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:08:04.288047    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4faf6f15_2872_4b36_93d5_62c1d62fe036.slice/crio-bee725331b7635d2285f07bb5eed214df11f9ceb4b84cc6f587b6e007bbcadf9 WatchSource:0}: Error finding container bee725331b7635d2285f07bb5eed214df11f9ceb4b84cc6f587b6e007bbcadf9: Status 404 returned error can't find the container with id bee725331b7635d2285f07bb5eed214df11f9ceb4b84cc6f587b6e007bbcadf9
Jul 30 20:08:05.188899 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:05.188860    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd" event={"ID":"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6","Type":"ContainerStarted","Data":"16e1a6802004e8efb9a49e3503084e4f0c4b70aa508943a88142ef48e23e2246"}
Jul 30 20:08:05.190337 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:05.190311    2568 generic.go:356] "Generic (PLEG): container finished" podID="4faf6f15-2872-4b36-93d5-62c1d62fe036" containerID="7dd0bd47b7395f55af926cb10ee1eeb458349269861a3be56bd9e0dff92519da" exitCode=0
Jul 30 20:08:05.190459 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:05.190349    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16079fbb-xp477" event={"ID":"4faf6f15-2872-4b36-93d5-62c1d62fe036","Type":"ContainerDied","Data":"7dd0bd47b7395f55af926cb10ee1eeb458349269861a3be56bd9e0dff92519da"}
Jul 30 20:08:05.190459 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:05.190389    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16079fbb-xp477" event={"ID":"4faf6f15-2872-4b36-93d5-62c1d62fe036","Type":"ContainerStarted","Data":"bee725331b7635d2285f07bb5eed214df11f9ceb4b84cc6f587b6e007bbcadf9"}
Jul 30 20:08:06.071915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:06.071872    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:08:06.072128 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:06.072106    2568 patch_prober.go:28] interesting pod/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 30 20:08:06.072176 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:06.072158    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd" podUID="f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 30 20:08:06.371354 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:06.371309    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16079fbb-xp477"
Jul 30 20:08:06.481856 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:06.481817    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4faf6f15-2872-4b36-93d5-62c1d62fe036-maas-api-service-ca\") pod \"4faf6f15-2872-4b36-93d5-62c1d62fe036\" (UID: \"4faf6f15-2872-4b36-93d5-62c1d62fe036\") "
Jul 30 20:08:06.482187 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:06.482158    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4faf6f15-2872-4b36-93d5-62c1d62fe036-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4faf6f15-2872-4b36-93d5-62c1d62fe036" (UID: "4faf6f15-2872-4b36-93d5-62c1d62fe036"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:08:06.583415 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:06.583322    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4faf6f15-2872-4b36-93d5-62c1d62fe036-maas-api-service-ca\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:07.072521 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:07.072483    2568 patch_prober.go:28] interesting pod/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 30 20:08:07.072832 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:07.072803    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd" podUID="f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 30 20:08:07.202764 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:07.202725    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16079fbb-xp477" event={"ID":"4faf6f15-2872-4b36-93d5-62c1d62fe036","Type":"ContainerDied","Data":"bee725331b7635d2285f07bb5eed214df11f9ceb4b84cc6f587b6e007bbcadf9"}
Jul 30 20:08:07.202764 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:07.202762    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16079fbb-xp477"
Jul 30 20:08:07.202963 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:07.202779    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bee725331b7635d2285f07bb5eed214df11f9ceb4b84cc6f587b6e007bbcadf9"
Jul 30 20:08:08.072197 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:08.072157    2568 patch_prober.go:28] interesting pod/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 30 20:08:08.072649 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:08.072229    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd" podUID="f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 30 20:08:09.076093 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:09.076061    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:08:09.076491 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:09.076448    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:08:09.077361 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:09.077335    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:08:09.457359 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:09.457249    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246"]
Jul 30 20:08:09.457691 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:09.457508    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246" podUID="04a758ae-b65c-4dff-a35f-056011854459" containerName="maas-api" containerID="cri-o://0a99ea2e037fb3e582b75ee8908651a434a41decb8edbce9650f50fd7d051cf4" gracePeriod=30
Jul 30 20:08:09.524749 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:09.523941    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62"]
Jul 30 20:08:09.524749 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:09.524195    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62" podUID="17f5cbd2-db75-4e31-8795-1429025aa5d5" containerName="payload-processing" containerID="cri-o://6057f82183fed55d1e6929b09dcb901a5f79c6a04db84e073582b64a783e511d" gracePeriod=30
Jul 30 20:08:09.536686 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:09.536656    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd"]
Jul 30 20:08:09.536941 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:09.536885    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd" podUID="5a01822b-9846-4e0d-b552-46029a00ca6b" containerName="payload-pre-processing" containerID="cri-o://6ed28652267b089e66e1e70049fb80a3010d2e8a4e499e52ab1731fba69bf09a" gracePeriod=30
Jul 30 20:08:09.667764 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:09.667728    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16079fbb-xp477"]
Jul 30 20:08:09.670248 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:09.670224    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-16079fbb-xp477"]
Jul 30 20:08:09.803647 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:09.803534    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"]
Jul 30 20:08:09.824826 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:09.824644    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62"
Jul 30 20:08:09.849198 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:09.849158    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246"
Jul 30 20:08:09.876537 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:09.876511    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd"
Jul 30 20:08:09.922054 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:09.922012    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pv9nn\" (UniqueName: \"kubernetes.io/projected/17f5cbd2-db75-4e31-8795-1429025aa5d5-kube-api-access-pv9nn\") pod \"17f5cbd2-db75-4e31-8795-1429025aa5d5\" (UID: \"17f5cbd2-db75-4e31-8795-1429025aa5d5\") "
Jul 30 20:08:09.922250 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:09.922101    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17f5cbd2-db75-4e31-8795-1429025aa5d5-plugins-config-volume\") pod \"17f5cbd2-db75-4e31-8795-1429025aa5d5\" (UID: \"17f5cbd2-db75-4e31-8795-1429025aa5d5\") "
Jul 30 20:08:09.923529 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:09.923493    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17f5cbd2-db75-4e31-8795-1429025aa5d5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "17f5cbd2-db75-4e31-8795-1429025aa5d5" (UID: "17f5cbd2-db75-4e31-8795-1429025aa5d5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:08:09.926053 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:09.926028    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17f5cbd2-db75-4e31-8795-1429025aa5d5-kube-api-access-pv9nn" (OuterVolumeSpecName: "kube-api-access-pv9nn") pod "17f5cbd2-db75-4e31-8795-1429025aa5d5" (UID: "17f5cbd2-db75-4e31-8795-1429025aa5d5"). InnerVolumeSpecName "kube-api-access-pv9nn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:08:10.025290 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.025215    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjps4\" (UniqueName: \"kubernetes.io/projected/04a758ae-b65c-4dff-a35f-056011854459-kube-api-access-pjps4\") pod \"04a758ae-b65c-4dff-a35f-056011854459\" (UID: \"04a758ae-b65c-4dff-a35f-056011854459\") "
Jul 30 20:08:10.025290 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.025259    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04a758ae-b65c-4dff-a35f-056011854459-maas-api-tls\") pod \"04a758ae-b65c-4dff-a35f-056011854459\" (UID: \"04a758ae-b65c-4dff-a35f-056011854459\") "
Jul 30 20:08:10.025493 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.025325    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a01822b-9846-4e0d-b552-46029a00ca6b-plugins-config-volume\") pod \"5a01822b-9846-4e0d-b552-46029a00ca6b\" (UID: \"5a01822b-9846-4e0d-b552-46029a00ca6b\") "
Jul 30 20:08:10.025493 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.025366    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04a758ae-b65c-4dff-a35f-056011854459-openshift-service-ca\") pod \"04a758ae-b65c-4dff-a35f-056011854459\" (UID: \"04a758ae-b65c-4dff-a35f-056011854459\") "
Jul 30 20:08:10.025493 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.025397    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhh9q\" (UniqueName: \"kubernetes.io/projected/5a01822b-9846-4e0d-b552-46029a00ca6b-kube-api-access-xhh9q\") pod \"5a01822b-9846-4e0d-b552-46029a00ca6b\" (UID: \"5a01822b-9846-4e0d-b552-46029a00ca6b\") "
Jul 30 20:08:10.025775 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.025739    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04a758ae-b65c-4dff-a35f-056011854459-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "04a758ae-b65c-4dff-a35f-056011854459" (UID: "04a758ae-b65c-4dff-a35f-056011854459"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:08:10.025775 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.025754    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a01822b-9846-4e0d-b552-46029a00ca6b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5a01822b-9846-4e0d-b552-46029a00ca6b" (UID: "5a01822b-9846-4e0d-b552-46029a00ca6b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:08:10.025904 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.025778    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pv9nn\" (UniqueName: \"kubernetes.io/projected/17f5cbd2-db75-4e31-8795-1429025aa5d5-kube-api-access-pv9nn\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:10.025904 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.025798    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/17f5cbd2-db75-4e31-8795-1429025aa5d5-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:10.027388 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.027360    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a01822b-9846-4e0d-b552-46029a00ca6b-kube-api-access-xhh9q" (OuterVolumeSpecName: "kube-api-access-xhh9q") pod "5a01822b-9846-4e0d-b552-46029a00ca6b" (UID: "5a01822b-9846-4e0d-b552-46029a00ca6b"). InnerVolumeSpecName "kube-api-access-xhh9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:08:10.027476 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.027424    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04a758ae-b65c-4dff-a35f-056011854459-kube-api-access-pjps4" (OuterVolumeSpecName: "kube-api-access-pjps4") pod "04a758ae-b65c-4dff-a35f-056011854459" (UID: "04a758ae-b65c-4dff-a35f-056011854459"). InnerVolumeSpecName "kube-api-access-pjps4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:08:10.027525 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.027482    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04a758ae-b65c-4dff-a35f-056011854459-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "04a758ae-b65c-4dff-a35f-056011854459" (UID: "04a758ae-b65c-4dff-a35f-056011854459"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:08:10.126418 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.126387    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjps4\" (UniqueName: \"kubernetes.io/projected/04a758ae-b65c-4dff-a35f-056011854459-kube-api-access-pjps4\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:10.126418 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.126416    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04a758ae-b65c-4dff-a35f-056011854459-maas-api-tls\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:10.126418 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.126425    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a01822b-9846-4e0d-b552-46029a00ca6b-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:10.126860 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.126435    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04a758ae-b65c-4dff-a35f-056011854459-openshift-service-ca\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:10.126860 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.126444    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhh9q\" (UniqueName: \"kubernetes.io/projected/5a01822b-9846-4e0d-b552-46029a00ca6b-kube-api-access-xhh9q\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:10.220373 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.220342    2568 generic.go:356] "Generic (PLEG): container finished" podID="04a758ae-b65c-4dff-a35f-056011854459" containerID="0a99ea2e037fb3e582b75ee8908651a434a41decb8edbce9650f50fd7d051cf4" exitCode=0
Jul 30 20:08:10.220545 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.220386    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246"
Jul 30 20:08:10.220545 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.220433    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246" event={"ID":"04a758ae-b65c-4dff-a35f-056011854459","Type":"ContainerDied","Data":"0a99ea2e037fb3e582b75ee8908651a434a41decb8edbce9650f50fd7d051cf4"}
Jul 30 20:08:10.220545 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.220492    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246" event={"ID":"04a758ae-b65c-4dff-a35f-056011854459","Type":"ContainerDied","Data":"ef86d54f8ca9fffa6cd7a1a47a940e6f60970172f5e8ea43e761fa67d638514b"}
Jul 30 20:08:10.220545 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.220521    2568 scope.go:117] "RemoveContainer" containerID="0a99ea2e037fb3e582b75ee8908651a434a41decb8edbce9650f50fd7d051cf4"
Jul 30 20:08:10.221791 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.221749    2568 generic.go:356] "Generic (PLEG): container finished" podID="17f5cbd2-db75-4e31-8795-1429025aa5d5" containerID="6057f82183fed55d1e6929b09dcb901a5f79c6a04db84e073582b64a783e511d" exitCode=0
Jul 30 20:08:10.221791 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.221776    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62" event={"ID":"17f5cbd2-db75-4e31-8795-1429025aa5d5","Type":"ContainerDied","Data":"6057f82183fed55d1e6929b09dcb901a5f79c6a04db84e073582b64a783e511d"}
Jul 30 20:08:10.222042 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.221809    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62"
Jul 30 20:08:10.222042 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.221818    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62" event={"ID":"17f5cbd2-db75-4e31-8795-1429025aa5d5","Type":"ContainerDied","Data":"69628c299cc657737be36ee680fdc4db26b56878313101c447081425b14ee22e"}
Jul 30 20:08:10.223261 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.223238    2568 generic.go:356] "Generic (PLEG): container finished" podID="5a01822b-9846-4e0d-b552-46029a00ca6b" containerID="6ed28652267b089e66e1e70049fb80a3010d2e8a4e499e52ab1731fba69bf09a" exitCode=0
Jul 30 20:08:10.223372 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.223286    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd"
Jul 30 20:08:10.223372 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.223351    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd" event={"ID":"5a01822b-9846-4e0d-b552-46029a00ca6b","Type":"ContainerDied","Data":"6ed28652267b089e66e1e70049fb80a3010d2e8a4e499e52ab1731fba69bf09a"}
Jul 30 20:08:10.223448 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.223391    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd" event={"ID":"5a01822b-9846-4e0d-b552-46029a00ca6b","Type":"ContainerDied","Data":"f2ac341b1b91d70ff786c59a47ef0ec16040db07db23ef7dd951ca34f96587a2"}
Jul 30 20:08:10.223892 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.223870    2568 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd" secret="" err="secret \"e2e-ait-16079fbb-openshift-default-dockercfg-qf5rd\" not found"
Jul 30 20:08:10.232262 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.232244    2568 scope.go:117] "RemoveContainer" containerID="0a99ea2e037fb3e582b75ee8908651a434a41decb8edbce9650f50fd7d051cf4"
Jul 30 20:08:10.232533 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:08:10.232514    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a99ea2e037fb3e582b75ee8908651a434a41decb8edbce9650f50fd7d051cf4\": container with ID starting with 0a99ea2e037fb3e582b75ee8908651a434a41decb8edbce9650f50fd7d051cf4 not found: ID does not exist" containerID="0a99ea2e037fb3e582b75ee8908651a434a41decb8edbce9650f50fd7d051cf4"
Jul 30 20:08:10.232646 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.232537    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a99ea2e037fb3e582b75ee8908651a434a41decb8edbce9650f50fd7d051cf4"} err="failed to get container status \"0a99ea2e037fb3e582b75ee8908651a434a41decb8edbce9650f50fd7d051cf4\": rpc error: code = NotFound desc = could not find container \"0a99ea2e037fb3e582b75ee8908651a434a41decb8edbce9650f50fd7d051cf4\": container with ID starting with 0a99ea2e037fb3e582b75ee8908651a434a41decb8edbce9650f50fd7d051cf4 not found: ID does not exist"
Jul 30 20:08:10.232646 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.232555    2568 scope.go:117] "RemoveContainer" containerID="6057f82183fed55d1e6929b09dcb901a5f79c6a04db84e073582b64a783e511d"
Jul 30 20:08:10.241467 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.241448    2568 scope.go:117] "RemoveContainer" containerID="6057f82183fed55d1e6929b09dcb901a5f79c6a04db84e073582b64a783e511d"
Jul 30 20:08:10.241779 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:08:10.241750    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6057f82183fed55d1e6929b09dcb901a5f79c6a04db84e073582b64a783e511d\": container with ID starting with 6057f82183fed55d1e6929b09dcb901a5f79c6a04db84e073582b64a783e511d not found: ID does not exist" containerID="6057f82183fed55d1e6929b09dcb901a5f79c6a04db84e073582b64a783e511d"
Jul 30 20:08:10.241886 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.241788    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6057f82183fed55d1e6929b09dcb901a5f79c6a04db84e073582b64a783e511d"} err="failed to get container status \"6057f82183fed55d1e6929b09dcb901a5f79c6a04db84e073582b64a783e511d\": rpc error: code = NotFound desc = could not find container \"6057f82183fed55d1e6929b09dcb901a5f79c6a04db84e073582b64a783e511d\": container with ID starting with 6057f82183fed55d1e6929b09dcb901a5f79c6a04db84e073582b64a783e511d not found: ID does not exist"
Jul 30 20:08:10.241886 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.241811    2568 scope.go:117] "RemoveContainer" containerID="6ed28652267b089e66e1e70049fb80a3010d2e8a4e499e52ab1731fba69bf09a"
Jul 30 20:08:10.249191 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.249169    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246"]
Jul 30 20:08:10.253261 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.253241    2568 scope.go:117] "RemoveContainer" containerID="6ed28652267b089e66e1e70049fb80a3010d2e8a4e499e52ab1731fba69bf09a"
Jul 30 20:08:10.253652 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:08:10.253620    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ed28652267b089e66e1e70049fb80a3010d2e8a4e499e52ab1731fba69bf09a\": container with ID starting with 6ed28652267b089e66e1e70049fb80a3010d2e8a4e499e52ab1731fba69bf09a not found: ID does not exist" containerID="6ed28652267b089e66e1e70049fb80a3010d2e8a4e499e52ab1731fba69bf09a"
Jul 30 20:08:10.253751 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.253659    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ed28652267b089e66e1e70049fb80a3010d2e8a4e499e52ab1731fba69bf09a"} err="failed to get container status \"6ed28652267b089e66e1e70049fb80a3010d2e8a4e499e52ab1731fba69bf09a\": rpc error: code = NotFound desc = could not find container \"6ed28652267b089e66e1e70049fb80a3010d2e8a4e499e52ab1731fba69bf09a\": container with ID starting with 6ed28652267b089e66e1e70049fb80a3010d2e8a4e499e52ab1731fba69bf09a not found: ID does not exist"
Jul 30 20:08:10.255136 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.255096    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16079fbb-65dc7dffd-tf246"]
Jul 30 20:08:10.271228 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.271209    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62"]
Jul 30 20:08:10.282072 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.282016    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-16079fbb-76d5dfc86-vsc62"]
Jul 30 20:08:10.296853 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.296832    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd"]
Jul 30 20:08:10.300682 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.300650    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-16079fbb-6bd8f5b56-scthd"]
Jul 30 20:08:10.793781 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.793741    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"]
Jul 30 20:08:10.794278 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.794256    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4faf6f15-2872-4b36-93d5-62c1d62fe036" containerName="revoke-keys"
Jul 30 20:08:10.794779 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.794599    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4faf6f15-2872-4b36-93d5-62c1d62fe036" containerName="revoke-keys"
Jul 30 20:08:10.794779 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.794637    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a01822b-9846-4e0d-b552-46029a00ca6b" containerName="payload-pre-processing"
Jul 30 20:08:10.794779 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.794647    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a01822b-9846-4e0d-b552-46029a00ca6b" containerName="payload-pre-processing"
Jul 30 20:08:10.794779 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.794658    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f5cbd2-db75-4e31-8795-1429025aa5d5" containerName="payload-processing"
Jul 30 20:08:10.794779 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.794665    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f5cbd2-db75-4e31-8795-1429025aa5d5" containerName="payload-processing"
Jul 30 20:08:10.794779 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.794740    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04a758ae-b65c-4dff-a35f-056011854459" containerName="maas-api"
Jul 30 20:08:10.794779 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.794751    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="04a758ae-b65c-4dff-a35f-056011854459" containerName="maas-api"
Jul 30 20:08:10.795132 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.794881    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="04a758ae-b65c-4dff-a35f-056011854459" containerName="maas-api"
Jul 30 20:08:10.795132 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.794893    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a01822b-9846-4e0d-b552-46029a00ca6b" containerName="payload-pre-processing"
Jul 30 20:08:10.795132 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.794908    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="17f5cbd2-db75-4e31-8795-1429025aa5d5" containerName="payload-processing"
Jul 30 20:08:10.795132 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.794919    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4faf6f15-2872-4b36-93d5-62c1d62fe036" containerName="revoke-keys"
Jul 30 20:08:10.797158 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.797138    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:10.799990 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.799967    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-3cca38ec-gw-openshift-default-dockercfg-qx4h9\""
Jul 30 20:08:10.809457 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.809427    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"]
Jul 30 20:08:10.934897 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.934864    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pc4j\" (UniqueName: \"kubernetes.io/projected/3a070769-1a73-4015-b266-3a997202f4da-kube-api-access-7pc4j\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:10.935087 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.934910    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-istio-envoy\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:10.935087 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.934951    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-workload-certs\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:10.935087 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.935040    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-workload-socket\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:10.935211 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.935121    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a070769-1a73-4015-b266-3a997202f4da-istiod-ca-cert\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:10.935211 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.935152    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-credential-socket\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:10.935211 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.935191    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-istio-data\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:10.935211 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.935209    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a070769-1a73-4015-b266-3a997202f4da-istio-podinfo\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:10.935363 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:10.935236    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a070769-1a73-4015-b266-3a997202f4da-istio-token\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:11.036467 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.036426    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a070769-1a73-4015-b266-3a997202f4da-istiod-ca-cert\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:11.036684 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.036478    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-credential-socket\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:11.036684 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.036517    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-istio-data\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:11.036684 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.036540    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a070769-1a73-4015-b266-3a997202f4da-istio-podinfo\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:11.036684 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.036604    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a070769-1a73-4015-b266-3a997202f4da-istio-token\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:11.036684 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.036673    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pc4j\" (UniqueName: \"kubernetes.io/projected/3a070769-1a73-4015-b266-3a997202f4da-kube-api-access-7pc4j\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:11.036968 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.036710    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-istio-envoy\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:11.036968 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.036750    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-workload-certs\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:11.037083 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.036970    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-credential-socket\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:11.037083 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.037011    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-istio-data\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:11.037083 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.037062    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-workload-socket\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:11.037271 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.037079    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-workload-certs\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:11.037271 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.037248    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a070769-1a73-4015-b266-3a997202f4da-istiod-ca-cert\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:11.037385 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.037348    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-workload-socket\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:11.039074 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.039049    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-istio-envoy\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:11.039178 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.039106    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a070769-1a73-4015-b266-3a997202f4da-istio-podinfo\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:11.049078 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.049015    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a070769-1a73-4015-b266-3a997202f4da-istio-token\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:11.049176 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.049130    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pc4j\" (UniqueName: \"kubernetes.io/projected/3a070769-1a73-4015-b266-3a997202f4da-kube-api-access-7pc4j\") pod \"e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") " pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:11.109754 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.109721    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:11.235536 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.235500    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd" podUID="f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" containerName="istio-proxy" containerID="cri-o://16e1a6802004e8efb9a49e3503084e4f0c4b70aa508943a88142ef48e23e2246" gracePeriod=30
Jul 30 20:08:11.251196 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.251171    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"]
Jul 30 20:08:11.252290 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:08:11.252265    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a070769_1a73_4015_b266_3a997202f4da.slice/crio-bce69324512425a85d8100cb0a600635d582dc270b125bdf672db28a5c68028d WatchSource:0}: Error finding container bce69324512425a85d8100cb0a600635d582dc270b125bdf672db28a5c68028d: Status 404 returned error can't find the container with id bce69324512425a85d8100cb0a600635d582dc270b125bdf672db28a5c68028d
Jul 30 20:08:11.254353 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.254325    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:08:11.254432 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.254380    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:08:11.254432 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.254412    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:08:11.485043 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.485011    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04a758ae-b65c-4dff-a35f-056011854459" path="/var/lib/kubelet/pods/04a758ae-b65c-4dff-a35f-056011854459/volumes"
Jul 30 20:08:11.485416 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.485401    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17f5cbd2-db75-4e31-8795-1429025aa5d5" path="/var/lib/kubelet/pods/17f5cbd2-db75-4e31-8795-1429025aa5d5/volumes"
Jul 30 20:08:11.485745 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.485729    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4faf6f15-2872-4b36-93d5-62c1d62fe036" path="/var/lib/kubelet/pods/4faf6f15-2872-4b36-93d5-62c1d62fe036/volumes"
Jul 30 20:08:11.486074 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:11.486040    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a01822b-9846-4e0d-b552-46029a00ca6b" path="/var/lib/kubelet/pods/5a01822b-9846-4e0d-b552-46029a00ca6b/volumes"
Jul 30 20:08:12.243922 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:12.243882    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj" event={"ID":"3a070769-1a73-4015-b266-3a997202f4da","Type":"ContainerStarted","Data":"d3b127e81c0d5f84fac9b77a6d38c01cb6de876983c59de30ab0dc99ba3acb25"}
Jul 30 20:08:12.244364 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:12.243979    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj" event={"ID":"3a070769-1a73-4015-b266-3a997202f4da","Type":"ContainerStarted","Data":"bce69324512425a85d8100cb0a600635d582dc270b125bdf672db28a5c68028d"}
Jul 30 20:08:12.263934 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:12.263882    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj" podStartSLOduration=2.263866903 podStartE2EDuration="2.263866903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:08:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:08:12.262765266 +0000 UTC m=+1713.362846454" watchObservedRunningTime="2026-07-30 20:08:12.263866903 +0000 UTC m=+1713.363948139"
Jul 30 20:08:13.110029 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:13.109992    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:13.114854 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:13.114827    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:13.250631 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:13.250590    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:13.251457 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:13.251437    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:13.791288 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:13.791254    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm"]
Jul 30 20:08:13.794913 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:13.794893    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm"
Jul 30 20:08:13.797294 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:13.797273    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-3cca38ec-serving-cert\""
Jul 30 20:08:13.804584 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:13.804352    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm"]
Jul 30 20:08:13.864142 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:13.864106    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc2fa95d-08dc-4c0d-a287-564fda5047d7-maas-api-tls\") pod \"maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm\" (UID: \"dc2fa95d-08dc-4c0d-a287-564fda5047d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm"
Jul 30 20:08:13.864142 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:13.864143    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc2fa95d-08dc-4c0d-a287-564fda5047d7-openshift-service-ca\") pod \"maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm\" (UID: \"dc2fa95d-08dc-4c0d-a287-564fda5047d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm"
Jul 30 20:08:13.864360 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:13.864161    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz89b\" (UniqueName: \"kubernetes.io/projected/dc2fa95d-08dc-4c0d-a287-564fda5047d7-kube-api-access-tz89b\") pod \"maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm\" (UID: \"dc2fa95d-08dc-4c0d-a287-564fda5047d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm"
Jul 30 20:08:13.965813 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:13.965779    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc2fa95d-08dc-4c0d-a287-564fda5047d7-maas-api-tls\") pod \"maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm\" (UID: \"dc2fa95d-08dc-4c0d-a287-564fda5047d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm"
Jul 30 20:08:13.965999 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:13.965825    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc2fa95d-08dc-4c0d-a287-564fda5047d7-openshift-service-ca\") pod \"maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm\" (UID: \"dc2fa95d-08dc-4c0d-a287-564fda5047d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm"
Jul 30 20:08:13.965999 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:13.965850    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz89b\" (UniqueName: \"kubernetes.io/projected/dc2fa95d-08dc-4c0d-a287-564fda5047d7-kube-api-access-tz89b\") pod \"maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm\" (UID: \"dc2fa95d-08dc-4c0d-a287-564fda5047d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm"
Jul 30 20:08:13.966579 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:13.966549    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc2fa95d-08dc-4c0d-a287-564fda5047d7-openshift-service-ca\") pod \"maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm\" (UID: \"dc2fa95d-08dc-4c0d-a287-564fda5047d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm"
Jul 30 20:08:13.968257 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:13.968238    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc2fa95d-08dc-4c0d-a287-564fda5047d7-maas-api-tls\") pod \"maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm\" (UID: \"dc2fa95d-08dc-4c0d-a287-564fda5047d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm"
Jul 30 20:08:13.973439 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:13.973413    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz89b\" (UniqueName: \"kubernetes.io/projected/dc2fa95d-08dc-4c0d-a287-564fda5047d7-kube-api-access-tz89b\") pod \"maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm\" (UID: \"dc2fa95d-08dc-4c0d-a287-564fda5047d7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm"
Jul 30 20:08:14.111111 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.111075    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm"
Jul 30 20:08:14.275481 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.275456    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm"]
Jul 30 20:08:14.277375 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:08:14.277352    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc2fa95d_08dc_4c0d_a287_564fda5047d7.slice/crio-da874e6eecec352c9373bee4383818da28323c23e85ad672f54f7b039505a559 WatchSource:0}: Error finding container da874e6eecec352c9373bee4383818da28323c23e85ad672f54f7b039505a559: Status 404 returned error can't find the container with id da874e6eecec352c9373bee4383818da28323c23e85ad672f54f7b039505a559
Jul 30 20:08:14.466464 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.466370    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz"]
Jul 30 20:08:14.469840 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.469818    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz"
Jul 30 20:08:14.472391 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.472338    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-3cca38ec-dockercfg-9p4x7\""
Jul 30 20:08:14.472391 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.472340    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-3cca38ec\""
Jul 30 20:08:14.478953 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.478921    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz"]
Jul 30 20:08:14.489819 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.489796    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4"]
Jul 30 20:08:14.492675 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.492651    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4"
Jul 30 20:08:14.504972 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.504948    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4"]
Jul 30 20:08:14.572259 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.571901    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ce2cf0c-ad1a-44d9-b181-ce3557c226bc-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4\" (UID: \"6ce2cf0c-ad1a-44d9-b181-ce3557c226bc\") " pod="openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4"
Jul 30 20:08:14.572259 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.571967    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5nk9\" (UniqueName: \"kubernetes.io/projected/3adde882-f9e7-4a1c-946e-3126ce741190-kube-api-access-n5nk9\") pod \"payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz\" (UID: \"3adde882-f9e7-4a1c-946e-3126ce741190\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz"
Jul 30 20:08:14.572259 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.572119    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k4mr\" (UniqueName: \"kubernetes.io/projected/6ce2cf0c-ad1a-44d9-b181-ce3557c226bc-kube-api-access-2k4mr\") pod \"payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4\" (UID: \"6ce2cf0c-ad1a-44d9-b181-ce3557c226bc\") " pod="openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4"
Jul 30 20:08:14.572259 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.572162    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3adde882-f9e7-4a1c-946e-3126ce741190-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz\" (UID: \"3adde882-f9e7-4a1c-946e-3126ce741190\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz"
Jul 30 20:08:14.673449 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.673404    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k4mr\" (UniqueName: \"kubernetes.io/projected/6ce2cf0c-ad1a-44d9-b181-ce3557c226bc-kube-api-access-2k4mr\") pod \"payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4\" (UID: \"6ce2cf0c-ad1a-44d9-b181-ce3557c226bc\") " pod="openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4"
Jul 30 20:08:14.673680 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.673464    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3adde882-f9e7-4a1c-946e-3126ce741190-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz\" (UID: \"3adde882-f9e7-4a1c-946e-3126ce741190\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz"
Jul 30 20:08:14.673680 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.673518    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ce2cf0c-ad1a-44d9-b181-ce3557c226bc-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4\" (UID: \"6ce2cf0c-ad1a-44d9-b181-ce3557c226bc\") " pod="openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4"
Jul 30 20:08:14.673680 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.673543    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5nk9\" (UniqueName: \"kubernetes.io/projected/3adde882-f9e7-4a1c-946e-3126ce741190-kube-api-access-n5nk9\") pod \"payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz\" (UID: \"3adde882-f9e7-4a1c-946e-3126ce741190\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz"
Jul 30 20:08:14.674265 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.674241    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3adde882-f9e7-4a1c-946e-3126ce741190-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz\" (UID: \"3adde882-f9e7-4a1c-946e-3126ce741190\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz"
Jul 30 20:08:14.674321 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.674301    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ce2cf0c-ad1a-44d9-b181-ce3557c226bc-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4\" (UID: \"6ce2cf0c-ad1a-44d9-b181-ce3557c226bc\") " pod="openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4"
Jul 30 20:08:14.680975 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.680951    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5nk9\" (UniqueName: \"kubernetes.io/projected/3adde882-f9e7-4a1c-946e-3126ce741190-kube-api-access-n5nk9\") pod \"payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz\" (UID: \"3adde882-f9e7-4a1c-946e-3126ce741190\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz"
Jul 30 20:08:14.681080 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.681007    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k4mr\" (UniqueName: \"kubernetes.io/projected/6ce2cf0c-ad1a-44d9-b181-ce3557c226bc-kube-api-access-2k4mr\") pod \"payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4\" (UID: \"6ce2cf0c-ad1a-44d9-b181-ce3557c226bc\") " pod="openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4"
Jul 30 20:08:14.783321 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.783234    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz"
Jul 30 20:08:14.804042 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:14.804008    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4"
Jul 30 20:08:15.142978 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:15.142935    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz"]
Jul 30 20:08:15.145965 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:08:15.145908    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3adde882_f9e7_4a1c_946e_3126ce741190.slice/crio-fa2281eee8a90508b0ca7eb165b13f33cb3344954d95ff10a1487c6e1a355f0a WatchSource:0}: Error finding container fa2281eee8a90508b0ca7eb165b13f33cb3344954d95ff10a1487c6e1a355f0a: Status 404 returned error can't find the container with id fa2281eee8a90508b0ca7eb165b13f33cb3344954d95ff10a1487c6e1a355f0a
Jul 30 20:08:15.176067 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:15.176046    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4"]
Jul 30 20:08:15.183794 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:08:15.183770    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce2cf0c_ad1a_44d9_b181_ce3557c226bc.slice/crio-e39e3ed24c3c89c161a0476985b2e853a6ee78bc543b256d3d5760af18dd6466 WatchSource:0}: Error finding container e39e3ed24c3c89c161a0476985b2e853a6ee78bc543b256d3d5760af18dd6466: Status 404 returned error can't find the container with id e39e3ed24c3c89c161a0476985b2e853a6ee78bc543b256d3d5760af18dd6466
Jul 30 20:08:15.273099 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:15.273051    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm" event={"ID":"dc2fa95d-08dc-4c0d-a287-564fda5047d7","Type":"ContainerStarted","Data":"3cd48d3136dea8f39eddf1d41909ab176407f84dac6920f0532ac849169d2543"}
Jul 30 20:08:15.273308 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:15.273283    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm"
Jul 30 20:08:15.273440 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:15.273345    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm" event={"ID":"dc2fa95d-08dc-4c0d-a287-564fda5047d7","Type":"ContainerStarted","Data":"da874e6eecec352c9373bee4383818da28323c23e85ad672f54f7b039505a559"}
Jul 30 20:08:15.274836 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:15.274805    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4" event={"ID":"6ce2cf0c-ad1a-44d9-b181-ce3557c226bc","Type":"ContainerStarted","Data":"691f483a1e9df43f7f7a6a290a23ca6d8c038ad022ac2da3d7bdd1df1c1c6b0f"}
Jul 30 20:08:15.274949 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:15.274847    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4" event={"ID":"6ce2cf0c-ad1a-44d9-b181-ce3557c226bc","Type":"ContainerStarted","Data":"e39e3ed24c3c89c161a0476985b2e853a6ee78bc543b256d3d5760af18dd6466"}
Jul 30 20:08:15.274949 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:15.274915    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4"
Jul 30 20:08:15.276610 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:15.276587    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz" event={"ID":"3adde882-f9e7-4a1c-946e-3126ce741190","Type":"ContainerStarted","Data":"f8b849cfa431aaabdd6cbee60de55ae20a001827e708312653e12d38c4b047e8"}
Jul 30 20:08:15.276993 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:15.276632    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz" event={"ID":"3adde882-f9e7-4a1c-946e-3126ce741190","Type":"ContainerStarted","Data":"fa2281eee8a90508b0ca7eb165b13f33cb3344954d95ff10a1487c6e1a355f0a"}
Jul 30 20:08:15.291004 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:15.290914    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm" podStartSLOduration=1.5777143279999999 podStartE2EDuration="2.290900327s" totalImagesPullingTime="713.185999ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:08:15.288099379 +0000 UTC m=+1716.388180568" watchObservedRunningTime="2026-07-30 20:08:15.290900327 +0000 UTC m=+1716.390981521"
Jul 30 20:08:15.303991 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:15.303947    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4" podStartSLOduration=1.303933322 podStartE2EDuration="1.303933322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:08:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:08:15.302542837 +0000 UTC m=+1716.402624025" watchObservedRunningTime="2026-07-30 20:08:15.303933322 +0000 UTC m=+1716.404014508"
Jul 30 20:08:15.315803 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:15.315750    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz" podStartSLOduration=1.3157329660000001 podStartE2EDuration="1.315732966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:08:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:08:15.315356812 +0000 UTC m=+1716.415437998" watchObservedRunningTime="2026-07-30 20:08:15.315732966 +0000 UTC m=+1716.415814155"
Jul 30 20:08:16.282192 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.282162    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz"
Jul 30 20:08:16.503599 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.503523    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:08:16.592547 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.592515    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-credential-socket\") pod \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") "
Jul 30 20:08:16.592725 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.592591    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-data\") pod \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") "
Jul 30 20:08:16.592725 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.592679    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-podinfo\") pod \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") "
Jul 30 20:08:16.592725 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.592713    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-workload-socket\") pod \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") "
Jul 30 20:08:16.592893 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.592743    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2v6t\" (UniqueName: \"kubernetes.io/projected/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-kube-api-access-m2v6t\") pod \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") "
Jul 30 20:08:16.592893 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.592819    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istiod-ca-cert\") pod \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") "
Jul 30 20:08:16.592893 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.592840    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" (UID: "f42cc58d-7ff5-4b62-a1e0-f28de790a8d6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:08:16.592893 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.592881    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-workload-certs\") pod \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") "
Jul 30 20:08:16.593099 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.592907    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-envoy\") pod \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") "
Jul 30 20:08:16.593099 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.592961    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-token\") pod \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\" (UID: \"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6\") "
Jul 30 20:08:16.593099 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.592963    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" (UID: "f42cc58d-7ff5-4b62-a1e0-f28de790a8d6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:08:16.593265 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.593103    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" (UID: "f42cc58d-7ff5-4b62-a1e0-f28de790a8d6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:08:16.593265 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.593182    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" (UID: "f42cc58d-7ff5-4b62-a1e0-f28de790a8d6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:08:16.593412 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.593391    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istiod-ca-cert\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:16.593472 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.593418    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-workload-certs\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:16.593472 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.593431    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-credential-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:16.593472 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.593445    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-workload-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:16.593656 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.593617    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-data" (OuterVolumeSpecName: "istio-data") pod "f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" (UID: "f42cc58d-7ff5-4b62-a1e0-f28de790a8d6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:08:16.595005 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.594980    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" (UID: "f42cc58d-7ff5-4b62-a1e0-f28de790a8d6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:08:16.595130 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.595020    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" (UID: "f42cc58d-7ff5-4b62-a1e0-f28de790a8d6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 20:08:16.595130 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.595031    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-kube-api-access-m2v6t" (OuterVolumeSpecName: "kube-api-access-m2v6t") pod "f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" (UID: "f42cc58d-7ff5-4b62-a1e0-f28de790a8d6"). InnerVolumeSpecName "kube-api-access-m2v6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:08:16.595130 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.595065    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-token" (OuterVolumeSpecName: "istio-token") pod "f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" (UID: "f42cc58d-7ff5-4b62-a1e0-f28de790a8d6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:08:16.694527 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.694489    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-data\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:16.694527 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.694523    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-podinfo\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:16.694784 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.694535    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2v6t\" (UniqueName: \"kubernetes.io/projected/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-kube-api-access-m2v6t\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:16.694784 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.694549    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-envoy\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:16.694784 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:16.694588    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6-istio-token\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:17.289056 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:17.289027    2568 generic.go:356] "Generic (PLEG): container finished" podID="f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" containerID="16e1a6802004e8efb9a49e3503084e4f0c4b70aa508943a88142ef48e23e2246" exitCode=0
Jul 30 20:08:17.289579 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:17.289077    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"
Jul 30 20:08:17.289579 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:17.289115    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd" event={"ID":"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6","Type":"ContainerDied","Data":"16e1a6802004e8efb9a49e3503084e4f0c4b70aa508943a88142ef48e23e2246"}
Jul 30 20:08:17.289579 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:17.289170    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd" event={"ID":"f42cc58d-7ff5-4b62-a1e0-f28de790a8d6","Type":"ContainerDied","Data":"1ba860b038f2bb17f2c403f801234aba1019cd22aec06a7495636e6b05b78283"}
Jul 30 20:08:17.289579 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:17.289195    2568 scope.go:117] "RemoveContainer" containerID="16e1a6802004e8efb9a49e3503084e4f0c4b70aa508943a88142ef48e23e2246"
Jul 30 20:08:17.300160 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:17.300142    2568 scope.go:117] "RemoveContainer" containerID="a18845123ede235b89ac2f1363a231f92d20210ba95264af0799fa481345ffe0"
Jul 30 20:08:17.309540 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:17.309508    2568 scope.go:117] "RemoveContainer" containerID="16e1a6802004e8efb9a49e3503084e4f0c4b70aa508943a88142ef48e23e2246"
Jul 30 20:08:17.309868 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:08:17.309834    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16e1a6802004e8efb9a49e3503084e4f0c4b70aa508943a88142ef48e23e2246\": container with ID starting with 16e1a6802004e8efb9a49e3503084e4f0c4b70aa508943a88142ef48e23e2246 not found: ID does not exist" containerID="16e1a6802004e8efb9a49e3503084e4f0c4b70aa508943a88142ef48e23e2246"
Jul 30 20:08:17.310019 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:17.309879    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16e1a6802004e8efb9a49e3503084e4f0c4b70aa508943a88142ef48e23e2246"} err="failed to get container status \"16e1a6802004e8efb9a49e3503084e4f0c4b70aa508943a88142ef48e23e2246\": rpc error: code = NotFound desc = could not find container \"16e1a6802004e8efb9a49e3503084e4f0c4b70aa508943a88142ef48e23e2246\": container with ID starting with 16e1a6802004e8efb9a49e3503084e4f0c4b70aa508943a88142ef48e23e2246 not found: ID does not exist"
Jul 30 20:08:17.310019 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:17.309906    2568 scope.go:117] "RemoveContainer" containerID="a18845123ede235b89ac2f1363a231f92d20210ba95264af0799fa481345ffe0"
Jul 30 20:08:17.310167 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:08:17.310150    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a18845123ede235b89ac2f1363a231f92d20210ba95264af0799fa481345ffe0\": container with ID starting with a18845123ede235b89ac2f1363a231f92d20210ba95264af0799fa481345ffe0 not found: ID does not exist" containerID="a18845123ede235b89ac2f1363a231f92d20210ba95264af0799fa481345ffe0"
Jul 30 20:08:17.310207 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:17.310173    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a18845123ede235b89ac2f1363a231f92d20210ba95264af0799fa481345ffe0"} err="failed to get container status \"a18845123ede235b89ac2f1363a231f92d20210ba95264af0799fa481345ffe0\": rpc error: code = NotFound desc = could not find container \"a18845123ede235b89ac2f1363a231f92d20210ba95264af0799fa481345ffe0\": container with ID starting with a18845123ede235b89ac2f1363a231f92d20210ba95264af0799fa481345ffe0 not found: ID does not exist"
Jul 30 20:08:17.313917 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:17.313897    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"]
Jul 30 20:08:17.316879 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:17.316858    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-16079fbb-openshift-default-c6c9fdb46-6lrqd"]
Jul 30 20:08:17.485786 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:17.483301    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" path="/var/lib/kubelet/pods/f42cc58d-7ff5-4b62-a1e0-f28de790a8d6/volumes"
Jul 30 20:08:21.288162 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:21.288132    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm"
Jul 30 20:08:26.284448 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:26.284418    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4"
Jul 30 20:08:27.292237 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:27.292207    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz"
Jul 30 20:08:28.252862 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:28.252785    2568 patch_prober.go:28] interesting pod/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 30 20:08:28.253036 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:28.252856    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj" podUID="3a070769-1a73-4015-b266-3a997202f4da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 30 20:08:28.360297 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:28.360267    2568 generic.go:356] "Generic (PLEG): container finished" podID="3a070769-1a73-4015-b266-3a997202f4da" containerID="d3b127e81c0d5f84fac9b77a6d38c01cb6de876983c59de30ab0dc99ba3acb25" exitCode=0
Jul 30 20:08:28.360667 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:28.360332    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj" event={"ID":"3a070769-1a73-4015-b266-3a997202f4da","Type":"ContainerDied","Data":"d3b127e81c0d5f84fac9b77a6d38c01cb6de876983c59de30ab0dc99ba3acb25"}
Jul 30 20:08:28.360726 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:28.360711    2568 scope.go:117] "RemoveContainer" containerID="d3b127e81c0d5f84fac9b77a6d38c01cb6de876983c59de30ab0dc99ba3acb25"
Jul 30 20:08:28.361767 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:28.361737    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:08:28.361829 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:28.361810    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:08:28.361869 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:28.361840    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:08:29.370731 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:29.370689    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj" event={"ID":"3a070769-1a73-4015-b266-3a997202f4da","Type":"ContainerStarted","Data":"7c8ca2bed56fad2fa86ad0ad5966b23babbc5d57ffea829cca91cfffbf769ee8"}
Jul 30 20:08:30.110709 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:30.110673    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:30.110915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:30.110892    2568 patch_prober.go:28] interesting pod/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 30 20:08:30.110977 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:30.110955    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj" podUID="3a070769-1a73-4015-b266-3a997202f4da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 30 20:08:31.110971 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:31.110937    2568 patch_prober.go:28] interesting pod/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 30 20:08:31.111355 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:31.110998    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj" podUID="3a070769-1a73-4015-b266-3a997202f4da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 30 20:08:32.110903 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:32.110870    2568 patch_prober.go:28] interesting pod/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 30 20:08:32.111077 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:32.110923    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj" podUID="3a070769-1a73-4015-b266-3a997202f4da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 30 20:08:33.110191 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:33.110154    2568 patch_prober.go:28] interesting pod/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 30 20:08:33.110373 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:33.110212    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj" podUID="3a070769-1a73-4015-b266-3a997202f4da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 30 20:08:34.114377 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:34.114345    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:34.114784 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:34.114615    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:34.115273 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:34.115256    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:38.765012 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:38.764979    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3cca38ec-xkpmv"]
Jul 30 20:08:38.765486 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:38.765473    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" containerName="istio-proxy"
Jul 30 20:08:38.765486 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:38.765487    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" containerName="istio-proxy"
Jul 30 20:08:38.765619 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:38.765595    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" containerName="istio-proxy"
Jul 30 20:08:38.769042 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:38.769019    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3cca38ec-xkpmv"
Jul 30 20:08:38.772231 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:38.772179    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mgdxn\""
Jul 30 20:08:38.775393 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:38.775372    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3cca38ec-xkpmv"]
Jul 30 20:08:38.931742 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:38.931699    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65eba931-ec44-488a-970f-4b6b826b4bc2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3cca38ec-xkpmv\" (UID: \"65eba931-ec44-488a-970f-4b6b826b4bc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3cca38ec-xkpmv"
Jul 30 20:08:39.033543 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:39.033453    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65eba931-ec44-488a-970f-4b6b826b4bc2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3cca38ec-xkpmv\" (UID: \"65eba931-ec44-488a-970f-4b6b826b4bc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3cca38ec-xkpmv"
Jul 30 20:08:39.034118 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:39.034093    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65eba931-ec44-488a-970f-4b6b826b4bc2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3cca38ec-xkpmv\" (UID: \"65eba931-ec44-488a-970f-4b6b826b4bc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3cca38ec-xkpmv"
Jul 30 20:08:39.081544 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:39.081516    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3cca38ec-xkpmv"
Jul 30 20:08:39.219700 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:39.219675    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3cca38ec-xkpmv"]
Jul 30 20:08:39.222186 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:08:39.222159    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65eba931_ec44_488a_970f_4b6b826b4bc2.slice/crio-4d13e293120c0fc04b18ee168529d25c99a975b2396a913c17b0c158bfdd585f WatchSource:0}: Error finding container 4d13e293120c0fc04b18ee168529d25c99a975b2396a913c17b0c158bfdd585f: Status 404 returned error can't find the container with id 4d13e293120c0fc04b18ee168529d25c99a975b2396a913c17b0c158bfdd585f
Jul 30 20:08:39.432537 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:39.432501    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3cca38ec-xkpmv" event={"ID":"65eba931-ec44-488a-970f-4b6b826b4bc2","Type":"ContainerStarted","Data":"4d13e293120c0fc04b18ee168529d25c99a975b2396a913c17b0c158bfdd585f"}
Jul 30 20:08:40.439816 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:40.439783    2568 generic.go:356] "Generic (PLEG): container finished" podID="65eba931-ec44-488a-970f-4b6b826b4bc2" containerID="046b0064ee8577f6e4eed8ed5251a290dbdf9117fcd06fe77d144542167b9405" exitCode=0
Jul 30 20:08:40.440237 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:40.439865    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3cca38ec-xkpmv" event={"ID":"65eba931-ec44-488a-970f-4b6b826b4bc2","Type":"ContainerDied","Data":"046b0064ee8577f6e4eed8ed5251a290dbdf9117fcd06fe77d144542167b9405"}
Jul 30 20:08:41.584869 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:41.584845    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3cca38ec-xkpmv"
Jul 30 20:08:41.763826 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:41.763737    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65eba931-ec44-488a-970f-4b6b826b4bc2-maas-api-service-ca\") pod \"65eba931-ec44-488a-970f-4b6b826b4bc2\" (UID: \"65eba931-ec44-488a-970f-4b6b826b4bc2\") "
Jul 30 20:08:41.764179 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:41.764150    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65eba931-ec44-488a-970f-4b6b826b4bc2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "65eba931-ec44-488a-970f-4b6b826b4bc2" (UID: "65eba931-ec44-488a-970f-4b6b826b4bc2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:08:41.865134 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:41.865102    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65eba931-ec44-488a-970f-4b6b826b4bc2-maas-api-service-ca\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:42.451559 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:42.451519    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3cca38ec-xkpmv" event={"ID":"65eba931-ec44-488a-970f-4b6b826b4bc2","Type":"ContainerDied","Data":"4d13e293120c0fc04b18ee168529d25c99a975b2396a913c17b0c158bfdd585f"}
Jul 30 20:08:42.451823 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:42.451606    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d13e293120c0fc04b18ee168529d25c99a975b2396a913c17b0c158bfdd585f"
Jul 30 20:08:42.451823 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:42.451612    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3cca38ec-xkpmv"
Jul 30 20:08:45.189848 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.189096    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm"]
Jul 30 20:08:45.189848 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.189310    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm" podUID="dc2fa95d-08dc-4c0d-a287-564fda5047d7" containerName="maas-api" containerID="cri-o://3cd48d3136dea8f39eddf1d41909ab176407f84dac6920f0532ac849169d2543" gracePeriod=30
Jul 30 20:08:45.253609 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.253130    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4"]
Jul 30 20:08:45.253609 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.253360    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4" podUID="6ce2cf0c-ad1a-44d9-b181-ce3557c226bc" containerName="payload-processing" containerID="cri-o://691f483a1e9df43f7f7a6a290a23ca6d8c038ad022ac2da3d7bdd1df1c1c6b0f" gracePeriod=30
Jul 30 20:08:45.256608 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.256546    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz"]
Jul 30 20:08:45.256805 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.256778    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz" podUID="3adde882-f9e7-4a1c-946e-3126ce741190" containerName="payload-pre-processing" containerID="cri-o://f8b849cfa431aaabdd6cbee60de55ae20a001827e708312653e12d38c4b047e8" gracePeriod=30
Jul 30 20:08:45.384477 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.384431    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3cca38ec-xkpmv"]
Jul 30 20:08:45.387184 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.387150    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3cca38ec-xkpmv"]
Jul 30 20:08:45.474701 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.474662    2568 generic.go:356] "Generic (PLEG): container finished" podID="dc2fa95d-08dc-4c0d-a287-564fda5047d7" containerID="3cd48d3136dea8f39eddf1d41909ab176407f84dac6920f0532ac849169d2543" exitCode=0
Jul 30 20:08:45.477069 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.477042    2568 generic.go:356] "Generic (PLEG): container finished" podID="6ce2cf0c-ad1a-44d9-b181-ce3557c226bc" containerID="691f483a1e9df43f7f7a6a290a23ca6d8c038ad022ac2da3d7bdd1df1c1c6b0f" exitCode=0
Jul 30 20:08:45.479323 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.479231    2568 generic.go:356] "Generic (PLEG): container finished" podID="3adde882-f9e7-4a1c-946e-3126ce741190" containerID="f8b849cfa431aaabdd6cbee60de55ae20a001827e708312653e12d38c4b047e8" exitCode=0
Jul 30 20:08:45.482753 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.482731    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65eba931-ec44-488a-970f-4b6b826b4bc2" path="/var/lib/kubelet/pods/65eba931-ec44-488a-970f-4b6b826b4bc2/volumes"
Jul 30 20:08:45.483035 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.483016    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm" event={"ID":"dc2fa95d-08dc-4c0d-a287-564fda5047d7","Type":"ContainerDied","Data":"3cd48d3136dea8f39eddf1d41909ab176407f84dac6920f0532ac849169d2543"}
Jul 30 20:08:45.483079 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.483063    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4" event={"ID":"6ce2cf0c-ad1a-44d9-b181-ce3557c226bc","Type":"ContainerDied","Data":"691f483a1e9df43f7f7a6a290a23ca6d8c038ad022ac2da3d7bdd1df1c1c6b0f"}
Jul 30 20:08:45.483118 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.483082    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz" event={"ID":"3adde882-f9e7-4a1c-946e-3126ce741190","Type":"ContainerDied","Data":"f8b849cfa431aaabdd6cbee60de55ae20a001827e708312653e12d38c4b047e8"}
Jul 30 20:08:45.520356 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.520323    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"]
Jul 30 20:08:45.520798 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.520762    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj" podUID="3a070769-1a73-4015-b266-3a997202f4da" containerName="istio-proxy" containerID="cri-o://7c8ca2bed56fad2fa86ad0ad5966b23babbc5d57ffea829cca91cfffbf769ee8" gracePeriod=30
Jul 30 20:08:45.538589 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.538545    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm"
Jul 30 20:08:45.564855 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.564827    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz"
Jul 30 20:08:45.569738 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.569713    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4"
Jul 30 20:08:45.606411 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.606384    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc2fa95d-08dc-4c0d-a287-564fda5047d7-maas-api-tls\") pod \"dc2fa95d-08dc-4c0d-a287-564fda5047d7\" (UID: \"dc2fa95d-08dc-4c0d-a287-564fda5047d7\") "
Jul 30 20:08:45.606589 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.606425    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc2fa95d-08dc-4c0d-a287-564fda5047d7-openshift-service-ca\") pod \"dc2fa95d-08dc-4c0d-a287-564fda5047d7\" (UID: \"dc2fa95d-08dc-4c0d-a287-564fda5047d7\") "
Jul 30 20:08:45.606589 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.606506    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2k4mr\" (UniqueName: \"kubernetes.io/projected/6ce2cf0c-ad1a-44d9-b181-ce3557c226bc-kube-api-access-2k4mr\") pod \"6ce2cf0c-ad1a-44d9-b181-ce3557c226bc\" (UID: \"6ce2cf0c-ad1a-44d9-b181-ce3557c226bc\") "
Jul 30 20:08:45.606589 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.606532    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ce2cf0c-ad1a-44d9-b181-ce3557c226bc-plugins-config-volume\") pod \"6ce2cf0c-ad1a-44d9-b181-ce3557c226bc\" (UID: \"6ce2cf0c-ad1a-44d9-b181-ce3557c226bc\") "
Jul 30 20:08:45.606776 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.606642    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3adde882-f9e7-4a1c-946e-3126ce741190-plugins-config-volume\") pod \"3adde882-f9e7-4a1c-946e-3126ce741190\" (UID: \"3adde882-f9e7-4a1c-946e-3126ce741190\") "
Jul 30 20:08:45.606776 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.606695    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tz89b\" (UniqueName: \"kubernetes.io/projected/dc2fa95d-08dc-4c0d-a287-564fda5047d7-kube-api-access-tz89b\") pod \"dc2fa95d-08dc-4c0d-a287-564fda5047d7\" (UID: \"dc2fa95d-08dc-4c0d-a287-564fda5047d7\") "
Jul 30 20:08:45.606776 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.606718    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5nk9\" (UniqueName: \"kubernetes.io/projected/3adde882-f9e7-4a1c-946e-3126ce741190-kube-api-access-n5nk9\") pod \"3adde882-f9e7-4a1c-946e-3126ce741190\" (UID: \"3adde882-f9e7-4a1c-946e-3126ce741190\") "
Jul 30 20:08:45.606937 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.606919    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc2fa95d-08dc-4c0d-a287-564fda5047d7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dc2fa95d-08dc-4c0d-a287-564fda5047d7" (UID: "dc2fa95d-08dc-4c0d-a287-564fda5047d7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:08:45.607347 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.607169    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc2fa95d-08dc-4c0d-a287-564fda5047d7-openshift-service-ca\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:45.607477 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.607435    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ce2cf0c-ad1a-44d9-b181-ce3557c226bc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6ce2cf0c-ad1a-44d9-b181-ce3557c226bc" (UID: "6ce2cf0c-ad1a-44d9-b181-ce3557c226bc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:08:45.607799 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.607758    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3adde882-f9e7-4a1c-946e-3126ce741190-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3adde882-f9e7-4a1c-946e-3126ce741190" (UID: "3adde882-f9e7-4a1c-946e-3126ce741190"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:08:45.609443 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.609411    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3adde882-f9e7-4a1c-946e-3126ce741190-kube-api-access-n5nk9" (OuterVolumeSpecName: "kube-api-access-n5nk9") pod "3adde882-f9e7-4a1c-946e-3126ce741190" (UID: "3adde882-f9e7-4a1c-946e-3126ce741190"). InnerVolumeSpecName "kube-api-access-n5nk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:08:45.609612 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.609594    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc2fa95d-08dc-4c0d-a287-564fda5047d7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dc2fa95d-08dc-4c0d-a287-564fda5047d7" (UID: "dc2fa95d-08dc-4c0d-a287-564fda5047d7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:08:45.609729 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.609710    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ce2cf0c-ad1a-44d9-b181-ce3557c226bc-kube-api-access-2k4mr" (OuterVolumeSpecName: "kube-api-access-2k4mr") pod "6ce2cf0c-ad1a-44d9-b181-ce3557c226bc" (UID: "6ce2cf0c-ad1a-44d9-b181-ce3557c226bc"). InnerVolumeSpecName "kube-api-access-2k4mr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:08:45.610025 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.610001    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc2fa95d-08dc-4c0d-a287-564fda5047d7-kube-api-access-tz89b" (OuterVolumeSpecName: "kube-api-access-tz89b") pod "dc2fa95d-08dc-4c0d-a287-564fda5047d7" (UID: "dc2fa95d-08dc-4c0d-a287-564fda5047d7"). InnerVolumeSpecName "kube-api-access-tz89b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:08:45.708085 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.708005    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3adde882-f9e7-4a1c-946e-3126ce741190-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:45.708085 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.708033    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tz89b\" (UniqueName: \"kubernetes.io/projected/dc2fa95d-08dc-4c0d-a287-564fda5047d7-kube-api-access-tz89b\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:45.708085 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.708042    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5nk9\" (UniqueName: \"kubernetes.io/projected/3adde882-f9e7-4a1c-946e-3126ce741190-kube-api-access-n5nk9\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:45.708085 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.708050    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc2fa95d-08dc-4c0d-a287-564fda5047d7-maas-api-tls\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:45.708085 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.708059    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2k4mr\" (UniqueName: \"kubernetes.io/projected/6ce2cf0c-ad1a-44d9-b181-ce3557c226bc-kube-api-access-2k4mr\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:45.708085 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:45.708067    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ce2cf0c-ad1a-44d9-b181-ce3557c226bc-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:46.285870 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.285836    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"]
Jul 30 20:08:46.286483 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.286467    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ce2cf0c-ad1a-44d9-b181-ce3557c226bc" containerName="payload-processing"
Jul 30 20:08:46.286534 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.286486    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ce2cf0c-ad1a-44d9-b181-ce3557c226bc" containerName="payload-processing"
Jul 30 20:08:46.286534 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.286529    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3adde882-f9e7-4a1c-946e-3126ce741190" containerName="payload-pre-processing"
Jul 30 20:08:46.286635 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.286538    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3adde882-f9e7-4a1c-946e-3126ce741190" containerName="payload-pre-processing"
Jul 30 20:08:46.286635 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.286551    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65eba931-ec44-488a-970f-4b6b826b4bc2" containerName="revoke-keys"
Jul 30 20:08:46.286635 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.286590    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="65eba931-ec44-488a-970f-4b6b826b4bc2" containerName="revoke-keys"
Jul 30 20:08:46.286635 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.286608    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" containerName="istio-proxy"
Jul 30 20:08:46.286635 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.286617    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" containerName="istio-proxy"
Jul 30 20:08:46.286635 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.286628    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc2fa95d-08dc-4c0d-a287-564fda5047d7" containerName="maas-api"
Jul 30 20:08:46.286635 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.286637    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc2fa95d-08dc-4c0d-a287-564fda5047d7" containerName="maas-api"
Jul 30 20:08:46.286880 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.286735    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3adde882-f9e7-4a1c-946e-3126ce741190" containerName="payload-pre-processing"
Jul 30 20:08:46.286880 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.286749    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="65eba931-ec44-488a-970f-4b6b826b4bc2" containerName="revoke-keys"
Jul 30 20:08:46.286880 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.286766    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f42cc58d-7ff5-4b62-a1e0-f28de790a8d6" containerName="istio-proxy"
Jul 30 20:08:46.286880 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.286774    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc2fa95d-08dc-4c0d-a287-564fda5047d7" containerName="maas-api"
Jul 30 20:08:46.286880 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.286784    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ce2cf0c-ad1a-44d9-b181-ce3557c226bc" containerName="payload-processing"
Jul 30 20:08:46.290282 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.290265    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.292856 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.292836    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-be206e5c-openshift-default-dockercfg-jxsjd\""
Jul 30 20:08:46.299770 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.299745    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"]
Jul 30 20:08:46.312838 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.312809    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f10dc06-339c-42bc-bc2c-596987b32437-istiod-ca-cert\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.312983 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.312862    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f10dc06-339c-42bc-bc2c-596987b32437-istio-token\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.312983 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.312882    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-istio-envoy\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.313063 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.312984    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-credential-socket\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.313063 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.313021    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f10dc06-339c-42bc-bc2c-596987b32437-istio-podinfo\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.313123 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.313096    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqf84\" (UniqueName: \"kubernetes.io/projected/4f10dc06-339c-42bc-bc2c-596987b32437-kube-api-access-hqf84\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.313158 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.313128    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-workload-certs\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.313192 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.313154    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-workload-socket\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.313261 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.313243    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-istio-data\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.413721 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.413687    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-istio-data\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.413907 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.413737    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f10dc06-339c-42bc-bc2c-596987b32437-istiod-ca-cert\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.413907 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.413772    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f10dc06-339c-42bc-bc2c-596987b32437-istio-token\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.413907 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.413789    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-istio-envoy\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.413907 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.413817    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-credential-socket\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.413907 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.413831    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f10dc06-339c-42bc-bc2c-596987b32437-istio-podinfo\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.413907 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.413877    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqf84\" (UniqueName: \"kubernetes.io/projected/4f10dc06-339c-42bc-bc2c-596987b32437-kube-api-access-hqf84\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.413907 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.413905    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-workload-certs\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.414287 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.413937    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-workload-socket\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.414287 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.414106    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-istio-data\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.414287 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.414193    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-credential-socket\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.414287 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.414251    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-workload-socket\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.414451 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.414401    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-workload-certs\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.414502 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.414485    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f10dc06-339c-42bc-bc2c-596987b32437-istiod-ca-cert\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.416052 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.416031    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-istio-envoy\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.416250 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.416231    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f10dc06-339c-42bc-bc2c-596987b32437-istio-podinfo\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.421456 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.421432    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f10dc06-339c-42bc-bc2c-596987b32437-istio-token\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.421635 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.421595    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqf84\" (UniqueName: \"kubernetes.io/projected/4f10dc06-339c-42bc-bc2c-596987b32437-kube-api-access-hqf84\") pod \"e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") " pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.485817 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.485742    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm"
Jul 30 20:08:46.485817 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.485761    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm" event={"ID":"dc2fa95d-08dc-4c0d-a287-564fda5047d7","Type":"ContainerDied","Data":"da874e6eecec352c9373bee4383818da28323c23e85ad672f54f7b039505a559"}
Jul 30 20:08:46.486024 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.485825    2568 scope.go:117] "RemoveContainer" containerID="3cd48d3136dea8f39eddf1d41909ab176407f84dac6920f0532ac849169d2543"
Jul 30 20:08:46.487194 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.487177    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4"
Jul 30 20:08:46.487194 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.487183    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4" event={"ID":"6ce2cf0c-ad1a-44d9-b181-ce3557c226bc","Type":"ContainerDied","Data":"e39e3ed24c3c89c161a0476985b2e853a6ee78bc543b256d3d5760af18dd6466"}
Jul 30 20:08:46.498200 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.489145    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz"
Jul 30 20:08:46.498200 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.489066    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz" event={"ID":"3adde882-f9e7-4a1c-946e-3126ce741190","Type":"ContainerDied","Data":"fa2281eee8a90508b0ca7eb165b13f33cb3344954d95ff10a1487c6e1a355f0a"}
Jul 30 20:08:46.501806 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.501787    2568 scope.go:117] "RemoveContainer" containerID="691f483a1e9df43f7f7a6a290a23ca6d8c038ad022ac2da3d7bdd1df1c1c6b0f"
Jul 30 20:08:46.510818 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.510791    2568 scope.go:117] "RemoveContainer" containerID="f8b849cfa431aaabdd6cbee60de55ae20a001827e708312653e12d38c4b047e8"
Jul 30 20:08:46.517868 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.517845    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4"]
Jul 30 20:08:46.521276 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.521259    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3cca38ec-5f858949-9wbw4"]
Jul 30 20:08:46.531394 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.531374    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz"]
Jul 30 20:08:46.535430 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.535406    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3cca38ec-778c74f7d4-trbqz"]
Jul 30 20:08:46.547175 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.547138    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm"]
Jul 30 20:08:46.549908 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.549888    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3cca38ec-66bd59874c-wn6dm"]
Jul 30 20:08:46.601611 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.601587    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:46.745631 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.745599    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"]
Jul 30 20:08:46.746378 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:08:46.746346    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f10dc06_339c_42bc_bc2c_596987b32437.slice/crio-babae8268e4d9cdb78cfbf0155a87e42f8c36c2b059fdbe88aa1e5ba9a3c6c9f WatchSource:0}: Error finding container babae8268e4d9cdb78cfbf0155a87e42f8c36c2b059fdbe88aa1e5ba9a3c6c9f: Status 404 returned error can't find the container with id babae8268e4d9cdb78cfbf0155a87e42f8c36c2b059fdbe88aa1e5ba9a3c6c9f
Jul 30 20:08:46.748732 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.748699    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:08:46.748814 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.748779    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:08:46.748850 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:46.748821    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:08:47.485701 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:47.485665    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3adde882-f9e7-4a1c-946e-3126ce741190" path="/var/lib/kubelet/pods/3adde882-f9e7-4a1c-946e-3126ce741190/volumes"
Jul 30 20:08:47.486212 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:47.486194    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ce2cf0c-ad1a-44d9-b181-ce3557c226bc" path="/var/lib/kubelet/pods/6ce2cf0c-ad1a-44d9-b181-ce3557c226bc/volumes"
Jul 30 20:08:47.486559 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:47.486547    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc2fa95d-08dc-4c0d-a287-564fda5047d7" path="/var/lib/kubelet/pods/dc2fa95d-08dc-4c0d-a287-564fda5047d7/volumes"
Jul 30 20:08:47.498532 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:47.498506    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq" event={"ID":"4f10dc06-339c-42bc-bc2c-596987b32437","Type":"ContainerStarted","Data":"48c90efadef605fa591aa76ac43f4d009fc34afd0c0529dc4c74d28e00869e03"}
Jul 30 20:08:47.498701 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:47.498551    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq" event={"ID":"4f10dc06-339c-42bc-bc2c-596987b32437","Type":"ContainerStarted","Data":"babae8268e4d9cdb78cfbf0155a87e42f8c36c2b059fdbe88aa1e5ba9a3c6c9f"}
Jul 30 20:08:47.519637 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:47.519553    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq" podStartSLOduration=1.519539867 podStartE2EDuration="1.519539867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:08:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:08:47.518178449 +0000 UTC m=+1748.618259637" watchObservedRunningTime="2026-07-30 20:08:47.519539867 +0000 UTC m=+1748.619621053"
Jul 30 20:08:47.602037 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:47.601997    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:47.606874 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:47.606848    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:48.505380 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:48.505351    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:48.506412 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:48.506391    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:08:49.117464 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:49.117422    2568 patch_prober.go:28] interesting pod/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 20:08:49.117654 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:49.117488    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj" podUID="3a070769-1a73-4015-b266-3a997202f4da" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 20:08:50.095524 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.095493    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"]
Jul 30 20:08:50.100894 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.100871    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"
Jul 30 20:08:50.103396 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.103374    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-be206e5c-serving-cert\""
Jul 30 20:08:50.110912 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.110889    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"]
Jul 30 20:08:50.154950 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.154922    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkgpz\" (UniqueName: \"kubernetes.io/projected/4281ff6b-6d28-4760-baae-8117508450ca-kube-api-access-kkgpz\") pod \"maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd\" (UID: \"4281ff6b-6d28-4760-baae-8117508450ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"
Jul 30 20:08:50.155127 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.154989    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4281ff6b-6d28-4760-baae-8117508450ca-openshift-service-ca\") pod \"maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd\" (UID: \"4281ff6b-6d28-4760-baae-8117508450ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"
Jul 30 20:08:50.155176 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.155135    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4281ff6b-6d28-4760-baae-8117508450ca-maas-api-tls\") pod \"maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd\" (UID: \"4281ff6b-6d28-4760-baae-8117508450ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"
Jul 30 20:08:50.256050 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.256014    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4281ff6b-6d28-4760-baae-8117508450ca-maas-api-tls\") pod \"maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd\" (UID: \"4281ff6b-6d28-4760-baae-8117508450ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"
Jul 30 20:08:50.256224 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.256079    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkgpz\" (UniqueName: \"kubernetes.io/projected/4281ff6b-6d28-4760-baae-8117508450ca-kube-api-access-kkgpz\") pod \"maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd\" (UID: \"4281ff6b-6d28-4760-baae-8117508450ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"
Jul 30 20:08:50.256224 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.256134    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4281ff6b-6d28-4760-baae-8117508450ca-openshift-service-ca\") pod \"maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd\" (UID: \"4281ff6b-6d28-4760-baae-8117508450ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"
Jul 30 20:08:50.256224 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:08:50.256174    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-serving-cert: secret "maas-api-e2e-ait-be206e5c-serving-cert" not found
Jul 30 20:08:50.256332 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:08:50.256241    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4281ff6b-6d28-4760-baae-8117508450ca-maas-api-tls podName:4281ff6b-6d28-4760-baae-8117508450ca nodeName:}" failed. No retries permitted until 2026-07-30 20:08:50.756220649 +0000 UTC m=+1751.856301838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4281ff6b-6d28-4760-baae-8117508450ca-maas-api-tls") pod "maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd" (UID: "4281ff6b-6d28-4760-baae-8117508450ca") : secret "maas-api-e2e-ait-be206e5c-serving-cert" not found
Jul 30 20:08:50.256786 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.256768    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4281ff6b-6d28-4760-baae-8117508450ca-openshift-service-ca\") pod \"maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd\" (UID: \"4281ff6b-6d28-4760-baae-8117508450ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"
Jul 30 20:08:50.265238 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.265219    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkgpz\" (UniqueName: \"kubernetes.io/projected/4281ff6b-6d28-4760-baae-8117508450ca-kube-api-access-kkgpz\") pod \"maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd\" (UID: \"4281ff6b-6d28-4760-baae-8117508450ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"
Jul 30 20:08:50.762396 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.762366    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4281ff6b-6d28-4760-baae-8117508450ca-maas-api-tls\") pod \"maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd\" (UID: \"4281ff6b-6d28-4760-baae-8117508450ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"
Jul 30 20:08:50.765383 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.765311    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4281ff6b-6d28-4760-baae-8117508450ca-maas-api-tls\") pod \"maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd\" (UID: \"4281ff6b-6d28-4760-baae-8117508450ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"
Jul 30 20:08:50.791518 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.791468    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2"]
Jul 30 20:08:50.795587 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.795522    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2"
Jul 30 20:08:50.798086 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.798064    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-be206e5c\""
Jul 30 20:08:50.798220 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.798202    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-be206e5c-dockercfg-gdwcd\""
Jul 30 20:08:50.802808 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.802769    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2"]
Jul 30 20:08:50.810060 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.810035    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4"]
Jul 30 20:08:50.813759 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.813742    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4"
Jul 30 20:08:50.822831 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.822810    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4"]
Jul 30 20:08:50.827318 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.826872    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:50.863286 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.863261    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a070769-1a73-4015-b266-3a997202f4da-istiod-ca-cert\") pod \"3a070769-1a73-4015-b266-3a997202f4da\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") "
Jul 30 20:08:50.863445 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.863300    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a070769-1a73-4015-b266-3a997202f4da-istio-token\") pod \"3a070769-1a73-4015-b266-3a997202f4da\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") "
Jul 30 20:08:50.863445 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.863321    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-workload-certs\") pod \"3a070769-1a73-4015-b266-3a997202f4da\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") "
Jul 30 20:08:50.863445 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.863358    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-istio-envoy\") pod \"3a070769-1a73-4015-b266-3a997202f4da\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") "
Jul 30 20:08:50.863445 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.863381    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-workload-socket\") pod \"3a070769-1a73-4015-b266-3a997202f4da\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") "
Jul 30 20:08:50.863445 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.863444    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-credential-socket\") pod \"3a070769-1a73-4015-b266-3a997202f4da\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") "
Jul 30 20:08:50.863759 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.863477    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pc4j\" (UniqueName: \"kubernetes.io/projected/3a070769-1a73-4015-b266-3a997202f4da-kube-api-access-7pc4j\") pod \"3a070769-1a73-4015-b266-3a997202f4da\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") "
Jul 30 20:08:50.863759 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.863548    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-istio-data\") pod \"3a070769-1a73-4015-b266-3a997202f4da\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") "
Jul 30 20:08:50.863759 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.863600    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a070769-1a73-4015-b266-3a997202f4da-istio-podinfo\") pod \"3a070769-1a73-4015-b266-3a997202f4da\" (UID: \"3a070769-1a73-4015-b266-3a997202f4da\") "
Jul 30 20:08:50.864191 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.864159    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a070769-1a73-4015-b266-3a997202f4da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3a070769-1a73-4015-b266-3a997202f4da" (UID: "3a070769-1a73-4015-b266-3a997202f4da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:08:50.865031 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.864448    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz42n\" (UniqueName: \"kubernetes.io/projected/72da2f22-56d7-4cc7-a426-5cd226a6a944-kube-api-access-wz42n\") pod \"payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2\" (UID: \"72da2f22-56d7-4cc7-a426-5cd226a6a944\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2"
Jul 30 20:08:50.865137 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.864239    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3a070769-1a73-4015-b266-3a997202f4da" (UID: "3a070769-1a73-4015-b266-3a997202f4da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:08:50.865137 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.865102    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72da2f22-56d7-4cc7-a426-5cd226a6a944-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2\" (UID: \"72da2f22-56d7-4cc7-a426-5cd226a6a944\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2"
Jul 30 20:08:50.865260 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.865138    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tv7g\" (UniqueName: \"kubernetes.io/projected/cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30-kube-api-access-6tv7g\") pod \"payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4\" (UID: \"cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30\") " pod="openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4"
Jul 30 20:08:50.865260 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.864595    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3a070769-1a73-4015-b266-3a997202f4da" (UID: "3a070769-1a73-4015-b266-3a997202f4da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:08:50.865260 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.864704    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3a070769-1a73-4015-b266-3a997202f4da" (UID: "3a070769-1a73-4015-b266-3a997202f4da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:08:50.865416 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.865303    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30-plugins-config-volume\") pod \"payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4\" (UID: \"cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30\") " pod="openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4"
Jul 30 20:08:50.865471 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.865420    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a070769-1a73-4015-b266-3a997202f4da-istiod-ca-cert\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:50.865471 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.865435    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-workload-certs\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:50.865471 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.865450    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-workload-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:50.865471 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.865464    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-credential-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:50.866155 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.866131    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-istio-data" (OuterVolumeSpecName: "istio-data") pod "3a070769-1a73-4015-b266-3a997202f4da" (UID: "3a070769-1a73-4015-b266-3a997202f4da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:08:50.867478 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.867452    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a070769-1a73-4015-b266-3a997202f4da-kube-api-access-7pc4j" (OuterVolumeSpecName: "kube-api-access-7pc4j") pod "3a070769-1a73-4015-b266-3a997202f4da" (UID: "3a070769-1a73-4015-b266-3a997202f4da"). InnerVolumeSpecName "kube-api-access-7pc4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:08:50.867715 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.867632    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a070769-1a73-4015-b266-3a997202f4da-istio-token" (OuterVolumeSpecName: "istio-token") pod "3a070769-1a73-4015-b266-3a997202f4da" (UID: "3a070769-1a73-4015-b266-3a997202f4da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:08:50.867715 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.867657    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3a070769-1a73-4015-b266-3a997202f4da" (UID: "3a070769-1a73-4015-b266-3a997202f4da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:08:50.867997 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.867975    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a070769-1a73-4015-b266-3a997202f4da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3a070769-1a73-4015-b266-3a997202f4da" (UID: "3a070769-1a73-4015-b266-3a997202f4da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 20:08:50.966559 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.966521    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30-plugins-config-volume\") pod \"payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4\" (UID: \"cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30\") " pod="openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4"
Jul 30 20:08:50.966746 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.966652    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz42n\" (UniqueName: \"kubernetes.io/projected/72da2f22-56d7-4cc7-a426-5cd226a6a944-kube-api-access-wz42n\") pod \"payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2\" (UID: \"72da2f22-56d7-4cc7-a426-5cd226a6a944\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2"
Jul 30 20:08:50.966746 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.966688    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72da2f22-56d7-4cc7-a426-5cd226a6a944-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2\" (UID: \"72da2f22-56d7-4cc7-a426-5cd226a6a944\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2"
Jul 30 20:08:50.966746 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.966705    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tv7g\" (UniqueName: \"kubernetes.io/projected/cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30-kube-api-access-6tv7g\") pod \"payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4\" (UID: \"cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30\") " pod="openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4"
Jul 30 20:08:50.966858 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.966766    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-istio-data\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:50.966858 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.966776    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a070769-1a73-4015-b266-3a997202f4da-istio-podinfo\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:50.966858 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.966786    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a070769-1a73-4015-b266-3a997202f4da-istio-token\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:50.966858 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.966795    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a070769-1a73-4015-b266-3a997202f4da-istio-envoy\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:50.966858 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.966803    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pc4j\" (UniqueName: \"kubernetes.io/projected/3a070769-1a73-4015-b266-3a997202f4da-kube-api-access-7pc4j\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:08:50.967432 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.967405    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30-plugins-config-volume\") pod \"payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4\" (UID: \"cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30\") " pod="openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4"
Jul 30 20:08:50.967467 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.967430    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72da2f22-56d7-4cc7-a426-5cd226a6a944-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2\" (UID: \"72da2f22-56d7-4cc7-a426-5cd226a6a944\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2"
Jul 30 20:08:50.974874 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.974845    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz42n\" (UniqueName: \"kubernetes.io/projected/72da2f22-56d7-4cc7-a426-5cd226a6a944-kube-api-access-wz42n\") pod \"payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2\" (UID: \"72da2f22-56d7-4cc7-a426-5cd226a6a944\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2"
Jul 30 20:08:50.975179 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:50.975162    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tv7g\" (UniqueName: \"kubernetes.io/projected/cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30-kube-api-access-6tv7g\") pod \"payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4\" (UID: \"cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30\") " pod="openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4"
Jul 30 20:08:51.015116 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.015088    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"
Jul 30 20:08:51.128977 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.128942    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2"
Jul 30 20:08:51.136018 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.135991    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4"
Jul 30 20:08:51.154921 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.154846    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"]
Jul 30 20:08:51.156770 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:08:51.156741    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4281ff6b_6d28_4760_baae_8117508450ca.slice/crio-18e3af7677ebb43f0f70b1b81af2863e96925abf99cf246ab5b0afc073ab5248 WatchSource:0}: Error finding container 18e3af7677ebb43f0f70b1b81af2863e96925abf99cf246ab5b0afc073ab5248: Status 404 returned error can't find the container with id 18e3af7677ebb43f0f70b1b81af2863e96925abf99cf246ab5b0afc073ab5248
Jul 30 20:08:51.298887 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.298853    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2"]
Jul 30 20:08:51.302329 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:08:51.302287    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72da2f22_56d7_4cc7_a426_5cd226a6a944.slice/crio-5e1cb72e0eda88278bf296ea91026be170cb281953c6a2d9af0586d16242217b WatchSource:0}: Error finding container 5e1cb72e0eda88278bf296ea91026be170cb281953c6a2d9af0586d16242217b: Status 404 returned error can't find the container with id 5e1cb72e0eda88278bf296ea91026be170cb281953c6a2d9af0586d16242217b
Jul 30 20:08:51.525529 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.525486    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2" event={"ID":"72da2f22-56d7-4cc7-a426-5cd226a6a944","Type":"ContainerStarted","Data":"28ef75d97a12b336b568a25a91aea83fef695a14907582b7dcb61af1358c71fb"}
Jul 30 20:08:51.525738 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.525687    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2"
Jul 30 20:08:51.525738 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.525730    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2" event={"ID":"72da2f22-56d7-4cc7-a426-5cd226a6a944","Type":"ContainerStarted","Data":"5e1cb72e0eda88278bf296ea91026be170cb281953c6a2d9af0586d16242217b"}
Jul 30 20:08:51.527095 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.527071    2568 generic.go:356] "Generic (PLEG): container finished" podID="3a070769-1a73-4015-b266-3a997202f4da" containerID="7c8ca2bed56fad2fa86ad0ad5966b23babbc5d57ffea829cca91cfffbf769ee8" exitCode=0
Jul 30 20:08:51.527214 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.527113    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"
Jul 30 20:08:51.527214 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.527125    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj" event={"ID":"3a070769-1a73-4015-b266-3a997202f4da","Type":"ContainerDied","Data":"7c8ca2bed56fad2fa86ad0ad5966b23babbc5d57ffea829cca91cfffbf769ee8"}
Jul 30 20:08:51.527214 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.527165    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj" event={"ID":"3a070769-1a73-4015-b266-3a997202f4da","Type":"ContainerDied","Data":"bce69324512425a85d8100cb0a600635d582dc270b125bdf672db28a5c68028d"}
Jul 30 20:08:51.527214 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.527192    2568 scope.go:117] "RemoveContainer" containerID="7c8ca2bed56fad2fa86ad0ad5966b23babbc5d57ffea829cca91cfffbf769ee8"
Jul 30 20:08:51.528453 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.528425    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd" event={"ID":"4281ff6b-6d28-4760-baae-8117508450ca","Type":"ContainerStarted","Data":"18e3af7677ebb43f0f70b1b81af2863e96925abf99cf246ab5b0afc073ab5248"}
Jul 30 20:08:51.535329 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.535309    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4"]
Jul 30 20:08:51.538187 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.538166    2568 scope.go:117] "RemoveContainer" containerID="d3b127e81c0d5f84fac9b77a6d38c01cb6de876983c59de30ab0dc99ba3acb25"
Jul 30 20:08:51.539504 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:08:51.539480    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc9f4d36_75e1_465c_86ef_1b6b5d4ebf30.slice/crio-c164d015a5361335606766bec002a50d8eaddbf2f4271e52b361cd40900e63bf WatchSource:0}: Error finding container c164d015a5361335606766bec002a50d8eaddbf2f4271e52b361cd40900e63bf: Status 404 returned error can't find the container with id c164d015a5361335606766bec002a50d8eaddbf2f4271e52b361cd40900e63bf
Jul 30 20:08:51.542107 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.542063    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2" podStartSLOduration=1.542047038 podStartE2EDuration="1.542047038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:08:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:08:51.540628129 +0000 UTC m=+1752.640709316" watchObservedRunningTime="2026-07-30 20:08:51.542047038 +0000 UTC m=+1752.642128226"
Jul 30 20:08:51.558697 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.558668    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"]
Jul 30 20:08:51.562520 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.562502    2568 scope.go:117] "RemoveContainer" containerID="7c8ca2bed56fad2fa86ad0ad5966b23babbc5d57ffea829cca91cfffbf769ee8"
Jul 30 20:08:51.562725 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.562704    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-3cca38ec-gw-openshift-default-864d5bdd-4nspj"]
Jul 30 20:08:51.562853 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:08:51.562835    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c8ca2bed56fad2fa86ad0ad5966b23babbc5d57ffea829cca91cfffbf769ee8\": container with ID starting with 7c8ca2bed56fad2fa86ad0ad5966b23babbc5d57ffea829cca91cfffbf769ee8 not found: ID does not exist" containerID="7c8ca2bed56fad2fa86ad0ad5966b23babbc5d57ffea829cca91cfffbf769ee8"
Jul 30 20:08:51.562958 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.562860    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c8ca2bed56fad2fa86ad0ad5966b23babbc5d57ffea829cca91cfffbf769ee8"} err="failed to get container status \"7c8ca2bed56fad2fa86ad0ad5966b23babbc5d57ffea829cca91cfffbf769ee8\": rpc error: code = NotFound desc = could not find container \"7c8ca2bed56fad2fa86ad0ad5966b23babbc5d57ffea829cca91cfffbf769ee8\": container with ID starting with 7c8ca2bed56fad2fa86ad0ad5966b23babbc5d57ffea829cca91cfffbf769ee8 not found: ID does not exist"
Jul 30 20:08:51.562958 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.562878    2568 scope.go:117] "RemoveContainer" containerID="d3b127e81c0d5f84fac9b77a6d38c01cb6de876983c59de30ab0dc99ba3acb25"
Jul 30 20:08:51.563172 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:08:51.563152    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3b127e81c0d5f84fac9b77a6d38c01cb6de876983c59de30ab0dc99ba3acb25\": container with ID starting with d3b127e81c0d5f84fac9b77a6d38c01cb6de876983c59de30ab0dc99ba3acb25 not found: ID does not exist" containerID="d3b127e81c0d5f84fac9b77a6d38c01cb6de876983c59de30ab0dc99ba3acb25"
Jul 30 20:08:51.563253 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:51.563177    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3b127e81c0d5f84fac9b77a6d38c01cb6de876983c59de30ab0dc99ba3acb25"} err="failed to get container status \"d3b127e81c0d5f84fac9b77a6d38c01cb6de876983c59de30ab0dc99ba3acb25\": rpc error: code = NotFound desc = could not find container \"d3b127e81c0d5f84fac9b77a6d38c01cb6de876983c59de30ab0dc99ba3acb25\": container with ID starting with d3b127e81c0d5f84fac9b77a6d38c01cb6de876983c59de30ab0dc99ba3acb25 not found: ID does not exist"
Jul 30 20:08:52.536637 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:52.536597    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4" event={"ID":"cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30","Type":"ContainerStarted","Data":"18a30d55178bae9a2cce110fd9dfe5e726e3ed25d19e2f01e57f0b4c68e772b9"}
Jul 30 20:08:52.537104 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:52.536662    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4"
Jul 30 20:08:52.537104 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:52.536688    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4" event={"ID":"cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30","Type":"ContainerStarted","Data":"c164d015a5361335606766bec002a50d8eaddbf2f4271e52b361cd40900e63bf"}
Jul 30 20:08:52.538016 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:52.537991    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd" event={"ID":"4281ff6b-6d28-4760-baae-8117508450ca","Type":"ContainerStarted","Data":"bbaab16f1bca6c65c52fb19ea2738e19d215ce2dfbcbbe517d457259e4395804"}
Jul 30 20:08:52.538133 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:52.538073    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"
Jul 30 20:08:52.551878 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:52.551833    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4" podStartSLOduration=2.551818164 podStartE2EDuration="2.551818164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:08:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:08:52.551614601 +0000 UTC m=+1753.651695787" watchObservedRunningTime="2026-07-30 20:08:52.551818164 +0000 UTC m=+1753.651899365"
Jul 30 20:08:52.570416 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:52.570372    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd" podStartSLOduration=1.915627834 podStartE2EDuration="2.570360064s" totalImagesPullingTime="654.73223ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:08:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:08:52.568927672 +0000 UTC m=+1753.669008860" watchObservedRunningTime="2026-07-30 20:08:52.570360064 +0000 UTC m=+1753.670441250"
Jul 30 20:08:53.482286 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:53.482250    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a070769-1a73-4015-b266-3a997202f4da" path="/var/lib/kubelet/pods/3a070769-1a73-4015-b266-3a997202f4da/volumes"
Jul 30 20:08:58.550724 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:08:58.550649    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"
Jul 30 20:09:01.599722 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:01.599688    2568 generic.go:356] "Generic (PLEG): container finished" podID="4f10dc06-339c-42bc-bc2c-596987b32437" containerID="48c90efadef605fa591aa76ac43f4d009fc34afd0c0529dc4c74d28e00869e03" exitCode=0
Jul 30 20:09:01.600269 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:01.599767    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq" event={"ID":"4f10dc06-339c-42bc-bc2c-596987b32437","Type":"ContainerDied","Data":"48c90efadef605fa591aa76ac43f4d009fc34afd0c0529dc4c74d28e00869e03"}
Jul 30 20:09:01.600342 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:01.600272    2568 scope.go:117] "RemoveContainer" containerID="48c90efadef605fa591aa76ac43f4d009fc34afd0c0529dc4c74d28e00869e03"
Jul 30 20:09:01.601294 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:01.601268    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:09:01.601366 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:01.601349    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:09:01.601413 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:01.601398    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:09:02.542817 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:02.542780    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2"
Jul 30 20:09:02.607430 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:02.607392    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq" event={"ID":"4f10dc06-339c-42bc-bc2c-596987b32437","Type":"ContainerStarted","Data":"7918fb60522bcaf256f948a4fbb423ba70b7f7869310317cd20711b68102e75a"}
Jul 30 20:09:03.505467 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:03.505441    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:09:03.548792 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:03.548766    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4"
Jul 30 20:09:03.602119 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:03.602084    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:09:03.603074 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:03.603050    2568 patch_prober.go:28] interesting pod/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 30 20:09:03.603266 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:03.603241    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq" podUID="4f10dc06-339c-42bc-bc2c-596987b32437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 30 20:09:04.602132 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:04.602096    2568 patch_prober.go:28] interesting pod/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 30 20:09:04.602530 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:04.602152    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq" podUID="4f10dc06-339c-42bc-bc2c-596987b32437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 30 20:09:05.602679 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:05.602640    2568 patch_prober.go:28] interesting pod/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 30 20:09:05.603154 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:05.602703    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq" podUID="4f10dc06-339c-42bc-bc2c-596987b32437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 30 20:09:06.606452 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:06.606420    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:09:06.607637 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:06.607616    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:09:30.619988 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:30.619948    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"]
Jul 30 20:09:30.620618 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:30.620171    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd" podUID="4281ff6b-6d28-4760-baae-8117508450ca" containerName="maas-api" containerID="cri-o://bbaab16f1bca6c65c52fb19ea2738e19d215ce2dfbcbbe517d457259e4395804" gracePeriod=30
Jul 30 20:09:30.674102 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:30.674065    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4"]
Jul 30 20:09:30.674385 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:30.674333    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4" podUID="cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30" containerName="payload-processing" containerID="cri-o://18a30d55178bae9a2cce110fd9dfe5e726e3ed25d19e2f01e57f0b4c68e772b9" gracePeriod=30
Jul 30 20:09:30.681622 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:30.680890    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2"]
Jul 30 20:09:30.681622 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:30.681107    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2" podUID="72da2f22-56d7-4cc7-a426-5cd226a6a944" containerName="payload-pre-processing" containerID="cri-o://28ef75d97a12b336b568a25a91aea83fef695a14907582b7dcb61af1358c71fb" gracePeriod=30
Jul 30 20:09:30.762309 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:30.762272    2568 generic.go:356] "Generic (PLEG): container finished" podID="4281ff6b-6d28-4760-baae-8117508450ca" containerID="bbaab16f1bca6c65c52fb19ea2738e19d215ce2dfbcbbe517d457259e4395804" exitCode=0
Jul 30 20:09:30.762454 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:30.762339    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd" event={"ID":"4281ff6b-6d28-4760-baae-8117508450ca","Type":"ContainerDied","Data":"bbaab16f1bca6c65c52fb19ea2738e19d215ce2dfbcbbe517d457259e4395804"}
Jul 30 20:09:30.964390 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:30.964365    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"
Jul 30 20:09:30.969012 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:30.968984    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4"
Jul 30 20:09:30.994024 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:30.994000    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2"
Jul 30 20:09:31.072294 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.072265    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkgpz\" (UniqueName: \"kubernetes.io/projected/4281ff6b-6d28-4760-baae-8117508450ca-kube-api-access-kkgpz\") pod \"4281ff6b-6d28-4760-baae-8117508450ca\" (UID: \"4281ff6b-6d28-4760-baae-8117508450ca\") "
Jul 30 20:09:31.072485 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.072315    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wz42n\" (UniqueName: \"kubernetes.io/projected/72da2f22-56d7-4cc7-a426-5cd226a6a944-kube-api-access-wz42n\") pod \"72da2f22-56d7-4cc7-a426-5cd226a6a944\" (UID: \"72da2f22-56d7-4cc7-a426-5cd226a6a944\") "
Jul 30 20:09:31.072485 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.072349    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4281ff6b-6d28-4760-baae-8117508450ca-maas-api-tls\") pod \"4281ff6b-6d28-4760-baae-8117508450ca\" (UID: \"4281ff6b-6d28-4760-baae-8117508450ca\") "
Jul 30 20:09:31.072485 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.072371    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tv7g\" (UniqueName: \"kubernetes.io/projected/cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30-kube-api-access-6tv7g\") pod \"cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30\" (UID: \"cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30\") "
Jul 30 20:09:31.072485 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.072432    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30-plugins-config-volume\") pod \"cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30\" (UID: \"cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30\") "
Jul 30 20:09:31.072745 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.072554    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4281ff6b-6d28-4760-baae-8117508450ca-openshift-service-ca\") pod \"4281ff6b-6d28-4760-baae-8117508450ca\" (UID: \"4281ff6b-6d28-4760-baae-8117508450ca\") "
Jul 30 20:09:31.072745 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.072595    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72da2f22-56d7-4cc7-a426-5cd226a6a944-plugins-config-volume\") pod \"72da2f22-56d7-4cc7-a426-5cd226a6a944\" (UID: \"72da2f22-56d7-4cc7-a426-5cd226a6a944\") "
Jul 30 20:09:31.072936 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.072907    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30" (UID: "cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:09:31.073014 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.072986    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72da2f22-56d7-4cc7-a426-5cd226a6a944-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "72da2f22-56d7-4cc7-a426-5cd226a6a944" (UID: "72da2f22-56d7-4cc7-a426-5cd226a6a944"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:09:31.073436 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.073411    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4281ff6b-6d28-4760-baae-8117508450ca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4281ff6b-6d28-4760-baae-8117508450ca" (UID: "4281ff6b-6d28-4760-baae-8117508450ca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:09:31.074469 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.074441    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72da2f22-56d7-4cc7-a426-5cd226a6a944-kube-api-access-wz42n" (OuterVolumeSpecName: "kube-api-access-wz42n") pod "72da2f22-56d7-4cc7-a426-5cd226a6a944" (UID: "72da2f22-56d7-4cc7-a426-5cd226a6a944"). InnerVolumeSpecName "kube-api-access-wz42n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:09:31.074469 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.074462    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4281ff6b-6d28-4760-baae-8117508450ca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4281ff6b-6d28-4760-baae-8117508450ca" (UID: "4281ff6b-6d28-4760-baae-8117508450ca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:09:31.074633 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.074485    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30-kube-api-access-6tv7g" (OuterVolumeSpecName: "kube-api-access-6tv7g") pod "cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30" (UID: "cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30"). InnerVolumeSpecName "kube-api-access-6tv7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:09:31.074633 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.074520    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4281ff6b-6d28-4760-baae-8117508450ca-kube-api-access-kkgpz" (OuterVolumeSpecName: "kube-api-access-kkgpz") pod "4281ff6b-6d28-4760-baae-8117508450ca" (UID: "4281ff6b-6d28-4760-baae-8117508450ca"). InnerVolumeSpecName "kube-api-access-kkgpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:09:31.173436 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.173354    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4281ff6b-6d28-4760-baae-8117508450ca-maas-api-tls\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:09:31.173436 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.173381    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tv7g\" (UniqueName: \"kubernetes.io/projected/cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30-kube-api-access-6tv7g\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:09:31.173436 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.173392    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:09:31.173436 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.173401    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4281ff6b-6d28-4760-baae-8117508450ca-openshift-service-ca\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:09:31.173436 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.173410    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72da2f22-56d7-4cc7-a426-5cd226a6a944-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:09:31.173436 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.173419    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkgpz\" (UniqueName: \"kubernetes.io/projected/4281ff6b-6d28-4760-baae-8117508450ca-kube-api-access-kkgpz\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:09:31.173436 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.173427    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wz42n\" (UniqueName: \"kubernetes.io/projected/72da2f22-56d7-4cc7-a426-5cd226a6a944-kube-api-access-wz42n\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:09:31.769461 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.769365    2568 generic.go:356] "Generic (PLEG): container finished" podID="72da2f22-56d7-4cc7-a426-5cd226a6a944" containerID="28ef75d97a12b336b568a25a91aea83fef695a14907582b7dcb61af1358c71fb" exitCode=0
Jul 30 20:09:31.769461 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.769428    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2"
Jul 30 20:09:31.770009 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.769456    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2" event={"ID":"72da2f22-56d7-4cc7-a426-5cd226a6a944","Type":"ContainerDied","Data":"28ef75d97a12b336b568a25a91aea83fef695a14907582b7dcb61af1358c71fb"}
Jul 30 20:09:31.770009 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.769557    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2" event={"ID":"72da2f22-56d7-4cc7-a426-5cd226a6a944","Type":"ContainerDied","Data":"5e1cb72e0eda88278bf296ea91026be170cb281953c6a2d9af0586d16242217b"}
Jul 30 20:09:31.770009 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.769603    2568 scope.go:117] "RemoveContainer" containerID="28ef75d97a12b336b568a25a91aea83fef695a14907582b7dcb61af1358c71fb"
Jul 30 20:09:31.771120 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.770959    2568 generic.go:356] "Generic (PLEG): container finished" podID="cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30" containerID="18a30d55178bae9a2cce110fd9dfe5e726e3ed25d19e2f01e57f0b4c68e772b9" exitCode=0
Jul 30 20:09:31.771120 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.770988    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4" event={"ID":"cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30","Type":"ContainerDied","Data":"18a30d55178bae9a2cce110fd9dfe5e726e3ed25d19e2f01e57f0b4c68e772b9"}
Jul 30 20:09:31.771120 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.771022    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4"
Jul 30 20:09:31.771120 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.771029    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4" event={"ID":"cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30","Type":"ContainerDied","Data":"c164d015a5361335606766bec002a50d8eaddbf2f4271e52b361cd40900e63bf"}
Jul 30 20:09:31.773047 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.773023    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd" event={"ID":"4281ff6b-6d28-4760-baae-8117508450ca","Type":"ContainerDied","Data":"18e3af7677ebb43f0f70b1b81af2863e96925abf99cf246ab5b0afc073ab5248"}
Jul 30 20:09:31.773142 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.773027    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"
Jul 30 20:09:31.780401 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.780384    2568 scope.go:117] "RemoveContainer" containerID="28ef75d97a12b336b568a25a91aea83fef695a14907582b7dcb61af1358c71fb"
Jul 30 20:09:31.780697 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:09:31.780676    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28ef75d97a12b336b568a25a91aea83fef695a14907582b7dcb61af1358c71fb\": container with ID starting with 28ef75d97a12b336b568a25a91aea83fef695a14907582b7dcb61af1358c71fb not found: ID does not exist" containerID="28ef75d97a12b336b568a25a91aea83fef695a14907582b7dcb61af1358c71fb"
Jul 30 20:09:31.780772 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.780706    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28ef75d97a12b336b568a25a91aea83fef695a14907582b7dcb61af1358c71fb"} err="failed to get container status \"28ef75d97a12b336b568a25a91aea83fef695a14907582b7dcb61af1358c71fb\": rpc error: code = NotFound desc = could not find container \"28ef75d97a12b336b568a25a91aea83fef695a14907582b7dcb61af1358c71fb\": container with ID starting with 28ef75d97a12b336b568a25a91aea83fef695a14907582b7dcb61af1358c71fb not found: ID does not exist"
Jul 30 20:09:31.780772 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.780724    2568 scope.go:117] "RemoveContainer" containerID="18a30d55178bae9a2cce110fd9dfe5e726e3ed25d19e2f01e57f0b4c68e772b9"
Jul 30 20:09:31.788335 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.788323    2568 scope.go:117] "RemoveContainer" containerID="18a30d55178bae9a2cce110fd9dfe5e726e3ed25d19e2f01e57f0b4c68e772b9"
Jul 30 20:09:31.788624 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:09:31.788605    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18a30d55178bae9a2cce110fd9dfe5e726e3ed25d19e2f01e57f0b4c68e772b9\": container with ID starting with 18a30d55178bae9a2cce110fd9dfe5e726e3ed25d19e2f01e57f0b4c68e772b9 not found: ID does not exist" containerID="18a30d55178bae9a2cce110fd9dfe5e726e3ed25d19e2f01e57f0b4c68e772b9"
Jul 30 20:09:31.788679 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.788630    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18a30d55178bae9a2cce110fd9dfe5e726e3ed25d19e2f01e57f0b4c68e772b9"} err="failed to get container status \"18a30d55178bae9a2cce110fd9dfe5e726e3ed25d19e2f01e57f0b4c68e772b9\": rpc error: code = NotFound desc = could not find container \"18a30d55178bae9a2cce110fd9dfe5e726e3ed25d19e2f01e57f0b4c68e772b9\": container with ID starting with 18a30d55178bae9a2cce110fd9dfe5e726e3ed25d19e2f01e57f0b4c68e772b9 not found: ID does not exist"
Jul 30 20:09:31.788679 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.788646    2568 scope.go:117] "RemoveContainer" containerID="bbaab16f1bca6c65c52fb19ea2738e19d215ce2dfbcbbe517d457259e4395804"
Jul 30 20:09:31.792938 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.792919    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2"]
Jul 30 20:09:31.796948 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.796927    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-be206e5c-76848fbbb8-44px2"]
Jul 30 20:09:31.806938 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.806914    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"]
Jul 30 20:09:31.810839 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.810820    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-be206e5c-cd6fc98f7-4hkvd"]
Jul 30 20:09:31.821598 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.821577    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4"]
Jul 30 20:09:31.823451 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:31.823433    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-be206e5c-5d74755bd4-jv4x4"]
Jul 30 20:09:32.026090 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.025997    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"]
Jul 30 20:09:32.026294 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.026264    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq" podUID="4f10dc06-339c-42bc-bc2c-596987b32437" containerName="istio-proxy" containerID="cri-o://7918fb60522bcaf256f948a4fbb423ba70b7f7869310317cd20711b68102e75a" gracePeriod=30
Jul 30 20:09:32.784986 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.784950    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"]
Jul 30 20:09:32.785637 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.785613    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72da2f22-56d7-4cc7-a426-5cd226a6a944" containerName="payload-pre-processing"
Jul 30 20:09:32.785637 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.785636    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="72da2f22-56d7-4cc7-a426-5cd226a6a944" containerName="payload-pre-processing"
Jul 30 20:09:32.785856 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.785653    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a070769-1a73-4015-b266-3a997202f4da" containerName="istio-proxy"
Jul 30 20:09:32.785856 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.785669    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a070769-1a73-4015-b266-3a997202f4da" containerName="istio-proxy"
Jul 30 20:09:32.785856 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.785692    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30" containerName="payload-processing"
Jul 30 20:09:32.785856 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.785701    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30" containerName="payload-processing"
Jul 30 20:09:32.785856 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.785724    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a070769-1a73-4015-b266-3a997202f4da" containerName="istio-proxy"
Jul 30 20:09:32.785856 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.785732    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a070769-1a73-4015-b266-3a997202f4da" containerName="istio-proxy"
Jul 30 20:09:32.785856 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.785746    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4281ff6b-6d28-4760-baae-8117508450ca" containerName="maas-api"
Jul 30 20:09:32.785856 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.785754    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4281ff6b-6d28-4760-baae-8117508450ca" containerName="maas-api"
Jul 30 20:09:32.785856 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.785852    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4281ff6b-6d28-4760-baae-8117508450ca" containerName="maas-api"
Jul 30 20:09:32.786270 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.785864    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a070769-1a73-4015-b266-3a997202f4da" containerName="istio-proxy"
Jul 30 20:09:32.786270 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.785875    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a070769-1a73-4015-b266-3a997202f4da" containerName="istio-proxy"
Jul 30 20:09:32.786270 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.785884    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="72da2f22-56d7-4cc7-a426-5cd226a6a944" containerName="payload-pre-processing"
Jul 30 20:09:32.786270 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.785893    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30" containerName="payload-processing"
Jul 30 20:09:32.790900 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.790881    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.793186 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.793165    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-21ae099f-openshift-default-dockercfg-2p6n7\""
Jul 30 20:09:32.797753 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.797731    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"]
Jul 30 20:09:32.891891 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.891854    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-envoy\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.892094 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.891915    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-workload-socket\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.892094 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.891989    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istiod-ca-cert\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.892094 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.892052    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-podinfo\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.892094 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.892085    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-data\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.892283 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.892205    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbz2k\" (UniqueName: \"kubernetes.io/projected/a64bb3cb-97bf-4406-890d-11c25a8ed53e-kube-api-access-cbz2k\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.892283 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.892239    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-credential-socket\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.892283 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.892263    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-workload-certs\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.892411 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.892386    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-token\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.993062 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.993021    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbz2k\" (UniqueName: \"kubernetes.io/projected/a64bb3cb-97bf-4406-890d-11c25a8ed53e-kube-api-access-cbz2k\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.993240 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.993073    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-credential-socket\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.993240 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.993099    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-workload-certs\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.993240 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.993149    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-token\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.993240 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.993192    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-envoy\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.993240 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.993232    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-workload-socket\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.993504 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.993257    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istiod-ca-cert\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.993504 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.993294    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-podinfo\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.993504 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.993321    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-data\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.993697 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.993544    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-credential-socket\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.993697 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.993619    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-workload-certs\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.993877 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.993856    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-workload-socket\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.993999 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.993978    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-data\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.994182 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.994161    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istiod-ca-cert\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.995632 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.995614    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-envoy\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:32.995951 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:32.995934    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-podinfo\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:33.000420 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:33.000400    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-token\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:33.000590 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:33.000558    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbz2k\" (UniqueName: \"kubernetes.io/projected/a64bb3cb-97bf-4406-890d-11c25a8ed53e-kube-api-access-cbz2k\") pod \"e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") " pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:33.102609 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:33.102551    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:33.248148 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:33.248113    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"]
Jul 30 20:09:33.248686 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:09:33.248660    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda64bb3cb_97bf_4406_890d_11c25a8ed53e.slice/crio-cd2028bef820529c2e180ce50eabd94d161e04762b64fc31bc7b3024af91677a WatchSource:0}: Error finding container cd2028bef820529c2e180ce50eabd94d161e04762b64fc31bc7b3024af91677a: Status 404 returned error can't find the container with id cd2028bef820529c2e180ce50eabd94d161e04762b64fc31bc7b3024af91677a
Jul 30 20:09:33.250865 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:33.250835    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:09:33.250950 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:33.250894    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:09:33.250950 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:33.250928    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:09:33.483329 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:33.483244    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4281ff6b-6d28-4760-baae-8117508450ca" path="/var/lib/kubelet/pods/4281ff6b-6d28-4760-baae-8117508450ca/volumes"
Jul 30 20:09:33.483670 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:33.483655    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72da2f22-56d7-4cc7-a426-5cd226a6a944" path="/var/lib/kubelet/pods/72da2f22-56d7-4cc7-a426-5cd226a6a944/volumes"
Jul 30 20:09:33.483996 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:33.483980    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30" path="/var/lib/kubelet/pods/cc9f4d36-75e1-465c-86ef-1b6b5d4ebf30/volumes"
Jul 30 20:09:33.790795 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:33.790707    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj" event={"ID":"a64bb3cb-97bf-4406-890d-11c25a8ed53e","Type":"ContainerStarted","Data":"3fd7fcfd6f437c74f5155d772cfbf7e84ce2c88c66003d198a51cf0285280481"}
Jul 30 20:09:33.790795 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:33.790769    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj" event={"ID":"a64bb3cb-97bf-4406-890d-11c25a8ed53e","Type":"ContainerStarted","Data":"cd2028bef820529c2e180ce50eabd94d161e04762b64fc31bc7b3024af91677a"}
Jul 30 20:09:33.811142 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:33.811088    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj" podStartSLOduration=1.811072628 podStartE2EDuration="1.811072628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:09:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:09:33.809342015 +0000 UTC m=+1794.909423203" watchObservedRunningTime="2026-07-30 20:09:33.811072628 +0000 UTC m=+1794.911153815"
Jul 30 20:09:34.102847 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:34.102809    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:34.104508 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:34.104483    2568 patch_prober.go:28] interesting pod/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 30 20:09:34.104607 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:34.104532    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj" podUID="a64bb3cb-97bf-4406-890d-11c25a8ed53e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 30 20:09:35.107062 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:35.107029    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:35.802022 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:35.801990    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:35.802948 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:35.802926    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:36.281603 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.281550    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh"]
Jul 30 20:09:36.286623 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.286601    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh"
Jul 30 20:09:36.289376 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.289348    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-21ae099f-serving-cert\""
Jul 30 20:09:36.291825 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.291801    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh"]
Jul 30 20:09:36.424719 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.424684    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b8078e7-6102-4d96-a90e-7b46adf270e9-openshift-service-ca\") pod \"maas-api-e2e-derive-21ae099f-67444b46c-pzsjh\" (UID: \"1b8078e7-6102-4d96-a90e-7b46adf270e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh"
Jul 30 20:09:36.424875 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.424760    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7zlp\" (UniqueName: \"kubernetes.io/projected/1b8078e7-6102-4d96-a90e-7b46adf270e9-kube-api-access-h7zlp\") pod \"maas-api-e2e-derive-21ae099f-67444b46c-pzsjh\" (UID: \"1b8078e7-6102-4d96-a90e-7b46adf270e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh"
Jul 30 20:09:36.424875 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.424808    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b8078e7-6102-4d96-a90e-7b46adf270e9-maas-api-tls\") pod \"maas-api-e2e-derive-21ae099f-67444b46c-pzsjh\" (UID: \"1b8078e7-6102-4d96-a90e-7b46adf270e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh"
Jul 30 20:09:36.526262 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.526224    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b8078e7-6102-4d96-a90e-7b46adf270e9-openshift-service-ca\") pod \"maas-api-e2e-derive-21ae099f-67444b46c-pzsjh\" (UID: \"1b8078e7-6102-4d96-a90e-7b46adf270e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh"
Jul 30 20:09:36.526448 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.526305    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7zlp\" (UniqueName: \"kubernetes.io/projected/1b8078e7-6102-4d96-a90e-7b46adf270e9-kube-api-access-h7zlp\") pod \"maas-api-e2e-derive-21ae099f-67444b46c-pzsjh\" (UID: \"1b8078e7-6102-4d96-a90e-7b46adf270e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh"
Jul 30 20:09:36.526448 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.526363    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b8078e7-6102-4d96-a90e-7b46adf270e9-maas-api-tls\") pod \"maas-api-e2e-derive-21ae099f-67444b46c-pzsjh\" (UID: \"1b8078e7-6102-4d96-a90e-7b46adf270e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh"
Jul 30 20:09:36.526979 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.526952    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b8078e7-6102-4d96-a90e-7b46adf270e9-openshift-service-ca\") pod \"maas-api-e2e-derive-21ae099f-67444b46c-pzsjh\" (UID: \"1b8078e7-6102-4d96-a90e-7b46adf270e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh"
Jul 30 20:09:36.528711 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.528691    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b8078e7-6102-4d96-a90e-7b46adf270e9-maas-api-tls\") pod \"maas-api-e2e-derive-21ae099f-67444b46c-pzsjh\" (UID: \"1b8078e7-6102-4d96-a90e-7b46adf270e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh"
Jul 30 20:09:36.533923 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.533865    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7zlp\" (UniqueName: \"kubernetes.io/projected/1b8078e7-6102-4d96-a90e-7b46adf270e9-kube-api-access-h7zlp\") pod \"maas-api-e2e-derive-21ae099f-67444b46c-pzsjh\" (UID: \"1b8078e7-6102-4d96-a90e-7b46adf270e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh"
Jul 30 20:09:36.600965 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.600928    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh"
Jul 30 20:09:36.609417 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.609384    2568 patch_prober.go:28] interesting pod/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 20:09:36.609535 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.609453    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq" podUID="4f10dc06-339c-42bc-bc2c-596987b32437" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 20:09:36.739829 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.739790    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh"]
Jul 30 20:09:36.744226 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:09:36.741944    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b8078e7_6102_4d96_a90e_7b46adf270e9.slice/crio-d72924e7cf7d63b300e5752d709beb79e999b33e826dfdf42b921d519b9ec4df WatchSource:0}: Error finding container d72924e7cf7d63b300e5752d709beb79e999b33e826dfdf42b921d519b9ec4df: Status 404 returned error can't find the container with id d72924e7cf7d63b300e5752d709beb79e999b33e826dfdf42b921d519b9ec4df
Jul 30 20:09:36.809054 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.809010    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh" event={"ID":"1b8078e7-6102-4d96-a90e-7b46adf270e9","Type":"ContainerStarted","Data":"d72924e7cf7d63b300e5752d709beb79e999b33e826dfdf42b921d519b9ec4df"}
Jul 30 20:09:36.929205 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.929173    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc"]
Jul 30 20:09:36.934104 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.934083    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc"
Jul 30 20:09:36.936710 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.936691    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-21ae099f\""
Jul 30 20:09:36.936843 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.936757    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-21ae099f-dockercfg-tq5dw\""
Jul 30 20:09:36.943221 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.942786    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc"]
Jul 30 20:09:36.954896 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.954874    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd"]
Jul 30 20:09:36.958927 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.958910    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd"
Jul 30 20:09:36.966944 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:36.966665    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd"]
Jul 30 20:09:37.033234 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.033065    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a696da0-a7a0-409d-bac1-51d23021b0c6-plugins-config-volume\") pod \"payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd\" (UID: \"6a696da0-a7a0-409d-bac1-51d23021b0c6\") " pod="openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd"
Jul 30 20:09:37.033234 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.033151    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2zpw\" (UniqueName: \"kubernetes.io/projected/6a696da0-a7a0-409d-bac1-51d23021b0c6-kube-api-access-d2zpw\") pod \"payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd\" (UID: \"6a696da0-a7a0-409d-bac1-51d23021b0c6\") " pod="openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd"
Jul 30 20:09:37.033234 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.033206    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scm9v\" (UniqueName: \"kubernetes.io/projected/0c68e5af-d30e-4a66-9688-c9ab73f9bbc9-kube-api-access-scm9v\") pod \"payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc\" (UID: \"0c68e5af-d30e-4a66-9688-c9ab73f9bbc9\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc"
Jul 30 20:09:37.033502 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.033242    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c68e5af-d30e-4a66-9688-c9ab73f9bbc9-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc\" (UID: \"0c68e5af-d30e-4a66-9688-c9ab73f9bbc9\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc"
Jul 30 20:09:37.134470 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.134424    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a696da0-a7a0-409d-bac1-51d23021b0c6-plugins-config-volume\") pod \"payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd\" (UID: \"6a696da0-a7a0-409d-bac1-51d23021b0c6\") " pod="openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd"
Jul 30 20:09:37.134677 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.134523    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2zpw\" (UniqueName: \"kubernetes.io/projected/6a696da0-a7a0-409d-bac1-51d23021b0c6-kube-api-access-d2zpw\") pod \"payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd\" (UID: \"6a696da0-a7a0-409d-bac1-51d23021b0c6\") " pod="openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd"
Jul 30 20:09:37.134677 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.134637    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scm9v\" (UniqueName: \"kubernetes.io/projected/0c68e5af-d30e-4a66-9688-c9ab73f9bbc9-kube-api-access-scm9v\") pod \"payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc\" (UID: \"0c68e5af-d30e-4a66-9688-c9ab73f9bbc9\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc"
Jul 30 20:09:37.134802 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.134679    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c68e5af-d30e-4a66-9688-c9ab73f9bbc9-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc\" (UID: \"0c68e5af-d30e-4a66-9688-c9ab73f9bbc9\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc"
Jul 30 20:09:37.135242 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.135216    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a696da0-a7a0-409d-bac1-51d23021b0c6-plugins-config-volume\") pod \"payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd\" (UID: \"6a696da0-a7a0-409d-bac1-51d23021b0c6\") " pod="openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd"
Jul 30 20:09:37.135524 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.135504    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c68e5af-d30e-4a66-9688-c9ab73f9bbc9-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc\" (UID: \"0c68e5af-d30e-4a66-9688-c9ab73f9bbc9\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc"
Jul 30 20:09:37.142986 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.142956    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2zpw\" (UniqueName: \"kubernetes.io/projected/6a696da0-a7a0-409d-bac1-51d23021b0c6-kube-api-access-d2zpw\") pod \"payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd\" (UID: \"6a696da0-a7a0-409d-bac1-51d23021b0c6\") " pod="openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd"
Jul 30 20:09:37.143401 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.143374    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scm9v\" (UniqueName: \"kubernetes.io/projected/0c68e5af-d30e-4a66-9688-c9ab73f9bbc9-kube-api-access-scm9v\") pod \"payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc\" (UID: \"0c68e5af-d30e-4a66-9688-c9ab73f9bbc9\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc"
Jul 30 20:09:37.248931 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.248843    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc"
Jul 30 20:09:37.271284 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.271203    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd"
Jul 30 20:09:37.293731 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.293704    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:09:37.410558 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.410516    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc"]
Jul 30 20:09:37.414426 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:09:37.414389    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c68e5af_d30e_4a66_9688_c9ab73f9bbc9.slice/crio-b1969bb88ad837cc3da5f1d8cac8003a7dec549421bf7c9ad9c315220e17c206 WatchSource:0}: Error finding container b1969bb88ad837cc3da5f1d8cac8003a7dec549421bf7c9ad9c315220e17c206: Status 404 returned error can't find the container with id b1969bb88ad837cc3da5f1d8cac8003a7dec549421bf7c9ad9c315220e17c206
Jul 30 20:09:37.437469 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.437439    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-istio-envoy\") pod \"4f10dc06-339c-42bc-bc2c-596987b32437\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") "
Jul 30 20:09:37.437613 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.437542    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-workload-certs\") pod \"4f10dc06-339c-42bc-bc2c-596987b32437\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") "
Jul 30 20:09:37.437694 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.437648    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-workload-socket\") pod \"4f10dc06-339c-42bc-bc2c-596987b32437\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") "
Jul 30 20:09:37.437694 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.437681    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-istio-data\") pod \"4f10dc06-339c-42bc-bc2c-596987b32437\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") "
Jul 30 20:09:37.437808 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.437725    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-credential-socket\") pod \"4f10dc06-339c-42bc-bc2c-596987b32437\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") "
Jul 30 20:09:37.437808 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.437770    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqf84\" (UniqueName: \"kubernetes.io/projected/4f10dc06-339c-42bc-bc2c-596987b32437-kube-api-access-hqf84\") pod \"4f10dc06-339c-42bc-bc2c-596987b32437\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") "
Jul 30 20:09:37.437925 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.437807    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4f10dc06-339c-42bc-bc2c-596987b32437" (UID: "4f10dc06-339c-42bc-bc2c-596987b32437"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:09:37.437925 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.437814    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f10dc06-339c-42bc-bc2c-596987b32437-istio-podinfo\") pod \"4f10dc06-339c-42bc-bc2c-596987b32437\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") "
Jul 30 20:09:37.437925 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.437907    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f10dc06-339c-42bc-bc2c-596987b32437-istiod-ca-cert\") pod \"4f10dc06-339c-42bc-bc2c-596987b32437\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") "
Jul 30 20:09:37.438085 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.437924    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4f10dc06-339c-42bc-bc2c-596987b32437" (UID: "4f10dc06-339c-42bc-bc2c-596987b32437"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:09:37.438085 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.437941    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f10dc06-339c-42bc-bc2c-596987b32437-istio-token\") pod \"4f10dc06-339c-42bc-bc2c-596987b32437\" (UID: \"4f10dc06-339c-42bc-bc2c-596987b32437\") "
Jul 30 20:09:37.438772 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.438274    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f10dc06-339c-42bc-bc2c-596987b32437-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4f10dc06-339c-42bc-bc2c-596987b32437" (UID: "4f10dc06-339c-42bc-bc2c-596987b32437"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:09:37.438772 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.438640    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4f10dc06-339c-42bc-bc2c-596987b32437" (UID: "4f10dc06-339c-42bc-bc2c-596987b32437"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:09:37.438772 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.438332    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-workload-certs\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:09:37.438772 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.438731    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-workload-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:09:37.439073 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.438931    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-istio-data" (OuterVolumeSpecName: "istio-data") pod "4f10dc06-339c-42bc-bc2c-596987b32437" (UID: "4f10dc06-339c-42bc-bc2c-596987b32437"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:09:37.440532 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.439887    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4f10dc06-339c-42bc-bc2c-596987b32437-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4f10dc06-339c-42bc-bc2c-596987b32437" (UID: "4f10dc06-339c-42bc-bc2c-596987b32437"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 20:09:37.440532 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.440490    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4f10dc06-339c-42bc-bc2c-596987b32437" (UID: "4f10dc06-339c-42bc-bc2c-596987b32437"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:09:37.443701 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.443638    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f10dc06-339c-42bc-bc2c-596987b32437-istio-token" (OuterVolumeSpecName: "istio-token") pod "4f10dc06-339c-42bc-bc2c-596987b32437" (UID: "4f10dc06-339c-42bc-bc2c-596987b32437"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:09:37.443701 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.443660    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f10dc06-339c-42bc-bc2c-596987b32437-kube-api-access-hqf84" (OuterVolumeSpecName: "kube-api-access-hqf84") pod "4f10dc06-339c-42bc-bc2c-596987b32437" (UID: "4f10dc06-339c-42bc-bc2c-596987b32437"). InnerVolumeSpecName "kube-api-access-hqf84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:09:37.446138 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.446115    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd"]
Jul 30 20:09:37.450207 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:09:37.450154    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a696da0_a7a0_409d_bac1_51d23021b0c6.slice/crio-fdf44321a8490781b492a8ca7e7c0e4bd77525a3b8b837d8ec9cb7d6069a84a8 WatchSource:0}: Error finding container fdf44321a8490781b492a8ca7e7c0e4bd77525a3b8b837d8ec9cb7d6069a84a8: Status 404 returned error can't find the container with id fdf44321a8490781b492a8ca7e7c0e4bd77525a3b8b837d8ec9cb7d6069a84a8
Jul 30 20:09:37.540389 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.540260    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-istio-data\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:09:37.540389 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.540295    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-credential-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:09:37.540389 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.540311    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqf84\" (UniqueName: \"kubernetes.io/projected/4f10dc06-339c-42bc-bc2c-596987b32437-kube-api-access-hqf84\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:09:37.540389 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.540326    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f10dc06-339c-42bc-bc2c-596987b32437-istio-podinfo\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:09:37.540389 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.540339    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f10dc06-339c-42bc-bc2c-596987b32437-istiod-ca-cert\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:09:37.540389 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.540354    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f10dc06-339c-42bc-bc2c-596987b32437-istio-token\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:09:37.540389 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.540367    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f10dc06-339c-42bc-bc2c-596987b32437-istio-envoy\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:09:37.823398 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.823357    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc" event={"ID":"0c68e5af-d30e-4a66-9688-c9ab73f9bbc9","Type":"ContainerStarted","Data":"502f91523df9b7db21f8a2446eab4406d38e665e326945540b0a1076c6314e9e"}
Jul 30 20:09:37.823608 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.823452    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc" event={"ID":"0c68e5af-d30e-4a66-9688-c9ab73f9bbc9","Type":"ContainerStarted","Data":"b1969bb88ad837cc3da5f1d8cac8003a7dec549421bf7c9ad9c315220e17c206"}
Jul 30 20:09:37.823608 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.823484    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc"
Jul 30 20:09:37.824882 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.824850    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd" event={"ID":"6a696da0-a7a0-409d-bac1-51d23021b0c6","Type":"ContainerStarted","Data":"94ebb2aabafc543e5866f825846e4030b6d13f02ff92a787b18fca1f7580d746"}
Jul 30 20:09:37.824989 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.824892    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd" event={"ID":"6a696da0-a7a0-409d-bac1-51d23021b0c6","Type":"ContainerStarted","Data":"fdf44321a8490781b492a8ca7e7c0e4bd77525a3b8b837d8ec9cb7d6069a84a8"}
Jul 30 20:09:37.824989 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.824945    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd"
Jul 30 20:09:37.826380 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.826354    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh" event={"ID":"1b8078e7-6102-4d96-a90e-7b46adf270e9","Type":"ContainerStarted","Data":"7c4be75fe404791fe19225700d826c49bbdf1dbd95450f4fb833c3a57292c188"}
Jul 30 20:09:37.826501 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.826404    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh"
Jul 30 20:09:37.827923 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.827903    2568 generic.go:356] "Generic (PLEG): container finished" podID="4f10dc06-339c-42bc-bc2c-596987b32437" containerID="7918fb60522bcaf256f948a4fbb423ba70b7f7869310317cd20711b68102e75a" exitCode=0
Jul 30 20:09:37.828023 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.827952    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"
Jul 30 20:09:37.828023 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.827983    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq" event={"ID":"4f10dc06-339c-42bc-bc2c-596987b32437","Type":"ContainerDied","Data":"7918fb60522bcaf256f948a4fbb423ba70b7f7869310317cd20711b68102e75a"}
Jul 30 20:09:37.828128 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.828030    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq" event={"ID":"4f10dc06-339c-42bc-bc2c-596987b32437","Type":"ContainerDied","Data":"babae8268e4d9cdb78cfbf0155a87e42f8c36c2b059fdbe88aa1e5ba9a3c6c9f"}
Jul 30 20:09:37.828128 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.828054    2568 scope.go:117] "RemoveContainer" containerID="7918fb60522bcaf256f948a4fbb423ba70b7f7869310317cd20711b68102e75a"
Jul 30 20:09:37.841833 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.841379    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc" podStartSLOduration=1.841357986 podStartE2EDuration="1.841357986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:09:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:09:37.837601005 +0000 UTC m=+1798.937682193" watchObservedRunningTime="2026-07-30 20:09:37.841357986 +0000 UTC m=+1798.941439175"
Jul 30 20:09:37.841833 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.841771    2568 scope.go:117] "RemoveContainer" containerID="48c90efadef605fa591aa76ac43f4d009fc34afd0c0529dc4c74d28e00869e03"
Jul 30 20:09:37.851948 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.851927    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"]
Jul 30 20:09:37.855256 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.855229    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-be206e5c-openshift-default-74b85cd856-db9zq"]
Jul 30 20:09:37.855675 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.855660    2568 scope.go:117] "RemoveContainer" containerID="7918fb60522bcaf256f948a4fbb423ba70b7f7869310317cd20711b68102e75a"
Jul 30 20:09:37.855942 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:09:37.855924    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7918fb60522bcaf256f948a4fbb423ba70b7f7869310317cd20711b68102e75a\": container with ID starting with 7918fb60522bcaf256f948a4fbb423ba70b7f7869310317cd20711b68102e75a not found: ID does not exist" containerID="7918fb60522bcaf256f948a4fbb423ba70b7f7869310317cd20711b68102e75a"
Jul 30 20:09:37.856012 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.855949    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7918fb60522bcaf256f948a4fbb423ba70b7f7869310317cd20711b68102e75a"} err="failed to get container status \"7918fb60522bcaf256f948a4fbb423ba70b7f7869310317cd20711b68102e75a\": rpc error: code = NotFound desc = could not find container \"7918fb60522bcaf256f948a4fbb423ba70b7f7869310317cd20711b68102e75a\": container with ID starting with 7918fb60522bcaf256f948a4fbb423ba70b7f7869310317cd20711b68102e75a not found: ID does not exist"
Jul 30 20:09:37.856012 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.855965    2568 scope.go:117] "RemoveContainer" containerID="48c90efadef605fa591aa76ac43f4d009fc34afd0c0529dc4c74d28e00869e03"
Jul 30 20:09:37.856182 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:09:37.856168    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48c90efadef605fa591aa76ac43f4d009fc34afd0c0529dc4c74d28e00869e03\": container with ID starting with 48c90efadef605fa591aa76ac43f4d009fc34afd0c0529dc4c74d28e00869e03 not found: ID does not exist" containerID="48c90efadef605fa591aa76ac43f4d009fc34afd0c0529dc4c74d28e00869e03"
Jul 30 20:09:37.856221 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.856186    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48c90efadef605fa591aa76ac43f4d009fc34afd0c0529dc4c74d28e00869e03"} err="failed to get container status \"48c90efadef605fa591aa76ac43f4d009fc34afd0c0529dc4c74d28e00869e03\": rpc error: code = NotFound desc = could not find container \"48c90efadef605fa591aa76ac43f4d009fc34afd0c0529dc4c74d28e00869e03\": container with ID starting with 48c90efadef605fa591aa76ac43f4d009fc34afd0c0529dc4c74d28e00869e03 not found: ID does not exist"
Jul 30 20:09:37.867063 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.867000    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh" podStartSLOduration=1.5312756969999999 podStartE2EDuration="1.866986979s" totalImagesPullingTime="335.711282ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:09:37.866287881 +0000 UTC m=+1798.966369092" watchObservedRunningTime="2026-07-30 20:09:37.866986979 +0000 UTC m=+1798.967068165"
Jul 30 20:09:37.881979 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:37.881938    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd" podStartSLOduration=1.881925464 podStartE2EDuration="1.881925464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:09:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:09:37.88047124 +0000 UTC m=+1798.980552428" watchObservedRunningTime="2026-07-30 20:09:37.881925464 +0000 UTC m=+1798.982006651"
Jul 30 20:09:39.485422 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:39.485381    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f10dc06-339c-42bc-bc2c-596987b32437" path="/var/lib/kubelet/pods/4f10dc06-339c-42bc-bc2c-596987b32437/volumes"
Jul 30 20:09:43.841440 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:43.840527    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh"
Jul 30 20:09:48.836686 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:48.836648    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc"
Jul 30 20:09:48.837104 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:48.836722    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd"
Jul 30 20:09:49.908918 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:49.908880    2568 generic.go:356] "Generic (PLEG): container finished" podID="a64bb3cb-97bf-4406-890d-11c25a8ed53e" containerID="3fd7fcfd6f437c74f5155d772cfbf7e84ce2c88c66003d198a51cf0285280481" exitCode=0
Jul 30 20:09:49.909463 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:49.908967    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj" event={"ID":"a64bb3cb-97bf-4406-890d-11c25a8ed53e","Type":"ContainerDied","Data":"3fd7fcfd6f437c74f5155d772cfbf7e84ce2c88c66003d198a51cf0285280481"}
Jul 30 20:09:49.909534 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:49.909477    2568 scope.go:117] "RemoveContainer" containerID="3fd7fcfd6f437c74f5155d772cfbf7e84ce2c88c66003d198a51cf0285280481"
Jul 30 20:09:49.910631 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:49.910601    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:09:49.910771 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:49.910686    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:09:49.910771 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:49.910734    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:09:50.802117 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:50.802086    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:50.916664 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:50.916627    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj" event={"ID":"a64bb3cb-97bf-4406-890d-11c25a8ed53e","Type":"ContainerStarted","Data":"51a5a51377f4fe282aeffed506a98b9696d13d531ddaef01dcff5531725dd8f9"}
Jul 30 20:09:51.103340 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:51.103308    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:51.104520 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:51.104493    2568 patch_prober.go:28] interesting pod/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 30 20:09:51.104617 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:51.104542    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj" podUID="a64bb3cb-97bf-4406-890d-11c25a8ed53e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 30 20:09:52.103886 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:52.103853    2568 patch_prober.go:28] interesting pod/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 30 20:09:52.104264 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:52.103903    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj" podUID="a64bb3cb-97bf-4406-890d-11c25a8ed53e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 30 20:09:53.103072 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:53.103037    2568 patch_prober.go:28] interesting pod/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 30 20:09:53.103252 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:53.103093    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj" podUID="a64bb3cb-97bf-4406-890d-11c25a8ed53e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 30 20:09:54.103132 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:54.103092    2568 patch_prober.go:28] interesting pod/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 30 20:09:54.103522 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:54.103152    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj" podUID="a64bb3cb-97bf-4406-890d-11c25a8ed53e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 30 20:09:55.108303 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:55.108271    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:55.108731 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:55.108599    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:09:55.109421 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:09:55.109403    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:10:00.098140 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:00.098100    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21ae099f-pj9j4"]
Jul 30 20:10:00.098558 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:00.098545    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f10dc06-339c-42bc-bc2c-596987b32437" containerName="istio-proxy"
Jul 30 20:10:00.098622 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:00.098558    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f10dc06-339c-42bc-bc2c-596987b32437" containerName="istio-proxy"
Jul 30 20:10:00.098622 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:00.098591    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f10dc06-339c-42bc-bc2c-596987b32437" containerName="istio-proxy"
Jul 30 20:10:00.098622 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:00.098598    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f10dc06-339c-42bc-bc2c-596987b32437" containerName="istio-proxy"
Jul 30 20:10:00.098721 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:00.098670    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f10dc06-339c-42bc-bc2c-596987b32437" containerName="istio-proxy"
Jul 30 20:10:00.102158 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:00.102142    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21ae099f-pj9j4"
Jul 30 20:10:00.104698 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:00.104654    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mgdxn\""
Jul 30 20:10:00.109183 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:00.109151    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21ae099f-pj9j4"]
Jul 30 20:10:00.167471 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:00.167440    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1f1a029-decb-4672-867d-1c4318b60a25-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-21ae099f-pj9j4\" (UID: \"a1f1a029-decb-4672-867d-1c4318b60a25\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21ae099f-pj9j4"
Jul 30 20:10:00.268665 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:00.268632    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1f1a029-decb-4672-867d-1c4318b60a25-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-21ae099f-pj9j4\" (UID: \"a1f1a029-decb-4672-867d-1c4318b60a25\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21ae099f-pj9j4"
Jul 30 20:10:00.269257 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:00.269236    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1f1a029-decb-4672-867d-1c4318b60a25-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-21ae099f-pj9j4\" (UID: \"a1f1a029-decb-4672-867d-1c4318b60a25\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21ae099f-pj9j4"
Jul 30 20:10:00.416235 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:00.416156    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21ae099f-pj9j4"
Jul 30 20:10:00.554341 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:00.554314    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21ae099f-pj9j4"]
Jul 30 20:10:00.556202 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:10:00.556174    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f1a029_decb_4672_867d_1c4318b60a25.slice/crio-044e8d147b127672a1c6ecb3e7390aaac3eae3ae6df9c8968356ecee7ea8f839 WatchSource:0}: Error finding container 044e8d147b127672a1c6ecb3e7390aaac3eae3ae6df9c8968356ecee7ea8f839: Status 404 returned error can't find the container with id 044e8d147b127672a1c6ecb3e7390aaac3eae3ae6df9c8968356ecee7ea8f839
Jul 30 20:10:00.976041 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:00.976007    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21ae099f-pj9j4" event={"ID":"a1f1a029-decb-4672-867d-1c4318b60a25","Type":"ContainerStarted","Data":"7e744ce6ad0073aef53cff154a34fb9f8770238c464e398bd11f15318037c93a"}
Jul 30 20:10:00.976256 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:00.976059    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21ae099f-pj9j4" event={"ID":"a1f1a029-decb-4672-867d-1c4318b60a25","Type":"ContainerStarted","Data":"044e8d147b127672a1c6ecb3e7390aaac3eae3ae6df9c8968356ecee7ea8f839"}
Jul 30 20:10:00.990409 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:00.990350    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21ae099f-pj9j4" podStartSLOduration=0.990332642 podStartE2EDuration="990.332642ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:10:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:10:00.990311115 +0000 UTC m=+1822.090392301" watchObservedRunningTime="2026-07-30 20:10:00.990332642 +0000 UTC m=+1822.090413824"
Jul 30 20:10:01.982775 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:01.982738    2568 generic.go:356] "Generic (PLEG): container finished" podID="a1f1a029-decb-4672-867d-1c4318b60a25" containerID="7e744ce6ad0073aef53cff154a34fb9f8770238c464e398bd11f15318037c93a" exitCode=0
Jul 30 20:10:01.983184 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:01.982823    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21ae099f-pj9j4" event={"ID":"a1f1a029-decb-4672-867d-1c4318b60a25","Type":"ContainerDied","Data":"7e744ce6ad0073aef53cff154a34fb9f8770238c464e398bd11f15318037c93a"}
Jul 30 20:10:03.141659 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:03.141635    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21ae099f-pj9j4"
Jul 30 20:10:03.199596 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:03.199552    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1f1a029-decb-4672-867d-1c4318b60a25-maas-api-service-ca\") pod \"a1f1a029-decb-4672-867d-1c4318b60a25\" (UID: \"a1f1a029-decb-4672-867d-1c4318b60a25\") "
Jul 30 20:10:03.199949 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:03.199926    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1f1a029-decb-4672-867d-1c4318b60a25-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a1f1a029-decb-4672-867d-1c4318b60a25" (UID: "a1f1a029-decb-4672-867d-1c4318b60a25"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:10:03.300559 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:03.300481    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1f1a029-decb-4672-867d-1c4318b60a25-maas-api-service-ca\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:10:03.995231 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:03.995199    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21ae099f-pj9j4"
Jul 30 20:10:03.995231 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:03.995230    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21ae099f-pj9j4" event={"ID":"a1f1a029-decb-4672-867d-1c4318b60a25","Type":"ContainerDied","Data":"044e8d147b127672a1c6ecb3e7390aaac3eae3ae6df9c8968356ecee7ea8f839"}
Jul 30 20:10:03.995445 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:03.995278    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="044e8d147b127672a1c6ecb3e7390aaac3eae3ae6df9c8968356ecee7ea8f839"
Jul 30 20:10:06.815663 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:06.815619    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh"]
Jul 30 20:10:06.816264 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:06.815859    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh" podUID="1b8078e7-6102-4d96-a90e-7b46adf270e9" containerName="maas-api" containerID="cri-o://7c4be75fe404791fe19225700d826c49bbdf1dbd95450f4fb833c3a57292c188" gracePeriod=30
Jul 30 20:10:06.873957 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:06.873922    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd"]
Jul 30 20:10:06.874207 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:06.874174    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd" podUID="6a696da0-a7a0-409d-bac1-51d23021b0c6" containerName="payload-processing" containerID="cri-o://94ebb2aabafc543e5866f825846e4030b6d13f02ff92a787b18fca1f7580d746" gracePeriod=30
Jul 30 20:10:06.885847 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:06.885708    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc"]
Jul 30 20:10:06.885962 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:06.885932    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc" podUID="0c68e5af-d30e-4a66-9688-c9ab73f9bbc9" containerName="payload-pre-processing" containerID="cri-o://502f91523df9b7db21f8a2446eab4406d38e665e326945540b0a1076c6314e9e" gracePeriod=30
Jul 30 20:10:07.013312 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.013280    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21ae099f-pj9j4"]
Jul 30 20:10:07.016819 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.016789    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-21ae099f-pj9j4"]
Jul 30 20:10:07.017752 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.017724    2568 generic.go:356] "Generic (PLEG): container finished" podID="0c68e5af-d30e-4a66-9688-c9ab73f9bbc9" containerID="502f91523df9b7db21f8a2446eab4406d38e665e326945540b0a1076c6314e9e" exitCode=0
Jul 30 20:10:07.017847 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.017814    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc" event={"ID":"0c68e5af-d30e-4a66-9688-c9ab73f9bbc9","Type":"ContainerDied","Data":"502f91523df9b7db21f8a2446eab4406d38e665e326945540b0a1076c6314e9e"}
Jul 30 20:10:07.019831 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.019792    2568 generic.go:356] "Generic (PLEG): container finished" podID="6a696da0-a7a0-409d-bac1-51d23021b0c6" containerID="94ebb2aabafc543e5866f825846e4030b6d13f02ff92a787b18fca1f7580d746" exitCode=0
Jul 30 20:10:07.019945 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.019866    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd" event={"ID":"6a696da0-a7a0-409d-bac1-51d23021b0c6","Type":"ContainerDied","Data":"94ebb2aabafc543e5866f825846e4030b6d13f02ff92a787b18fca1f7580d746"}
Jul 30 20:10:07.021828 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.021796    2568 generic.go:356] "Generic (PLEG): container finished" podID="1b8078e7-6102-4d96-a90e-7b46adf270e9" containerID="7c4be75fe404791fe19225700d826c49bbdf1dbd95450f4fb833c3a57292c188" exitCode=0
Jul 30 20:10:07.021933 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.021871    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh" event={"ID":"1b8078e7-6102-4d96-a90e-7b46adf270e9","Type":"ContainerDied","Data":"7c4be75fe404791fe19225700d826c49bbdf1dbd95450f4fb833c3a57292c188"}
Jul 30 20:10:07.144758 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.144717    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"]
Jul 30 20:10:07.145208 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.145179    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj" podUID="a64bb3cb-97bf-4406-890d-11c25a8ed53e" containerName="istio-proxy" containerID="cri-o://51a5a51377f4fe282aeffed506a98b9696d13d531ddaef01dcff5531725dd8f9" gracePeriod=30
Jul 30 20:10:07.180052 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.180027    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd"
Jul 30 20:10:07.185736 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.185715    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh"
Jul 30 20:10:07.221285 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.221200    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc"
Jul 30 20:10:07.239678 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.239651    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b8078e7-6102-4d96-a90e-7b46adf270e9-openshift-service-ca\") pod \"1b8078e7-6102-4d96-a90e-7b46adf270e9\" (UID: \"1b8078e7-6102-4d96-a90e-7b46adf270e9\") "
Jul 30 20:10:07.239955 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.239938    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b8078e7-6102-4d96-a90e-7b46adf270e9-maas-api-tls\") pod \"1b8078e7-6102-4d96-a90e-7b46adf270e9\" (UID: \"1b8078e7-6102-4d96-a90e-7b46adf270e9\") "
Jul 30 20:10:07.240443 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.240115    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b8078e7-6102-4d96-a90e-7b46adf270e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1b8078e7-6102-4d96-a90e-7b46adf270e9" (UID: "1b8078e7-6102-4d96-a90e-7b46adf270e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:10:07.240665 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.240652    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7zlp\" (UniqueName: \"kubernetes.io/projected/1b8078e7-6102-4d96-a90e-7b46adf270e9-kube-api-access-h7zlp\") pod \"1b8078e7-6102-4d96-a90e-7b46adf270e9\" (UID: \"1b8078e7-6102-4d96-a90e-7b46adf270e9\") "
Jul 30 20:10:07.241083 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.241066    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2zpw\" (UniqueName: \"kubernetes.io/projected/6a696da0-a7a0-409d-bac1-51d23021b0c6-kube-api-access-d2zpw\") pod \"6a696da0-a7a0-409d-bac1-51d23021b0c6\" (UID: \"6a696da0-a7a0-409d-bac1-51d23021b0c6\") "
Jul 30 20:10:07.241637 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.241620    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a696da0-a7a0-409d-bac1-51d23021b0c6-plugins-config-volume\") pod \"6a696da0-a7a0-409d-bac1-51d23021b0c6\" (UID: \"6a696da0-a7a0-409d-bac1-51d23021b0c6\") "
Jul 30 20:10:07.242227 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.242165    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a696da0-a7a0-409d-bac1-51d23021b0c6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6a696da0-a7a0-409d-bac1-51d23021b0c6" (UID: "6a696da0-a7a0-409d-bac1-51d23021b0c6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:10:07.244355 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.244317    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b8078e7-6102-4d96-a90e-7b46adf270e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1b8078e7-6102-4d96-a90e-7b46adf270e9" (UID: "1b8078e7-6102-4d96-a90e-7b46adf270e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:10:07.247086 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.247050    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a696da0-a7a0-409d-bac1-51d23021b0c6-kube-api-access-d2zpw" (OuterVolumeSpecName: "kube-api-access-d2zpw") pod "6a696da0-a7a0-409d-bac1-51d23021b0c6" (UID: "6a696da0-a7a0-409d-bac1-51d23021b0c6"). InnerVolumeSpecName "kube-api-access-d2zpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:10:07.248941 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.248899    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b8078e7-6102-4d96-a90e-7b46adf270e9-kube-api-access-h7zlp" (OuterVolumeSpecName: "kube-api-access-h7zlp") pod "1b8078e7-6102-4d96-a90e-7b46adf270e9" (UID: "1b8078e7-6102-4d96-a90e-7b46adf270e9"). InnerVolumeSpecName "kube-api-access-h7zlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:10:07.249423 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.249346    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b8078e7-6102-4d96-a90e-7b46adf270e9-maas-api-tls\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:10:07.249598 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.249549    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7zlp\" (UniqueName: \"kubernetes.io/projected/1b8078e7-6102-4d96-a90e-7b46adf270e9-kube-api-access-h7zlp\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:10:07.249729 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.249714    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2zpw\" (UniqueName: \"kubernetes.io/projected/6a696da0-a7a0-409d-bac1-51d23021b0c6-kube-api-access-d2zpw\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:10:07.249828 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.249816    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a696da0-a7a0-409d-bac1-51d23021b0c6-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:10:07.252622 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.252604    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b8078e7-6102-4d96-a90e-7b46adf270e9-openshift-service-ca\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:10:07.353350 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.353266    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c68e5af-d30e-4a66-9688-c9ab73f9bbc9-plugins-config-volume\") pod \"0c68e5af-d30e-4a66-9688-c9ab73f9bbc9\" (UID: \"0c68e5af-d30e-4a66-9688-c9ab73f9bbc9\") "
Jul 30 20:10:07.353350 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.353329    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scm9v\" (UniqueName: \"kubernetes.io/projected/0c68e5af-d30e-4a66-9688-c9ab73f9bbc9-kube-api-access-scm9v\") pod \"0c68e5af-d30e-4a66-9688-c9ab73f9bbc9\" (UID: \"0c68e5af-d30e-4a66-9688-c9ab73f9bbc9\") "
Jul 30 20:10:07.353680 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.353638    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c68e5af-d30e-4a66-9688-c9ab73f9bbc9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0c68e5af-d30e-4a66-9688-c9ab73f9bbc9" (UID: "0c68e5af-d30e-4a66-9688-c9ab73f9bbc9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:10:07.353814 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.353742    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c68e5af-d30e-4a66-9688-c9ab73f9bbc9-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:10:07.355359 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.355339    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c68e5af-d30e-4a66-9688-c9ab73f9bbc9-kube-api-access-scm9v" (OuterVolumeSpecName: "kube-api-access-scm9v") pod "0c68e5af-d30e-4a66-9688-c9ab73f9bbc9" (UID: "0c68e5af-d30e-4a66-9688-c9ab73f9bbc9"). InnerVolumeSpecName "kube-api-access-scm9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:10:07.454757 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.454726    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scm9v\" (UniqueName: \"kubernetes.io/projected/0c68e5af-d30e-4a66-9688-c9ab73f9bbc9-kube-api-access-scm9v\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:10:07.481713 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:07.481685    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1f1a029-decb-4672-867d-1c4318b60a25" path="/var/lib/kubelet/pods/a1f1a029-decb-4672-867d-1c4318b60a25/volumes"
Jul 30 20:10:08.029764 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:08.029734    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd"
Jul 30 20:10:08.030201 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:08.029731    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd" event={"ID":"6a696da0-a7a0-409d-bac1-51d23021b0c6","Type":"ContainerDied","Data":"fdf44321a8490781b492a8ca7e7c0e4bd77525a3b8b837d8ec9cb7d6069a84a8"}
Jul 30 20:10:08.030201 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:08.029876    2568 scope.go:117] "RemoveContainer" containerID="94ebb2aabafc543e5866f825846e4030b6d13f02ff92a787b18fca1f7580d746"
Jul 30 20:10:08.031406 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:08.031254    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh"
Jul 30 20:10:08.031406 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:08.031293    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh" event={"ID":"1b8078e7-6102-4d96-a90e-7b46adf270e9","Type":"ContainerDied","Data":"d72924e7cf7d63b300e5752d709beb79e999b33e826dfdf42b921d519b9ec4df"}
Jul 30 20:10:08.032925 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:08.032901    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc" event={"ID":"0c68e5af-d30e-4a66-9688-c9ab73f9bbc9","Type":"ContainerDied","Data":"b1969bb88ad837cc3da5f1d8cac8003a7dec549421bf7c9ad9c315220e17c206"}
Jul 30 20:10:08.033057 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:08.032936    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc"
Jul 30 20:10:08.042384 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:08.042359    2568 scope.go:117] "RemoveContainer" containerID="7c4be75fe404791fe19225700d826c49bbdf1dbd95450f4fb833c3a57292c188"
Jul 30 20:10:08.053991 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:08.053969    2568 scope.go:117] "RemoveContainer" containerID="502f91523df9b7db21f8a2446eab4406d38e665e326945540b0a1076c6314e9e"
Jul 30 20:10:08.062654 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:08.062625    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc"]
Jul 30 20:10:08.068377 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:08.068357    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-21ae099f-fddccbc96-2j2xc"]
Jul 30 20:10:08.084165 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:08.084105    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh"]
Jul 30 20:10:08.089490 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:08.089466    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-21ae099f-67444b46c-pzsjh"]
Jul 30 20:10:08.099782 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:08.099754    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd"]
Jul 30 20:10:08.105526 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:08.105503    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-21ae099f-5fd9bd967d-9shvd"]
Jul 30 20:10:09.481757 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:09.481724    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c68e5af-d30e-4a66-9688-c9ab73f9bbc9" path="/var/lib/kubelet/pods/0c68e5af-d30e-4a66-9688-c9ab73f9bbc9/volumes"
Jul 30 20:10:09.482151 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:09.482099    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b8078e7-6102-4d96-a90e-7b46adf270e9" path="/var/lib/kubelet/pods/1b8078e7-6102-4d96-a90e-7b46adf270e9/volumes"
Jul 30 20:10:09.482423 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:09.482411    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a696da0-a7a0-409d-bac1-51d23021b0c6" path="/var/lib/kubelet/pods/6a696da0-a7a0-409d-bac1-51d23021b0c6/volumes"
Jul 30 20:10:10.111744 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:10.111709    2568 patch_prober.go:28] interesting pod/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 20:10:10.111960 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:10.111777    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj" podUID="a64bb3cb-97bf-4406-890d-11c25a8ed53e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 20:10:12.395542 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.395519    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:10:12.505948 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.505865    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-workload-socket\") pod \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") "
Jul 30 20:10:12.505948 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.505913    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-token\") pod \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") "
Jul 30 20:10:12.506134 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.505958    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-credential-socket\") pod \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") "
Jul 30 20:10:12.506134 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.505997    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-podinfo\") pod \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") "
Jul 30 20:10:12.506134 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.506055    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istiod-ca-cert\") pod \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") "
Jul 30 20:10:12.506134 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.506070    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-workload-certs\") pod \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") "
Jul 30 20:10:12.506134 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.506097    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbz2k\" (UniqueName: \"kubernetes.io/projected/a64bb3cb-97bf-4406-890d-11c25a8ed53e-kube-api-access-cbz2k\") pod \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") "
Jul 30 20:10:12.506400 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.506154    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a64bb3cb-97bf-4406-890d-11c25a8ed53e" (UID: "a64bb3cb-97bf-4406-890d-11c25a8ed53e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:10:12.506400 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.506202    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-envoy\") pod \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") "
Jul 30 20:10:12.506400 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.506240    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-data\") pod \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\" (UID: \"a64bb3cb-97bf-4406-890d-11c25a8ed53e\") "
Jul 30 20:10:12.506400 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.506304    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a64bb3cb-97bf-4406-890d-11c25a8ed53e" (UID: "a64bb3cb-97bf-4406-890d-11c25a8ed53e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:10:12.506400 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.506392    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a64bb3cb-97bf-4406-890d-11c25a8ed53e" (UID: "a64bb3cb-97bf-4406-890d-11c25a8ed53e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:10:12.506666 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.506445    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a64bb3cb-97bf-4406-890d-11c25a8ed53e" (UID: "a64bb3cb-97bf-4406-890d-11c25a8ed53e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:10:12.506800 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.506779    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istiod-ca-cert\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:10:12.506901 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.506804    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-workload-certs\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:10:12.506901 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.506819    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-workload-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:10:12.506901 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.506832    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-credential-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:10:12.507498 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.507468    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-data" (OuterVolumeSpecName: "istio-data") pod "a64bb3cb-97bf-4406-890d-11c25a8ed53e" (UID: "a64bb3cb-97bf-4406-890d-11c25a8ed53e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:10:12.508241 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.508221    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-token" (OuterVolumeSpecName: "istio-token") pod "a64bb3cb-97bf-4406-890d-11c25a8ed53e" (UID: "a64bb3cb-97bf-4406-890d-11c25a8ed53e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:10:12.508596 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.508556    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a64bb3cb-97bf-4406-890d-11c25a8ed53e-kube-api-access-cbz2k" (OuterVolumeSpecName: "kube-api-access-cbz2k") pod "a64bb3cb-97bf-4406-890d-11c25a8ed53e" (UID: "a64bb3cb-97bf-4406-890d-11c25a8ed53e"). InnerVolumeSpecName "kube-api-access-cbz2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:10:12.508596 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.508584    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a64bb3cb-97bf-4406-890d-11c25a8ed53e" (UID: "a64bb3cb-97bf-4406-890d-11c25a8ed53e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 20:10:12.508752 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.508678    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a64bb3cb-97bf-4406-890d-11c25a8ed53e" (UID: "a64bb3cb-97bf-4406-890d-11c25a8ed53e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:10:12.607371 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.607336    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-podinfo\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:10:12.607371 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.607363    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbz2k\" (UniqueName: \"kubernetes.io/projected/a64bb3cb-97bf-4406-890d-11c25a8ed53e-kube-api-access-cbz2k\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:10:12.607371 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.607373    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-envoy\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:10:12.607371 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.607382    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-data\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:10:12.607660 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:12.607390    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a64bb3cb-97bf-4406-890d-11c25a8ed53e-istio-token\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:10:13.067193 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:13.067160    2568 generic.go:356] "Generic (PLEG): container finished" podID="a64bb3cb-97bf-4406-890d-11c25a8ed53e" containerID="51a5a51377f4fe282aeffed506a98b9696d13d531ddaef01dcff5531725dd8f9" exitCode=0
Jul 30 20:10:13.067369 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:13.067207    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"
Jul 30 20:10:13.067369 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:13.067207    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj" event={"ID":"a64bb3cb-97bf-4406-890d-11c25a8ed53e","Type":"ContainerDied","Data":"51a5a51377f4fe282aeffed506a98b9696d13d531ddaef01dcff5531725dd8f9"}
Jul 30 20:10:13.067369 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:13.067330    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj" event={"ID":"a64bb3cb-97bf-4406-890d-11c25a8ed53e","Type":"ContainerDied","Data":"cd2028bef820529c2e180ce50eabd94d161e04762b64fc31bc7b3024af91677a"}
Jul 30 20:10:13.067369 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:13.067357    2568 scope.go:117] "RemoveContainer" containerID="51a5a51377f4fe282aeffed506a98b9696d13d531ddaef01dcff5531725dd8f9"
Jul 30 20:10:13.077022 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:13.077007    2568 scope.go:117] "RemoveContainer" containerID="3fd7fcfd6f437c74f5155d772cfbf7e84ce2c88c66003d198a51cf0285280481"
Jul 30 20:10:13.085076 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:13.085060    2568 scope.go:117] "RemoveContainer" containerID="51a5a51377f4fe282aeffed506a98b9696d13d531ddaef01dcff5531725dd8f9"
Jul 30 20:10:13.085337 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:10:13.085319    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51a5a51377f4fe282aeffed506a98b9696d13d531ddaef01dcff5531725dd8f9\": container with ID starting with 51a5a51377f4fe282aeffed506a98b9696d13d531ddaef01dcff5531725dd8f9 not found: ID does not exist" containerID="51a5a51377f4fe282aeffed506a98b9696d13d531ddaef01dcff5531725dd8f9"
Jul 30 20:10:13.085385 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:13.085344    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51a5a51377f4fe282aeffed506a98b9696d13d531ddaef01dcff5531725dd8f9"} err="failed to get container status \"51a5a51377f4fe282aeffed506a98b9696d13d531ddaef01dcff5531725dd8f9\": rpc error: code = NotFound desc = could not find container \"51a5a51377f4fe282aeffed506a98b9696d13d531ddaef01dcff5531725dd8f9\": container with ID starting with 51a5a51377f4fe282aeffed506a98b9696d13d531ddaef01dcff5531725dd8f9 not found: ID does not exist"
Jul 30 20:10:13.085385 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:13.085360    2568 scope.go:117] "RemoveContainer" containerID="3fd7fcfd6f437c74f5155d772cfbf7e84ce2c88c66003d198a51cf0285280481"
Jul 30 20:10:13.085613 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:10:13.085595    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fd7fcfd6f437c74f5155d772cfbf7e84ce2c88c66003d198a51cf0285280481\": container with ID starting with 3fd7fcfd6f437c74f5155d772cfbf7e84ce2c88c66003d198a51cf0285280481 not found: ID does not exist" containerID="3fd7fcfd6f437c74f5155d772cfbf7e84ce2c88c66003d198a51cf0285280481"
Jul 30 20:10:13.085671 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:13.085618    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fd7fcfd6f437c74f5155d772cfbf7e84ce2c88c66003d198a51cf0285280481"} err="failed to get container status \"3fd7fcfd6f437c74f5155d772cfbf7e84ce2c88c66003d198a51cf0285280481\": rpc error: code = NotFound desc = could not find container \"3fd7fcfd6f437c74f5155d772cfbf7e84ce2c88c66003d198a51cf0285280481\": container with ID starting with 3fd7fcfd6f437c74f5155d772cfbf7e84ce2c88c66003d198a51cf0285280481 not found: ID does not exist"
Jul 30 20:10:13.089187 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:13.089164    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"]
Jul 30 20:10:13.092970 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:13.092950    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-21ae099f-openshift-default-796bc5f46d-jv5tj"]
Jul 30 20:10:13.480911 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:10:13.480827    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a64bb3cb-97bf-4406-890d-11c25a8ed53e" path="/var/lib/kubelet/pods/a64bb3cb-97bf-4406-890d-11c25a8ed53e/volumes"
Jul 30 20:12:13.653754 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.653720    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"]
Jul 30 20:12:13.654215 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.654187    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c68e5af-d30e-4a66-9688-c9ab73f9bbc9" containerName="payload-pre-processing"
Jul 30 20:12:13.654215 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.654200    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c68e5af-d30e-4a66-9688-c9ab73f9bbc9" containerName="payload-pre-processing"
Jul 30 20:12:13.654215 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.654215    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b8078e7-6102-4d96-a90e-7b46adf270e9" containerName="maas-api"
Jul 30 20:12:13.654319 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.654222    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b8078e7-6102-4d96-a90e-7b46adf270e9" containerName="maas-api"
Jul 30 20:12:13.654319 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.654234    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a696da0-a7a0-409d-bac1-51d23021b0c6" containerName="payload-processing"
Jul 30 20:12:13.654319 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.654240    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a696da0-a7a0-409d-bac1-51d23021b0c6" containerName="payload-processing"
Jul 30 20:12:13.654319 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.654255    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a64bb3cb-97bf-4406-890d-11c25a8ed53e" containerName="istio-proxy"
Jul 30 20:12:13.654319 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.654260    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a64bb3cb-97bf-4406-890d-11c25a8ed53e" containerName="istio-proxy"
Jul 30 20:12:13.654319 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.654268    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1f1a029-decb-4672-867d-1c4318b60a25" containerName="revoke-keys"
Jul 30 20:12:13.654319 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.654274    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1f1a029-decb-4672-867d-1c4318b60a25" containerName="revoke-keys"
Jul 30 20:12:13.654319 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.654285    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a64bb3cb-97bf-4406-890d-11c25a8ed53e" containerName="istio-proxy"
Jul 30 20:12:13.654319 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.654290    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a64bb3cb-97bf-4406-890d-11c25a8ed53e" containerName="istio-proxy"
Jul 30 20:12:13.654641 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.654344    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f10dc06-339c-42bc-bc2c-596987b32437" containerName="istio-proxy"
Jul 30 20:12:13.654641 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.654352    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a64bb3cb-97bf-4406-890d-11c25a8ed53e" containerName="istio-proxy"
Jul 30 20:12:13.654641 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.654357    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a64bb3cb-97bf-4406-890d-11c25a8ed53e" containerName="istio-proxy"
Jul 30 20:12:13.654641 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.654364    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1f1a029-decb-4672-867d-1c4318b60a25" containerName="revoke-keys"
Jul 30 20:12:13.654641 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.654369    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c68e5af-d30e-4a66-9688-c9ab73f9bbc9" containerName="payload-pre-processing"
Jul 30 20:12:13.654641 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.654375    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b8078e7-6102-4d96-a90e-7b46adf270e9" containerName="maas-api"
Jul 30 20:12:13.654641 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.654382    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a696da0-a7a0-409d-bac1-51d23021b0c6" containerName="payload-processing"
Jul 30 20:12:13.657117 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.657102    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.659662 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.659636    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-37cdef40-openshift-default-dockercfg-ck265\""
Jul 30 20:12:13.677091 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.677068    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"]
Jul 30 20:12:13.691403 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.691375    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-token\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.691498 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.691448    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istiod-ca-cert\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.691498 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.691474    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9489k\" (UniqueName: \"kubernetes.io/projected/b929989d-0626-4c6c-bc7e-4cce7e4e3989-kube-api-access-9489k\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.691649 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.691508    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-credential-socket\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.691649 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.691614    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-podinfo\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.691745 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.691666    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-envoy\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.691745 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.691729    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-data\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.691826 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.691792    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-workload-socket\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.691826 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.691812    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-workload-certs\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.793062 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.793026    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-token\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.793062 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.793077    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istiod-ca-cert\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.793350 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.793095    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9489k\" (UniqueName: \"kubernetes.io/projected/b929989d-0626-4c6c-bc7e-4cce7e4e3989-kube-api-access-9489k\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.793350 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.793125    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-credential-socket\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.793350 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.793337    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-podinfo\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.793534 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.793399    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-envoy\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.793534 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.793438    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-data\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.793534 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.793522    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-workload-socket\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.793762 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.793536    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-credential-socket\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.793762 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.793557    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-workload-certs\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.793882 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.793868    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-data\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.793944 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.793870    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istiod-ca-cert\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.794088 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.794064    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-workload-certs\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.794414 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.794387    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-workload-socket\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.796537 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.796510    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-podinfo\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.796838 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.796819    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-envoy\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.802061 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.802038    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-token\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.802628 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.802607    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9489k\" (UniqueName: \"kubernetes.io/projected/b929989d-0626-4c6c-bc7e-4cce7e4e3989-kube-api-access-9489k\") pod \"e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") " pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:13.967696 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:13.967624    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:14.103390 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:14.103362    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"]
Jul 30 20:12:14.105080 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:12:14.105052    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb929989d_0626_4c6c_bc7e_4cce7e4e3989.slice/crio-10d22202a95bd8dfcaa241cfa29b535d6b0ac1e2f8dd7f59e27be85a390663ad WatchSource:0}: Error finding container 10d22202a95bd8dfcaa241cfa29b535d6b0ac1e2f8dd7f59e27be85a390663ad: Status 404 returned error can't find the container with id 10d22202a95bd8dfcaa241cfa29b535d6b0ac1e2f8dd7f59e27be85a390663ad
Jul 30 20:12:14.107174 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:14.107142    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:12:14.107265 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:14.107220    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:12:14.107328 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:14.107266    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:12:14.716303 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:14.716260    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj" event={"ID":"b929989d-0626-4c6c-bc7e-4cce7e4e3989","Type":"ContainerStarted","Data":"cdac52d1b888ebbc24188be053eba7e9e55269151985027668e9c17ccc6dbed8"}
Jul 30 20:12:14.716737 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:14.716325    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj" event={"ID":"b929989d-0626-4c6c-bc7e-4cce7e4e3989","Type":"ContainerStarted","Data":"10d22202a95bd8dfcaa241cfa29b535d6b0ac1e2f8dd7f59e27be85a390663ad"}
Jul 30 20:12:14.736984 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:14.736935    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj" podStartSLOduration=1.7369179959999999 podStartE2EDuration="1.736917996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:12:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:12:14.735775941 +0000 UTC m=+1955.835857141" watchObservedRunningTime="2026-07-30 20:12:14.736917996 +0000 UTC m=+1955.836999186"
Jul 30 20:12:14.968623 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:14.968528    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:15.973847 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:15.973819    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:16.733855 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:16.733824    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:16.734904 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:16.734886    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:17.996183 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:17.996150    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c"]
Jul 30 20:12:18.000149 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.000125    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c"
Jul 30 20:12:18.002616 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.002593    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-37cdef40-serving-cert\""
Jul 30 20:12:18.009017 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.008996    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c"]
Jul 30 20:12:18.033518 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.033493    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e15d9de1-1279-4fc4-b93e-233f3b75b3c4-openshift-service-ca\") pod \"maas-api-e2e-mt-37cdef40-69795b976d-d5b7c\" (UID: \"e15d9de1-1279-4fc4-b93e-233f3b75b3c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c"
Jul 30 20:12:18.033650 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.033538    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqn77\" (UniqueName: \"kubernetes.io/projected/e15d9de1-1279-4fc4-b93e-233f3b75b3c4-kube-api-access-jqn77\") pod \"maas-api-e2e-mt-37cdef40-69795b976d-d5b7c\" (UID: \"e15d9de1-1279-4fc4-b93e-233f3b75b3c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c"
Jul 30 20:12:18.033650 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.033586    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e15d9de1-1279-4fc4-b93e-233f3b75b3c4-maas-api-tls\") pod \"maas-api-e2e-mt-37cdef40-69795b976d-d5b7c\" (UID: \"e15d9de1-1279-4fc4-b93e-233f3b75b3c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c"
Jul 30 20:12:18.134436 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.134407    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqn77\" (UniqueName: \"kubernetes.io/projected/e15d9de1-1279-4fc4-b93e-233f3b75b3c4-kube-api-access-jqn77\") pod \"maas-api-e2e-mt-37cdef40-69795b976d-d5b7c\" (UID: \"e15d9de1-1279-4fc4-b93e-233f3b75b3c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c"
Jul 30 20:12:18.134634 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.134462    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e15d9de1-1279-4fc4-b93e-233f3b75b3c4-maas-api-tls\") pod \"maas-api-e2e-mt-37cdef40-69795b976d-d5b7c\" (UID: \"e15d9de1-1279-4fc4-b93e-233f3b75b3c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c"
Jul 30 20:12:18.134634 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.134528    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e15d9de1-1279-4fc4-b93e-233f3b75b3c4-openshift-service-ca\") pod \"maas-api-e2e-mt-37cdef40-69795b976d-d5b7c\" (UID: \"e15d9de1-1279-4fc4-b93e-233f3b75b3c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c"
Jul 30 20:12:18.135247 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.135223    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e15d9de1-1279-4fc4-b93e-233f3b75b3c4-openshift-service-ca\") pod \"maas-api-e2e-mt-37cdef40-69795b976d-d5b7c\" (UID: \"e15d9de1-1279-4fc4-b93e-233f3b75b3c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c"
Jul 30 20:12:18.137015 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.136991    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e15d9de1-1279-4fc4-b93e-233f3b75b3c4-maas-api-tls\") pod \"maas-api-e2e-mt-37cdef40-69795b976d-d5b7c\" (UID: \"e15d9de1-1279-4fc4-b93e-233f3b75b3c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c"
Jul 30 20:12:18.143144 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.143116    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqn77\" (UniqueName: \"kubernetes.io/projected/e15d9de1-1279-4fc4-b93e-233f3b75b3c4-kube-api-access-jqn77\") pod \"maas-api-e2e-mt-37cdef40-69795b976d-d5b7c\" (UID: \"e15d9de1-1279-4fc4-b93e-233f3b75b3c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c"
Jul 30 20:12:18.313265 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.313237    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c"
Jul 30 20:12:18.591654 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.591579    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8"]
Jul 30 20:12:18.595493 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.595473    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8"
Jul 30 20:12:18.597967 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.597943    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-37cdef40\""
Jul 30 20:12:18.598064 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.597999    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-37cdef40-dockercfg-cffjk\""
Jul 30 20:12:18.606663 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.606644    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8"]
Jul 30 20:12:18.612989 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.612970    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7"]
Jul 30 20:12:18.616265 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.616250    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7"
Jul 30 20:12:18.627626 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.626783    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7"]
Jul 30 20:12:18.640584 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.640541    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b1fc063-e77d-468d-990f-9d82b014181b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8\" (UID: \"1b1fc063-e77d-468d-990f-9d82b014181b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8"
Jul 30 20:12:18.640720 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.640655    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb8hk\" (UniqueName: \"kubernetes.io/projected/1b1fc063-e77d-468d-990f-9d82b014181b-kube-api-access-lb8hk\") pod \"payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8\" (UID: \"1b1fc063-e77d-468d-990f-9d82b014181b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8"
Jul 30 20:12:18.662384 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.662361    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c"]
Jul 30 20:12:18.663176 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:12:18.663151    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15d9de1_1279_4fc4_b93e_233f3b75b3c4.slice/crio-0eac2662721b900fdb8a9dccbb7a90ba8169ed72d7ab3e4ed047495ff1dfbc9b WatchSource:0}: Error finding container 0eac2662721b900fdb8a9dccbb7a90ba8169ed72d7ab3e4ed047495ff1dfbc9b: Status 404 returned error can't find the container with id 0eac2662721b900fdb8a9dccbb7a90ba8169ed72d7ab3e4ed047495ff1dfbc9b
Jul 30 20:12:18.741935 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.741868    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3e12aab-dd9a-4b30-9839-457cbfd32c38-plugins-config-volume\") pod \"payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7\" (UID: \"f3e12aab-dd9a-4b30-9839-457cbfd32c38\") " pod="openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7"
Jul 30 20:12:18.742107 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.741951    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b1fc063-e77d-468d-990f-9d82b014181b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8\" (UID: \"1b1fc063-e77d-468d-990f-9d82b014181b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8"
Jul 30 20:12:18.742107 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.742086    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2psbj\" (UniqueName: \"kubernetes.io/projected/f3e12aab-dd9a-4b30-9839-457cbfd32c38-kube-api-access-2psbj\") pod \"payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7\" (UID: \"f3e12aab-dd9a-4b30-9839-457cbfd32c38\") " pod="openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7"
Jul 30 20:12:18.742256 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.742165    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb8hk\" (UniqueName: \"kubernetes.io/projected/1b1fc063-e77d-468d-990f-9d82b014181b-kube-api-access-lb8hk\") pod \"payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8\" (UID: \"1b1fc063-e77d-468d-990f-9d82b014181b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8"
Jul 30 20:12:18.742947 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.742917    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b1fc063-e77d-468d-990f-9d82b014181b-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8\" (UID: \"1b1fc063-e77d-468d-990f-9d82b014181b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8"
Jul 30 20:12:18.749512 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.749483    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c" event={"ID":"e15d9de1-1279-4fc4-b93e-233f3b75b3c4","Type":"ContainerStarted","Data":"0eac2662721b900fdb8a9dccbb7a90ba8169ed72d7ab3e4ed047495ff1dfbc9b"}
Jul 30 20:12:18.749974 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.749956    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb8hk\" (UniqueName: \"kubernetes.io/projected/1b1fc063-e77d-468d-990f-9d82b014181b-kube-api-access-lb8hk\") pod \"payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8\" (UID: \"1b1fc063-e77d-468d-990f-9d82b014181b\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8"
Jul 30 20:12:18.843476 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.843404    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3e12aab-dd9a-4b30-9839-457cbfd32c38-plugins-config-volume\") pod \"payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7\" (UID: \"f3e12aab-dd9a-4b30-9839-457cbfd32c38\") " pod="openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7"
Jul 30 20:12:18.843476 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.843474    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2psbj\" (UniqueName: \"kubernetes.io/projected/f3e12aab-dd9a-4b30-9839-457cbfd32c38-kube-api-access-2psbj\") pod \"payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7\" (UID: \"f3e12aab-dd9a-4b30-9839-457cbfd32c38\") " pod="openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7"
Jul 30 20:12:18.844163 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.844141    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3e12aab-dd9a-4b30-9839-457cbfd32c38-plugins-config-volume\") pod \"payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7\" (UID: \"f3e12aab-dd9a-4b30-9839-457cbfd32c38\") " pod="openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7"
Jul 30 20:12:18.850853 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.850828    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2psbj\" (UniqueName: \"kubernetes.io/projected/f3e12aab-dd9a-4b30-9839-457cbfd32c38-kube-api-access-2psbj\") pod \"payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7\" (UID: \"f3e12aab-dd9a-4b30-9839-457cbfd32c38\") " pod="openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7"
Jul 30 20:12:18.907812 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.907784    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8"
Jul 30 20:12:18.927808 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:18.927791    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7"
Jul 30 20:12:19.054259 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:19.054227    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8"]
Jul 30 20:12:19.055870 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:12:19.055847    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b1fc063_e77d_468d_990f_9d82b014181b.slice/crio-8d5fb7579d4424e68772755e74e8870f6b06c952f3bf3b7d523a8cc78534a21e WatchSource:0}: Error finding container 8d5fb7579d4424e68772755e74e8870f6b06c952f3bf3b7d523a8cc78534a21e: Status 404 returned error can't find the container with id 8d5fb7579d4424e68772755e74e8870f6b06c952f3bf3b7d523a8cc78534a21e
Jul 30 20:12:19.084420 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:19.084382    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7"]
Jul 30 20:12:19.092701 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:12:19.092673    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3e12aab_dd9a_4b30_9839_457cbfd32c38.slice/crio-931feb0176fd3b4b1052ec18d3d8252f0b5acf4a0ec004f5c00b72869c783d76 WatchSource:0}: Error finding container 931feb0176fd3b4b1052ec18d3d8252f0b5acf4a0ec004f5c00b72869c783d76: Status 404 returned error can't find the container with id 931feb0176fd3b4b1052ec18d3d8252f0b5acf4a0ec004f5c00b72869c783d76
Jul 30 20:12:19.758945 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:19.758905    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c" event={"ID":"e15d9de1-1279-4fc4-b93e-233f3b75b3c4","Type":"ContainerStarted","Data":"e45f21db0a12b45e7adb4d50d845b99fb47893949dd811f75a1ed68fbb8ca7c5"}
Jul 30 20:12:19.759163 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:19.759143    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c"
Jul 30 20:12:19.760614 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:19.760560    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8" event={"ID":"1b1fc063-e77d-468d-990f-9d82b014181b","Type":"ContainerStarted","Data":"548c076d1568841f0c8b4a1fb550dadd11bec0c18c9671ac1b9988671a068ae8"}
Jul 30 20:12:19.760744 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:19.760636    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8" event={"ID":"1b1fc063-e77d-468d-990f-9d82b014181b","Type":"ContainerStarted","Data":"8d5fb7579d4424e68772755e74e8870f6b06c952f3bf3b7d523a8cc78534a21e"}
Jul 30 20:12:19.760744 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:19.760666    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8"
Jul 30 20:12:19.762068 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:19.762045    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7" event={"ID":"f3e12aab-dd9a-4b30-9839-457cbfd32c38","Type":"ContainerStarted","Data":"bd3e665c1737374a7c66c87a2d3537b883052351bc8d1c663d50c01cb825896a"}
Jul 30 20:12:19.762201 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:19.762085    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7" event={"ID":"f3e12aab-dd9a-4b30-9839-457cbfd32c38","Type":"ContainerStarted","Data":"931feb0176fd3b4b1052ec18d3d8252f0b5acf4a0ec004f5c00b72869c783d76"}
Jul 30 20:12:19.762201 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:19.762109    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7"
Jul 30 20:12:19.776810 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:19.776770    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c" podStartSLOduration=2.340419417 podStartE2EDuration="2.776757848s" totalImagesPullingTime="436.338431ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:12:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:12:19.774290851 +0000 UTC m=+1960.874372039" watchObservedRunningTime="2026-07-30 20:12:19.776757848 +0000 UTC m=+1960.876839034"
Jul 30 20:12:19.790838 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:19.790802    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7" podStartSLOduration=1.790790694 podStartE2EDuration="1.790790694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:12:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:12:19.789213483 +0000 UTC m=+1960.889294671" watchObservedRunningTime="2026-07-30 20:12:19.790790694 +0000 UTC m=+1960.890871881"
Jul 30 20:12:19.805366 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:19.805325    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8" podStartSLOduration=1.8053132440000002 podStartE2EDuration="1.805313244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:12:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:12:19.803281686 +0000 UTC m=+1960.903362875" watchObservedRunningTime="2026-07-30 20:12:19.805313244 +0000 UTC m=+1960.905394430"
Jul 30 20:12:25.774876 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:25.774844    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c"
Jul 30 20:12:30.771293 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:30.771263    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7"
Jul 30 20:12:30.771778 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:30.771352    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8"
Jul 30 20:12:31.735473 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:31.735397    2568 patch_prober.go:28] interesting pod/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 30 20:12:31.735473 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:31.735460    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj" podUID="b929989d-0626-4c6c-bc7e-4cce7e4e3989" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 30 20:12:31.832125 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:31.832092    2568 generic.go:356] "Generic (PLEG): container finished" podID="b929989d-0626-4c6c-bc7e-4cce7e4e3989" containerID="cdac52d1b888ebbc24188be053eba7e9e55269151985027668e9c17ccc6dbed8" exitCode=0
Jul 30 20:12:31.832543 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:31.832167    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj" event={"ID":"b929989d-0626-4c6c-bc7e-4cce7e4e3989","Type":"ContainerDied","Data":"cdac52d1b888ebbc24188be053eba7e9e55269151985027668e9c17ccc6dbed8"}
Jul 30 20:12:31.832680 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:31.832663    2568 scope.go:117] "RemoveContainer" containerID="cdac52d1b888ebbc24188be053eba7e9e55269151985027668e9c17ccc6dbed8"
Jul 30 20:12:31.833680 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:31.833653    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:12:31.833795 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:31.833723    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:12:31.833795 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:31.833775    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:12:32.839440 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:32.839406    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj" event={"ID":"b929989d-0626-4c6c-bc7e-4cce7e4e3989","Type":"ContainerStarted","Data":"508a03d3c590f4528d599bafcf8cd5e02c1d649291eb466449f3e13de38bcf4c"}
Jul 30 20:12:32.968118 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:32.968078    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:32.968455 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:32.968430    2568 patch_prober.go:28] interesting pod/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 30 20:12:32.968513 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:32.968488    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj" podUID="b929989d-0626-4c6c-bc7e-4cce7e4e3989" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 30 20:12:33.968343 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:33.968308    2568 patch_prober.go:28] interesting pod/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 30 20:12:33.968768 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:33.968357    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj" podUID="b929989d-0626-4c6c-bc7e-4cce7e4e3989" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 30 20:12:34.968957 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:34.968924    2568 patch_prober.go:28] interesting pod/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 30 20:12:34.969323 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:34.968972    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj" podUID="b929989d-0626-4c6c-bc7e-4cce7e4e3989" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 30 20:12:35.967981 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:35.967944    2568 patch_prober.go:28] interesting pod/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 30 20:12:35.968147 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:35.967995    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj" podUID="b929989d-0626-4c6c-bc7e-4cce7e4e3989" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 30 20:12:36.972306 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:36.972278    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:36.972721 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:36.972532    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:36.973134 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:36.973119    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:12:54.238513 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:54.238478    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37cdef40-rffx5"]
Jul 30 20:12:54.242092 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:54.242073    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37cdef40-rffx5"
Jul 30 20:12:54.244894 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:54.244871    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mgdxn\""
Jul 30 20:12:54.249122 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:54.249102    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37cdef40-rffx5"]
Jul 30 20:12:54.277451 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:54.277425    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71edbd99-3fd6-4318-8347-c6bf3ef2097c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-37cdef40-rffx5\" (UID: \"71edbd99-3fd6-4318-8347-c6bf3ef2097c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37cdef40-rffx5"
Jul 30 20:12:54.378656 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:54.378627    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71edbd99-3fd6-4318-8347-c6bf3ef2097c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-37cdef40-rffx5\" (UID: \"71edbd99-3fd6-4318-8347-c6bf3ef2097c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37cdef40-rffx5"
Jul 30 20:12:54.379360 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:54.379335    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71edbd99-3fd6-4318-8347-c6bf3ef2097c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-37cdef40-rffx5\" (UID: \"71edbd99-3fd6-4318-8347-c6bf3ef2097c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37cdef40-rffx5"
Jul 30 20:12:54.554114 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:54.554093    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37cdef40-rffx5"
Jul 30 20:12:54.685496 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:54.685472    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37cdef40-rffx5"]
Jul 30 20:12:54.687668 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:12:54.687626    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71edbd99_3fd6_4318_8347_c6bf3ef2097c.slice/crio-7e8a556569ac180b6434e92498b98cd9bbf2ff73ba8e42f4eff45bb7ea6288f6 WatchSource:0}: Error finding container 7e8a556569ac180b6434e92498b98cd9bbf2ff73ba8e42f4eff45bb7ea6288f6: Status 404 returned error can't find the container with id 7e8a556569ac180b6434e92498b98cd9bbf2ff73ba8e42f4eff45bb7ea6288f6
Jul 30 20:12:54.971502 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:54.971472    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37cdef40-rffx5" event={"ID":"71edbd99-3fd6-4318-8347-c6bf3ef2097c","Type":"ContainerStarted","Data":"5f85ddea076d95125097a6d90b0fd7c49c7837b4b6d8ab2805bb563a99d66209"}
Jul 30 20:12:54.971646 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:54.971524    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37cdef40-rffx5" event={"ID":"71edbd99-3fd6-4318-8347-c6bf3ef2097c","Type":"ContainerStarted","Data":"7e8a556569ac180b6434e92498b98cd9bbf2ff73ba8e42f4eff45bb7ea6288f6"}
Jul 30 20:12:54.990887 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:54.990844    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37cdef40-rffx5" podStartSLOduration=0.990828349 podStartE2EDuration="990.828349ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:12:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:12:54.989350397 +0000 UTC m=+1996.089431586" watchObservedRunningTime="2026-07-30 20:12:54.990828349 +0000 UTC m=+1996.090909535"
Jul 30 20:12:55.978578 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:55.978534    2568 generic.go:356] "Generic (PLEG): container finished" podID="71edbd99-3fd6-4318-8347-c6bf3ef2097c" containerID="5f85ddea076d95125097a6d90b0fd7c49c7837b4b6d8ab2805bb563a99d66209" exitCode=0
Jul 30 20:12:55.978958 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:55.978624    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37cdef40-rffx5" event={"ID":"71edbd99-3fd6-4318-8347-c6bf3ef2097c","Type":"ContainerDied","Data":"5f85ddea076d95125097a6d90b0fd7c49c7837b4b6d8ab2805bb563a99d66209"}
Jul 30 20:12:57.118510 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:57.118484    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37cdef40-rffx5"
Jul 30 20:12:57.197180 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:57.197151    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71edbd99-3fd6-4318-8347-c6bf3ef2097c-maas-api-service-ca\") pod \"71edbd99-3fd6-4318-8347-c6bf3ef2097c\" (UID: \"71edbd99-3fd6-4318-8347-c6bf3ef2097c\") "
Jul 30 20:12:57.197485 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:57.197464    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71edbd99-3fd6-4318-8347-c6bf3ef2097c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "71edbd99-3fd6-4318-8347-c6bf3ef2097c" (UID: "71edbd99-3fd6-4318-8347-c6bf3ef2097c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:12:57.297928 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:57.297869    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71edbd99-3fd6-4318-8347-c6bf3ef2097c-maas-api-service-ca\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:12:57.991368 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:57.991333    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37cdef40-rffx5" event={"ID":"71edbd99-3fd6-4318-8347-c6bf3ef2097c","Type":"ContainerDied","Data":"7e8a556569ac180b6434e92498b98cd9bbf2ff73ba8e42f4eff45bb7ea6288f6"}
Jul 30 20:12:57.991368 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:57.991371    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37cdef40-rffx5"
Jul 30 20:12:57.991588 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:12:57.991386    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e8a556569ac180b6434e92498b98cd9bbf2ff73ba8e42f4eff45bb7ea6288f6"
Jul 30 20:13:04.627955 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:04.627924    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c"]
Jul 30 20:13:04.628418 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:04.628332    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c" podUID="e15d9de1-1279-4fc4-b93e-233f3b75b3c4" containerName="maas-api" containerID="cri-o://e45f21db0a12b45e7adb4d50d845b99fb47893949dd811f75a1ed68fbb8ca7c5" gracePeriod=30
Jul 30 20:13:04.679735 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:04.679708    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7"]
Jul 30 20:13:04.679974 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:04.679918    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7" podUID="f3e12aab-dd9a-4b30-9839-457cbfd32c38" containerName="payload-processing" containerID="cri-o://bd3e665c1737374a7c66c87a2d3537b883052351bc8d1c663d50c01cb825896a" gracePeriod=30
Jul 30 20:13:04.695146 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:04.695115    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8"]
Jul 30 20:13:04.698442 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:04.698402    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8" podUID="1b1fc063-e77d-468d-990f-9d82b014181b" containerName="payload-pre-processing" containerID="cri-o://548c076d1568841f0c8b4a1fb550dadd11bec0c18c9671ac1b9988671a068ae8" gracePeriod=30
Jul 30 20:13:04.863225 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:04.863148    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37cdef40-rffx5"]
Jul 30 20:13:04.867225 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:04.867188    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-37cdef40-rffx5"]
Jul 30 20:13:05.000355 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.000329    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7"
Jul 30 20:13:05.003640 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.003618    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8"
Jul 30 20:13:05.013421 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.013405    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c"
Jul 30 20:13:05.029796 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.029774    2568 generic.go:356] "Generic (PLEG): container finished" podID="f3e12aab-dd9a-4b30-9839-457cbfd32c38" containerID="bd3e665c1737374a7c66c87a2d3537b883052351bc8d1c663d50c01cb825896a" exitCode=0
Jul 30 20:13:05.029894 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.029809    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7" event={"ID":"f3e12aab-dd9a-4b30-9839-457cbfd32c38","Type":"ContainerDied","Data":"bd3e665c1737374a7c66c87a2d3537b883052351bc8d1c663d50c01cb825896a"}
Jul 30 20:13:05.029894 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.029822    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7"
Jul 30 20:13:05.029894 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.029865    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7" event={"ID":"f3e12aab-dd9a-4b30-9839-457cbfd32c38","Type":"ContainerDied","Data":"931feb0176fd3b4b1052ec18d3d8252f0b5acf4a0ec004f5c00b72869c783d76"}
Jul 30 20:13:05.030044 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.029896    2568 scope.go:117] "RemoveContainer" containerID="bd3e665c1737374a7c66c87a2d3537b883052351bc8d1c663d50c01cb825896a"
Jul 30 20:13:05.031735 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.031706    2568 generic.go:356] "Generic (PLEG): container finished" podID="e15d9de1-1279-4fc4-b93e-233f3b75b3c4" containerID="e45f21db0a12b45e7adb4d50d845b99fb47893949dd811f75a1ed68fbb8ca7c5" exitCode=0
Jul 30 20:13:05.031834 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.031785    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c"
Jul 30 20:13:05.031904 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.031835    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c" event={"ID":"e15d9de1-1279-4fc4-b93e-233f3b75b3c4","Type":"ContainerDied","Data":"e45f21db0a12b45e7adb4d50d845b99fb47893949dd811f75a1ed68fbb8ca7c5"}
Jul 30 20:13:05.031996 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.031905    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c" event={"ID":"e15d9de1-1279-4fc4-b93e-233f3b75b3c4","Type":"ContainerDied","Data":"0eac2662721b900fdb8a9dccbb7a90ba8169ed72d7ab3e4ed047495ff1dfbc9b"}
Jul 30 20:13:05.034204 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.034055    2568 generic.go:356] "Generic (PLEG): container finished" podID="1b1fc063-e77d-468d-990f-9d82b014181b" containerID="548c076d1568841f0c8b4a1fb550dadd11bec0c18c9671ac1b9988671a068ae8" exitCode=0
Jul 30 20:13:05.034204 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.034130    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8" event={"ID":"1b1fc063-e77d-468d-990f-9d82b014181b","Type":"ContainerDied","Data":"548c076d1568841f0c8b4a1fb550dadd11bec0c18c9671ac1b9988671a068ae8"}
Jul 30 20:13:05.034204 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.034146    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8"
Jul 30 20:13:05.034204 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.034170    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8" event={"ID":"1b1fc063-e77d-468d-990f-9d82b014181b","Type":"ContainerDied","Data":"8d5fb7579d4424e68772755e74e8870f6b06c952f3bf3b7d523a8cc78534a21e"}
Jul 30 20:13:05.040697 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.040682    2568 scope.go:117] "RemoveContainer" containerID="bd3e665c1737374a7c66c87a2d3537b883052351bc8d1c663d50c01cb825896a"
Jul 30 20:13:05.041126 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:13:05.041102    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd3e665c1737374a7c66c87a2d3537b883052351bc8d1c663d50c01cb825896a\": container with ID starting with bd3e665c1737374a7c66c87a2d3537b883052351bc8d1c663d50c01cb825896a not found: ID does not exist" containerID="bd3e665c1737374a7c66c87a2d3537b883052351bc8d1c663d50c01cb825896a"
Jul 30 20:13:05.041368 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.041343    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd3e665c1737374a7c66c87a2d3537b883052351bc8d1c663d50c01cb825896a"} err="failed to get container status \"bd3e665c1737374a7c66c87a2d3537b883052351bc8d1c663d50c01cb825896a\": rpc error: code = NotFound desc = could not find container \"bd3e665c1737374a7c66c87a2d3537b883052351bc8d1c663d50c01cb825896a\": container with ID starting with bd3e665c1737374a7c66c87a2d3537b883052351bc8d1c663d50c01cb825896a not found: ID does not exist"
Jul 30 20:13:05.041472 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.041461    2568 scope.go:117] "RemoveContainer" containerID="e45f21db0a12b45e7adb4d50d845b99fb47893949dd811f75a1ed68fbb8ca7c5"
Jul 30 20:13:05.051644 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.051238    2568 scope.go:117] "RemoveContainer" containerID="e45f21db0a12b45e7adb4d50d845b99fb47893949dd811f75a1ed68fbb8ca7c5"
Jul 30 20:13:05.052793 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:13:05.052172    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e45f21db0a12b45e7adb4d50d845b99fb47893949dd811f75a1ed68fbb8ca7c5\": container with ID starting with e45f21db0a12b45e7adb4d50d845b99fb47893949dd811f75a1ed68fbb8ca7c5 not found: ID does not exist" containerID="e45f21db0a12b45e7adb4d50d845b99fb47893949dd811f75a1ed68fbb8ca7c5"
Jul 30 20:13:05.052793 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.052226    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e45f21db0a12b45e7adb4d50d845b99fb47893949dd811f75a1ed68fbb8ca7c5"} err="failed to get container status \"e45f21db0a12b45e7adb4d50d845b99fb47893949dd811f75a1ed68fbb8ca7c5\": rpc error: code = NotFound desc = could not find container \"e45f21db0a12b45e7adb4d50d845b99fb47893949dd811f75a1ed68fbb8ca7c5\": container with ID starting with e45f21db0a12b45e7adb4d50d845b99fb47893949dd811f75a1ed68fbb8ca7c5 not found: ID does not exist"
Jul 30 20:13:05.052793 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.052444    2568 scope.go:117] "RemoveContainer" containerID="548c076d1568841f0c8b4a1fb550dadd11bec0c18c9671ac1b9988671a068ae8"
Jul 30 20:13:05.062978 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.062962    2568 scope.go:117] "RemoveContainer" containerID="548c076d1568841f0c8b4a1fb550dadd11bec0c18c9671ac1b9988671a068ae8"
Jul 30 20:13:05.063222 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:13:05.063204    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"548c076d1568841f0c8b4a1fb550dadd11bec0c18c9671ac1b9988671a068ae8\": container with ID starting with 548c076d1568841f0c8b4a1fb550dadd11bec0c18c9671ac1b9988671a068ae8 not found: ID does not exist" containerID="548c076d1568841f0c8b4a1fb550dadd11bec0c18c9671ac1b9988671a068ae8"
Jul 30 20:13:05.063267 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.063242    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"548c076d1568841f0c8b4a1fb550dadd11bec0c18c9671ac1b9988671a068ae8"} err="failed to get container status \"548c076d1568841f0c8b4a1fb550dadd11bec0c18c9671ac1b9988671a068ae8\": rpc error: code = NotFound desc = could not find container \"548c076d1568841f0c8b4a1fb550dadd11bec0c18c9671ac1b9988671a068ae8\": container with ID starting with 548c076d1568841f0c8b4a1fb550dadd11bec0c18c9671ac1b9988671a068ae8 not found: ID does not exist"
Jul 30 20:13:05.066547 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.066531    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2psbj\" (UniqueName: \"kubernetes.io/projected/f3e12aab-dd9a-4b30-9839-457cbfd32c38-kube-api-access-2psbj\") pod \"f3e12aab-dd9a-4b30-9839-457cbfd32c38\" (UID: \"f3e12aab-dd9a-4b30-9839-457cbfd32c38\") "
Jul 30 20:13:05.066650 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.066609    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3e12aab-dd9a-4b30-9839-457cbfd32c38-plugins-config-volume\") pod \"f3e12aab-dd9a-4b30-9839-457cbfd32c38\" (UID: \"f3e12aab-dd9a-4b30-9839-457cbfd32c38\") "
Jul 30 20:13:05.066689 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.066663    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e15d9de1-1279-4fc4-b93e-233f3b75b3c4-openshift-service-ca\") pod \"e15d9de1-1279-4fc4-b93e-233f3b75b3c4\" (UID: \"e15d9de1-1279-4fc4-b93e-233f3b75b3c4\") "
Jul 30 20:13:05.066738 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.066722    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e15d9de1-1279-4fc4-b93e-233f3b75b3c4-maas-api-tls\") pod \"e15d9de1-1279-4fc4-b93e-233f3b75b3c4\" (UID: \"e15d9de1-1279-4fc4-b93e-233f3b75b3c4\") "
Jul 30 20:13:05.066781 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.066768    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqn77\" (UniqueName: \"kubernetes.io/projected/e15d9de1-1279-4fc4-b93e-233f3b75b3c4-kube-api-access-jqn77\") pod \"e15d9de1-1279-4fc4-b93e-233f3b75b3c4\" (UID: \"e15d9de1-1279-4fc4-b93e-233f3b75b3c4\") "
Jul 30 20:13:05.066840 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.066825    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lb8hk\" (UniqueName: \"kubernetes.io/projected/1b1fc063-e77d-468d-990f-9d82b014181b-kube-api-access-lb8hk\") pod \"1b1fc063-e77d-468d-990f-9d82b014181b\" (UID: \"1b1fc063-e77d-468d-990f-9d82b014181b\") "
Jul 30 20:13:05.066883 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.066859    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b1fc063-e77d-468d-990f-9d82b014181b-plugins-config-volume\") pod \"1b1fc063-e77d-468d-990f-9d82b014181b\" (UID: \"1b1fc063-e77d-468d-990f-9d82b014181b\") "
Jul 30 20:13:05.067025 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.067006    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3e12aab-dd9a-4b30-9839-457cbfd32c38-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f3e12aab-dd9a-4b30-9839-457cbfd32c38" (UID: "f3e12aab-dd9a-4b30-9839-457cbfd32c38"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:13:05.067126 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.067102    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e15d9de1-1279-4fc4-b93e-233f3b75b3c4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e15d9de1-1279-4fc4-b93e-233f3b75b3c4" (UID: "e15d9de1-1279-4fc4-b93e-233f3b75b3c4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:13:05.067425 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.067403    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3e12aab-dd9a-4b30-9839-457cbfd32c38-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:13:05.067598 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.067553    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e15d9de1-1279-4fc4-b93e-233f3b75b3c4-openshift-service-ca\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:13:05.067726 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.067481    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b1fc063-e77d-468d-990f-9d82b014181b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1b1fc063-e77d-468d-990f-9d82b014181b" (UID: "1b1fc063-e77d-468d-990f-9d82b014181b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:13:05.068906 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.068879    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e15d9de1-1279-4fc4-b93e-233f3b75b3c4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e15d9de1-1279-4fc4-b93e-233f3b75b3c4" (UID: "e15d9de1-1279-4fc4-b93e-233f3b75b3c4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:13:05.068984 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.068924    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b1fc063-e77d-468d-990f-9d82b014181b-kube-api-access-lb8hk" (OuterVolumeSpecName: "kube-api-access-lb8hk") pod "1b1fc063-e77d-468d-990f-9d82b014181b" (UID: "1b1fc063-e77d-468d-990f-9d82b014181b"). InnerVolumeSpecName "kube-api-access-lb8hk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:13:05.069085 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.069070    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3e12aab-dd9a-4b30-9839-457cbfd32c38-kube-api-access-2psbj" (OuterVolumeSpecName: "kube-api-access-2psbj") pod "f3e12aab-dd9a-4b30-9839-457cbfd32c38" (UID: "f3e12aab-dd9a-4b30-9839-457cbfd32c38"). InnerVolumeSpecName "kube-api-access-2psbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:13:05.069289 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.069263    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e15d9de1-1279-4fc4-b93e-233f3b75b3c4-kube-api-access-jqn77" (OuterVolumeSpecName: "kube-api-access-jqn77") pod "e15d9de1-1279-4fc4-b93e-233f3b75b3c4" (UID: "e15d9de1-1279-4fc4-b93e-233f3b75b3c4"). InnerVolumeSpecName "kube-api-access-jqn77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:13:05.169009 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.168948    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2psbj\" (UniqueName: \"kubernetes.io/projected/f3e12aab-dd9a-4b30-9839-457cbfd32c38-kube-api-access-2psbj\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:13:05.169009 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.168973    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e15d9de1-1279-4fc4-b93e-233f3b75b3c4-maas-api-tls\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:13:05.169009 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.168984    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqn77\" (UniqueName: \"kubernetes.io/projected/e15d9de1-1279-4fc4-b93e-233f3b75b3c4-kube-api-access-jqn77\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:13:05.169009 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.168992    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lb8hk\" (UniqueName: \"kubernetes.io/projected/1b1fc063-e77d-468d-990f-9d82b014181b-kube-api-access-lb8hk\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:13:05.169009 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.169000    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b1fc063-e77d-468d-990f-9d82b014181b-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:13:05.356855 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.356830    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c"]
Jul 30 20:13:05.362238 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.362210    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-37cdef40-69795b976d-d5b7c"]
Jul 30 20:13:05.371996 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.371975    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7"]
Jul 30 20:13:05.377046 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.377027    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-37cdef40-87546f5c8-6gcv7"]
Jul 30 20:13:05.386948 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.386914    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8"]
Jul 30 20:13:05.392067 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.392050    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-37cdef40-5d9694f4d4-lh9w8"]
Jul 30 20:13:05.481244 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.481185    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b1fc063-e77d-468d-990f-9d82b014181b" path="/var/lib/kubelet/pods/1b1fc063-e77d-468d-990f-9d82b014181b/volumes"
Jul 30 20:13:05.481496 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.481484    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71edbd99-3fd6-4318-8347-c6bf3ef2097c" path="/var/lib/kubelet/pods/71edbd99-3fd6-4318-8347-c6bf3ef2097c/volumes"
Jul 30 20:13:05.481879 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.481866    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e15d9de1-1279-4fc4-b93e-233f3b75b3c4" path="/var/lib/kubelet/pods/e15d9de1-1279-4fc4-b93e-233f3b75b3c4/volumes"
Jul 30 20:13:05.482183 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:05.482171    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3e12aab-dd9a-4b30-9839-457cbfd32c38" path="/var/lib/kubelet/pods/f3e12aab-dd9a-4b30-9839-457cbfd32c38/volumes"
Jul 30 20:13:11.275027 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:11.274990    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"]
Jul 30 20:13:11.275508 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:11.275235    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj" podUID="b929989d-0626-4c6c-bc7e-4cce7e4e3989" containerName="istio-proxy" containerID="cri-o://508a03d3c590f4528d599bafcf8cd5e02c1d649291eb466449f3e13de38bcf4c" gracePeriod=30
Jul 30 20:13:16.527434 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.527411    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:13:16.570621 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.570599    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-data\") pod \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") "
Jul 30 20:13:16.570724 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.570646    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-workload-socket\") pod \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") "
Jul 30 20:13:16.570724 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.570687    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-token\") pod \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") "
Jul 30 20:13:16.570724 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.570705    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-workload-certs\") pod \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") "
Jul 30 20:13:16.570724 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.570719    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-envoy\") pod \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") "
Jul 30 20:13:16.570890 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.570808    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-podinfo\") pod \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") "
Jul 30 20:13:16.570890 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.570839    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istiod-ca-cert\") pod \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") "
Jul 30 20:13:16.570990 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.570901    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9489k\" (UniqueName: \"kubernetes.io/projected/b929989d-0626-4c6c-bc7e-4cce7e4e3989-kube-api-access-9489k\") pod \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") "
Jul 30 20:13:16.570990 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.570942    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-credential-socket\") pod \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\" (UID: \"b929989d-0626-4c6c-bc7e-4cce7e4e3989\") "
Jul 30 20:13:16.570990 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.570968    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b929989d-0626-4c6c-bc7e-4cce7e4e3989" (UID: "b929989d-0626-4c6c-bc7e-4cce7e4e3989"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:13:16.571152 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.571018    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b929989d-0626-4c6c-bc7e-4cce7e4e3989" (UID: "b929989d-0626-4c6c-bc7e-4cce7e4e3989"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:13:16.571457 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.571257    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b929989d-0626-4c6c-bc7e-4cce7e4e3989" (UID: "b929989d-0626-4c6c-bc7e-4cce7e4e3989"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:13:16.571457 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.571334    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-workload-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:13:16.571457 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.571381    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-workload-certs\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:13:16.571457 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.571410    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b929989d-0626-4c6c-bc7e-4cce7e4e3989" (UID: "b929989d-0626-4c6c-bc7e-4cce7e4e3989"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:13:16.571744 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.571532    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-data" (OuterVolumeSpecName: "istio-data") pod "b929989d-0626-4c6c-bc7e-4cce7e4e3989" (UID: "b929989d-0626-4c6c-bc7e-4cce7e4e3989"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:13:16.573085 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.573060    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b929989d-0626-4c6c-bc7e-4cce7e4e3989" (UID: "b929989d-0626-4c6c-bc7e-4cce7e4e3989"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:13:16.573363 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.573331    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-token" (OuterVolumeSpecName: "istio-token") pod "b929989d-0626-4c6c-bc7e-4cce7e4e3989" (UID: "b929989d-0626-4c6c-bc7e-4cce7e4e3989"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:13:16.573484 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.573377    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b929989d-0626-4c6c-bc7e-4cce7e4e3989" (UID: "b929989d-0626-4c6c-bc7e-4cce7e4e3989"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 20:13:16.573484 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.573453    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b929989d-0626-4c6c-bc7e-4cce7e4e3989-kube-api-access-9489k" (OuterVolumeSpecName: "kube-api-access-9489k") pod "b929989d-0626-4c6c-bc7e-4cce7e4e3989" (UID: "b929989d-0626-4c6c-bc7e-4cce7e4e3989"). InnerVolumeSpecName "kube-api-access-9489k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:13:16.672456 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.672429    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-token\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:13:16.672456 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.672450    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-envoy\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:13:16.672456 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.672459    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-podinfo\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:13:16.672654 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.672467    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istiod-ca-cert\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:13:16.672654 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.672477    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9489k\" (UniqueName: \"kubernetes.io/projected/b929989d-0626-4c6c-bc7e-4cce7e4e3989-kube-api-access-9489k\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:13:16.672654 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.672486    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-credential-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:13:16.672654 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:16.672494    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b929989d-0626-4c6c-bc7e-4cce7e4e3989-istio-data\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:13:17.106930 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:17.106898    2568 generic.go:356] "Generic (PLEG): container finished" podID="b929989d-0626-4c6c-bc7e-4cce7e4e3989" containerID="508a03d3c590f4528d599bafcf8cd5e02c1d649291eb466449f3e13de38bcf4c" exitCode=0
Jul 30 20:13:17.107103 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:17.106945    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"
Jul 30 20:13:17.107103 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:17.106986    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj" event={"ID":"b929989d-0626-4c6c-bc7e-4cce7e4e3989","Type":"ContainerDied","Data":"508a03d3c590f4528d599bafcf8cd5e02c1d649291eb466449f3e13de38bcf4c"}
Jul 30 20:13:17.107103 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:17.107045    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj" event={"ID":"b929989d-0626-4c6c-bc7e-4cce7e4e3989","Type":"ContainerDied","Data":"10d22202a95bd8dfcaa241cfa29b535d6b0ac1e2f8dd7f59e27be85a390663ad"}
Jul 30 20:13:17.107103 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:17.107074    2568 scope.go:117] "RemoveContainer" containerID="508a03d3c590f4528d599bafcf8cd5e02c1d649291eb466449f3e13de38bcf4c"
Jul 30 20:13:17.116792 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:17.116775    2568 scope.go:117] "RemoveContainer" containerID="cdac52d1b888ebbc24188be053eba7e9e55269151985027668e9c17ccc6dbed8"
Jul 30 20:13:17.125052 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:17.125036    2568 scope.go:117] "RemoveContainer" containerID="508a03d3c590f4528d599bafcf8cd5e02c1d649291eb466449f3e13de38bcf4c"
Jul 30 20:13:17.125289 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:13:17.125273    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"508a03d3c590f4528d599bafcf8cd5e02c1d649291eb466449f3e13de38bcf4c\": container with ID starting with 508a03d3c590f4528d599bafcf8cd5e02c1d649291eb466449f3e13de38bcf4c not found: ID does not exist" containerID="508a03d3c590f4528d599bafcf8cd5e02c1d649291eb466449f3e13de38bcf4c"
Jul 30 20:13:17.125331 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:17.125297    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"508a03d3c590f4528d599bafcf8cd5e02c1d649291eb466449f3e13de38bcf4c"} err="failed to get container status \"508a03d3c590f4528d599bafcf8cd5e02c1d649291eb466449f3e13de38bcf4c\": rpc error: code = NotFound desc = could not find container \"508a03d3c590f4528d599bafcf8cd5e02c1d649291eb466449f3e13de38bcf4c\": container with ID starting with 508a03d3c590f4528d599bafcf8cd5e02c1d649291eb466449f3e13de38bcf4c not found: ID does not exist"
Jul 30 20:13:17.125331 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:17.125312    2568 scope.go:117] "RemoveContainer" containerID="cdac52d1b888ebbc24188be053eba7e9e55269151985027668e9c17ccc6dbed8"
Jul 30 20:13:17.125500 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:13:17.125485    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdac52d1b888ebbc24188be053eba7e9e55269151985027668e9c17ccc6dbed8\": container with ID starting with cdac52d1b888ebbc24188be053eba7e9e55269151985027668e9c17ccc6dbed8 not found: ID does not exist" containerID="cdac52d1b888ebbc24188be053eba7e9e55269151985027668e9c17ccc6dbed8"
Jul 30 20:13:17.125541 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:17.125505    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdac52d1b888ebbc24188be053eba7e9e55269151985027668e9c17ccc6dbed8"} err="failed to get container status \"cdac52d1b888ebbc24188be053eba7e9e55269151985027668e9c17ccc6dbed8\": rpc error: code = NotFound desc = could not find container \"cdac52d1b888ebbc24188be053eba7e9e55269151985027668e9c17ccc6dbed8\": container with ID starting with cdac52d1b888ebbc24188be053eba7e9e55269151985027668e9c17ccc6dbed8 not found: ID does not exist"
Jul 30 20:13:17.130077 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:17.130051    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"]
Jul 30 20:13:17.134126 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:17.134104    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-37cdef40-openshift-default-84d9c5f4d-csstj"]
Jul 30 20:13:17.482624 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:17.482531    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b929989d-0626-4c6c-bc7e-4cce7e4e3989" path="/var/lib/kubelet/pods/b929989d-0626-4c6c-bc7e-4cce7e4e3989/volumes"
Jul 30 20:13:52.088622 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:52.088587    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z"]
Jul 30 20:13:52.089045 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:52.088818    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z" podUID="4c7a841b-e0c2-49d1-99c6-908485e8da5c" containerName="manager" containerID="cri-o://23fa19a3d3ad9434ccf6180180838f4a7d1fca42e076ce2fd6c8f17066df0204" gracePeriod=10
Jul 30 20:13:52.305284 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:52.305254    2568 generic.go:356] "Generic (PLEG): container finished" podID="4c7a841b-e0c2-49d1-99c6-908485e8da5c" containerID="23fa19a3d3ad9434ccf6180180838f4a7d1fca42e076ce2fd6c8f17066df0204" exitCode=0
Jul 30 20:13:52.305412 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:52.305330    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z" event={"ID":"4c7a841b-e0c2-49d1-99c6-908485e8da5c","Type":"ContainerDied","Data":"23fa19a3d3ad9434ccf6180180838f4a7d1fca42e076ce2fd6c8f17066df0204"}
Jul 30 20:13:52.848092 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:52.848064    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z"
Jul 30 20:13:52.888770 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:52.888742    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjk69\" (UniqueName: \"kubernetes.io/projected/4c7a841b-e0c2-49d1-99c6-908485e8da5c-kube-api-access-kjk69\") pod \"4c7a841b-e0c2-49d1-99c6-908485e8da5c\" (UID: \"4c7a841b-e0c2-49d1-99c6-908485e8da5c\") "
Jul 30 20:13:52.888926 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:52.888822    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c7a841b-e0c2-49d1-99c6-908485e8da5c-extensions-socket-volume\") pod \"4c7a841b-e0c2-49d1-99c6-908485e8da5c\" (UID: \"4c7a841b-e0c2-49d1-99c6-908485e8da5c\") "
Jul 30 20:13:52.889216 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:52.889194    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c7a841b-e0c2-49d1-99c6-908485e8da5c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4c7a841b-e0c2-49d1-99c6-908485e8da5c" (UID: "4c7a841b-e0c2-49d1-99c6-908485e8da5c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:13:52.890696 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:52.890671    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c7a841b-e0c2-49d1-99c6-908485e8da5c-kube-api-access-kjk69" (OuterVolumeSpecName: "kube-api-access-kjk69") pod "4c7a841b-e0c2-49d1-99c6-908485e8da5c" (UID: "4c7a841b-e0c2-49d1-99c6-908485e8da5c"). InnerVolumeSpecName "kube-api-access-kjk69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:13:52.989920 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:52.989845    2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4c7a841b-e0c2-49d1-99c6-908485e8da5c-extensions-socket-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:13:52.989920 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:52.989872    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjk69\" (UniqueName: \"kubernetes.io/projected/4c7a841b-e0c2-49d1-99c6-908485e8da5c-kube-api-access-kjk69\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:13:53.311486 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:53.311458    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z"
Jul 30 20:13:53.311486 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:53.311463    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z" event={"ID":"4c7a841b-e0c2-49d1-99c6-908485e8da5c","Type":"ContainerDied","Data":"869e6cfe0f30d1bc271412c7f5091f7904c1a6f0916c2bd0f1a6669e2408aa5c"}
Jul 30 20:13:53.312000 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:53.311556    2568 scope.go:117] "RemoveContainer" containerID="23fa19a3d3ad9434ccf6180180838f4a7d1fca42e076ce2fd6c8f17066df0204"
Jul 30 20:13:53.334971 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:53.334949    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z"]
Jul 30 20:13:53.338201 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:53.338181    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4ff8z"]
Jul 30 20:13:53.480517 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:13:53.480487    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c7a841b-e0c2-49d1-99c6-908485e8da5c" path="/var/lib/kubelet/pods/4c7a841b-e0c2-49d1-99c6-908485e8da5c/volumes"
Jul 30 20:14:39.700783 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:14:39.700749    2568 scope.go:117] "RemoveContainer" containerID="046b0064ee8577f6e4eed8ed5251a290dbdf9117fcd06fe77d144542167b9405"
Jul 30 20:14:39.708630 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:14:39.708613    2568 scope.go:117] "RemoveContainer" containerID="7dd0bd47b7395f55af926cb10ee1eeb458349269861a3be56bd9e0dff92519da"
Jul 30 20:15:00.139403 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.139369    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757375-6lktw"]
Jul 30 20:15:00.139915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.139817    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b929989d-0626-4c6c-bc7e-4cce7e4e3989" containerName="istio-proxy"
Jul 30 20:15:00.139915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.139830    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b929989d-0626-4c6c-bc7e-4cce7e4e3989" containerName="istio-proxy"
Jul 30 20:15:00.139915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.139839    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71edbd99-3fd6-4318-8347-c6bf3ef2097c" containerName="revoke-keys"
Jul 30 20:15:00.139915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.139845    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="71edbd99-3fd6-4318-8347-c6bf3ef2097c" containerName="revoke-keys"
Jul 30 20:15:00.139915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.139856    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b929989d-0626-4c6c-bc7e-4cce7e4e3989" containerName="istio-proxy"
Jul 30 20:15:00.139915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.139862    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b929989d-0626-4c6c-bc7e-4cce7e4e3989" containerName="istio-proxy"
Jul 30 20:15:00.139915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.139872    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b1fc063-e77d-468d-990f-9d82b014181b" containerName="payload-pre-processing"
Jul 30 20:15:00.139915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.139877    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b1fc063-e77d-468d-990f-9d82b014181b" containerName="payload-pre-processing"
Jul 30 20:15:00.139915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.139884    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c7a841b-e0c2-49d1-99c6-908485e8da5c" containerName="manager"
Jul 30 20:15:00.139915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.139889    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c7a841b-e0c2-49d1-99c6-908485e8da5c" containerName="manager"
Jul 30 20:15:00.139915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.139896    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3e12aab-dd9a-4b30-9839-457cbfd32c38" containerName="payload-processing"
Jul 30 20:15:00.139915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.139901    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3e12aab-dd9a-4b30-9839-457cbfd32c38" containerName="payload-processing"
Jul 30 20:15:00.139915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.139909    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e15d9de1-1279-4fc4-b93e-233f3b75b3c4" containerName="maas-api"
Jul 30 20:15:00.139915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.139914    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e15d9de1-1279-4fc4-b93e-233f3b75b3c4" containerName="maas-api"
Jul 30 20:15:00.140342 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.139976    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b929989d-0626-4c6c-bc7e-4cce7e4e3989" containerName="istio-proxy"
Jul 30 20:15:00.140342 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.139987    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="71edbd99-3fd6-4318-8347-c6bf3ef2097c" containerName="revoke-keys"
Jul 30 20:15:00.140342 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.139995    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3e12aab-dd9a-4b30-9839-457cbfd32c38" containerName="payload-processing"
Jul 30 20:15:00.140342 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.140001    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b1fc063-e77d-468d-990f-9d82b014181b" containerName="payload-pre-processing"
Jul 30 20:15:00.140342 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.140007    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c7a841b-e0c2-49d1-99c6-908485e8da5c" containerName="manager"
Jul 30 20:15:00.140342 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.140013    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e15d9de1-1279-4fc4-b93e-233f3b75b3c4" containerName="maas-api"
Jul 30 20:15:00.143194 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.143179    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757375-6lktw"
Jul 30 20:15:00.145844 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.145816    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mgdxn\""
Jul 30 20:15:00.149100 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.149078    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757375-6lktw"]
Jul 30 20:15:00.154984 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.154966    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757375-6lktw"
Jul 30 20:15:00.498462 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.498438    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757375-6lktw"]
Jul 30 20:15:00.500108 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:15:00.500083    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a6d1ea_c2db_4c92_82df_3607d76fea06.slice/crio-6e7fd113aeb055dacf2c84eac9633044c3acb57cecc687c421789940dc7b63a1 WatchSource:0}: Error finding container 6e7fd113aeb055dacf2c84eac9633044c3acb57cecc687c421789940dc7b63a1: Status 404 returned error can't find the container with id 6e7fd113aeb055dacf2c84eac9633044c3acb57cecc687c421789940dc7b63a1
Jul 30 20:15:00.666906 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:00.666869    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757375-6lktw" event={"ID":"48a6d1ea-c2db-4c92-82df-3607d76fea06","Type":"ContainerStarted","Data":"6e7fd113aeb055dacf2c84eac9633044c3acb57cecc687c421789940dc7b63a1"}
Jul 30 20:15:01.673423 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:01.673391    2568 generic.go:356] "Generic (PLEG): container finished" podID="48a6d1ea-c2db-4c92-82df-3607d76fea06" containerID="fabf1c778410bbb09d460f5f2edb5a29e5de7e721eaac9f152553c279c0f0eca" exitCode=0
Jul 30 20:15:01.673877 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:01.673481    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757375-6lktw" event={"ID":"48a6d1ea-c2db-4c92-82df-3607d76fea06","Type":"ContainerDied","Data":"fabf1c778410bbb09d460f5f2edb5a29e5de7e721eaac9f152553c279c0f0eca"}
Jul 30 20:15:02.836221 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:02.836197    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757375-6lktw"
Jul 30 20:15:03.683861 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:03.683833    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757375-6lktw"
Jul 30 20:15:03.684029 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:03.683881    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757375-6lktw" event={"ID":"48a6d1ea-c2db-4c92-82df-3607d76fea06","Type":"ContainerDied","Data":"6e7fd113aeb055dacf2c84eac9633044c3acb57cecc687c421789940dc7b63a1"}
Jul 30 20:15:03.684029 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:03.683924    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e7fd113aeb055dacf2c84eac9633044c3acb57cecc687c421789940dc7b63a1"
Jul 30 20:15:07.723091 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:07.723058    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vlbs"]
Jul 30 20:15:07.723603 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:07.723509    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48a6d1ea-c2db-4c92-82df-3607d76fea06" containerName="cleanup"
Jul 30 20:15:07.723603 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:07.723525    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="48a6d1ea-c2db-4c92-82df-3607d76fea06" containerName="cleanup"
Jul 30 20:15:07.723742 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:07.723617    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b929989d-0626-4c6c-bc7e-4cce7e4e3989" containerName="istio-proxy"
Jul 30 20:15:07.723742 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:07.723629    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="48a6d1ea-c2db-4c92-82df-3607d76fea06" containerName="cleanup"
Jul 30 20:15:07.727174 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:07.727157    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vlbs"
Jul 30 20:15:07.733076 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:07.733057    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jfscx\""
Jul 30 20:15:07.745411 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:07.745390    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vlbs"]
Jul 30 20:15:07.844847 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:07.844807    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99b09bf3-7413-4d1a-8e69-0b8641ce874e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9vlbs\" (UID: \"99b09bf3-7413-4d1a-8e69-0b8641ce874e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vlbs"
Jul 30 20:15:07.845049 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:07.844878    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62674\" (UniqueName: \"kubernetes.io/projected/99b09bf3-7413-4d1a-8e69-0b8641ce874e-kube-api-access-62674\") pod \"kuadrant-operator-controller-manager-86878c769f-9vlbs\" (UID: \"99b09bf3-7413-4d1a-8e69-0b8641ce874e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vlbs"
Jul 30 20:15:07.945731 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:07.945694    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99b09bf3-7413-4d1a-8e69-0b8641ce874e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9vlbs\" (UID: \"99b09bf3-7413-4d1a-8e69-0b8641ce874e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vlbs"
Jul 30 20:15:07.945906 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:07.945789    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62674\" (UniqueName: \"kubernetes.io/projected/99b09bf3-7413-4d1a-8e69-0b8641ce874e-kube-api-access-62674\") pod \"kuadrant-operator-controller-manager-86878c769f-9vlbs\" (UID: \"99b09bf3-7413-4d1a-8e69-0b8641ce874e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vlbs"
Jul 30 20:15:07.946153 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:07.946124    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99b09bf3-7413-4d1a-8e69-0b8641ce874e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9vlbs\" (UID: \"99b09bf3-7413-4d1a-8e69-0b8641ce874e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vlbs"
Jul 30 20:15:07.954599 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:07.954541    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62674\" (UniqueName: \"kubernetes.io/projected/99b09bf3-7413-4d1a-8e69-0b8641ce874e-kube-api-access-62674\") pod \"kuadrant-operator-controller-manager-86878c769f-9vlbs\" (UID: \"99b09bf3-7413-4d1a-8e69-0b8641ce874e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vlbs"
Jul 30 20:15:08.036895 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:08.036783    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vlbs"
Jul 30 20:15:08.179376 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:08.179352    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vlbs"]
Jul 30 20:15:08.181084 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:15:08.181052    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b09bf3_7413_4d1a_8e69_0b8641ce874e.slice/crio-ed3893dc759b44979b9ccaf61ec96d8c020c18ba5f58bab464a0c987c0bd97d9 WatchSource:0}: Error finding container ed3893dc759b44979b9ccaf61ec96d8c020c18ba5f58bab464a0c987c0bd97d9: Status 404 returned error can't find the container with id ed3893dc759b44979b9ccaf61ec96d8c020c18ba5f58bab464a0c987c0bd97d9
Jul 30 20:15:08.718485 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:08.718441    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vlbs" event={"ID":"99b09bf3-7413-4d1a-8e69-0b8641ce874e","Type":"ContainerStarted","Data":"bf8f51a9e4a38bc3d51884a6af8b6941e2a09fcfe9159b45d957a07ce9e4fd00"}
Jul 30 20:15:08.718678 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:08.718543    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vlbs"
Jul 30 20:15:08.718678 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:08.718579    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vlbs" event={"ID":"99b09bf3-7413-4d1a-8e69-0b8641ce874e","Type":"ContainerStarted","Data":"ed3893dc759b44979b9ccaf61ec96d8c020c18ba5f58bab464a0c987c0bd97d9"}
Jul 30 20:15:08.740677 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:08.740618    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vlbs" podStartSLOduration=1.7405995760000001 podStartE2EDuration="1.740599576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:15:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:15:08.7363197 +0000 UTC m=+2129.836400884" watchObservedRunningTime="2026-07-30 20:15:08.740599576 +0000 UTC m=+2129.840680765"
Jul 30 20:15:19.725202 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:19.725168    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9vlbs"
Jul 30 20:15:31.615465 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.615372    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"]
Jul 30 20:15:31.619384 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.619362    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.621783 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.621764    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-098f06cb-openshift-default-dockercfg-cq5z5\""
Jul 30 20:15:31.629555 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.629531    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"]
Jul 30 20:15:31.654698 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.654666    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-envoy\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.654834 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.654713    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-token\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.654834 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.654735    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-podinfo\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.654834 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.654762    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-data\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.654834 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.654800    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-credential-socket\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.655078 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.654892    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc964\" (UniqueName: \"kubernetes.io/projected/3c4351ab-9eff-491d-8eed-67efe7cbae04-kube-api-access-rc964\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.655078 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.654934    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-workload-certs\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.655078 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.654960    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c4351ab-9eff-491d-8eed-67efe7cbae04-istiod-ca-cert\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.655078 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.654991    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-workload-socket\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.755483 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.755447    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-credential-socket\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.755688 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.755503    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc964\" (UniqueName: \"kubernetes.io/projected/3c4351ab-9eff-491d-8eed-67efe7cbae04-kube-api-access-rc964\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.755688 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.755552    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-workload-certs\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.755688 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.755604    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c4351ab-9eff-491d-8eed-67efe7cbae04-istiod-ca-cert\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.755688 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.755650    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-workload-socket\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.755924 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.755698    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-envoy\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.755924 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.755750    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-token\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.755924 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.755780    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-podinfo\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.755924 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.755808    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-data\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.756137 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.755934    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-credential-socket\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.756137 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.755950    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-workload-certs\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.756137 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.756081    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-workload-socket\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.756273 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.756189    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-data\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.756313 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.756301    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c4351ab-9eff-491d-8eed-67efe7cbae04-istiod-ca-cert\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.758216 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.758195    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-envoy\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.758338 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.758289    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-podinfo\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.763521 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.763495    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc964\" (UniqueName: \"kubernetes.io/projected/3c4351ab-9eff-491d-8eed-67efe7cbae04-kube-api-access-rc964\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.763835 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.763819    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-token\") pod \"e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") " pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:31.933375 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:31.933298    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:32.068668 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:32.068641    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"]
Jul 30 20:15:32.070923 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:15:32.070889    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c4351ab_9eff_491d_8eed_67efe7cbae04.slice/crio-0b6606d997ec9ab5faec9d7d6161139e5f7fc872638603b01b3e820ed1f5790f WatchSource:0}: Error finding container 0b6606d997ec9ab5faec9d7d6161139e5f7fc872638603b01b3e820ed1f5790f: Status 404 returned error can't find the container with id 0b6606d997ec9ab5faec9d7d6161139e5f7fc872638603b01b3e820ed1f5790f
Jul 30 20:15:32.073359 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:32.073319    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:15:32.073438 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:32.073409    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:15:32.073497 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:32.073479    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:15:32.846001 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:32.845964    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp" event={"ID":"3c4351ab-9eff-491d-8eed-67efe7cbae04","Type":"ContainerStarted","Data":"0623c53289c1c54d0015e1a59f02113d4de2f04cdcf72c51ceddfd8f0a651d5a"}
Jul 30 20:15:32.846457 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:32.846022    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp" event={"ID":"3c4351ab-9eff-491d-8eed-67efe7cbae04","Type":"ContainerStarted","Data":"0b6606d997ec9ab5faec9d7d6161139e5f7fc872638603b01b3e820ed1f5790f"}
Jul 30 20:15:32.873850 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:32.873807    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp" podStartSLOduration=1.873793144 podStartE2EDuration="1.873793144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:15:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:15:32.871788498 +0000 UTC m=+2153.971869687" watchObservedRunningTime="2026-07-30 20:15:32.873793144 +0000 UTC m=+2153.973874332"
Jul 30 20:15:32.933758 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:32.933737    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:33.939470 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:33.939441    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:34.858219 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:34.858186    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:34.859010 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:34.858991    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:35.941875 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:35.941843    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp"]
Jul 30 20:15:35.946357 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:35.946329    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp"
Jul 30 20:15:35.948788 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:35.948766    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-098f06cb-serving-cert\""
Jul 30 20:15:35.955947 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:35.955923    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp"]
Jul 30 20:15:35.994711 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:35.994679    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f67e9cf-b275-467b-aec0-a73219ca0992-maas-api-tls\") pod \"maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp\" (UID: \"4f67e9cf-b275-467b-aec0-a73219ca0992\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp"
Jul 30 20:15:35.994857 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:35.994749    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwbr8\" (UniqueName: \"kubernetes.io/projected/4f67e9cf-b275-467b-aec0-a73219ca0992-kube-api-access-nwbr8\") pod \"maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp\" (UID: \"4f67e9cf-b275-467b-aec0-a73219ca0992\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp"
Jul 30 20:15:35.994912 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:35.994875    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f67e9cf-b275-467b-aec0-a73219ca0992-openshift-service-ca\") pod \"maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp\" (UID: \"4f67e9cf-b275-467b-aec0-a73219ca0992\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp"
Jul 30 20:15:36.096026 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.095992    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f67e9cf-b275-467b-aec0-a73219ca0992-openshift-service-ca\") pod \"maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp\" (UID: \"4f67e9cf-b275-467b-aec0-a73219ca0992\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp"
Jul 30 20:15:36.096181 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.096044    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f67e9cf-b275-467b-aec0-a73219ca0992-maas-api-tls\") pod \"maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp\" (UID: \"4f67e9cf-b275-467b-aec0-a73219ca0992\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp"
Jul 30 20:15:36.096181 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.096091    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwbr8\" (UniqueName: \"kubernetes.io/projected/4f67e9cf-b275-467b-aec0-a73219ca0992-kube-api-access-nwbr8\") pod \"maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp\" (UID: \"4f67e9cf-b275-467b-aec0-a73219ca0992\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp"
Jul 30 20:15:36.096675 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.096647    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f67e9cf-b275-467b-aec0-a73219ca0992-openshift-service-ca\") pod \"maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp\" (UID: \"4f67e9cf-b275-467b-aec0-a73219ca0992\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp"
Jul 30 20:15:36.098519 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.098496    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f67e9cf-b275-467b-aec0-a73219ca0992-maas-api-tls\") pod \"maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp\" (UID: \"4f67e9cf-b275-467b-aec0-a73219ca0992\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp"
Jul 30 20:15:36.104463 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.104442    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwbr8\" (UniqueName: \"kubernetes.io/projected/4f67e9cf-b275-467b-aec0-a73219ca0992-kube-api-access-nwbr8\") pod \"maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp\" (UID: \"4f67e9cf-b275-467b-aec0-a73219ca0992\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp"
Jul 30 20:15:36.262760 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.262679    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp"
Jul 30 20:15:36.397484 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.397459    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp"]
Jul 30 20:15:36.399644 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:15:36.399618    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f67e9cf_b275_467b_aec0_a73219ca0992.slice/crio-f0103f94afd8f36e859523cfddce7092ba5c39db2606fdfdce4980672a890f9e WatchSource:0}: Error finding container f0103f94afd8f36e859523cfddce7092ba5c39db2606fdfdce4980672a890f9e: Status 404 returned error can't find the container with id f0103f94afd8f36e859523cfddce7092ba5c39db2606fdfdce4980672a890f9e
Jul 30 20:15:36.401237 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.401215    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:15:36.567737 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.567706    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt"]
Jul 30 20:15:36.572480 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.572462    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt"
Jul 30 20:15:36.575054 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.575038    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-098f06cb\""
Jul 30 20:15:36.582217 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.582192    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt"]
Jul 30 20:15:36.601480 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.601456    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fxxz\" (UniqueName: \"kubernetes.io/projected/d2caeb96-9ad7-49c7-989c-b03b1bd43802-kube-api-access-4fxxz\") pod \"payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt\" (UID: \"d2caeb96-9ad7-49c7-989c-b03b1bd43802\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt"
Jul 30 20:15:36.601628 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.601543    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2caeb96-9ad7-49c7-989c-b03b1bd43802-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt\" (UID: \"d2caeb96-9ad7-49c7-989c-b03b1bd43802\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt"
Jul 30 20:15:36.618283 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.618263    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627"]
Jul 30 20:15:36.621952 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.621934    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627"
Jul 30 20:15:36.624765 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.624740    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-098f06cb-dockercfg-kl85h\""
Jul 30 20:15:36.633513 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.633493    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627"]
Jul 30 20:15:36.702491 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.702450    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2caeb96-9ad7-49c7-989c-b03b1bd43802-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt\" (UID: \"d2caeb96-9ad7-49c7-989c-b03b1bd43802\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt"
Jul 30 20:15:36.702786 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.702541    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/985e60b4-90a0-4eba-86f1-b765621547b1-plugins-config-volume\") pod \"payload-processing-e2e-mt-098f06cb-975cc799d-sm627\" (UID: \"985e60b4-90a0-4eba-86f1-b765621547b1\") " pod="openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627"
Jul 30 20:15:36.702786 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.702588    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl5pn\" (UniqueName: \"kubernetes.io/projected/985e60b4-90a0-4eba-86f1-b765621547b1-kube-api-access-pl5pn\") pod \"payload-processing-e2e-mt-098f06cb-975cc799d-sm627\" (UID: \"985e60b4-90a0-4eba-86f1-b765621547b1\") " pod="openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627"
Jul 30 20:15:36.702786 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.702667    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fxxz\" (UniqueName: \"kubernetes.io/projected/d2caeb96-9ad7-49c7-989c-b03b1bd43802-kube-api-access-4fxxz\") pod \"payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt\" (UID: \"d2caeb96-9ad7-49c7-989c-b03b1bd43802\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt"
Jul 30 20:15:36.703931 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.703905    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2caeb96-9ad7-49c7-989c-b03b1bd43802-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt\" (UID: \"d2caeb96-9ad7-49c7-989c-b03b1bd43802\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt"
Jul 30 20:15:36.710277 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.710253    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fxxz\" (UniqueName: \"kubernetes.io/projected/d2caeb96-9ad7-49c7-989c-b03b1bd43802-kube-api-access-4fxxz\") pod \"payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt\" (UID: \"d2caeb96-9ad7-49c7-989c-b03b1bd43802\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt"
Jul 30 20:15:36.803127 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.803089    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/985e60b4-90a0-4eba-86f1-b765621547b1-plugins-config-volume\") pod \"payload-processing-e2e-mt-098f06cb-975cc799d-sm627\" (UID: \"985e60b4-90a0-4eba-86f1-b765621547b1\") " pod="openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627"
Jul 30 20:15:36.803127 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.803129    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl5pn\" (UniqueName: \"kubernetes.io/projected/985e60b4-90a0-4eba-86f1-b765621547b1-kube-api-access-pl5pn\") pod \"payload-processing-e2e-mt-098f06cb-975cc799d-sm627\" (UID: \"985e60b4-90a0-4eba-86f1-b765621547b1\") " pod="openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627"
Jul 30 20:15:36.803835 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.803814    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/985e60b4-90a0-4eba-86f1-b765621547b1-plugins-config-volume\") pod \"payload-processing-e2e-mt-098f06cb-975cc799d-sm627\" (UID: \"985e60b4-90a0-4eba-86f1-b765621547b1\") " pod="openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627"
Jul 30 20:15:36.810680 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.810656    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl5pn\" (UniqueName: \"kubernetes.io/projected/985e60b4-90a0-4eba-86f1-b765621547b1-kube-api-access-pl5pn\") pod \"payload-processing-e2e-mt-098f06cb-975cc799d-sm627\" (UID: \"985e60b4-90a0-4eba-86f1-b765621547b1\") " pod="openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627"
Jul 30 20:15:36.869931 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.869863    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp" event={"ID":"4f67e9cf-b275-467b-aec0-a73219ca0992","Type":"ContainerStarted","Data":"f0103f94afd8f36e859523cfddce7092ba5c39db2606fdfdce4980672a890f9e"}
Jul 30 20:15:36.884202 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.884178    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt"
Jul 30 20:15:36.932865 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:36.932836    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627"
Jul 30 20:15:37.091593 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:37.091535    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627"]
Jul 30 20:15:37.092770 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:15:37.092743    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod985e60b4_90a0_4eba_86f1_b765621547b1.slice/crio-edf816b1106ae0ba6dfd147fcf6e735b2c72cf1165fe2ab25157533ef319e4bb WatchSource:0}: Error finding container edf816b1106ae0ba6dfd147fcf6e735b2c72cf1165fe2ab25157533ef319e4bb: Status 404 returned error can't find the container with id edf816b1106ae0ba6dfd147fcf6e735b2c72cf1165fe2ab25157533ef319e4bb
Jul 30 20:15:37.246120 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:37.246091    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt"]
Jul 30 20:15:37.248117 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:15:37.248072    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2caeb96_9ad7_49c7_989c_b03b1bd43802.slice/crio-ce3c15c47a10a5dbb3a8bc4cebdbd01b0c2f80c7582bcac86f752cbc0e749875 WatchSource:0}: Error finding container ce3c15c47a10a5dbb3a8bc4cebdbd01b0c2f80c7582bcac86f752cbc0e749875: Status 404 returned error can't find the container with id ce3c15c47a10a5dbb3a8bc4cebdbd01b0c2f80c7582bcac86f752cbc0e749875
Jul 30 20:15:37.881034 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:37.880989    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt" event={"ID":"d2caeb96-9ad7-49c7-989c-b03b1bd43802","Type":"ContainerStarted","Data":"f34b765049b69a8435fa47d79b4ff5011912cc801a1936b9c092366955054443"}
Jul 30 20:15:37.881237 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:37.881148    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt"
Jul 30 20:15:37.881237 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:37.881194    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt" event={"ID":"d2caeb96-9ad7-49c7-989c-b03b1bd43802","Type":"ContainerStarted","Data":"ce3c15c47a10a5dbb3a8bc4cebdbd01b0c2f80c7582bcac86f752cbc0e749875"}
Jul 30 20:15:37.882634 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:37.882602    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627" event={"ID":"985e60b4-90a0-4eba-86f1-b765621547b1","Type":"ContainerStarted","Data":"5621c31a56540a658206497c185f2a72441129668b43ad52a8c0669cbea9c8c6"}
Jul 30 20:15:37.882768 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:37.882653    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627" event={"ID":"985e60b4-90a0-4eba-86f1-b765621547b1","Type":"ContainerStarted","Data":"edf816b1106ae0ba6dfd147fcf6e735b2c72cf1165fe2ab25157533ef319e4bb"}
Jul 30 20:15:37.882768 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:37.882725    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627"
Jul 30 20:15:37.884155 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:37.884132    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp" event={"ID":"4f67e9cf-b275-467b-aec0-a73219ca0992","Type":"ContainerStarted","Data":"8c767cc3809a607e20ecd8d642fb8dcb180df61517f47fc4cd784296a32fce3f"}
Jul 30 20:15:37.884283 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:37.884264    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp"
Jul 30 20:15:37.897263 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:37.897220    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt" podStartSLOduration=1.897206917 podStartE2EDuration="1.897206917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:15:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:15:37.894860365 +0000 UTC m=+2158.994941555" watchObservedRunningTime="2026-07-30 20:15:37.897206917 +0000 UTC m=+2158.997288104"
Jul 30 20:15:37.910522 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:37.910478    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627" podStartSLOduration=1.910467017 podStartE2EDuration="1.910467017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:15:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:15:37.909354419 +0000 UTC m=+2159.009435606" watchObservedRunningTime="2026-07-30 20:15:37.910467017 +0000 UTC m=+2159.010548203"
Jul 30 20:15:37.924827 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:37.924783    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp" podStartSLOduration=2.324009105 podStartE2EDuration="2.924767136s" totalImagesPullingTime="600.758031ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:15:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:15:37.924504006 +0000 UTC m=+2159.024585193" watchObservedRunningTime="2026-07-30 20:15:37.924767136 +0000 UTC m=+2159.024848324"
Jul 30 20:15:43.894828 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:43.894792    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp"
Jul 30 20:15:48.892203 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:48.892164    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627"
Jul 30 20:15:48.892668 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:48.892280    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt"
Jul 30 20:15:49.859917 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:49.859881    2568 patch_prober.go:28] interesting pod/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Jul 30 20:15:49.860131 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:49.859942    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp" podUID="3c4351ab-9eff-491d-8eed-67efe7cbae04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Jul 30 20:15:49.956650 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:49.956614    2568 generic.go:356] "Generic (PLEG): container finished" podID="3c4351ab-9eff-491d-8eed-67efe7cbae04" containerID="0623c53289c1c54d0015e1a59f02113d4de2f04cdcf72c51ceddfd8f0a651d5a" exitCode=0
Jul 30 20:15:49.956994 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:49.956686    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp" event={"ID":"3c4351ab-9eff-491d-8eed-67efe7cbae04","Type":"ContainerDied","Data":"0623c53289c1c54d0015e1a59f02113d4de2f04cdcf72c51ceddfd8f0a651d5a"}
Jul 30 20:15:49.957095 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:49.957080    2568 scope.go:117] "RemoveContainer" containerID="0623c53289c1c54d0015e1a59f02113d4de2f04cdcf72c51ceddfd8f0a651d5a"
Jul 30 20:15:49.958185 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:49.958157    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:15:49.958304 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:49.958223    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:15:49.958304 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:49.958259    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:15:50.968398 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:50.968364    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp" event={"ID":"3c4351ab-9eff-491d-8eed-67efe7cbae04","Type":"ContainerStarted","Data":"64124a337cb630d913d0c4859b01eb9c96aba2893045158c69e0edf3267ac377"}
Jul 30 20:15:51.933630 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:51.933602    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:51.933803 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:51.933757    2568 patch_prober.go:28] interesting pod/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Jul 30 20:15:51.933855 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:51.933805    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp" podUID="3c4351ab-9eff-491d-8eed-67efe7cbae04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Jul 30 20:15:52.934481 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:52.934445    2568 patch_prober.go:28] interesting pod/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Jul 30 20:15:52.934901 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:52.934497    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp" podUID="3c4351ab-9eff-491d-8eed-67efe7cbae04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Jul 30 20:15:53.933824 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:53.933791    2568 patch_prober.go:28] interesting pod/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Jul 30 20:15:53.934018 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:53.933843    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp" podUID="3c4351ab-9eff-491d-8eed-67efe7cbae04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Jul 30 20:15:54.937553 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:54.937523    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:54.938003 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:54.937847    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:15:54.938535 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:15:54.938520    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:16:39.729366 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:39.729329    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-098f06cb-8pzdx"]
Jul 30 20:16:39.733337 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:39.733318    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-098f06cb-8pzdx"
Jul 30 20:16:39.736379 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:39.736362    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mgdxn\""
Jul 30 20:16:39.740428 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:39.740392    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-098f06cb-8pzdx"]
Jul 30 20:16:39.745162 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:39.745135    2568 scope.go:117] "RemoveContainer" containerID="7e744ce6ad0073aef53cff154a34fb9f8770238c464e398bd11f15318037c93a"
Jul 30 20:16:39.874746 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:39.874721    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22b59f42-529f-4cbb-88d1-84cb7c6a1d10-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-098f06cb-8pzdx\" (UID: \"22b59f42-529f-4cbb-88d1-84cb7c6a1d10\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-098f06cb-8pzdx"
Jul 30 20:16:39.976355 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:39.976326    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22b59f42-529f-4cbb-88d1-84cb7c6a1d10-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-098f06cb-8pzdx\" (UID: \"22b59f42-529f-4cbb-88d1-84cb7c6a1d10\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-098f06cb-8pzdx"
Jul 30 20:16:39.976942 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:39.976916    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22b59f42-529f-4cbb-88d1-84cb7c6a1d10-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-098f06cb-8pzdx\" (UID: \"22b59f42-529f-4cbb-88d1-84cb7c6a1d10\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-098f06cb-8pzdx"
Jul 30 20:16:40.046583 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:40.046494    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-098f06cb-8pzdx"
Jul 30 20:16:40.228705 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:40.228673    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-098f06cb-8pzdx"]
Jul 30 20:16:40.230739 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:16:40.230698    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22b59f42_529f_4cbb_88d1_84cb7c6a1d10.slice/crio-c2b10c3865f755011c50a4b03c995286dd6330038b4bdf0f4f823c40d92c7360 WatchSource:0}: Error finding container c2b10c3865f755011c50a4b03c995286dd6330038b4bdf0f4f823c40d92c7360: Status 404 returned error can't find the container with id c2b10c3865f755011c50a4b03c995286dd6330038b4bdf0f4f823c40d92c7360
Jul 30 20:16:40.254259 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:40.254229    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-098f06cb-8pzdx" event={"ID":"22b59f42-529f-4cbb-88d1-84cb7c6a1d10","Type":"ContainerStarted","Data":"c2b10c3865f755011c50a4b03c995286dd6330038b4bdf0f4f823c40d92c7360"}
Jul 30 20:16:41.261683 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:41.261645    2568 generic.go:356] "Generic (PLEG): container finished" podID="22b59f42-529f-4cbb-88d1-84cb7c6a1d10" containerID="664845dee919e77dfccdb8dbd2cf26fa421f8ba27146272e0de758ec6caac741" exitCode=0
Jul 30 20:16:41.262104 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:41.261739    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-098f06cb-8pzdx" event={"ID":"22b59f42-529f-4cbb-88d1-84cb7c6a1d10","Type":"ContainerDied","Data":"664845dee919e77dfccdb8dbd2cf26fa421f8ba27146272e0de758ec6caac741"}
Jul 30 20:16:42.401622 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:42.401600    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-098f06cb-8pzdx"
Jul 30 20:16:42.501953 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:42.501916    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22b59f42-529f-4cbb-88d1-84cb7c6a1d10-maas-api-service-ca\") pod \"22b59f42-529f-4cbb-88d1-84cb7c6a1d10\" (UID: \"22b59f42-529f-4cbb-88d1-84cb7c6a1d10\") "
Jul 30 20:16:42.502210 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:42.502190    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22b59f42-529f-4cbb-88d1-84cb7c6a1d10-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "22b59f42-529f-4cbb-88d1-84cb7c6a1d10" (UID: "22b59f42-529f-4cbb-88d1-84cb7c6a1d10"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:16:42.602981 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:42.602868    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22b59f42-529f-4cbb-88d1-84cb7c6a1d10-maas-api-service-ca\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:16:43.273323 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:43.273294    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-098f06cb-8pzdx"
Jul 30 20:16:43.273323 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:43.273294    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-098f06cb-8pzdx" event={"ID":"22b59f42-529f-4cbb-88d1-84cb7c6a1d10","Type":"ContainerDied","Data":"c2b10c3865f755011c50a4b03c995286dd6330038b4bdf0f4f823c40d92c7360"}
Jul 30 20:16:43.273518 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:43.273342    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2b10c3865f755011c50a4b03c995286dd6330038b4bdf0f4f823c40d92c7360"
Jul 30 20:16:55.150531 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.149893    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp"]
Jul 30 20:16:55.150531 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.150124    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp" podUID="4f67e9cf-b275-467b-aec0-a73219ca0992" containerName="maas-api" containerID="cri-o://8c767cc3809a607e20ecd8d642fb8dcb180df61517f47fc4cd784296a32fce3f" gracePeriod=30
Jul 30 20:16:55.210425 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.210390    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627"]
Jul 30 20:16:55.210714 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.210696    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt"]
Jul 30 20:16:55.211050 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.211022    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt" podUID="d2caeb96-9ad7-49c7-989c-b03b1bd43802" containerName="payload-pre-processing" containerID="cri-o://f34b765049b69a8435fa47d79b4ff5011912cc801a1936b9c092366955054443" gracePeriod=30
Jul 30 20:16:55.211493 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.211470    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627" podUID="985e60b4-90a0-4eba-86f1-b765621547b1" containerName="payload-processing" containerID="cri-o://5621c31a56540a658206497c185f2a72441129668b43ad52a8c0669cbea9c8c6" gracePeriod=30
Jul 30 20:16:55.344555 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.344523    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-098f06cb-8pzdx"]
Jul 30 20:16:55.346796 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.346760    2568 generic.go:356] "Generic (PLEG): container finished" podID="d2caeb96-9ad7-49c7-989c-b03b1bd43802" containerID="f34b765049b69a8435fa47d79b4ff5011912cc801a1936b9c092366955054443" exitCode=0
Jul 30 20:16:55.346942 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.346885    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt" event={"ID":"d2caeb96-9ad7-49c7-989c-b03b1bd43802","Type":"ContainerDied","Data":"f34b765049b69a8435fa47d79b4ff5011912cc801a1936b9c092366955054443"}
Jul 30 20:16:55.347633 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.347608    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-098f06cb-8pzdx"]
Jul 30 20:16:55.348989 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.348957    2568 generic.go:356] "Generic (PLEG): container finished" podID="985e60b4-90a0-4eba-86f1-b765621547b1" containerID="5621c31a56540a658206497c185f2a72441129668b43ad52a8c0669cbea9c8c6" exitCode=0
Jul 30 20:16:55.349096 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.349004    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627" event={"ID":"985e60b4-90a0-4eba-86f1-b765621547b1","Type":"ContainerDied","Data":"5621c31a56540a658206497c185f2a72441129668b43ad52a8c0669cbea9c8c6"}
Jul 30 20:16:55.351092 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.351071    2568 generic.go:356] "Generic (PLEG): container finished" podID="4f67e9cf-b275-467b-aec0-a73219ca0992" containerID="8c767cc3809a607e20ecd8d642fb8dcb180df61517f47fc4cd784296a32fce3f" exitCode=0
Jul 30 20:16:55.351200 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.351143    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp" event={"ID":"4f67e9cf-b275-467b-aec0-a73219ca0992","Type":"ContainerDied","Data":"8c767cc3809a607e20ecd8d642fb8dcb180df61517f47fc4cd784296a32fce3f"}
Jul 30 20:16:55.486215 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.486139    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22b59f42-529f-4cbb-88d1-84cb7c6a1d10" path="/var/lib/kubelet/pods/22b59f42-529f-4cbb-88d1-84cb7c6a1d10/volumes"
Jul 30 20:16:55.493680 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.493646    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp"
Jul 30 20:16:55.519484 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.519458    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt"
Jul 30 20:16:55.528911 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.528890    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627"
Jul 30 20:16:55.621107 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.621079    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwbr8\" (UniqueName: \"kubernetes.io/projected/4f67e9cf-b275-467b-aec0-a73219ca0992-kube-api-access-nwbr8\") pod \"4f67e9cf-b275-467b-aec0-a73219ca0992\" (UID: \"4f67e9cf-b275-467b-aec0-a73219ca0992\") "
Jul 30 20:16:55.621252 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.621144    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fxxz\" (UniqueName: \"kubernetes.io/projected/d2caeb96-9ad7-49c7-989c-b03b1bd43802-kube-api-access-4fxxz\") pod \"d2caeb96-9ad7-49c7-989c-b03b1bd43802\" (UID: \"d2caeb96-9ad7-49c7-989c-b03b1bd43802\") "
Jul 30 20:16:55.621252 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.621246    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f67e9cf-b275-467b-aec0-a73219ca0992-openshift-service-ca\") pod \"4f67e9cf-b275-467b-aec0-a73219ca0992\" (UID: \"4f67e9cf-b275-467b-aec0-a73219ca0992\") "
Jul 30 20:16:55.621328 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.621293    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2caeb96-9ad7-49c7-989c-b03b1bd43802-plugins-config-volume\") pod \"d2caeb96-9ad7-49c7-989c-b03b1bd43802\" (UID: \"d2caeb96-9ad7-49c7-989c-b03b1bd43802\") "
Jul 30 20:16:55.621328 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.621318    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f67e9cf-b275-467b-aec0-a73219ca0992-maas-api-tls\") pod \"4f67e9cf-b275-467b-aec0-a73219ca0992\" (UID: \"4f67e9cf-b275-467b-aec0-a73219ca0992\") "
Jul 30 20:16:55.621658 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.621625    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2caeb96-9ad7-49c7-989c-b03b1bd43802-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d2caeb96-9ad7-49c7-989c-b03b1bd43802" (UID: "d2caeb96-9ad7-49c7-989c-b03b1bd43802"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:16:55.621781 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.621674    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f67e9cf-b275-467b-aec0-a73219ca0992-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4f67e9cf-b275-467b-aec0-a73219ca0992" (UID: "4f67e9cf-b275-467b-aec0-a73219ca0992"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:16:55.621781 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.621746    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2caeb96-9ad7-49c7-989c-b03b1bd43802-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:16:55.623289 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.623269    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f67e9cf-b275-467b-aec0-a73219ca0992-kube-api-access-nwbr8" (OuterVolumeSpecName: "kube-api-access-nwbr8") pod "4f67e9cf-b275-467b-aec0-a73219ca0992" (UID: "4f67e9cf-b275-467b-aec0-a73219ca0992"). InnerVolumeSpecName "kube-api-access-nwbr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:16:55.623289 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.623279    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f67e9cf-b275-467b-aec0-a73219ca0992-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4f67e9cf-b275-467b-aec0-a73219ca0992" (UID: "4f67e9cf-b275-467b-aec0-a73219ca0992"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:16:55.623416 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.623281    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2caeb96-9ad7-49c7-989c-b03b1bd43802-kube-api-access-4fxxz" (OuterVolumeSpecName: "kube-api-access-4fxxz") pod "d2caeb96-9ad7-49c7-989c-b03b1bd43802" (UID: "d2caeb96-9ad7-49c7-989c-b03b1bd43802"). InnerVolumeSpecName "kube-api-access-4fxxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:16:55.722211 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.722149    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pl5pn\" (UniqueName: \"kubernetes.io/projected/985e60b4-90a0-4eba-86f1-b765621547b1-kube-api-access-pl5pn\") pod \"985e60b4-90a0-4eba-86f1-b765621547b1\" (UID: \"985e60b4-90a0-4eba-86f1-b765621547b1\") "
Jul 30 20:16:55.722341 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.722212    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/985e60b4-90a0-4eba-86f1-b765621547b1-plugins-config-volume\") pod \"985e60b4-90a0-4eba-86f1-b765621547b1\" (UID: \"985e60b4-90a0-4eba-86f1-b765621547b1\") "
Jul 30 20:16:55.722495 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.722474    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f67e9cf-b275-467b-aec0-a73219ca0992-openshift-service-ca\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:16:55.722636 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.722500    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f67e9cf-b275-467b-aec0-a73219ca0992-maas-api-tls\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:16:55.722636 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.722514    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwbr8\" (UniqueName: \"kubernetes.io/projected/4f67e9cf-b275-467b-aec0-a73219ca0992-kube-api-access-nwbr8\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:16:55.722636 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.722529    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fxxz\" (UniqueName: \"kubernetes.io/projected/d2caeb96-9ad7-49c7-989c-b03b1bd43802-kube-api-access-4fxxz\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:16:55.722636 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.722620    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/985e60b4-90a0-4eba-86f1-b765621547b1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "985e60b4-90a0-4eba-86f1-b765621547b1" (UID: "985e60b4-90a0-4eba-86f1-b765621547b1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:16:55.723873 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.723852    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/985e60b4-90a0-4eba-86f1-b765621547b1-kube-api-access-pl5pn" (OuterVolumeSpecName: "kube-api-access-pl5pn") pod "985e60b4-90a0-4eba-86f1-b765621547b1" (UID: "985e60b4-90a0-4eba-86f1-b765621547b1"). InnerVolumeSpecName "kube-api-access-pl5pn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:16:55.823933 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.823891    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl5pn\" (UniqueName: \"kubernetes.io/projected/985e60b4-90a0-4eba-86f1-b765621547b1-kube-api-access-pl5pn\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:16:55.823933 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:55.823928    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/985e60b4-90a0-4eba-86f1-b765621547b1-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:16:56.358930 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:56.358901    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp"
Jul 30 20:16:56.359331 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:56.358925    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp" event={"ID":"4f67e9cf-b275-467b-aec0-a73219ca0992","Type":"ContainerDied","Data":"f0103f94afd8f36e859523cfddce7092ba5c39db2606fdfdce4980672a890f9e"}
Jul 30 20:16:56.359331 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:56.358989    2568 scope.go:117] "RemoveContainer" containerID="8c767cc3809a607e20ecd8d642fb8dcb180df61517f47fc4cd784296a32fce3f"
Jul 30 20:16:56.360556 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:56.360540    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt"
Jul 30 20:16:56.360688 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:56.360602    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt" event={"ID":"d2caeb96-9ad7-49c7-989c-b03b1bd43802","Type":"ContainerDied","Data":"ce3c15c47a10a5dbb3a8bc4cebdbd01b0c2f80c7582bcac86f752cbc0e749875"}
Jul 30 20:16:56.362138 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:56.362112    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627" event={"ID":"985e60b4-90a0-4eba-86f1-b765621547b1","Type":"ContainerDied","Data":"edf816b1106ae0ba6dfd147fcf6e735b2c72cf1165fe2ab25157533ef319e4bb"}
Jul 30 20:16:56.362263 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:56.362156    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627"
Jul 30 20:16:56.370534 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:56.370498    2568 scope.go:117] "RemoveContainer" containerID="f34b765049b69a8435fa47d79b4ff5011912cc801a1936b9c092366955054443"
Jul 30 20:16:56.379647 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:56.379629    2568 scope.go:117] "RemoveContainer" containerID="5621c31a56540a658206497c185f2a72441129668b43ad52a8c0669cbea9c8c6"
Jul 30 20:16:56.385911 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:56.385885    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp"]
Jul 30 20:16:56.388916 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:56.388896    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-098f06cb-d6fcbdbdd-phtbp"]
Jul 30 20:16:56.398631 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:56.398609    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt"]
Jul 30 20:16:56.406855 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:56.406835    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-098f06cb-858c97f684-g4fdt"]
Jul 30 20:16:56.420182 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:56.420135    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627"]
Jul 30 20:16:56.424239 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:56.424222    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-098f06cb-975cc799d-sm627"]
Jul 30 20:16:57.481961 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:57.481927    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f67e9cf-b275-467b-aec0-a73219ca0992" path="/var/lib/kubelet/pods/4f67e9cf-b275-467b-aec0-a73219ca0992/volumes"
Jul 30 20:16:57.482321 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:57.482304    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="985e60b4-90a0-4eba-86f1-b765621547b1" path="/var/lib/kubelet/pods/985e60b4-90a0-4eba-86f1-b765621547b1/volumes"
Jul 30 20:16:57.482636 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:16:57.482622    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2caeb96-9ad7-49c7-989c-b03b1bd43802" path="/var/lib/kubelet/pods/d2caeb96-9ad7-49c7-989c-b03b1bd43802/volumes"
Jul 30 20:17:46.537096 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:46.537057    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"]
Jul 30 20:17:46.537646 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:46.537432    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp" podUID="3c4351ab-9eff-491d-8eed-67efe7cbae04" containerName="istio-proxy" containerID="cri-o://64124a337cb630d913d0c4859b01eb9c96aba2893045158c69e0edf3267ac377" gracePeriod=30
Jul 30 20:17:51.667087 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.667059    2568 generic.go:356] "Generic (PLEG): container finished" podID="3c4351ab-9eff-491d-8eed-67efe7cbae04" containerID="64124a337cb630d913d0c4859b01eb9c96aba2893045158c69e0edf3267ac377" exitCode=0
Jul 30 20:17:51.667434 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.667099    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp" event={"ID":"3c4351ab-9eff-491d-8eed-67efe7cbae04","Type":"ContainerDied","Data":"64124a337cb630d913d0c4859b01eb9c96aba2893045158c69e0edf3267ac377"}
Jul 30 20:17:51.667434 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.667146    2568 scope.go:117] "RemoveContainer" containerID="0623c53289c1c54d0015e1a59f02113d4de2f04cdcf72c51ceddfd8f0a651d5a"
Jul 30 20:17:51.790220 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.790194    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:17:51.851550 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.848288    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rc964\" (UniqueName: \"kubernetes.io/projected/3c4351ab-9eff-491d-8eed-67efe7cbae04-kube-api-access-rc964\") pod \"3c4351ab-9eff-491d-8eed-67efe7cbae04\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") "
Jul 30 20:17:51.851550 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.848397    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-workload-certs\") pod \"3c4351ab-9eff-491d-8eed-67efe7cbae04\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") "
Jul 30 20:17:51.851550 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.848437    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c4351ab-9eff-491d-8eed-67efe7cbae04-istiod-ca-cert\") pod \"3c4351ab-9eff-491d-8eed-67efe7cbae04\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") "
Jul 30 20:17:51.851550 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.848461    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-workload-socket\") pod \"3c4351ab-9eff-491d-8eed-67efe7cbae04\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") "
Jul 30 20:17:51.851550 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.848537    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-podinfo\") pod \"3c4351ab-9eff-491d-8eed-67efe7cbae04\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") "
Jul 30 20:17:51.851550 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.848588    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-credential-socket\") pod \"3c4351ab-9eff-491d-8eed-67efe7cbae04\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") "
Jul 30 20:17:51.851550 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.848617    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-data\") pod \"3c4351ab-9eff-491d-8eed-67efe7cbae04\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") "
Jul 30 20:17:51.851550 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.848686    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-token\") pod \"3c4351ab-9eff-491d-8eed-67efe7cbae04\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") "
Jul 30 20:17:51.851550 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.848728    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-envoy\") pod \"3c4351ab-9eff-491d-8eed-67efe7cbae04\" (UID: \"3c4351ab-9eff-491d-8eed-67efe7cbae04\") "
Jul 30 20:17:51.851550 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.849944    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3c4351ab-9eff-491d-8eed-67efe7cbae04" (UID: "3c4351ab-9eff-491d-8eed-67efe7cbae04"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:17:51.851550 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.850305    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3c4351ab-9eff-491d-8eed-67efe7cbae04" (UID: "3c4351ab-9eff-491d-8eed-67efe7cbae04"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:17:51.851550 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.851012    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-data" (OuterVolumeSpecName: "istio-data") pod "3c4351ab-9eff-491d-8eed-67efe7cbae04" (UID: "3c4351ab-9eff-491d-8eed-67efe7cbae04"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:17:51.853005 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.852976    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c4351ab-9eff-491d-8eed-67efe7cbae04-kube-api-access-rc964" (OuterVolumeSpecName: "kube-api-access-rc964") pod "3c4351ab-9eff-491d-8eed-67efe7cbae04" (UID: "3c4351ab-9eff-491d-8eed-67efe7cbae04"). InnerVolumeSpecName "kube-api-access-rc964". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:17:51.853274 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.853251    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c4351ab-9eff-491d-8eed-67efe7cbae04-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3c4351ab-9eff-491d-8eed-67efe7cbae04" (UID: "3c4351ab-9eff-491d-8eed-67efe7cbae04"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:17:51.853489 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.853460    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3c4351ab-9eff-491d-8eed-67efe7cbae04" (UID: "3c4351ab-9eff-491d-8eed-67efe7cbae04"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:17:51.857883 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.855630    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3c4351ab-9eff-491d-8eed-67efe7cbae04" (UID: "3c4351ab-9eff-491d-8eed-67efe7cbae04"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:17:51.858008 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.857898    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3c4351ab-9eff-491d-8eed-67efe7cbae04" (UID: "3c4351ab-9eff-491d-8eed-67efe7cbae04"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 20:17:51.858684 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.858656    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-token" (OuterVolumeSpecName: "istio-token") pod "3c4351ab-9eff-491d-8eed-67efe7cbae04" (UID: "3c4351ab-9eff-491d-8eed-67efe7cbae04"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:17:51.949672 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.949642    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-workload-certs\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:17:51.949672 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.949671    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c4351ab-9eff-491d-8eed-67efe7cbae04-istiod-ca-cert\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:17:51.949804 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.949680    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-workload-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:17:51.949804 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.949688    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-podinfo\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:17:51.949804 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.949698    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-credential-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:17:51.949804 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.949707    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-data\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:17:51.949804 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.949715    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-token\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:17:51.949804 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.949722    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c4351ab-9eff-491d-8eed-67efe7cbae04-istio-envoy\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:17:51.949804 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:51.949730    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rc964\" (UniqueName: \"kubernetes.io/projected/3c4351ab-9eff-491d-8eed-67efe7cbae04-kube-api-access-rc964\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:17:52.673159 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:52.673121    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp" event={"ID":"3c4351ab-9eff-491d-8eed-67efe7cbae04","Type":"ContainerDied","Data":"0b6606d997ec9ab5faec9d7d6161139e5f7fc872638603b01b3e820ed1f5790f"}
Jul 30 20:17:52.673159 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:52.673150    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"
Jul 30 20:17:52.673701 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:52.673187    2568 scope.go:117] "RemoveContainer" containerID="64124a337cb630d913d0c4859b01eb9c96aba2893045158c69e0edf3267ac377"
Jul 30 20:17:52.694619 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:52.694595    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"]
Jul 30 20:17:52.697672 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:52.697644    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-098f06cb-openshift-default-64754c549b-7m6xp"]
Jul 30 20:17:53.481325 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:17:53.481291    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c4351ab-9eff-491d-8eed-67efe7cbae04" path="/var/lib/kubelet/pods/3c4351ab-9eff-491d-8eed-67efe7cbae04/volumes"
Jul 30 20:18:53.397828 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.397782    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"]
Jul 30 20:18:53.398394 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.398374    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="985e60b4-90a0-4eba-86f1-b765621547b1" containerName="payload-processing"
Jul 30 20:18:53.398468 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.398396    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="985e60b4-90a0-4eba-86f1-b765621547b1" containerName="payload-processing"
Jul 30 20:18:53.398468 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.398417    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22b59f42-529f-4cbb-88d1-84cb7c6a1d10" containerName="revoke-keys"
Jul 30 20:18:53.398468 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.398425    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="22b59f42-529f-4cbb-88d1-84cb7c6a1d10" containerName="revoke-keys"
Jul 30 20:18:53.398468 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.398435    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c4351ab-9eff-491d-8eed-67efe7cbae04" containerName="istio-proxy"
Jul 30 20:18:53.398468 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.398441    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c4351ab-9eff-491d-8eed-67efe7cbae04" containerName="istio-proxy"
Jul 30 20:18:53.398468 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.398454    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f67e9cf-b275-467b-aec0-a73219ca0992" containerName="maas-api"
Jul 30 20:18:53.398468 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.398461    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f67e9cf-b275-467b-aec0-a73219ca0992" containerName="maas-api"
Jul 30 20:18:53.398737 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.398473    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c4351ab-9eff-491d-8eed-67efe7cbae04" containerName="istio-proxy"
Jul 30 20:18:53.398737 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.398478    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c4351ab-9eff-491d-8eed-67efe7cbae04" containerName="istio-proxy"
Jul 30 20:18:53.398737 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.398489    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2caeb96-9ad7-49c7-989c-b03b1bd43802" containerName="payload-pre-processing"
Jul 30 20:18:53.398737 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.398494    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2caeb96-9ad7-49c7-989c-b03b1bd43802" containerName="payload-pre-processing"
Jul 30 20:18:53.398737 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.398553    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c4351ab-9eff-491d-8eed-67efe7cbae04" containerName="istio-proxy"
Jul 30 20:18:53.398737 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.398576    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f67e9cf-b275-467b-aec0-a73219ca0992" containerName="maas-api"
Jul 30 20:18:53.398737 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.398586    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="985e60b4-90a0-4eba-86f1-b765621547b1" containerName="payload-processing"
Jul 30 20:18:53.398737 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.398594    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c4351ab-9eff-491d-8eed-67efe7cbae04" containerName="istio-proxy"
Jul 30 20:18:53.398737 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.398603    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2caeb96-9ad7-49c7-989c-b03b1bd43802" containerName="payload-pre-processing"
Jul 30 20:18:53.398737 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.398614    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="22b59f42-529f-4cbb-88d1-84cb7c6a1d10" containerName="revoke-keys"
Jul 30 20:18:53.401829 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.401813    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.404487 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.404465    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-478a06-openshift-default-dockercfg-tv7j7\""
Jul 30 20:18:53.414533 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.414511    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"]
Jul 30 20:18:53.527911 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.527876    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-token\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.528089 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.527927    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxslq\" (UniqueName: \"kubernetes.io/projected/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-kube-api-access-fxslq\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.528089 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.527954    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-data\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.528089 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.528012    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-envoy\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.528089 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.528060    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-credential-socket\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.528089 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.528084    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-workload-socket\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.528268 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.528112    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-podinfo\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.528268 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.528132    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istiod-ca-cert\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.528268 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.528194    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-workload-certs\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.629011 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.628975    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-podinfo\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.629011 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.629010    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istiod-ca-cert\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.629297 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.629041    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-workload-certs\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.629297 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.629201    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-token\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.629297 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.629255    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxslq\" (UniqueName: \"kubernetes.io/projected/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-kube-api-access-fxslq\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.629297 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.629280    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-data\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.629520 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.629305    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-envoy\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.629520 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.629342    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-credential-socket\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.629520 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.629367    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-workload-socket\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.629520 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.629473    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-workload-certs\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.629792 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.629660    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-data\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.629919 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.629897    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istiod-ca-cert\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.629980 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.629944    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-credential-socket\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.629980 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.629958    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-workload-socket\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.631389 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.631366    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-envoy\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.631553 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.631535    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-podinfo\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.638313 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.638289    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-token\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.639136 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.639116    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxslq\" (UniqueName: \"kubernetes.io/projected/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-kube-api-access-fxslq\") pod \"e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") " pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.713280 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.713167    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:53.853724 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.853694    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"]
Jul 30 20:18:53.855077 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:18:53.855045    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64cfa0b9_4fc2_4cbe_81f0_789420d7a7e0.slice/crio-0b50a924adad150e64899ca99f3201140fbbdb86217b7205ac9ff5d1df6e393c WatchSource:0}: Error finding container 0b50a924adad150e64899ca99f3201140fbbdb86217b7205ac9ff5d1df6e393c: Status 404 returned error can't find the container with id 0b50a924adad150e64899ca99f3201140fbbdb86217b7205ac9ff5d1df6e393c
Jul 30 20:18:53.857285 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.857253    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:18:53.857383 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.857314    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:18:53.857383 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:53.857343    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:18:54.000489 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:54.000385    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p" event={"ID":"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0","Type":"ContainerStarted","Data":"cae362d3e70324913f9964c629535b2c70049c4929db2c7b4c3e5a47ca702417"}
Jul 30 20:18:54.000489 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:54.000448    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p" event={"ID":"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0","Type":"ContainerStarted","Data":"0b50a924adad150e64899ca99f3201140fbbdb86217b7205ac9ff5d1df6e393c"}
Jul 30 20:18:54.026126 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:54.026073    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p" podStartSLOduration=1.026057635 podStartE2EDuration="1.026057635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:18:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:18:54.024354278 +0000 UTC m=+2355.124435465" watchObservedRunningTime="2026-07-30 20:18:54.026057635 +0000 UTC m=+2355.126138822"
Jul 30 20:18:54.714298 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:54.714265    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:54.719003 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:54.718980    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:55.005722 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:55.005633    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:55.006433 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:55.006412    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:18:57.136424 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.136390    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559"]
Jul 30 20:18:57.140293 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.140267    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559"
Jul 30 20:18:57.143308 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.143272    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-478a06-serving-cert\""
Jul 30 20:18:57.150987 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.150859    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559"]
Jul 30 20:18:57.265527 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.265493    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qmcf\" (UniqueName: \"kubernetes.io/projected/1ee01446-0741-4cdb-8d0d-0c6112648d6d-kube-api-access-7qmcf\") pod \"maas-api-e2e-inf-a-478a06-786c8c6d6-ws559\" (UID: \"1ee01446-0741-4cdb-8d0d-0c6112648d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559"
Jul 30 20:18:57.265757 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.265606    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ee01446-0741-4cdb-8d0d-0c6112648d6d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-478a06-786c8c6d6-ws559\" (UID: \"1ee01446-0741-4cdb-8d0d-0c6112648d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559"
Jul 30 20:18:57.265757 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.265681    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ee01446-0741-4cdb-8d0d-0c6112648d6d-maas-api-tls\") pod \"maas-api-e2e-inf-a-478a06-786c8c6d6-ws559\" (UID: \"1ee01446-0741-4cdb-8d0d-0c6112648d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559"
Jul 30 20:18:57.366880 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.366847    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ee01446-0741-4cdb-8d0d-0c6112648d6d-maas-api-tls\") pod \"maas-api-e2e-inf-a-478a06-786c8c6d6-ws559\" (UID: \"1ee01446-0741-4cdb-8d0d-0c6112648d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559"
Jul 30 20:18:57.367047 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.366907    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qmcf\" (UniqueName: \"kubernetes.io/projected/1ee01446-0741-4cdb-8d0d-0c6112648d6d-kube-api-access-7qmcf\") pod \"maas-api-e2e-inf-a-478a06-786c8c6d6-ws559\" (UID: \"1ee01446-0741-4cdb-8d0d-0c6112648d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559"
Jul 30 20:18:57.367047 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.366987    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ee01446-0741-4cdb-8d0d-0c6112648d6d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-478a06-786c8c6d6-ws559\" (UID: \"1ee01446-0741-4cdb-8d0d-0c6112648d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559"
Jul 30 20:18:57.367637 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.367614    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ee01446-0741-4cdb-8d0d-0c6112648d6d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-478a06-786c8c6d6-ws559\" (UID: \"1ee01446-0741-4cdb-8d0d-0c6112648d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559"
Jul 30 20:18:57.369327 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.369303    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ee01446-0741-4cdb-8d0d-0c6112648d6d-maas-api-tls\") pod \"maas-api-e2e-inf-a-478a06-786c8c6d6-ws559\" (UID: \"1ee01446-0741-4cdb-8d0d-0c6112648d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559"
Jul 30 20:18:57.375421 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.375395    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qmcf\" (UniqueName: \"kubernetes.io/projected/1ee01446-0741-4cdb-8d0d-0c6112648d6d-kube-api-access-7qmcf\") pod \"maas-api-e2e-inf-a-478a06-786c8c6d6-ws559\" (UID: \"1ee01446-0741-4cdb-8d0d-0c6112648d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559"
Jul 30 20:18:57.455468 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.455384    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559"
Jul 30 20:18:57.602168 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.602130    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559"]
Jul 30 20:18:57.605241 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:18:57.605212    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ee01446_0741_4cdb_8d0d_0c6112648d6d.slice/crio-cd6541a76b95739659a6c72157d97bfc0836b2ca4e9d2bc51d57c1815bf6c0f6 WatchSource:0}: Error finding container cd6541a76b95739659a6c72157d97bfc0836b2ca4e9d2bc51d57c1815bf6c0f6: Status 404 returned error can't find the container with id cd6541a76b95739659a6c72157d97bfc0836b2ca4e9d2bc51d57c1815bf6c0f6
Jul 30 20:18:57.818504 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.818471    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d"]
Jul 30 20:18:57.822999 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.822979    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d"
Jul 30 20:18:57.825854 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.825829    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-478a06\""
Jul 30 20:18:57.825964 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.825858    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-478a06-dockercfg-2ks2q\""
Jul 30 20:18:57.832368 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.832342    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d"]
Jul 30 20:18:57.856636 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.856606    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh"]
Jul 30 20:18:57.860225 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.860209    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh"
Jul 30 20:18:57.867777 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.867627    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh"]
Jul 30 20:18:57.974664 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.974632    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97c7345a-45ee-46b0-883c-07cdace9bc41-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh\" (UID: \"97c7345a-45ee-46b0-883c-07cdace9bc41\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh"
Jul 30 20:18:57.974830 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.974690    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05a984ea-ad37-4e6a-a312-2bb1b53f922e-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d\" (UID: \"05a984ea-ad37-4e6a-a312-2bb1b53f922e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d"
Jul 30 20:18:57.974830 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.974789    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbbhw\" (UniqueName: \"kubernetes.io/projected/05a984ea-ad37-4e6a-a312-2bb1b53f922e-kube-api-access-fbbhw\") pod \"payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d\" (UID: \"05a984ea-ad37-4e6a-a312-2bb1b53f922e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d"
Jul 30 20:18:57.974904 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:57.974887    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drsvh\" (UniqueName: \"kubernetes.io/projected/97c7345a-45ee-46b0-883c-07cdace9bc41-kube-api-access-drsvh\") pod \"payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh\" (UID: \"97c7345a-45ee-46b0-883c-07cdace9bc41\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh"
Jul 30 20:18:58.022417 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:58.022375    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559" event={"ID":"1ee01446-0741-4cdb-8d0d-0c6112648d6d","Type":"ContainerStarted","Data":"cd6541a76b95739659a6c72157d97bfc0836b2ca4e9d2bc51d57c1815bf6c0f6"}
Jul 30 20:18:58.076626 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:58.076560    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbbhw\" (UniqueName: \"kubernetes.io/projected/05a984ea-ad37-4e6a-a312-2bb1b53f922e-kube-api-access-fbbhw\") pod \"payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d\" (UID: \"05a984ea-ad37-4e6a-a312-2bb1b53f922e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d"
Jul 30 20:18:58.076745 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:58.076692    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drsvh\" (UniqueName: \"kubernetes.io/projected/97c7345a-45ee-46b0-883c-07cdace9bc41-kube-api-access-drsvh\") pod \"payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh\" (UID: \"97c7345a-45ee-46b0-883c-07cdace9bc41\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh"
Jul 30 20:18:58.076745 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:58.076734    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97c7345a-45ee-46b0-883c-07cdace9bc41-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh\" (UID: \"97c7345a-45ee-46b0-883c-07cdace9bc41\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh"
Jul 30 20:18:58.076863 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:58.076775    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05a984ea-ad37-4e6a-a312-2bb1b53f922e-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d\" (UID: \"05a984ea-ad37-4e6a-a312-2bb1b53f922e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d"
Jul 30 20:18:58.077673 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:58.077650    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05a984ea-ad37-4e6a-a312-2bb1b53f922e-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d\" (UID: \"05a984ea-ad37-4e6a-a312-2bb1b53f922e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d"
Jul 30 20:18:58.077791 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:58.077650    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97c7345a-45ee-46b0-883c-07cdace9bc41-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh\" (UID: \"97c7345a-45ee-46b0-883c-07cdace9bc41\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh"
Jul 30 20:18:58.085664 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:58.085635    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drsvh\" (UniqueName: \"kubernetes.io/projected/97c7345a-45ee-46b0-883c-07cdace9bc41-kube-api-access-drsvh\") pod \"payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh\" (UID: \"97c7345a-45ee-46b0-883c-07cdace9bc41\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh"
Jul 30 20:18:58.086042 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:58.086023    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbbhw\" (UniqueName: \"kubernetes.io/projected/05a984ea-ad37-4e6a-a312-2bb1b53f922e-kube-api-access-fbbhw\") pod \"payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d\" (UID: \"05a984ea-ad37-4e6a-a312-2bb1b53f922e\") " pod="openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d"
Jul 30 20:18:58.134495 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:58.134474    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d"
Jul 30 20:18:58.172629 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:58.172599    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh"
Jul 30 20:18:58.290117 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:58.290093    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d"]
Jul 30 20:18:58.292011 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:18:58.291969    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a984ea_ad37_4e6a_a312_2bb1b53f922e.slice/crio-35ec8b52469e14fa21103b14f4df160d02cda21d217b0177fbe38f95b0561afb WatchSource:0}: Error finding container 35ec8b52469e14fa21103b14f4df160d02cda21d217b0177fbe38f95b0561afb: Status 404 returned error can't find the container with id 35ec8b52469e14fa21103b14f4df160d02cda21d217b0177fbe38f95b0561afb
Jul 30 20:18:58.335697 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:58.335670    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh"]
Jul 30 20:18:58.337441 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:18:58.337408    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c7345a_45ee_46b0_883c_07cdace9bc41.slice/crio-41069df95f83d0444ee2e2bf8df417e0752e9684f1c7c0b1076e21c3012f818f WatchSource:0}: Error finding container 41069df95f83d0444ee2e2bf8df417e0752e9684f1c7c0b1076e21c3012f818f: Status 404 returned error can't find the container with id 41069df95f83d0444ee2e2bf8df417e0752e9684f1c7c0b1076e21c3012f818f
Jul 30 20:18:59.030049 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:59.030013    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh" event={"ID":"97c7345a-45ee-46b0-883c-07cdace9bc41","Type":"ContainerStarted","Data":"bccefc7f9862c1a1beb597f0f6544c87d8849f96ad9dcf134d6256dfb5346bf1"}
Jul 30 20:18:59.030326 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:59.030182    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh"
Jul 30 20:18:59.030326 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:59.030211    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh" event={"ID":"97c7345a-45ee-46b0-883c-07cdace9bc41","Type":"ContainerStarted","Data":"41069df95f83d0444ee2e2bf8df417e0752e9684f1c7c0b1076e21c3012f818f"}
Jul 30 20:18:59.031601 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:59.031544    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d" event={"ID":"05a984ea-ad37-4e6a-a312-2bb1b53f922e","Type":"ContainerStarted","Data":"7fff393c21050e1f98d50105dd8704263b85407f1d9a776690f624c29812763e"}
Jul 30 20:18:59.031736 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:59.031624    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d" event={"ID":"05a984ea-ad37-4e6a-a312-2bb1b53f922e","Type":"ContainerStarted","Data":"35ec8b52469e14fa21103b14f4df160d02cda21d217b0177fbe38f95b0561afb"}
Jul 30 20:18:59.031736 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:59.031645    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d"
Jul 30 20:18:59.033081 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:59.033058    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559" event={"ID":"1ee01446-0741-4cdb-8d0d-0c6112648d6d","Type":"ContainerStarted","Data":"423ad1e43b539f58ed34c3edf116f5381cb02dc97fc2718a4d8883c85ab7043d"}
Jul 30 20:18:59.033212 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:59.033191    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559"
Jul 30 20:18:59.047726 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:59.047678    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh" podStartSLOduration=2.047660416 podStartE2EDuration="2.047660416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:18:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:18:59.044291538 +0000 UTC m=+2360.144372729" watchObservedRunningTime="2026-07-30 20:18:59.047660416 +0000 UTC m=+2360.147741607"
Jul 30 20:18:59.060486 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:59.060445    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d" podStartSLOduration=2.060434145 podStartE2EDuration="2.060434145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:18:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:18:59.058796647 +0000 UTC m=+2360.158877835" watchObservedRunningTime="2026-07-30 20:18:59.060434145 +0000 UTC m=+2360.160515332"
Jul 30 20:18:59.076804 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:18:59.076765    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559" podStartSLOduration=1.623450537 podStartE2EDuration="2.076752404s" totalImagesPullingTime="453.301867ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:18:59.075637923 +0000 UTC m=+2360.175719114" watchObservedRunningTime="2026-07-30 20:18:59.076752404 +0000 UTC m=+2360.176833591"
Jul 30 20:19:05.050390 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:05.050351    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559"
Jul 30 20:19:10.041053 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:10.041016    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh"
Jul 30 20:19:10.041526 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:10.041103    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d"
Jul 30 20:19:10.807438 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:10.806855    2568 patch_prober.go:28] interesting pod/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": read tcp 10.134.0.2:58188->10.134.0.77:15021: read: connection reset by peer" start-of-body=
Jul 30 20:19:10.807438 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:10.806921    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p" podUID="64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": read tcp 10.134.0.2:58188->10.134.0.77:15021: read: connection reset by peer"
Jul 30 20:19:11.113290 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:11.113201    2568 generic.go:356] "Generic (PLEG): container finished" podID="64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" containerID="cae362d3e70324913f9964c629535b2c70049c4929db2c7b4c3e5a47ca702417" exitCode=0
Jul 30 20:19:11.113696 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:11.113284    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p" event={"ID":"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0","Type":"ContainerDied","Data":"cae362d3e70324913f9964c629535b2c70049c4929db2c7b4c3e5a47ca702417"}
Jul 30 20:19:11.113744 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:11.113694    2568 scope.go:117] "RemoveContainer" containerID="cae362d3e70324913f9964c629535b2c70049c4929db2c7b4c3e5a47ca702417"
Jul 30 20:19:11.114713 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:11.114684    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:19:11.114827 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:11.114764    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:19:11.114827 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:11.114811    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:19:12.120475 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:12.120426    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p" event={"ID":"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0","Type":"ContainerStarted","Data":"7908da7c05f42a92769681248d11e67e080f792272e6ccc3b433fe948054a328"}
Jul 30 20:19:12.713981 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:12.713947    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:19:12.714281 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:12.714261    2568 patch_prober.go:28] interesting pod/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 30 20:19:12.714329 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:12.714306    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p" podUID="64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 30 20:19:13.714488 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:13.714457    2568 patch_prober.go:28] interesting pod/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 30 20:19:13.714892 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:13.714517    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p" podUID="64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 30 20:19:14.714378 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:14.714346    2568 patch_prober.go:28] interesting pod/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 30 20:19:14.714589 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:14.714399    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p" podUID="64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 30 20:19:15.714442 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:15.714404    2568 patch_prober.go:28] interesting pod/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 30 20:19:15.714635 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:15.714462    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p" podUID="64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 30 20:19:16.717363 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:16.717327    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:19:16.717789 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:16.717592    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:19:16.718309 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:16.718290    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:19:21.795113 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:21.795077    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"]
Jul 30 20:19:21.798978 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:21.798956    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:21.801601 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:21.801554    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-7edd0a-openshift-default-dockercfg-8ct2h\""
Jul 30 20:19:21.813554 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:21.813532    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"]
Jul 30 20:19:21.917758 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:21.917723    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-workload-certs\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:21.917921 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:21.917788    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-token\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:21.917921 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:21.917851    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-podinfo\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:21.917921 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:21.917871    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istiod-ca-cert\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:21.917921 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:21.917917    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn948\" (UniqueName: \"kubernetes.io/projected/7d96d383-eaf1-4312-b514-51ca3cf9a20c-kube-api-access-qn948\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:21.918158 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:21.917946    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-credential-socket\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:21.918158 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:21.917988    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-data\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:21.918158 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:21.918050    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-workload-socket\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:21.918158 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:21.918140    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-envoy\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:22.019613 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.019561    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-envoy\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:22.019783 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.019637    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-workload-certs\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:22.019783 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.019683    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-token\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:22.019783 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.019731    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-podinfo\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:22.019783 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.019753    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istiod-ca-cert\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:22.020004 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.019806    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn948\" (UniqueName: \"kubernetes.io/projected/7d96d383-eaf1-4312-b514-51ca3cf9a20c-kube-api-access-qn948\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:22.020004 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.019946    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-credential-socket\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:22.020004 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.019994    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-data\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:22.020167 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.020034    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-workload-certs\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:22.020167 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.020071    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-workload-socket\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:22.020307 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.020284    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-data\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:22.020396 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.020366    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-credential-socket\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:22.020534 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.020412    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-workload-socket\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:22.020637 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.020600    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istiod-ca-cert\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:22.022000 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.021982    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-envoy\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:22.022211 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.022194    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-podinfo\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:22.028338 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.028312    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-token\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:22.028494 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.028474    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn948\" (UniqueName: \"kubernetes.io/projected/7d96d383-eaf1-4312-b514-51ca3cf9a20c-kube-api-access-qn948\") pod \"e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") " pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:22.109388 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.109366    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:22.460818 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.460793    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"]
Jul 30 20:19:22.463231 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:19:22.463203    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d96d383_eaf1_4312_b514_51ca3cf9a20c.slice/crio-f8a28560e0cbe6936a7f1662cf5e235cad9a424cc94b3e05fd3da922cb72007d WatchSource:0}: Error finding container f8a28560e0cbe6936a7f1662cf5e235cad9a424cc94b3e05fd3da922cb72007d: Status 404 returned error can't find the container with id f8a28560e0cbe6936a7f1662cf5e235cad9a424cc94b3e05fd3da922cb72007d
Jul 30 20:19:22.465468 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.465434    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:19:22.465558 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.465517    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:19:22.465558 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:22.465550    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:19:23.184093 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:23.184057    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9" event={"ID":"7d96d383-eaf1-4312-b514-51ca3cf9a20c","Type":"ContainerStarted","Data":"541c6262cd1e54ad112fa98ce5457563c0b809f32ff588ff2fe21ab427aa9bc2"}
Jul 30 20:19:23.184455 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:23.184124    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9" event={"ID":"7d96d383-eaf1-4312-b514-51ca3cf9a20c","Type":"ContainerStarted","Data":"f8a28560e0cbe6936a7f1662cf5e235cad9a424cc94b3e05fd3da922cb72007d"}
Jul 30 20:19:23.207243 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:23.207190    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9" podStartSLOduration=2.20717399 podStartE2EDuration="2.20717399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:19:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:19:23.205998274 +0000 UTC m=+2384.306079462" watchObservedRunningTime="2026-07-30 20:19:23.20717399 +0000 UTC m=+2384.307255177"
Jul 30 20:19:24.110099 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:24.110075    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:24.114853 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:24.114831    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:24.189271 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:24.189245    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:24.190177 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:24.190160    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:26.301176 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:26.301131    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"]
Jul 30 20:19:26.305263 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:26.305242    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"
Jul 30 20:19:26.307761 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:26.307744    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-7edd0a-serving-cert\""
Jul 30 20:19:26.315243 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:26.315221    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"]
Jul 30 20:19:26.462263 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:26.462225    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4dd046d-4919-4b0f-868e-6708908eeb46-maas-api-tls\") pod \"maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47\" (UID: \"f4dd046d-4919-4b0f-868e-6708908eeb46\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"
Jul 30 20:19:26.462433 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:26.462368    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcpxn\" (UniqueName: \"kubernetes.io/projected/f4dd046d-4919-4b0f-868e-6708908eeb46-kube-api-access-vcpxn\") pod \"maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47\" (UID: \"f4dd046d-4919-4b0f-868e-6708908eeb46\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"
Jul 30 20:19:26.462433 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:26.462402    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4dd046d-4919-4b0f-868e-6708908eeb46-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47\" (UID: \"f4dd046d-4919-4b0f-868e-6708908eeb46\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"
Jul 30 20:19:26.563152 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:26.563118    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcpxn\" (UniqueName: \"kubernetes.io/projected/f4dd046d-4919-4b0f-868e-6708908eeb46-kube-api-access-vcpxn\") pod \"maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47\" (UID: \"f4dd046d-4919-4b0f-868e-6708908eeb46\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"
Jul 30 20:19:26.563152 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:26.563156    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4dd046d-4919-4b0f-868e-6708908eeb46-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47\" (UID: \"f4dd046d-4919-4b0f-868e-6708908eeb46\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"
Jul 30 20:19:26.563394 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:26.563233    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4dd046d-4919-4b0f-868e-6708908eeb46-maas-api-tls\") pod \"maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47\" (UID: \"f4dd046d-4919-4b0f-868e-6708908eeb46\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"
Jul 30 20:19:26.563460 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:19:26.563414    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-serving-cert: secret "maas-api-e2e-inf-b-7edd0a-serving-cert" not found
Jul 30 20:19:26.563521 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:19:26.563488    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4dd046d-4919-4b0f-868e-6708908eeb46-maas-api-tls podName:f4dd046d-4919-4b0f-868e-6708908eeb46 nodeName:}" failed. No retries permitted until 2026-07-30 20:19:27.063472223 +0000 UTC m=+2388.163553388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f4dd046d-4919-4b0f-868e-6708908eeb46-maas-api-tls") pod "maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47" (UID: "f4dd046d-4919-4b0f-868e-6708908eeb46") : secret "maas-api-e2e-inf-b-7edd0a-serving-cert" not found
Jul 30 20:19:26.563974 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:26.563948    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4dd046d-4919-4b0f-868e-6708908eeb46-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47\" (UID: \"f4dd046d-4919-4b0f-868e-6708908eeb46\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"
Jul 30 20:19:26.571549 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:26.571529    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcpxn\" (UniqueName: \"kubernetes.io/projected/f4dd046d-4919-4b0f-868e-6708908eeb46-kube-api-access-vcpxn\") pod \"maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47\" (UID: \"f4dd046d-4919-4b0f-868e-6708908eeb46\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"
Jul 30 20:19:27.068035 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:27.067999    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4dd046d-4919-4b0f-868e-6708908eeb46-maas-api-tls\") pod \"maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47\" (UID: \"f4dd046d-4919-4b0f-868e-6708908eeb46\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"
Jul 30 20:19:27.070447 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:27.070421    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4dd046d-4919-4b0f-868e-6708908eeb46-maas-api-tls\") pod \"maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47\" (UID: \"f4dd046d-4919-4b0f-868e-6708908eeb46\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"
Jul 30 20:19:27.089701 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:27.089675    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m"]
Jul 30 20:19:27.093905 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:27.093883    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m"
Jul 30 20:19:27.096548 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:27.096527    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-7edd0a-dockercfg-b47gw\""
Jul 30 20:19:27.096836 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:27.096530    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-7edd0a\""
Jul 30 20:19:27.115750 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:27.115724    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m"]
Jul 30 20:19:27.216963 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:27.216930    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"
Jul 30 20:19:27.271149 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:27.271118    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffb2c4fc-ee82-43f3-966b-2f74b3513e68-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m\" (UID: \"ffb2c4fc-ee82-43f3-966b-2f74b3513e68\") " pod="openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m"
Jul 30 20:19:27.271320 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:27.271187    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz74x\" (UniqueName: \"kubernetes.io/projected/ffb2c4fc-ee82-43f3-966b-2f74b3513e68-kube-api-access-pz74x\") pod \"payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m\" (UID: \"ffb2c4fc-ee82-43f3-966b-2f74b3513e68\") " pod="openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m"
Jul 30 20:19:27.372595 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:27.372504    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffb2c4fc-ee82-43f3-966b-2f74b3513e68-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m\" (UID: \"ffb2c4fc-ee82-43f3-966b-2f74b3513e68\") " pod="openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m"
Jul 30 20:19:27.372998 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:27.372603    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz74x\" (UniqueName: \"kubernetes.io/projected/ffb2c4fc-ee82-43f3-966b-2f74b3513e68-kube-api-access-pz74x\") pod \"payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m\" (UID: \"ffb2c4fc-ee82-43f3-966b-2f74b3513e68\") " pod="openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m"
Jul 30 20:19:27.373262 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:27.373241    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffb2c4fc-ee82-43f3-966b-2f74b3513e68-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m\" (UID: \"ffb2c4fc-ee82-43f3-966b-2f74b3513e68\") " pod="openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m"
Jul 30 20:19:27.381039 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:27.381014    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz74x\" (UniqueName: \"kubernetes.io/projected/ffb2c4fc-ee82-43f3-966b-2f74b3513e68-kube-api-access-pz74x\") pod \"payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m\" (UID: \"ffb2c4fc-ee82-43f3-966b-2f74b3513e68\") " pod="openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m"
Jul 30 20:19:27.405415 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:27.405394    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m"
Jul 30 20:19:27.572072 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:27.572041    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"]
Jul 30 20:19:27.573010 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:19:27.572988    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4dd046d_4919_4b0f_868e_6708908eeb46.slice/crio-486b6cc85df31743b67b62e357a48a7de895076eed217fd832d539b114d68cb4 WatchSource:0}: Error finding container 486b6cc85df31743b67b62e357a48a7de895076eed217fd832d539b114d68cb4: Status 404 returned error can't find the container with id 486b6cc85df31743b67b62e357a48a7de895076eed217fd832d539b114d68cb4
Jul 30 20:19:27.766139 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:27.766110    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m"]
Jul 30 20:19:27.766988 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:19:27.766953    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffb2c4fc_ee82_43f3_966b_2f74b3513e68.slice/crio-0b26bdd9444a994f030fb1d0151fb097b7e751f17d517fd0b5e07c1bc609982d WatchSource:0}: Error finding container 0b26bdd9444a994f030fb1d0151fb097b7e751f17d517fd0b5e07c1bc609982d: Status 404 returned error can't find the container with id 0b26bdd9444a994f030fb1d0151fb097b7e751f17d517fd0b5e07c1bc609982d
Jul 30 20:19:28.212241 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:28.212201    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m" event={"ID":"ffb2c4fc-ee82-43f3-966b-2f74b3513e68","Type":"ContainerStarted","Data":"ff5e5c290c592325121fe756305ab839050540c3d58eb539369332232ecee0e5"}
Jul 30 20:19:28.212419 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:28.212269    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m" event={"ID":"ffb2c4fc-ee82-43f3-966b-2f74b3513e68","Type":"ContainerStarted","Data":"0b26bdd9444a994f030fb1d0151fb097b7e751f17d517fd0b5e07c1bc609982d"}
Jul 30 20:19:28.213076 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:28.213049    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m"
Jul 30 20:19:28.216168 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:28.216145    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47" event={"ID":"f4dd046d-4919-4b0f-868e-6708908eeb46","Type":"ContainerStarted","Data":"b2f82283f8a9580acf7d859b101552a3542f058c72390d7ba25cce0a3db8412e"}
Jul 30 20:19:28.216302 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:28.216192    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"
Jul 30 20:19:28.216302 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:28.216212    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47" event={"ID":"f4dd046d-4919-4b0f-868e-6708908eeb46","Type":"ContainerStarted","Data":"486b6cc85df31743b67b62e357a48a7de895076eed217fd832d539b114d68cb4"}
Jul 30 20:19:28.232134 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:28.232093    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m" podStartSLOduration=1.232075571 podStartE2EDuration="1.232075571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:19:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:19:28.231359248 +0000 UTC m=+2389.331440435" watchObservedRunningTime="2026-07-30 20:19:28.232075571 +0000 UTC m=+2389.332156761"
Jul 30 20:19:28.250544 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:28.250501    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47" podStartSLOduration=1.78141843 podStartE2EDuration="2.250488188s" totalImagesPullingTime="469.069758ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:19:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:19:28.248411901 +0000 UTC m=+2389.348493095" watchObservedRunningTime="2026-07-30 20:19:28.250488188 +0000 UTC m=+2389.350569416"
Jul 30 20:19:34.229218 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:34.229190    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"
Jul 30 20:19:39.811098 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:39.811066    2568 scope.go:117] "RemoveContainer" containerID="5f85ddea076d95125097a6d90b0fd7c49c7837b4b6d8ab2805bb563a99d66209"
Jul 30 20:19:40.229596 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:40.229491    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m"
Jul 30 20:19:40.230676 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:40.230651    2568 patch_prober.go:28] interesting pod/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 30 20:19:40.230795 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:40.230691    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9" podUID="7d96d383-eaf1-4312-b514-51ca3cf9a20c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 30 20:19:41.308818 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:41.308783    2568 generic.go:356] "Generic (PLEG): container finished" podID="7d96d383-eaf1-4312-b514-51ca3cf9a20c" containerID="541c6262cd1e54ad112fa98ce5457563c0b809f32ff588ff2fe21ab427aa9bc2" exitCode=0
Jul 30 20:19:41.309221 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:41.308836    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9" event={"ID":"7d96d383-eaf1-4312-b514-51ca3cf9a20c","Type":"ContainerDied","Data":"541c6262cd1e54ad112fa98ce5457563c0b809f32ff588ff2fe21ab427aa9bc2"}
Jul 30 20:19:41.309221 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:41.309180    2568 scope.go:117] "RemoveContainer" containerID="541c6262cd1e54ad112fa98ce5457563c0b809f32ff588ff2fe21ab427aa9bc2"
Jul 30 20:19:41.310238 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:41.310206    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:19:41.310319 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:41.310275    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:19:41.310319 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:41.310306    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:19:42.316172 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:42.316132    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9" event={"ID":"7d96d383-eaf1-4312-b514-51ca3cf9a20c","Type":"ContainerStarted","Data":"15ce7326ea402b2020c55afcf360f790fa91704dacd2e6d3a3f02a0c0106abcb"}
Jul 30 20:19:43.109768 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:43.109736    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:43.109944 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:43.109927    2568 patch_prober.go:28] interesting pod/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Jul 30 20:19:43.109994 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:43.109973    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9" podUID="7d96d383-eaf1-4312-b514-51ca3cf9a20c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Jul 30 20:19:44.109716 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:44.109680    2568 patch_prober.go:28] interesting pod/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Jul 30 20:19:44.110199 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:44.109750    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9" podUID="7d96d383-eaf1-4312-b514-51ca3cf9a20c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Jul 30 20:19:45.110399 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:45.110364    2568 patch_prober.go:28] interesting pod/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Jul 30 20:19:45.110832 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:45.110415    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9" podUID="7d96d383-eaf1-4312-b514-51ca3cf9a20c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Jul 30 20:19:46.110676 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:46.110637    2568 patch_prober.go:28] interesting pod/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Jul 30 20:19:46.111172 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:46.110710    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9" podUID="7d96d383-eaf1-4312-b514-51ca3cf9a20c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Jul 30 20:19:47.113938 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:47.113911    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:47.114396 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:47.114343    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:19:47.115035 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:19:47.115018    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:21:16.253231 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.253197    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559"]
Jul 30 20:21:16.254130 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.254093    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559" podUID="1ee01446-0741-4cdb-8d0d-0c6112648d6d" containerName="maas-api" containerID="cri-o://423ad1e43b539f58ed34c3edf116f5381cb02dc97fc2718a4d8883c85ab7043d" gracePeriod=30
Jul 30 20:21:16.312272 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.312239    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d"]
Jul 30 20:21:16.312592 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.312543    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d" podUID="05a984ea-ad37-4e6a-a312-2bb1b53f922e" containerName="payload-processing" containerID="cri-o://7fff393c21050e1f98d50105dd8704263b85407f1d9a776690f624c29812763e" gracePeriod=30
Jul 30 20:21:16.320770 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.320742    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh"]
Jul 30 20:21:16.321200 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.320957    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh" podUID="97c7345a-45ee-46b0-883c-07cdace9bc41" containerName="payload-pre-processing" containerID="cri-o://bccefc7f9862c1a1beb597f0f6544c87d8849f96ad9dcf134d6256dfb5346bf1" gracePeriod=30
Jul 30 20:21:16.545179 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.545124    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559"
Jul 30 20:21:16.601380 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.601350    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d"
Jul 30 20:21:16.645481 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.645449    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh"
Jul 30 20:21:16.714720 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.714683    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ee01446-0741-4cdb-8d0d-0c6112648d6d-openshift-service-ca\") pod \"1ee01446-0741-4cdb-8d0d-0c6112648d6d\" (UID: \"1ee01446-0741-4cdb-8d0d-0c6112648d6d\") "
Jul 30 20:21:16.714866 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.714725    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05a984ea-ad37-4e6a-a312-2bb1b53f922e-plugins-config-volume\") pod \"05a984ea-ad37-4e6a-a312-2bb1b53f922e\" (UID: \"05a984ea-ad37-4e6a-a312-2bb1b53f922e\") "
Jul 30 20:21:16.714866 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.714854    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbbhw\" (UniqueName: \"kubernetes.io/projected/05a984ea-ad37-4e6a-a312-2bb1b53f922e-kube-api-access-fbbhw\") pod \"05a984ea-ad37-4e6a-a312-2bb1b53f922e\" (UID: \"05a984ea-ad37-4e6a-a312-2bb1b53f922e\") "
Jul 30 20:21:16.714981 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.714902    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ee01446-0741-4cdb-8d0d-0c6112648d6d-maas-api-tls\") pod \"1ee01446-0741-4cdb-8d0d-0c6112648d6d\" (UID: \"1ee01446-0741-4cdb-8d0d-0c6112648d6d\") "
Jul 30 20:21:16.714981 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.714926    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qmcf\" (UniqueName: \"kubernetes.io/projected/1ee01446-0741-4cdb-8d0d-0c6112648d6d-kube-api-access-7qmcf\") pod \"1ee01446-0741-4cdb-8d0d-0c6112648d6d\" (UID: \"1ee01446-0741-4cdb-8d0d-0c6112648d6d\") "
Jul 30 20:21:16.715107 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.715003    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ee01446-0741-4cdb-8d0d-0c6112648d6d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1ee01446-0741-4cdb-8d0d-0c6112648d6d" (UID: "1ee01446-0741-4cdb-8d0d-0c6112648d6d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:21:16.715107 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.715069    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05a984ea-ad37-4e6a-a312-2bb1b53f922e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "05a984ea-ad37-4e6a-a312-2bb1b53f922e" (UID: "05a984ea-ad37-4e6a-a312-2bb1b53f922e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:21:16.715375 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.715343    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ee01446-0741-4cdb-8d0d-0c6112648d6d-openshift-service-ca\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:16.715375 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.715367    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05a984ea-ad37-4e6a-a312-2bb1b53f922e-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:16.716918 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.716884    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ee01446-0741-4cdb-8d0d-0c6112648d6d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1ee01446-0741-4cdb-8d0d-0c6112648d6d" (UID: "1ee01446-0741-4cdb-8d0d-0c6112648d6d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:21:16.717018 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.716926    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ee01446-0741-4cdb-8d0d-0c6112648d6d-kube-api-access-7qmcf" (OuterVolumeSpecName: "kube-api-access-7qmcf") pod "1ee01446-0741-4cdb-8d0d-0c6112648d6d" (UID: "1ee01446-0741-4cdb-8d0d-0c6112648d6d"). InnerVolumeSpecName "kube-api-access-7qmcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:21:16.717018 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.716938    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05a984ea-ad37-4e6a-a312-2bb1b53f922e-kube-api-access-fbbhw" (OuterVolumeSpecName: "kube-api-access-fbbhw") pod "05a984ea-ad37-4e6a-a312-2bb1b53f922e" (UID: "05a984ea-ad37-4e6a-a312-2bb1b53f922e"). InnerVolumeSpecName "kube-api-access-fbbhw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:21:16.816582 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.816539    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97c7345a-45ee-46b0-883c-07cdace9bc41-plugins-config-volume\") pod \"97c7345a-45ee-46b0-883c-07cdace9bc41\" (UID: \"97c7345a-45ee-46b0-883c-07cdace9bc41\") "
Jul 30 20:21:16.816717 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.816641    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drsvh\" (UniqueName: \"kubernetes.io/projected/97c7345a-45ee-46b0-883c-07cdace9bc41-kube-api-access-drsvh\") pod \"97c7345a-45ee-46b0-883c-07cdace9bc41\" (UID: \"97c7345a-45ee-46b0-883c-07cdace9bc41\") "
Jul 30 20:21:16.816916 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.816892    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97c7345a-45ee-46b0-883c-07cdace9bc41-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "97c7345a-45ee-46b0-883c-07cdace9bc41" (UID: "97c7345a-45ee-46b0-883c-07cdace9bc41"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:21:16.816995 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.816904    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbbhw\" (UniqueName: \"kubernetes.io/projected/05a984ea-ad37-4e6a-a312-2bb1b53f922e-kube-api-access-fbbhw\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:16.816995 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.816942    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ee01446-0741-4cdb-8d0d-0c6112648d6d-maas-api-tls\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:16.816995 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.816958    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qmcf\" (UniqueName: \"kubernetes.io/projected/1ee01446-0741-4cdb-8d0d-0c6112648d6d-kube-api-access-7qmcf\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:16.818362 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.818342    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97c7345a-45ee-46b0-883c-07cdace9bc41-kube-api-access-drsvh" (OuterVolumeSpecName: "kube-api-access-drsvh") pod "97c7345a-45ee-46b0-883c-07cdace9bc41" (UID: "97c7345a-45ee-46b0-883c-07cdace9bc41"). InnerVolumeSpecName "kube-api-access-drsvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:21:16.832356 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.832329    2568 generic.go:356] "Generic (PLEG): container finished" podID="1ee01446-0741-4cdb-8d0d-0c6112648d6d" containerID="423ad1e43b539f58ed34c3edf116f5381cb02dc97fc2718a4d8883c85ab7043d" exitCode=0
Jul 30 20:21:16.832468 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.832378    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559"
Jul 30 20:21:16.832468 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.832408    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559" event={"ID":"1ee01446-0741-4cdb-8d0d-0c6112648d6d","Type":"ContainerDied","Data":"423ad1e43b539f58ed34c3edf116f5381cb02dc97fc2718a4d8883c85ab7043d"}
Jul 30 20:21:16.832468 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.832459    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559" event={"ID":"1ee01446-0741-4cdb-8d0d-0c6112648d6d","Type":"ContainerDied","Data":"cd6541a76b95739659a6c72157d97bfc0836b2ca4e9d2bc51d57c1815bf6c0f6"}
Jul 30 20:21:16.832651 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.832491    2568 scope.go:117] "RemoveContainer" containerID="423ad1e43b539f58ed34c3edf116f5381cb02dc97fc2718a4d8883c85ab7043d"
Jul 30 20:21:16.833807 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.833779    2568 generic.go:356] "Generic (PLEG): container finished" podID="97c7345a-45ee-46b0-883c-07cdace9bc41" containerID="bccefc7f9862c1a1beb597f0f6544c87d8849f96ad9dcf134d6256dfb5346bf1" exitCode=0
Jul 30 20:21:16.833923 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.833810    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh"
Jul 30 20:21:16.833923 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.833812    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh" event={"ID":"97c7345a-45ee-46b0-883c-07cdace9bc41","Type":"ContainerDied","Data":"bccefc7f9862c1a1beb597f0f6544c87d8849f96ad9dcf134d6256dfb5346bf1"}
Jul 30 20:21:16.834044 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.833953    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh" event={"ID":"97c7345a-45ee-46b0-883c-07cdace9bc41","Type":"ContainerDied","Data":"41069df95f83d0444ee2e2bf8df417e0752e9684f1c7c0b1076e21c3012f818f"}
Jul 30 20:21:16.835420 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.835400    2568 generic.go:356] "Generic (PLEG): container finished" podID="05a984ea-ad37-4e6a-a312-2bb1b53f922e" containerID="7fff393c21050e1f98d50105dd8704263b85407f1d9a776690f624c29812763e" exitCode=0
Jul 30 20:21:16.835534 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.835449    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d"
Jul 30 20:21:16.835534 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.835484    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d" event={"ID":"05a984ea-ad37-4e6a-a312-2bb1b53f922e","Type":"ContainerDied","Data":"7fff393c21050e1f98d50105dd8704263b85407f1d9a776690f624c29812763e"}
Jul 30 20:21:16.835672 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.835550    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d" event={"ID":"05a984ea-ad37-4e6a-a312-2bb1b53f922e","Type":"ContainerDied","Data":"35ec8b52469e14fa21103b14f4df160d02cda21d217b0177fbe38f95b0561afb"}
Jul 30 20:21:16.843915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.843898    2568 scope.go:117] "RemoveContainer" containerID="423ad1e43b539f58ed34c3edf116f5381cb02dc97fc2718a4d8883c85ab7043d"
Jul 30 20:21:16.844993 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:21:16.844969    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"423ad1e43b539f58ed34c3edf116f5381cb02dc97fc2718a4d8883c85ab7043d\": container with ID starting with 423ad1e43b539f58ed34c3edf116f5381cb02dc97fc2718a4d8883c85ab7043d not found: ID does not exist" containerID="423ad1e43b539f58ed34c3edf116f5381cb02dc97fc2718a4d8883c85ab7043d"
Jul 30 20:21:16.845077 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.845003    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"423ad1e43b539f58ed34c3edf116f5381cb02dc97fc2718a4d8883c85ab7043d"} err="failed to get container status \"423ad1e43b539f58ed34c3edf116f5381cb02dc97fc2718a4d8883c85ab7043d\": rpc error: code = NotFound desc = could not find container \"423ad1e43b539f58ed34c3edf116f5381cb02dc97fc2718a4d8883c85ab7043d\": container with ID starting with 423ad1e43b539f58ed34c3edf116f5381cb02dc97fc2718a4d8883c85ab7043d not found: ID does not exist"
Jul 30 20:21:16.845077 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.845026    2568 scope.go:117] "RemoveContainer" containerID="bccefc7f9862c1a1beb597f0f6544c87d8849f96ad9dcf134d6256dfb5346bf1"
Jul 30 20:21:16.854218 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.854203    2568 scope.go:117] "RemoveContainer" containerID="bccefc7f9862c1a1beb597f0f6544c87d8849f96ad9dcf134d6256dfb5346bf1"
Jul 30 20:21:16.854468 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:21:16.854451    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bccefc7f9862c1a1beb597f0f6544c87d8849f96ad9dcf134d6256dfb5346bf1\": container with ID starting with bccefc7f9862c1a1beb597f0f6544c87d8849f96ad9dcf134d6256dfb5346bf1 not found: ID does not exist" containerID="bccefc7f9862c1a1beb597f0f6544c87d8849f96ad9dcf134d6256dfb5346bf1"
Jul 30 20:21:16.854516 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.854475    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bccefc7f9862c1a1beb597f0f6544c87d8849f96ad9dcf134d6256dfb5346bf1"} err="failed to get container status \"bccefc7f9862c1a1beb597f0f6544c87d8849f96ad9dcf134d6256dfb5346bf1\": rpc error: code = NotFound desc = could not find container \"bccefc7f9862c1a1beb597f0f6544c87d8849f96ad9dcf134d6256dfb5346bf1\": container with ID starting with bccefc7f9862c1a1beb597f0f6544c87d8849f96ad9dcf134d6256dfb5346bf1 not found: ID does not exist"
Jul 30 20:21:16.854516 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.854492    2568 scope.go:117] "RemoveContainer" containerID="7fff393c21050e1f98d50105dd8704263b85407f1d9a776690f624c29812763e"
Jul 30 20:21:16.861977 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.861962    2568 scope.go:117] "RemoveContainer" containerID="7fff393c21050e1f98d50105dd8704263b85407f1d9a776690f624c29812763e"
Jul 30 20:21:16.862248 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:21:16.862230    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fff393c21050e1f98d50105dd8704263b85407f1d9a776690f624c29812763e\": container with ID starting with 7fff393c21050e1f98d50105dd8704263b85407f1d9a776690f624c29812763e not found: ID does not exist" containerID="7fff393c21050e1f98d50105dd8704263b85407f1d9a776690f624c29812763e"
Jul 30 20:21:16.862293 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.862254    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fff393c21050e1f98d50105dd8704263b85407f1d9a776690f624c29812763e"} err="failed to get container status \"7fff393c21050e1f98d50105dd8704263b85407f1d9a776690f624c29812763e\": rpc error: code = NotFound desc = could not find container \"7fff393c21050e1f98d50105dd8704263b85407f1d9a776690f624c29812763e\": container with ID starting with 7fff393c21050e1f98d50105dd8704263b85407f1d9a776690f624c29812763e not found: ID does not exist"
Jul 30 20:21:16.898175 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.898155    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh"]
Jul 30 20:21:16.907448 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.907426    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-478a06-54fb5c79b8-l4pqh"]
Jul 30 20:21:16.918114 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.918096    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97c7345a-45ee-46b0-883c-07cdace9bc41-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:16.918191 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.918116    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drsvh\" (UniqueName: \"kubernetes.io/projected/97c7345a-45ee-46b0-883c-07cdace9bc41-kube-api-access-drsvh\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:16.927432 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.927413    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d"]
Jul 30 20:21:16.939410 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.939388    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-478a06-79cdf58bdb-24n2d"]
Jul 30 20:21:16.965046 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.965025    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559"]
Jul 30 20:21:16.974434 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:16.974411    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-478a06-786c8c6d6-ws559"]
Jul 30 20:21:17.482320 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:17.482289    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05a984ea-ad37-4e6a-a312-2bb1b53f922e" path="/var/lib/kubelet/pods/05a984ea-ad37-4e6a-a312-2bb1b53f922e/volumes"
Jul 30 20:21:17.482779 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:17.482763    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ee01446-0741-4cdb-8d0d-0c6112648d6d" path="/var/lib/kubelet/pods/1ee01446-0741-4cdb-8d0d-0c6112648d6d/volumes"
Jul 30 20:21:17.483133 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:17.483120    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97c7345a-45ee-46b0-883c-07cdace9bc41" path="/var/lib/kubelet/pods/97c7345a-45ee-46b0-883c-07cdace9bc41/volumes"
Jul 30 20:21:22.936415 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:22.936376    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"]
Jul 30 20:21:22.936912 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:22.936624    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p" podUID="64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" containerName="istio-proxy" containerID="cri-o://7908da7c05f42a92769681248d11e67e080f792272e6ccc3b433fe948054a328" gracePeriod=30
Jul 30 20:21:28.200727 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.200670    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:21:28.233331 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.233306    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-podinfo\") pod \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") "
Jul 30 20:21:28.233472 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.233338    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-token\") pod \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") "
Jul 30 20:21:28.233472 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.233367    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-envoy\") pod \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") "
Jul 30 20:21:28.233472 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.233413    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istiod-ca-cert\") pod \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") "
Jul 30 20:21:28.233472 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.233428    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-workload-certs\") pod \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") "
Jul 30 20:21:28.233714 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.233474    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxslq\" (UniqueName: \"kubernetes.io/projected/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-kube-api-access-fxslq\") pod \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") "
Jul 30 20:21:28.233714 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.233503    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-data\") pod \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") "
Jul 30 20:21:28.233714 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.233529    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-workload-socket\") pod \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") "
Jul 30 20:21:28.233714 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.233553    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-credential-socket\") pod \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\" (UID: \"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0\") "
Jul 30 20:21:28.234476 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.234123    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" (UID: "64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:21:28.234476 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.234230    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" (UID: "64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:21:28.234476 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.234313    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" (UID: "64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:21:28.234476 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.234453    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" (UID: "64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:21:28.234710 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.234528    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-data" (OuterVolumeSpecName: "istio-data") pod "64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" (UID: "64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:21:28.235792 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.235767    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" (UID: "64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:21:28.236054 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.236031    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-kube-api-access-fxslq" (OuterVolumeSpecName: "kube-api-access-fxslq") pod "64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" (UID: "64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0"). InnerVolumeSpecName "kube-api-access-fxslq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:21:28.236145 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.236077    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-token" (OuterVolumeSpecName: "istio-token") pod "64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" (UID: "64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:21:28.236145 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.236094    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" (UID: "64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 20:21:28.334785 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.334757    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-podinfo\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:28.334785 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.334780    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-token\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:28.334785 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.334791    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-envoy\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:28.335010 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.334798    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istiod-ca-cert\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:28.335010 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.334806    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-workload-certs\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:28.335010 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.334815    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxslq\" (UniqueName: \"kubernetes.io/projected/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-kube-api-access-fxslq\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:28.335010 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.334825    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-istio-data\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:28.335010 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.334833    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-workload-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:28.335010 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.334841    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0-credential-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:28.907748 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.907710    2568 generic.go:356] "Generic (PLEG): container finished" podID="64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" containerID="7908da7c05f42a92769681248d11e67e080f792272e6ccc3b433fe948054a328" exitCode=0
Jul 30 20:21:28.907748 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.907750    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"
Jul 30 20:21:28.907982 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.907794    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p" event={"ID":"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0","Type":"ContainerDied","Data":"7908da7c05f42a92769681248d11e67e080f792272e6ccc3b433fe948054a328"}
Jul 30 20:21:28.907982 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.907856    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p" event={"ID":"64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0","Type":"ContainerDied","Data":"0b50a924adad150e64899ca99f3201140fbbdb86217b7205ac9ff5d1df6e393c"}
Jul 30 20:21:28.907982 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.907885    2568 scope.go:117] "RemoveContainer" containerID="7908da7c05f42a92769681248d11e67e080f792272e6ccc3b433fe948054a328"
Jul 30 20:21:28.920970 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.920352    2568 scope.go:117] "RemoveContainer" containerID="cae362d3e70324913f9964c629535b2c70049c4929db2c7b4c3e5a47ca702417"
Jul 30 20:21:28.929960 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.929938    2568 scope.go:117] "RemoveContainer" containerID="7908da7c05f42a92769681248d11e67e080f792272e6ccc3b433fe948054a328"
Jul 30 20:21:28.930270 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:21:28.930233    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7908da7c05f42a92769681248d11e67e080f792272e6ccc3b433fe948054a328\": container with ID starting with 7908da7c05f42a92769681248d11e67e080f792272e6ccc3b433fe948054a328 not found: ID does not exist" containerID="7908da7c05f42a92769681248d11e67e080f792272e6ccc3b433fe948054a328"
Jul 30 20:21:28.930429 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.930269    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7908da7c05f42a92769681248d11e67e080f792272e6ccc3b433fe948054a328"} err="failed to get container status \"7908da7c05f42a92769681248d11e67e080f792272e6ccc3b433fe948054a328\": rpc error: code = NotFound desc = could not find container \"7908da7c05f42a92769681248d11e67e080f792272e6ccc3b433fe948054a328\": container with ID starting with 7908da7c05f42a92769681248d11e67e080f792272e6ccc3b433fe948054a328 not found: ID does not exist"
Jul 30 20:21:28.930429 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.930295    2568 scope.go:117] "RemoveContainer" containerID="cae362d3e70324913f9964c629535b2c70049c4929db2c7b4c3e5a47ca702417"
Jul 30 20:21:28.930954 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:21:28.930862    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cae362d3e70324913f9964c629535b2c70049c4929db2c7b4c3e5a47ca702417\": container with ID starting with cae362d3e70324913f9964c629535b2c70049c4929db2c7b4c3e5a47ca702417 not found: ID does not exist" containerID="cae362d3e70324913f9964c629535b2c70049c4929db2c7b4c3e5a47ca702417"
Jul 30 20:21:28.930954 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.930896    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cae362d3e70324913f9964c629535b2c70049c4929db2c7b4c3e5a47ca702417"} err="failed to get container status \"cae362d3e70324913f9964c629535b2c70049c4929db2c7b4c3e5a47ca702417\": rpc error: code = NotFound desc = could not find container \"cae362d3e70324913f9964c629535b2c70049c4929db2c7b4c3e5a47ca702417\": container with ID starting with cae362d3e70324913f9964c629535b2c70049c4929db2c7b4c3e5a47ca702417 not found: ID does not exist"
Jul 30 20:21:28.934665 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.934643    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"]
Jul 30 20:21:28.938576 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:28.938548    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-478a06-openshift-default-67b8947974-vbz8p"]
Jul 30 20:21:29.481143 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:29.481113    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" path="/var/lib/kubelet/pods/64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0/volumes"
Jul 30 20:21:33.805106 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:33.805020    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"]
Jul 30 20:21:33.805507 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:33.805218    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47" podUID="f4dd046d-4919-4b0f-868e-6708908eeb46" containerName="maas-api" containerID="cri-o://b2f82283f8a9580acf7d859b101552a3542f058c72390d7ba25cce0a3db8412e" gracePeriod=30
Jul 30 20:21:33.860501 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:33.860472    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m"]
Jul 30 20:21:33.860747 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:33.860717    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m" podUID="ffb2c4fc-ee82-43f3-966b-2f74b3513e68" containerName="payload-processing" containerID="cri-o://ff5e5c290c592325121fe756305ab839050540c3d58eb539369332232ecee0e5" gracePeriod=30
Jul 30 20:21:34.162020 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.161963    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m"
Jul 30 20:21:34.189125 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.189097    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffb2c4fc-ee82-43f3-966b-2f74b3513e68-plugins-config-volume\") pod \"ffb2c4fc-ee82-43f3-966b-2f74b3513e68\" (UID: \"ffb2c4fc-ee82-43f3-966b-2f74b3513e68\") "
Jul 30 20:21:34.189236 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.189221    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz74x\" (UniqueName: \"kubernetes.io/projected/ffb2c4fc-ee82-43f3-966b-2f74b3513e68-kube-api-access-pz74x\") pod \"ffb2c4fc-ee82-43f3-966b-2f74b3513e68\" (UID: \"ffb2c4fc-ee82-43f3-966b-2f74b3513e68\") "
Jul 30 20:21:34.189460 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.189439    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffb2c4fc-ee82-43f3-966b-2f74b3513e68-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ffb2c4fc-ee82-43f3-966b-2f74b3513e68" (UID: "ffb2c4fc-ee82-43f3-966b-2f74b3513e68"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:21:34.189584 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.189537    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffb2c4fc-ee82-43f3-966b-2f74b3513e68-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:34.191359 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.191329    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffb2c4fc-ee82-43f3-966b-2f74b3513e68-kube-api-access-pz74x" (OuterVolumeSpecName: "kube-api-access-pz74x") pod "ffb2c4fc-ee82-43f3-966b-2f74b3513e68" (UID: "ffb2c4fc-ee82-43f3-966b-2f74b3513e68"). InnerVolumeSpecName "kube-api-access-pz74x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:21:34.269398 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.269375    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"
Jul 30 20:21:34.290118 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.290088    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4dd046d-4919-4b0f-868e-6708908eeb46-maas-api-tls\") pod \"f4dd046d-4919-4b0f-868e-6708908eeb46\" (UID: \"f4dd046d-4919-4b0f-868e-6708908eeb46\") "
Jul 30 20:21:34.290360 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.290331    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4dd046d-4919-4b0f-868e-6708908eeb46-openshift-service-ca\") pod \"f4dd046d-4919-4b0f-868e-6708908eeb46\" (UID: \"f4dd046d-4919-4b0f-868e-6708908eeb46\") "
Jul 30 20:21:34.290467 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.290379    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcpxn\" (UniqueName: \"kubernetes.io/projected/f4dd046d-4919-4b0f-868e-6708908eeb46-kube-api-access-vcpxn\") pod \"f4dd046d-4919-4b0f-868e-6708908eeb46\" (UID: \"f4dd046d-4919-4b0f-868e-6708908eeb46\") "
Jul 30 20:21:34.290884 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.290860    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz74x\" (UniqueName: \"kubernetes.io/projected/ffb2c4fc-ee82-43f3-966b-2f74b3513e68-kube-api-access-pz74x\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:34.290985 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.290907    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4dd046d-4919-4b0f-868e-6708908eeb46-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f4dd046d-4919-4b0f-868e-6708908eeb46" (UID: "f4dd046d-4919-4b0f-868e-6708908eeb46"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:21:34.292601 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.292544    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4dd046d-4919-4b0f-868e-6708908eeb46-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f4dd046d-4919-4b0f-868e-6708908eeb46" (UID: "f4dd046d-4919-4b0f-868e-6708908eeb46"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:21:34.293117 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.293092    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4dd046d-4919-4b0f-868e-6708908eeb46-kube-api-access-vcpxn" (OuterVolumeSpecName: "kube-api-access-vcpxn") pod "f4dd046d-4919-4b0f-868e-6708908eeb46" (UID: "f4dd046d-4919-4b0f-868e-6708908eeb46"). InnerVolumeSpecName "kube-api-access-vcpxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:21:34.392125 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.392063    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4dd046d-4919-4b0f-868e-6708908eeb46-maas-api-tls\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:34.392125 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.392086    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4dd046d-4919-4b0f-868e-6708908eeb46-openshift-service-ca\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:34.392125 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.392099    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcpxn\" (UniqueName: \"kubernetes.io/projected/f4dd046d-4919-4b0f-868e-6708908eeb46-kube-api-access-vcpxn\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:34.940768 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.940733    2568 generic.go:356] "Generic (PLEG): container finished" podID="ffb2c4fc-ee82-43f3-966b-2f74b3513e68" containerID="ff5e5c290c592325121fe756305ab839050540c3d58eb539369332232ecee0e5" exitCode=0
Jul 30 20:21:34.941208 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.940779    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m"
Jul 30 20:21:34.941208 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.940844    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m" event={"ID":"ffb2c4fc-ee82-43f3-966b-2f74b3513e68","Type":"ContainerDied","Data":"ff5e5c290c592325121fe756305ab839050540c3d58eb539369332232ecee0e5"}
Jul 30 20:21:34.941208 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.940906    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m" event={"ID":"ffb2c4fc-ee82-43f3-966b-2f74b3513e68","Type":"ContainerDied","Data":"0b26bdd9444a994f030fb1d0151fb097b7e751f17d517fd0b5e07c1bc609982d"}
Jul 30 20:21:34.941208 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.940938    2568 scope.go:117] "RemoveContainer" containerID="ff5e5c290c592325121fe756305ab839050540c3d58eb539369332232ecee0e5"
Jul 30 20:21:34.942486 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.942466    2568 generic.go:356] "Generic (PLEG): container finished" podID="f4dd046d-4919-4b0f-868e-6708908eeb46" containerID="b2f82283f8a9580acf7d859b101552a3542f058c72390d7ba25cce0a3db8412e" exitCode=0
Jul 30 20:21:34.942601 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.942519    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"
Jul 30 20:21:34.942601 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.942529    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47" event={"ID":"f4dd046d-4919-4b0f-868e-6708908eeb46","Type":"ContainerDied","Data":"b2f82283f8a9580acf7d859b101552a3542f058c72390d7ba25cce0a3db8412e"}
Jul 30 20:21:34.942601 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.942583    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47" event={"ID":"f4dd046d-4919-4b0f-868e-6708908eeb46","Type":"ContainerDied","Data":"486b6cc85df31743b67b62e357a48a7de895076eed217fd832d539b114d68cb4"}
Jul 30 20:21:34.951588 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.951574    2568 scope.go:117] "RemoveContainer" containerID="ff5e5c290c592325121fe756305ab839050540c3d58eb539369332232ecee0e5"
Jul 30 20:21:34.951810 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:21:34.951790    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff5e5c290c592325121fe756305ab839050540c3d58eb539369332232ecee0e5\": container with ID starting with ff5e5c290c592325121fe756305ab839050540c3d58eb539369332232ecee0e5 not found: ID does not exist" containerID="ff5e5c290c592325121fe756305ab839050540c3d58eb539369332232ecee0e5"
Jul 30 20:21:34.951898 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.951816    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff5e5c290c592325121fe756305ab839050540c3d58eb539369332232ecee0e5"} err="failed to get container status \"ff5e5c290c592325121fe756305ab839050540c3d58eb539369332232ecee0e5\": rpc error: code = NotFound desc = could not find container \"ff5e5c290c592325121fe756305ab839050540c3d58eb539369332232ecee0e5\": container with ID starting with ff5e5c290c592325121fe756305ab839050540c3d58eb539369332232ecee0e5 not found: ID does not exist"
Jul 30 20:21:34.951898 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.951832    2568 scope.go:117] "RemoveContainer" containerID="b2f82283f8a9580acf7d859b101552a3542f058c72390d7ba25cce0a3db8412e"
Jul 30 20:21:34.959940 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.959924    2568 scope.go:117] "RemoveContainer" containerID="b2f82283f8a9580acf7d859b101552a3542f058c72390d7ba25cce0a3db8412e"
Jul 30 20:21:34.960178 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:21:34.960160    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2f82283f8a9580acf7d859b101552a3542f058c72390d7ba25cce0a3db8412e\": container with ID starting with b2f82283f8a9580acf7d859b101552a3542f058c72390d7ba25cce0a3db8412e not found: ID does not exist" containerID="b2f82283f8a9580acf7d859b101552a3542f058c72390d7ba25cce0a3db8412e"
Jul 30 20:21:34.960233 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.960183    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2f82283f8a9580acf7d859b101552a3542f058c72390d7ba25cce0a3db8412e"} err="failed to get container status \"b2f82283f8a9580acf7d859b101552a3542f058c72390d7ba25cce0a3db8412e\": rpc error: code = NotFound desc = could not find container \"b2f82283f8a9580acf7d859b101552a3542f058c72390d7ba25cce0a3db8412e\": container with ID starting with b2f82283f8a9580acf7d859b101552a3542f058c72390d7ba25cce0a3db8412e not found: ID does not exist"
Jul 30 20:21:34.979871 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.979847    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m"]
Jul 30 20:21:34.984388 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:34.984366    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-7edd0a-75f7974d98-57j4m"]
Jul 30 20:21:35.002744 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:35.002717    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"]
Jul 30 20:21:35.009169 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:35.009150    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47"]
Jul 30 20:21:35.481765 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:35.481725    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4dd046d-4919-4b0f-868e-6708908eeb46" path="/var/lib/kubelet/pods/f4dd046d-4919-4b0f-868e-6708908eeb46/volumes"
Jul 30 20:21:35.482186 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:35.482165    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffb2c4fc-ee82-43f3-966b-2f74b3513e68" path="/var/lib/kubelet/pods/ffb2c4fc-ee82-43f3-966b-2f74b3513e68/volumes"
Jul 30 20:21:37.227407 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:37.227367    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7edd0a-5c7768bdb6-qqf47" podUID="f4dd046d-4919-4b0f-868e-6708908eeb46" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.82:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 30 20:21:40.524863 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:40.524832    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"]
Jul 30 20:21:40.525243 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:40.525045    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9" podUID="7d96d383-eaf1-4312-b514-51ca3cf9a20c" containerName="istio-proxy" containerID="cri-o://15ce7326ea402b2020c55afcf360f790fa91704dacd2e6d3a3f02a0c0106abcb" gracePeriod=30
Jul 30 20:21:41.379382 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.379346    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"]
Jul 30 20:21:41.379826 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.379803    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffb2c4fc-ee82-43f3-966b-2f74b3513e68" containerName="payload-processing"
Jul 30 20:21:41.379826 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.379821    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffb2c4fc-ee82-43f3-966b-2f74b3513e68" containerName="payload-processing"
Jul 30 20:21:41.379924 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.379837    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" containerName="istio-proxy"
Jul 30 20:21:41.379924 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.379842    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" containerName="istio-proxy"
Jul 30 20:21:41.379924 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.379868    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97c7345a-45ee-46b0-883c-07cdace9bc41" containerName="payload-pre-processing"
Jul 30 20:21:41.379924 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.379876    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="97c7345a-45ee-46b0-883c-07cdace9bc41" containerName="payload-pre-processing"
Jul 30 20:21:41.379924 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.379884    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05a984ea-ad37-4e6a-a312-2bb1b53f922e" containerName="payload-processing"
Jul 30 20:21:41.379924 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.379889    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="05a984ea-ad37-4e6a-a312-2bb1b53f922e" containerName="payload-processing"
Jul 30 20:21:41.379924 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.379900    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ee01446-0741-4cdb-8d0d-0c6112648d6d" containerName="maas-api"
Jul 30 20:21:41.379924 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.379905    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ee01446-0741-4cdb-8d0d-0c6112648d6d" containerName="maas-api"
Jul 30 20:21:41.379924 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.379910    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4dd046d-4919-4b0f-868e-6708908eeb46" containerName="maas-api"
Jul 30 20:21:41.379924 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.379917    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4dd046d-4919-4b0f-868e-6708908eeb46" containerName="maas-api"
Jul 30 20:21:41.380257 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.380023    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" containerName="istio-proxy"
Jul 30 20:21:41.380257 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.380035    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="97c7345a-45ee-46b0-883c-07cdace9bc41" containerName="payload-pre-processing"
Jul 30 20:21:41.380257 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.380045    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffb2c4fc-ee82-43f3-966b-2f74b3513e68" containerName="payload-processing"
Jul 30 20:21:41.380257 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.380068    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4dd046d-4919-4b0f-868e-6708908eeb46" containerName="maas-api"
Jul 30 20:21:41.380257 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.380079    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ee01446-0741-4cdb-8d0d-0c6112648d6d" containerName="maas-api"
Jul 30 20:21:41.380257 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.380090    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" containerName="istio-proxy"
Jul 30 20:21:41.380257 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.380098    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="05a984ea-ad37-4e6a-a312-2bb1b53f922e" containerName="payload-processing"
Jul 30 20:21:41.385084 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.385067    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.387624 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.387606    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-d0b78d-openshift-default-dockercfg-krqfw\""
Jul 30 20:21:41.394846 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.394822    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"]
Jul 30 20:21:41.457832 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.457800    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-credential-socket\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.457983 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.457854    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f675c683-d9d8-43ab-af67-15805cdde81a-istio-podinfo\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.457983 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.457917    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-istio-envoy\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.457983 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.457943    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f675c683-d9d8-43ab-af67-15805cdde81a-istiod-ca-cert\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.458118 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.457982    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-istio-data\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.458118 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.458022    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-workload-certs\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.458118 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.458060    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-workload-socket\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.458118 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.458104    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wth5v\" (UniqueName: \"kubernetes.io/projected/f675c683-d9d8-43ab-af67-15805cdde81a-kube-api-access-wth5v\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.458270 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.458138    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f675c683-d9d8-43ab-af67-15805cdde81a-istio-token\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.558836 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.558803    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-credential-socket\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.558836 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.558841    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f675c683-d9d8-43ab-af67-15805cdde81a-istio-podinfo\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.559343 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.558863    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-istio-envoy\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.559343 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.558880    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f675c683-d9d8-43ab-af67-15805cdde81a-istiod-ca-cert\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.559343 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.559004    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-istio-data\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.559343 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.559056    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-workload-certs\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.559343 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.559107    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-workload-socket\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.559343 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.559162    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wth5v\" (UniqueName: \"kubernetes.io/projected/f675c683-d9d8-43ab-af67-15805cdde81a-kube-api-access-wth5v\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.559343 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.559207    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-credential-socket\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.559343 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.559211    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f675c683-d9d8-43ab-af67-15805cdde81a-istio-token\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.559343 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.559310    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-istio-data\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.559915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.559361    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-workload-certs\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.559915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.559548    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-workload-socket\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.559915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.559596    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f675c683-d9d8-43ab-af67-15805cdde81a-istiod-ca-cert\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.561216 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.561195    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-istio-envoy\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.561352 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.561336    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f675c683-d9d8-43ab-af67-15805cdde81a-istio-podinfo\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.569552 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.569514    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f675c683-d9d8-43ab-af67-15805cdde81a-istio-token\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.572683 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.572662    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wth5v\" (UniqueName: \"kubernetes.io/projected/f675c683-d9d8-43ab-af67-15805cdde81a-kube-api-access-wth5v\") pod \"e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") " pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.696907 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.696830    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:41.830260 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.830235    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"]
Jul 30 20:21:41.831965 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:21:41.831942    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf675c683_d9d8_43ab_af67_15805cdde81a.slice/crio-dbe33adf90943e6ca48f9004f01385e81fa2fd2fbc2ef0f2f898f4fa91568f87 WatchSource:0}: Error finding container dbe33adf90943e6ca48f9004f01385e81fa2fd2fbc2ef0f2f898f4fa91568f87: Status 404 returned error can't find the container with id dbe33adf90943e6ca48f9004f01385e81fa2fd2fbc2ef0f2f898f4fa91568f87
Jul 30 20:21:41.834066 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.834035    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:21:41.834137 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.834099    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:21:41.834137 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.834134    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:21:41.983398 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.983297    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v" event={"ID":"f675c683-d9d8-43ab-af67-15805cdde81a","Type":"ContainerStarted","Data":"0b115547171139fd455676e72e44a8990075e9ce2d77b0e67f0220d4a289e441"}
Jul 30 20:21:41.983398 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:41.983369    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v" event={"ID":"f675c683-d9d8-43ab-af67-15805cdde81a","Type":"ContainerStarted","Data":"dbe33adf90943e6ca48f9004f01385e81fa2fd2fbc2ef0f2f898f4fa91568f87"}
Jul 30 20:21:42.002747 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:42.002701    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v" podStartSLOduration=1.002682155 podStartE2EDuration="1.002682155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:21:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:21:42.001491727 +0000 UTC m=+2523.101572911" watchObservedRunningTime="2026-07-30 20:21:42.002682155 +0000 UTC m=+2523.102763343"
Jul 30 20:21:42.697885 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:42.697849    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:42.702820 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:42.702793    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:42.989098 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:42.989015    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:42.989914 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:42.989892    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:44.990808 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:44.990772    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949"]
Jul 30 20:21:44.991265 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:44.991221    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" containerName="istio-proxy"
Jul 30 20:21:44.991265 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:44.991235    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="64cfa0b9-4fc2-4cbe-81f0-789420d7a7e0" containerName="istio-proxy"
Jul 30 20:21:44.994504 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:44.994486    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949"
Jul 30 20:21:44.996997 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:44.996977    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-d0b78d-serving-cert\""
Jul 30 20:21:45.005393 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.005371    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949"]
Jul 30 20:21:45.092875 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.092843    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/138994ed-5e12-47d5-b2db-77b139368ff4-openshift-service-ca\") pod \"maas-api-e2e-api-a-d0b78d-77c5bff48-4m949\" (UID: \"138994ed-5e12-47d5-b2db-77b139368ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949"
Jul 30 20:21:45.093042 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.092922    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/138994ed-5e12-47d5-b2db-77b139368ff4-maas-api-tls\") pod \"maas-api-e2e-api-a-d0b78d-77c5bff48-4m949\" (UID: \"138994ed-5e12-47d5-b2db-77b139368ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949"
Jul 30 20:21:45.093152 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.093130    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nsr8\" (UniqueName: \"kubernetes.io/projected/138994ed-5e12-47d5-b2db-77b139368ff4-kube-api-access-5nsr8\") pod \"maas-api-e2e-api-a-d0b78d-77c5bff48-4m949\" (UID: \"138994ed-5e12-47d5-b2db-77b139368ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949"
Jul 30 20:21:45.194360 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.194324    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/138994ed-5e12-47d5-b2db-77b139368ff4-maas-api-tls\") pod \"maas-api-e2e-api-a-d0b78d-77c5bff48-4m949\" (UID: \"138994ed-5e12-47d5-b2db-77b139368ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949"
Jul 30 20:21:45.194560 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.194441    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nsr8\" (UniqueName: \"kubernetes.io/projected/138994ed-5e12-47d5-b2db-77b139368ff4-kube-api-access-5nsr8\") pod \"maas-api-e2e-api-a-d0b78d-77c5bff48-4m949\" (UID: \"138994ed-5e12-47d5-b2db-77b139368ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949"
Jul 30 20:21:45.194560 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.194496    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/138994ed-5e12-47d5-b2db-77b139368ff4-openshift-service-ca\") pod \"maas-api-e2e-api-a-d0b78d-77c5bff48-4m949\" (UID: \"138994ed-5e12-47d5-b2db-77b139368ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949"
Jul 30 20:21:45.195145 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.195122    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/138994ed-5e12-47d5-b2db-77b139368ff4-openshift-service-ca\") pod \"maas-api-e2e-api-a-d0b78d-77c5bff48-4m949\" (UID: \"138994ed-5e12-47d5-b2db-77b139368ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949"
Jul 30 20:21:45.196772 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.196752    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/138994ed-5e12-47d5-b2db-77b139368ff4-maas-api-tls\") pod \"maas-api-e2e-api-a-d0b78d-77c5bff48-4m949\" (UID: \"138994ed-5e12-47d5-b2db-77b139368ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949"
Jul 30 20:21:45.207462 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.207439    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nsr8\" (UniqueName: \"kubernetes.io/projected/138994ed-5e12-47d5-b2db-77b139368ff4-kube-api-access-5nsr8\") pod \"maas-api-e2e-api-a-d0b78d-77c5bff48-4m949\" (UID: \"138994ed-5e12-47d5-b2db-77b139368ff4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949"
Jul 30 20:21:45.309457 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.309430    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949"
Jul 30 20:21:45.449241 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.449111    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949"]
Jul 30 20:21:45.451354 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:21:45.451258    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod138994ed_5e12_47d5_b2db_77b139368ff4.slice/crio-93e182a8749997880e35e6feb4fd8583518d039bb449b037bcbef1700a666878 WatchSource:0}: Error finding container 93e182a8749997880e35e6feb4fd8583518d039bb449b037bcbef1700a666878: Status 404 returned error can't find the container with id 93e182a8749997880e35e6feb4fd8583518d039bb449b037bcbef1700a666878
Jul 30 20:21:45.453359 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.453340    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:21:45.728625 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.728592    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v"]
Jul 30 20:21:45.732906 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.732886    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v"
Jul 30 20:21:45.735322 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.735296    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-d0b78d-dockercfg-8bk7d\""
Jul 30 20:21:45.735826 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.735807    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-d0b78d\""
Jul 30 20:21:45.743088 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.741061    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v"]
Jul 30 20:21:45.761686 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.761650    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b"]
Jul 30 20:21:45.766506 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.766487    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b"
Jul 30 20:21:45.770885 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.770864    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:21:45.777045 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.777020    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b"]
Jul 30 20:21:45.802300 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.801877    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1ac57b3-751d-47ce-b6f6-b336202de070-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v\" (UID: \"d1ac57b3-751d-47ce-b6f6-b336202de070\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v"
Jul 30 20:21:45.802935 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.802830    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9b6q\" (UniqueName: \"kubernetes.io/projected/d1ac57b3-751d-47ce-b6f6-b336202de070-kube-api-access-c9b6q\") pod \"payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v\" (UID: \"d1ac57b3-751d-47ce-b6f6-b336202de070\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v"
Jul 30 20:21:45.903756 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.903704    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-workload-socket\") pod \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") "
Jul 30 20:21:45.903853 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.903776    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-token\") pod \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") "
Jul 30 20:21:45.903853 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.903817    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qn948\" (UniqueName: \"kubernetes.io/projected/7d96d383-eaf1-4312-b514-51ca3cf9a20c-kube-api-access-qn948\") pod \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") "
Jul 30 20:21:45.903853 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.903838    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istiod-ca-cert\") pod \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") "
Jul 30 20:21:45.903853 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.903854    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-data\") pod \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") "
Jul 30 20:21:45.904073 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.903946    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-podinfo\") pod \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") "
Jul 30 20:21:45.904073 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.903958    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7d96d383-eaf1-4312-b514-51ca3cf9a20c" (UID: "7d96d383-eaf1-4312-b514-51ca3cf9a20c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:21:45.904073 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.903992    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-credential-socket\") pod \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") "
Jul 30 20:21:45.904228 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.904083    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-envoy\") pod \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") "
Jul 30 20:21:45.904228 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.904108    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-workload-certs\") pod \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\" (UID: \"7d96d383-eaf1-4312-b514-51ca3cf9a20c\") "
Jul 30 20:21:45.904346 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.904234    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7d96d383-eaf1-4312-b514-51ca3cf9a20c" (UID: "7d96d383-eaf1-4312-b514-51ca3cf9a20c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:21:45.904346 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.904276    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7d96d383-eaf1-4312-b514-51ca3cf9a20c" (UID: "7d96d383-eaf1-4312-b514-51ca3cf9a20c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:21:45.904461 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.904409    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9eee382c-be79-4d2f-a5f7-d77a46032b42-plugins-config-volume\") pod \"payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b\" (UID: \"9eee382c-be79-4d2f-a5f7-d77a46032b42\") " pod="openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b"
Jul 30 20:21:45.904461 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.904419    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7d96d383-eaf1-4312-b514-51ca3cf9a20c" (UID: "7d96d383-eaf1-4312-b514-51ca3cf9a20c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:21:45.904461 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.904446    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9b6q\" (UniqueName: \"kubernetes.io/projected/d1ac57b3-751d-47ce-b6f6-b336202de070-kube-api-access-c9b6q\") pod \"payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v\" (UID: \"d1ac57b3-751d-47ce-b6f6-b336202de070\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v"
Jul 30 20:21:45.904648 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.904492    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v76p7\" (UniqueName: \"kubernetes.io/projected/9eee382c-be79-4d2f-a5f7-d77a46032b42-kube-api-access-v76p7\") pod \"payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b\" (UID: \"9eee382c-be79-4d2f-a5f7-d77a46032b42\") " pod="openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b"
Jul 30 20:21:45.904648 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.904609    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1ac57b3-751d-47ce-b6f6-b336202de070-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v\" (UID: \"d1ac57b3-751d-47ce-b6f6-b336202de070\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v"
Jul 30 20:21:45.904770 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.904709    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-workload-certs\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:45.904770 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.904724    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-workload-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:45.904770 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.904739    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istiod-ca-cert\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:45.904770 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.904754    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-credential-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:45.904963 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.904845    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-data" (OuterVolumeSpecName: "istio-data") pod "7d96d383-eaf1-4312-b514-51ca3cf9a20c" (UID: "7d96d383-eaf1-4312-b514-51ca3cf9a20c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:21:45.905540 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.905518    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1ac57b3-751d-47ce-b6f6-b336202de070-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v\" (UID: \"d1ac57b3-751d-47ce-b6f6-b336202de070\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v"
Jul 30 20:21:45.906543 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.906505    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7d96d383-eaf1-4312-b514-51ca3cf9a20c" (UID: "7d96d383-eaf1-4312-b514-51ca3cf9a20c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 20:21:45.906975 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.906953    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d96d383-eaf1-4312-b514-51ca3cf9a20c-kube-api-access-qn948" (OuterVolumeSpecName: "kube-api-access-qn948") pod "7d96d383-eaf1-4312-b514-51ca3cf9a20c" (UID: "7d96d383-eaf1-4312-b514-51ca3cf9a20c"). InnerVolumeSpecName "kube-api-access-qn948". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:21:45.907218 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.907177    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7d96d383-eaf1-4312-b514-51ca3cf9a20c" (UID: "7d96d383-eaf1-4312-b514-51ca3cf9a20c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:21:45.907500 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.907482    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-token" (OuterVolumeSpecName: "istio-token") pod "7d96d383-eaf1-4312-b514-51ca3cf9a20c" (UID: "7d96d383-eaf1-4312-b514-51ca3cf9a20c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:21:45.913644 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:45.913621    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9b6q\" (UniqueName: \"kubernetes.io/projected/d1ac57b3-751d-47ce-b6f6-b336202de070-kube-api-access-c9b6q\") pod \"payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v\" (UID: \"d1ac57b3-751d-47ce-b6f6-b336202de070\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v"
Jul 30 20:21:46.005522 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.005490    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9eee382c-be79-4d2f-a5f7-d77a46032b42-plugins-config-volume\") pod \"payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b\" (UID: \"9eee382c-be79-4d2f-a5f7-d77a46032b42\") " pod="openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b"
Jul 30 20:21:46.006047 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.005538    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v76p7\" (UniqueName: \"kubernetes.io/projected/9eee382c-be79-4d2f-a5f7-d77a46032b42-kube-api-access-v76p7\") pod \"payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b\" (UID: \"9eee382c-be79-4d2f-a5f7-d77a46032b42\") " pod="openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b"
Jul 30 20:21:46.006047 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.005738    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-data\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:46.006047 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.005756    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-podinfo\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:46.006047 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.005768    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-envoy\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:46.006047 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.005781    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d96d383-eaf1-4312-b514-51ca3cf9a20c-istio-token\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:46.006047 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.005794    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qn948\" (UniqueName: \"kubernetes.io/projected/7d96d383-eaf1-4312-b514-51ca3cf9a20c-kube-api-access-qn948\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:21:46.006365 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.006242    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9eee382c-be79-4d2f-a5f7-d77a46032b42-plugins-config-volume\") pod \"payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b\" (UID: \"9eee382c-be79-4d2f-a5f7-d77a46032b42\") " pod="openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b"
Jul 30 20:21:46.009991 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.009955    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949" event={"ID":"138994ed-5e12-47d5-b2db-77b139368ff4","Type":"ContainerStarted","Data":"d509b2987cd9297d3d76a55077150f51e05731cda960539623257d1bec7b1192"}
Jul 30 20:21:46.010144 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.010012    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949" event={"ID":"138994ed-5e12-47d5-b2db-77b139368ff4","Type":"ContainerStarted","Data":"93e182a8749997880e35e6feb4fd8583518d039bb449b037bcbef1700a666878"}
Jul 30 20:21:46.010144 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.010033    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949"
Jul 30 20:21:46.011545 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.011520    2568 generic.go:356] "Generic (PLEG): container finished" podID="7d96d383-eaf1-4312-b514-51ca3cf9a20c" containerID="15ce7326ea402b2020c55afcf360f790fa91704dacd2e6d3a3f02a0c0106abcb" exitCode=0
Jul 30 20:21:46.011676 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.011547    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9" event={"ID":"7d96d383-eaf1-4312-b514-51ca3cf9a20c","Type":"ContainerDied","Data":"15ce7326ea402b2020c55afcf360f790fa91704dacd2e6d3a3f02a0c0106abcb"}
Jul 30 20:21:46.011676 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.011581    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"
Jul 30 20:21:46.011676 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.011614    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9" event={"ID":"7d96d383-eaf1-4312-b514-51ca3cf9a20c","Type":"ContainerDied","Data":"f8a28560e0cbe6936a7f1662cf5e235cad9a424cc94b3e05fd3da922cb72007d"}
Jul 30 20:21:46.011676 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.011642    2568 scope.go:117] "RemoveContainer" containerID="15ce7326ea402b2020c55afcf360f790fa91704dacd2e6d3a3f02a0c0106abcb"
Jul 30 20:21:46.014070 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.014043    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v76p7\" (UniqueName: \"kubernetes.io/projected/9eee382c-be79-4d2f-a5f7-d77a46032b42-kube-api-access-v76p7\") pod \"payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b\" (UID: \"9eee382c-be79-4d2f-a5f7-d77a46032b42\") " pod="openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b"
Jul 30 20:21:46.020864 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.020847    2568 scope.go:117] "RemoveContainer" containerID="541c6262cd1e54ad112fa98ce5457563c0b809f32ff588ff2fe21ab427aa9bc2"
Jul 30 20:21:46.025849 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.025810    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949" podStartSLOduration=1.605332351 podStartE2EDuration="2.025797887s" totalImagesPullingTime="420.465536ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:21:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:21:46.025181059 +0000 UTC m=+2527.125262246" watchObservedRunningTime="2026-07-30 20:21:46.025797887 +0000 UTC m=+2527.125879075"
Jul 30 20:21:46.029793 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.029774    2568 scope.go:117] "RemoveContainer" containerID="15ce7326ea402b2020c55afcf360f790fa91704dacd2e6d3a3f02a0c0106abcb"
Jul 30 20:21:46.030068 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:21:46.030051    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15ce7326ea402b2020c55afcf360f790fa91704dacd2e6d3a3f02a0c0106abcb\": container with ID starting with 15ce7326ea402b2020c55afcf360f790fa91704dacd2e6d3a3f02a0c0106abcb not found: ID does not exist" containerID="15ce7326ea402b2020c55afcf360f790fa91704dacd2e6d3a3f02a0c0106abcb"
Jul 30 20:21:46.030104 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.030079    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15ce7326ea402b2020c55afcf360f790fa91704dacd2e6d3a3f02a0c0106abcb"} err="failed to get container status \"15ce7326ea402b2020c55afcf360f790fa91704dacd2e6d3a3f02a0c0106abcb\": rpc error: code = NotFound desc = could not find container \"15ce7326ea402b2020c55afcf360f790fa91704dacd2e6d3a3f02a0c0106abcb\": container with ID starting with 15ce7326ea402b2020c55afcf360f790fa91704dacd2e6d3a3f02a0c0106abcb not found: ID does not exist"
Jul 30 20:21:46.030104 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.030096    2568 scope.go:117] "RemoveContainer" containerID="541c6262cd1e54ad112fa98ce5457563c0b809f32ff588ff2fe21ab427aa9bc2"
Jul 30 20:21:46.030352 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:21:46.030336    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"541c6262cd1e54ad112fa98ce5457563c0b809f32ff588ff2fe21ab427aa9bc2\": container with ID starting with 541c6262cd1e54ad112fa98ce5457563c0b809f32ff588ff2fe21ab427aa9bc2 not found: ID does not exist" containerID="541c6262cd1e54ad112fa98ce5457563c0b809f32ff588ff2fe21ab427aa9bc2"
Jul 30 20:21:46.030390 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.030360    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"541c6262cd1e54ad112fa98ce5457563c0b809f32ff588ff2fe21ab427aa9bc2"} err="failed to get container status \"541c6262cd1e54ad112fa98ce5457563c0b809f32ff588ff2fe21ab427aa9bc2\": rpc error: code = NotFound desc = could not find container \"541c6262cd1e54ad112fa98ce5457563c0b809f32ff588ff2fe21ab427aa9bc2\": container with ID starting with 541c6262cd1e54ad112fa98ce5457563c0b809f32ff588ff2fe21ab427aa9bc2 not found: ID does not exist"
Jul 30 20:21:46.039030 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.039008    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"]
Jul 30 20:21:46.047341 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.047316    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-7edd0a-openshift-default-69d76dcd46-hvqm9"]
Jul 30 20:21:46.047471 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.047391    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v"
Jul 30 20:21:46.079079 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.079048    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b"
Jul 30 20:21:46.228654 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.228620    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v"]
Jul 30 20:21:46.229439 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:21:46.229391    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ac57b3_751d_47ce_b6f6_b336202de070.slice/crio-5d37f07165e62ca95f3436a5000ec751e3d503b47c26cbc63d52019d15ea7edd WatchSource:0}: Error finding container 5d37f07165e62ca95f3436a5000ec751e3d503b47c26cbc63d52019d15ea7edd: Status 404 returned error can't find the container with id 5d37f07165e62ca95f3436a5000ec751e3d503b47c26cbc63d52019d15ea7edd
Jul 30 20:21:46.262789 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:46.262762    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b"]
Jul 30 20:21:46.263831 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:21:46.263799    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eee382c_be79_4d2f_a5f7_d77a46032b42.slice/crio-7eba3f312d38dbcdbf336a89afca26a8c4558026918e2167e3ca4f765b7dae24 WatchSource:0}: Error finding container 7eba3f312d38dbcdbf336a89afca26a8c4558026918e2167e3ca4f765b7dae24: Status 404 returned error can't find the container with id 7eba3f312d38dbcdbf336a89afca26a8c4558026918e2167e3ca4f765b7dae24
Jul 30 20:21:47.021445 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:47.021407    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v" event={"ID":"d1ac57b3-751d-47ce-b6f6-b336202de070","Type":"ContainerStarted","Data":"b4245cff9f38835e1692b2b2f6efb6ada2e9d6ddd4e2917d6b44ec3efca4b463"}
Jul 30 20:21:47.021938 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:47.021478    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v" event={"ID":"d1ac57b3-751d-47ce-b6f6-b336202de070","Type":"ContainerStarted","Data":"5d37f07165e62ca95f3436a5000ec751e3d503b47c26cbc63d52019d15ea7edd"}
Jul 30 20:21:47.021938 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:47.021510    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v"
Jul 30 20:21:47.023235 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:47.023207    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b" event={"ID":"9eee382c-be79-4d2f-a5f7-d77a46032b42","Type":"ContainerStarted","Data":"2e56fc395e076ec961600bbc0038dcda384319e5ca5e2fb5106cc1dbf24d53aa"}
Jul 30 20:21:47.023388 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:47.023258    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b" event={"ID":"9eee382c-be79-4d2f-a5f7-d77a46032b42","Type":"ContainerStarted","Data":"7eba3f312d38dbcdbf336a89afca26a8c4558026918e2167e3ca4f765b7dae24"}
Jul 30 20:21:47.023388 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:47.023287    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b"
Jul 30 20:21:47.039153 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:47.039108    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v" podStartSLOduration=2.039094183 podStartE2EDuration="2.039094183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:21:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:21:47.036583428 +0000 UTC m=+2528.136664610" watchObservedRunningTime="2026-07-30 20:21:47.039094183 +0000 UTC m=+2528.139175370"
Jul 30 20:21:47.055426 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:47.055370    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b" podStartSLOduration=2.055349294 podStartE2EDuration="2.055349294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:21:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:21:47.052558237 +0000 UTC m=+2528.152639420" watchObservedRunningTime="2026-07-30 20:21:47.055349294 +0000 UTC m=+2528.155430482"
Jul 30 20:21:47.484120 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:47.484082    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d96d383-eaf1-4312-b514-51ca3cf9a20c" path="/var/lib/kubelet/pods/7d96d383-eaf1-4312-b514-51ca3cf9a20c/volumes"
Jul 30 20:21:52.030162 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:52.030128    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949"
Jul 30 20:21:57.990922 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:57.990882    2568 patch_prober.go:28] interesting pod/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Jul 30 20:21:57.991331 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:57.990967    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v" podUID="f675c683-d9d8-43ab-af67-15805cdde81a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Jul 30 20:21:58.032210 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:58.032179    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v"
Jul 30 20:21:58.032366 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:58.032338    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b"
Jul 30 20:21:58.100508 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:58.100477    2568 generic.go:356] "Generic (PLEG): container finished" podID="f675c683-d9d8-43ab-af67-15805cdde81a" containerID="0b115547171139fd455676e72e44a8990075e9ce2d77b0e67f0220d4a289e441" exitCode=0
Jul 30 20:21:58.100687 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:58.100546    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v" event={"ID":"f675c683-d9d8-43ab-af67-15805cdde81a","Type":"ContainerDied","Data":"0b115547171139fd455676e72e44a8990075e9ce2d77b0e67f0220d4a289e441"}
Jul 30 20:21:58.100993 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:58.100977    2568 scope.go:117] "RemoveContainer" containerID="0b115547171139fd455676e72e44a8990075e9ce2d77b0e67f0220d4a289e441"
Jul 30 20:21:58.102140 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:58.102109    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:21:58.102204 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:58.102194    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:21:58.102254 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:58.102239    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:21:59.107549 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:59.107512    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v" event={"ID":"f675c683-d9d8-43ab-af67-15805cdde81a","Type":"ContainerStarted","Data":"73824ff556fdd7a33eb5c29f61a044acbbc3dd315b433f2d19d0973c88b0a327"}
Jul 30 20:21:59.697619 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:59.697583    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:21:59.697838 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:59.697814    2568 patch_prober.go:28] interesting pod/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Jul 30 20:21:59.697888 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:21:59.697865    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v" podUID="f675c683-d9d8-43ab-af67-15805cdde81a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Jul 30 20:22:00.697351 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:00.697312    2568 patch_prober.go:28] interesting pod/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Jul 30 20:22:00.697791 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:00.697370    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v" podUID="f675c683-d9d8-43ab-af67-15805cdde81a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Jul 30 20:22:01.698053 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:01.698015    2568 patch_prober.go:28] interesting pod/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Jul 30 20:22:01.698433 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:01.698072    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v" podUID="f675c683-d9d8-43ab-af67-15805cdde81a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Jul 30 20:22:02.697419 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:02.697381    2568 patch_prober.go:28] interesting pod/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Jul 30 20:22:02.697637 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:02.697446    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v" podUID="f675c683-d9d8-43ab-af67-15805cdde81a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Jul 30 20:22:03.701012 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:03.700978    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:22:03.701495 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:03.701376    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:22:03.702145 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:03.702124    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:22:09.634338 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.634308    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"]
Jul 30 20:22:09.635069 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.635045    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d96d383-eaf1-4312-b514-51ca3cf9a20c" containerName="istio-proxy"
Jul 30 20:22:09.635069 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.635071    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d96d383-eaf1-4312-b514-51ca3cf9a20c" containerName="istio-proxy"
Jul 30 20:22:09.635267 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.635165    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d96d383-eaf1-4312-b514-51ca3cf9a20c" containerName="istio-proxy"
Jul 30 20:22:09.638794 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.638773    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.641319 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.641259    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-671642-openshift-default-dockercfg-l64lt\""
Jul 30 20:22:09.649332 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.649150    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"]
Jul 30 20:22:09.759866 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.759831    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88d347ae-4843-4593-b892-bde7c41498a8-istiod-ca-cert\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.760065 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.759936    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-credential-socket\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.760065 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.759979    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-istio-envoy\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.760065 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.759997    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-workload-certs\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.760065 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.760018    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88d347ae-4843-4593-b892-bde7c41498a8-istio-token\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.760065 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.760057    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zz7v\" (UniqueName: \"kubernetes.io/projected/88d347ae-4843-4593-b892-bde7c41498a8-kube-api-access-7zz7v\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.760335 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.760129    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88d347ae-4843-4593-b892-bde7c41498a8-istio-podinfo\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.760335 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.760149    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-workload-socket\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.760335 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.760209    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-istio-data\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.861834 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.861800    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88d347ae-4843-4593-b892-bde7c41498a8-istio-podinfo\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.861834 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.861833    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-workload-socket\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.862034 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.861856    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-istio-data\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.862034 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.861906    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88d347ae-4843-4593-b892-bde7c41498a8-istiod-ca-cert\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.862034 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.861963    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-credential-socket\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.862034 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.862007    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-istio-envoy\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.862034 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.862034    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-workload-certs\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.862350 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.862066    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88d347ae-4843-4593-b892-bde7c41498a8-istio-token\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.862350 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.862163    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zz7v\" (UniqueName: \"kubernetes.io/projected/88d347ae-4843-4593-b892-bde7c41498a8-kube-api-access-7zz7v\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.862350 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.862270    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-workload-socket\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.862496 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.862449    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-workload-certs\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.862496 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.862454    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-credential-socket\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.862655 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.862634    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-istio-data\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.862770 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.862751    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88d347ae-4843-4593-b892-bde7c41498a8-istiod-ca-cert\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.864400 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.864364    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-istio-envoy\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.864531 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.864471    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88d347ae-4843-4593-b892-bde7c41498a8-istio-podinfo\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.869731 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.869709    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zz7v\" (UniqueName: \"kubernetes.io/projected/88d347ae-4843-4593-b892-bde7c41498a8-kube-api-access-7zz7v\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.869884 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.869865    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88d347ae-4843-4593-b892-bde7c41498a8-istio-token\") pod \"e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") " pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:09.954910 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:09.954826    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:10.094139 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:10.094115    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"]
Jul 30 20:22:10.096009 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:22:10.095977    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88d347ae_4843_4593_b892_bde7c41498a8.slice/crio-a79d60d1a91eb3ab3998f491e0864cf438308c630a5c6ff521404705f9a52a28 WatchSource:0}: Error finding container a79d60d1a91eb3ab3998f491e0864cf438308c630a5c6ff521404705f9a52a28: Status 404 returned error can't find the container with id a79d60d1a91eb3ab3998f491e0864cf438308c630a5c6ff521404705f9a52a28
Jul 30 20:22:10.098307 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:10.098277    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:22:10.098395 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:10.098338    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:22:10.098395 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:10.098367    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:22:10.172953 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:10.172924    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv" event={"ID":"88d347ae-4843-4593-b892-bde7c41498a8","Type":"ContainerStarted","Data":"3e895e29829bbaa584ef470f763a5f2acc70ce4a617df116b486d9103a5777f5"}
Jul 30 20:22:10.173053 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:10.172973    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv" event={"ID":"88d347ae-4843-4593-b892-bde7c41498a8","Type":"ContainerStarted","Data":"a79d60d1a91eb3ab3998f491e0864cf438308c630a5c6ff521404705f9a52a28"}
Jul 30 20:22:10.214092 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:10.213962    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv" podStartSLOduration=1.213942724 podStartE2EDuration="1.213942724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:22:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:10.209956256 +0000 UTC m=+2551.310037443" watchObservedRunningTime="2026-07-30 20:22:10.213942724 +0000 UTC m=+2551.314023919"
Jul 30 20:22:10.955453 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:10.955423    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:11.960083 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:11.960054    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:12.183481 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:12.183446    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:12.184361 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:12.184339    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:14.026882 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:14.026852    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc"]
Jul 30 20:22:14.027442 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:14.027424    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d96d383-eaf1-4312-b514-51ca3cf9a20c" containerName="istio-proxy"
Jul 30 20:22:14.027442 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:14.027443    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d96d383-eaf1-4312-b514-51ca3cf9a20c" containerName="istio-proxy"
Jul 30 20:22:14.027538 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:14.027530    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d96d383-eaf1-4312-b514-51ca3cf9a20c" containerName="istio-proxy"
Jul 30 20:22:14.030975 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:14.030960    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc"
Jul 30 20:22:14.033772 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:14.033751    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-671642-dockercfg-snmx7\""
Jul 30 20:22:14.033889 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:14.033818    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-671642\""
Jul 30 20:22:14.043365 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:14.043339    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc"]
Jul 30 20:22:14.101273 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:14.101233    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm6g7\" (UniqueName: \"kubernetes.io/projected/6c4872e6-5a96-4d8e-9035-fa014bd7c4a7-kube-api-access-sm6g7\") pod \"payload-processing-e2e-api-b-671642-b7d785674-cqmfc\" (UID: \"6c4872e6-5a96-4d8e-9035-fa014bd7c4a7\") " pod="openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc"
Jul 30 20:22:14.101453 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:14.101326    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c4872e6-5a96-4d8e-9035-fa014bd7c4a7-plugins-config-volume\") pod \"payload-processing-e2e-api-b-671642-b7d785674-cqmfc\" (UID: \"6c4872e6-5a96-4d8e-9035-fa014bd7c4a7\") " pod="openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc"
Jul 30 20:22:14.202476 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:14.202445    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm6g7\" (UniqueName: \"kubernetes.io/projected/6c4872e6-5a96-4d8e-9035-fa014bd7c4a7-kube-api-access-sm6g7\") pod \"payload-processing-e2e-api-b-671642-b7d785674-cqmfc\" (UID: \"6c4872e6-5a96-4d8e-9035-fa014bd7c4a7\") " pod="openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc"
Jul 30 20:22:14.202687 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:14.202490    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c4872e6-5a96-4d8e-9035-fa014bd7c4a7-plugins-config-volume\") pod \"payload-processing-e2e-api-b-671642-b7d785674-cqmfc\" (UID: \"6c4872e6-5a96-4d8e-9035-fa014bd7c4a7\") " pod="openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc"
Jul 30 20:22:14.203154 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:14.203137    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c4872e6-5a96-4d8e-9035-fa014bd7c4a7-plugins-config-volume\") pod \"payload-processing-e2e-api-b-671642-b7d785674-cqmfc\" (UID: \"6c4872e6-5a96-4d8e-9035-fa014bd7c4a7\") " pod="openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc"
Jul 30 20:22:14.214859 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:14.214834    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm6g7\" (UniqueName: \"kubernetes.io/projected/6c4872e6-5a96-4d8e-9035-fa014bd7c4a7-kube-api-access-sm6g7\") pod \"payload-processing-e2e-api-b-671642-b7d785674-cqmfc\" (UID: \"6c4872e6-5a96-4d8e-9035-fa014bd7c4a7\") " pod="openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc"
Jul 30 20:22:14.344043 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:14.344012    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc"
Jul 30 20:22:14.484132 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:14.484110    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc"]
Jul 30 20:22:14.486707 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:22:14.486680    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c4872e6_5a96_4d8e_9035_fa014bd7c4a7.slice/crio-b98a429dc1db26aab9a5278722fb225319842fb034bf18d0675851203b38efa4 WatchSource:0}: Error finding container b98a429dc1db26aab9a5278722fb225319842fb034bf18d0675851203b38efa4: Status 404 returned error can't find the container with id b98a429dc1db26aab9a5278722fb225319842fb034bf18d0675851203b38efa4
Jul 30 20:22:15.202846 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:15.202809    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc" event={"ID":"6c4872e6-5a96-4d8e-9035-fa014bd7c4a7","Type":"ContainerStarted","Data":"72aa1e6ee8e4366ac6f34bd0e30f65e5883f02cb843e01b02ab200ddc40ec2ab"}
Jul 30 20:22:15.203232 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:15.202876    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc"
Jul 30 20:22:15.203232 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:15.202895    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc" event={"ID":"6c4872e6-5a96-4d8e-9035-fa014bd7c4a7","Type":"ContainerStarted","Data":"b98a429dc1db26aab9a5278722fb225319842fb034bf18d0675851203b38efa4"}
Jul 30 20:22:15.221988 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:15.221942    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc" podStartSLOduration=1.221927018 podStartE2EDuration="1.221927018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:22:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:15.219617023 +0000 UTC m=+2556.319698211" watchObservedRunningTime="2026-07-30 20:22:15.221927018 +0000 UTC m=+2556.322008204"
Jul 30 20:22:26.210039 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:26.210009    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc"
Jul 30 20:22:28.224721 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:28.224678    2568 patch_prober.go:28] interesting pod/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 30 20:22:28.225205 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:28.224732    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv" podUID="88d347ae-4843-4593-b892-bde7c41498a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 30 20:22:29.292892 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:29.292864    2568 generic.go:356] "Generic (PLEG): container finished" podID="88d347ae-4843-4593-b892-bde7c41498a8" containerID="3e895e29829bbaa584ef470f763a5f2acc70ce4a617df116b486d9103a5777f5" exitCode=0
Jul 30 20:22:29.293289 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:29.292948    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv" event={"ID":"88d347ae-4843-4593-b892-bde7c41498a8","Type":"ContainerDied","Data":"3e895e29829bbaa584ef470f763a5f2acc70ce4a617df116b486d9103a5777f5"}
Jul 30 20:22:29.293482 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:29.293466    2568 scope.go:117] "RemoveContainer" containerID="3e895e29829bbaa584ef470f763a5f2acc70ce4a617df116b486d9103a5777f5"
Jul 30 20:22:29.294639 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:29.294614    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:22:29.294697 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:29.294678    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:22:29.294733 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:29.294709    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:22:30.299897 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:30.299863    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv" event={"ID":"88d347ae-4843-4593-b892-bde7c41498a8","Type":"ContainerStarted","Data":"76a20fd83b070d73bbfe48b0b6e8fd275fd5fe9f2f763f5c83c4c0bd1fb62b2f"}
Jul 30 20:22:30.955966 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:30.955924    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:30.956355 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:30.956324    2568 patch_prober.go:28] interesting pod/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Jul 30 20:22:30.956479 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:30.956383    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv" podUID="88d347ae-4843-4593-b892-bde7c41498a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Jul 30 20:22:31.955587 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:31.955534    2568 patch_prober.go:28] interesting pod/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Jul 30 20:22:31.956130 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:31.956097    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv" podUID="88d347ae-4843-4593-b892-bde7c41498a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Jul 30 20:22:32.955887 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:32.955435    2568 patch_prober.go:28] interesting pod/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Jul 30 20:22:32.955887 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:32.955496    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv" podUID="88d347ae-4843-4593-b892-bde7c41498a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Jul 30 20:22:33.955772 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:33.955728    2568 patch_prober.go:28] interesting pod/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Jul 30 20:22:33.955961 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:33.955793    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv" podUID="88d347ae-4843-4593-b892-bde7c41498a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Jul 30 20:22:34.959303 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:34.959272    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:34.959683 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:34.959620    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:34.960368 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:34.960349    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:22:56.350841 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.350806    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949"]
Jul 30 20:22:56.351446 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.351059    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949" podUID="138994ed-5e12-47d5-b2db-77b139368ff4" containerName="maas-api" containerID="cri-o://d509b2987cd9297d3d76a55077150f51e05731cda960539623257d1bec7b1192" gracePeriod=30
Jul 30 20:22:56.402147 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.402120    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b"]
Jul 30 20:22:56.402336 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.402313    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b" podUID="9eee382c-be79-4d2f-a5f7-d77a46032b42" containerName="payload-processing" containerID="cri-o://2e56fc395e076ec961600bbc0038dcda384319e5ca5e2fb5106cc1dbf24d53aa" gracePeriod=30
Jul 30 20:22:56.409314 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.409289    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v"]
Jul 30 20:22:56.409581 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.409523    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v" podUID="d1ac57b3-751d-47ce-b6f6-b336202de070" containerName="payload-pre-processing" containerID="cri-o://b4245cff9f38835e1692b2b2f6efb6ada2e9d6ddd4e2917d6b44ec3efca4b463" gracePeriod=30
Jul 30 20:22:56.680701 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.680675    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b"
Jul 30 20:22:56.736949 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.736917    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9eee382c-be79-4d2f-a5f7-d77a46032b42-plugins-config-volume\") pod \"9eee382c-be79-4d2f-a5f7-d77a46032b42\" (UID: \"9eee382c-be79-4d2f-a5f7-d77a46032b42\") "
Jul 30 20:22:56.737140 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.737028    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v76p7\" (UniqueName: \"kubernetes.io/projected/9eee382c-be79-4d2f-a5f7-d77a46032b42-kube-api-access-v76p7\") pod \"9eee382c-be79-4d2f-a5f7-d77a46032b42\" (UID: \"9eee382c-be79-4d2f-a5f7-d77a46032b42\") "
Jul 30 20:22:56.737368 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.737269    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9eee382c-be79-4d2f-a5f7-d77a46032b42-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9eee382c-be79-4d2f-a5f7-d77a46032b42" (UID: "9eee382c-be79-4d2f-a5f7-d77a46032b42"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:22:56.737505 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.737492    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9eee382c-be79-4d2f-a5f7-d77a46032b42-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:22:56.741683 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.739666    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eee382c-be79-4d2f-a5f7-d77a46032b42-kube-api-access-v76p7" (OuterVolumeSpecName: "kube-api-access-v76p7") pod "9eee382c-be79-4d2f-a5f7-d77a46032b42" (UID: "9eee382c-be79-4d2f-a5f7-d77a46032b42"). InnerVolumeSpecName "kube-api-access-v76p7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:22:56.758683 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.758658    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v"
Jul 30 20:22:56.762368 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.762343    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949"
Jul 30 20:22:56.837969 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.837937    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/138994ed-5e12-47d5-b2db-77b139368ff4-maas-api-tls\") pod \"138994ed-5e12-47d5-b2db-77b139368ff4\" (UID: \"138994ed-5e12-47d5-b2db-77b139368ff4\") "
Jul 30 20:22:56.838104 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.838001    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/138994ed-5e12-47d5-b2db-77b139368ff4-openshift-service-ca\") pod \"138994ed-5e12-47d5-b2db-77b139368ff4\" (UID: \"138994ed-5e12-47d5-b2db-77b139368ff4\") "
Jul 30 20:22:56.838104 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.838062    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9b6q\" (UniqueName: \"kubernetes.io/projected/d1ac57b3-751d-47ce-b6f6-b336202de070-kube-api-access-c9b6q\") pod \"d1ac57b3-751d-47ce-b6f6-b336202de070\" (UID: \"d1ac57b3-751d-47ce-b6f6-b336202de070\") "
Jul 30 20:22:56.838189 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.838164    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nsr8\" (UniqueName: \"kubernetes.io/projected/138994ed-5e12-47d5-b2db-77b139368ff4-kube-api-access-5nsr8\") pod \"138994ed-5e12-47d5-b2db-77b139368ff4\" (UID: \"138994ed-5e12-47d5-b2db-77b139368ff4\") "
Jul 30 20:22:56.838273 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.838258    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1ac57b3-751d-47ce-b6f6-b336202de070-plugins-config-volume\") pod \"d1ac57b3-751d-47ce-b6f6-b336202de070\" (UID: \"d1ac57b3-751d-47ce-b6f6-b336202de070\") "
Jul 30 20:22:56.838349 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.838332    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/138994ed-5e12-47d5-b2db-77b139368ff4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "138994ed-5e12-47d5-b2db-77b139368ff4" (UID: "138994ed-5e12-47d5-b2db-77b139368ff4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:22:56.838663 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.838631    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v76p7\" (UniqueName: \"kubernetes.io/projected/9eee382c-be79-4d2f-a5f7-d77a46032b42-kube-api-access-v76p7\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:22:56.838663 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.838656    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/138994ed-5e12-47d5-b2db-77b139368ff4-openshift-service-ca\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:22:56.838813 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.838728    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1ac57b3-751d-47ce-b6f6-b336202de070-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d1ac57b3-751d-47ce-b6f6-b336202de070" (UID: "d1ac57b3-751d-47ce-b6f6-b336202de070"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:22:56.840272 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.840243    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1ac57b3-751d-47ce-b6f6-b336202de070-kube-api-access-c9b6q" (OuterVolumeSpecName: "kube-api-access-c9b6q") pod "d1ac57b3-751d-47ce-b6f6-b336202de070" (UID: "d1ac57b3-751d-47ce-b6f6-b336202de070"). InnerVolumeSpecName "kube-api-access-c9b6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:22:56.840395 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.840303    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/138994ed-5e12-47d5-b2db-77b139368ff4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "138994ed-5e12-47d5-b2db-77b139368ff4" (UID: "138994ed-5e12-47d5-b2db-77b139368ff4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:22:56.840469 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.840432    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/138994ed-5e12-47d5-b2db-77b139368ff4-kube-api-access-5nsr8" (OuterVolumeSpecName: "kube-api-access-5nsr8") pod "138994ed-5e12-47d5-b2db-77b139368ff4" (UID: "138994ed-5e12-47d5-b2db-77b139368ff4"). InnerVolumeSpecName "kube-api-access-5nsr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:22:56.940366 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.940299    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9b6q\" (UniqueName: \"kubernetes.io/projected/d1ac57b3-751d-47ce-b6f6-b336202de070-kube-api-access-c9b6q\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:22:56.940366 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.940328    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nsr8\" (UniqueName: \"kubernetes.io/projected/138994ed-5e12-47d5-b2db-77b139368ff4-kube-api-access-5nsr8\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:22:56.940366 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.940344    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1ac57b3-751d-47ce-b6f6-b336202de070-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:22:56.940366 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:56.940358    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/138994ed-5e12-47d5-b2db-77b139368ff4-maas-api-tls\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:22:57.460692 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.460659    2568 generic.go:356] "Generic (PLEG): container finished" podID="d1ac57b3-751d-47ce-b6f6-b336202de070" containerID="b4245cff9f38835e1692b2b2f6efb6ada2e9d6ddd4e2917d6b44ec3efca4b463" exitCode=0
Jul 30 20:22:57.461090 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.460713    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v"
Jul 30 20:22:57.461090 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.460735    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v" event={"ID":"d1ac57b3-751d-47ce-b6f6-b336202de070","Type":"ContainerDied","Data":"b4245cff9f38835e1692b2b2f6efb6ada2e9d6ddd4e2917d6b44ec3efca4b463"}
Jul 30 20:22:57.461090 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.460815    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v" event={"ID":"d1ac57b3-751d-47ce-b6f6-b336202de070","Type":"ContainerDied","Data":"5d37f07165e62ca95f3436a5000ec751e3d503b47c26cbc63d52019d15ea7edd"}
Jul 30 20:22:57.461090 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.460841    2568 scope.go:117] "RemoveContainer" containerID="b4245cff9f38835e1692b2b2f6efb6ada2e9d6ddd4e2917d6b44ec3efca4b463"
Jul 30 20:22:57.462128 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.462071    2568 generic.go:356] "Generic (PLEG): container finished" podID="9eee382c-be79-4d2f-a5f7-d77a46032b42" containerID="2e56fc395e076ec961600bbc0038dcda384319e5ca5e2fb5106cc1dbf24d53aa" exitCode=0
Jul 30 20:22:57.462213 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.462143    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b"
Jul 30 20:22:57.462213 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.462167    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b" event={"ID":"9eee382c-be79-4d2f-a5f7-d77a46032b42","Type":"ContainerDied","Data":"2e56fc395e076ec961600bbc0038dcda384319e5ca5e2fb5106cc1dbf24d53aa"}
Jul 30 20:22:57.462328 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.462221    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b" event={"ID":"9eee382c-be79-4d2f-a5f7-d77a46032b42","Type":"ContainerDied","Data":"7eba3f312d38dbcdbf336a89afca26a8c4558026918e2167e3ca4f765b7dae24"}
Jul 30 20:22:57.463582 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.463533    2568 generic.go:356] "Generic (PLEG): container finished" podID="138994ed-5e12-47d5-b2db-77b139368ff4" containerID="d509b2987cd9297d3d76a55077150f51e05731cda960539623257d1bec7b1192" exitCode=0
Jul 30 20:22:57.463732 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.463592    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949" event={"ID":"138994ed-5e12-47d5-b2db-77b139368ff4","Type":"ContainerDied","Data":"d509b2987cd9297d3d76a55077150f51e05731cda960539623257d1bec7b1192"}
Jul 30 20:22:57.463732 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.463610    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949"
Jul 30 20:22:57.463732 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.463643    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949" event={"ID":"138994ed-5e12-47d5-b2db-77b139368ff4","Type":"ContainerDied","Data":"93e182a8749997880e35e6feb4fd8583518d039bb449b037bcbef1700a666878"}
Jul 30 20:22:57.472556 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.472535    2568 scope.go:117] "RemoveContainer" containerID="b4245cff9f38835e1692b2b2f6efb6ada2e9d6ddd4e2917d6b44ec3efca4b463"
Jul 30 20:22:57.472925 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:22:57.472897    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4245cff9f38835e1692b2b2f6efb6ada2e9d6ddd4e2917d6b44ec3efca4b463\": container with ID starting with b4245cff9f38835e1692b2b2f6efb6ada2e9d6ddd4e2917d6b44ec3efca4b463 not found: ID does not exist" containerID="b4245cff9f38835e1692b2b2f6efb6ada2e9d6ddd4e2917d6b44ec3efca4b463"
Jul 30 20:22:57.473025 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.472936    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4245cff9f38835e1692b2b2f6efb6ada2e9d6ddd4e2917d6b44ec3efca4b463"} err="failed to get container status \"b4245cff9f38835e1692b2b2f6efb6ada2e9d6ddd4e2917d6b44ec3efca4b463\": rpc error: code = NotFound desc = could not find container \"b4245cff9f38835e1692b2b2f6efb6ada2e9d6ddd4e2917d6b44ec3efca4b463\": container with ID starting with b4245cff9f38835e1692b2b2f6efb6ada2e9d6ddd4e2917d6b44ec3efca4b463 not found: ID does not exist"
Jul 30 20:22:57.473025 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.472960    2568 scope.go:117] "RemoveContainer" containerID="2e56fc395e076ec961600bbc0038dcda384319e5ca5e2fb5106cc1dbf24d53aa"
Jul 30 20:22:57.482274 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.482260    2568 scope.go:117] "RemoveContainer" containerID="2e56fc395e076ec961600bbc0038dcda384319e5ca5e2fb5106cc1dbf24d53aa"
Jul 30 20:22:57.482502 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:22:57.482486    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e56fc395e076ec961600bbc0038dcda384319e5ca5e2fb5106cc1dbf24d53aa\": container with ID starting with 2e56fc395e076ec961600bbc0038dcda384319e5ca5e2fb5106cc1dbf24d53aa not found: ID does not exist" containerID="2e56fc395e076ec961600bbc0038dcda384319e5ca5e2fb5106cc1dbf24d53aa"
Jul 30 20:22:57.482556 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.482509    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e56fc395e076ec961600bbc0038dcda384319e5ca5e2fb5106cc1dbf24d53aa"} err="failed to get container status \"2e56fc395e076ec961600bbc0038dcda384319e5ca5e2fb5106cc1dbf24d53aa\": rpc error: code = NotFound desc = could not find container \"2e56fc395e076ec961600bbc0038dcda384319e5ca5e2fb5106cc1dbf24d53aa\": container with ID starting with 2e56fc395e076ec961600bbc0038dcda384319e5ca5e2fb5106cc1dbf24d53aa not found: ID does not exist"
Jul 30 20:22:57.482556 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.482526    2568 scope.go:117] "RemoveContainer" containerID="d509b2987cd9297d3d76a55077150f51e05731cda960539623257d1bec7b1192"
Jul 30 20:22:57.486842 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.486819    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v"]
Jul 30 20:22:57.490553 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.490533    2568 scope.go:117] "RemoveContainer" containerID="d509b2987cd9297d3d76a55077150f51e05731cda960539623257d1bec7b1192"
Jul 30 20:22:57.490845 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:22:57.490826    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d509b2987cd9297d3d76a55077150f51e05731cda960539623257d1bec7b1192\": container with ID starting with d509b2987cd9297d3d76a55077150f51e05731cda960539623257d1bec7b1192 not found: ID does not exist" containerID="d509b2987cd9297d3d76a55077150f51e05731cda960539623257d1bec7b1192"
Jul 30 20:22:57.490914 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.490849    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d509b2987cd9297d3d76a55077150f51e05731cda960539623257d1bec7b1192"} err="failed to get container status \"d509b2987cd9297d3d76a55077150f51e05731cda960539623257d1bec7b1192\": rpc error: code = NotFound desc = could not find container \"d509b2987cd9297d3d76a55077150f51e05731cda960539623257d1bec7b1192\": container with ID starting with d509b2987cd9297d3d76a55077150f51e05731cda960539623257d1bec7b1192 not found: ID does not exist"
Jul 30 20:22:57.492328 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.492306    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d0b78d-6dcbdb445b-gkh9v"]
Jul 30 20:22:57.501890 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.501869    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b"]
Jul 30 20:22:57.508775 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.508756    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d0b78d-6c9895bfcd-6pq7b"]
Jul 30 20:22:57.518494 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.518477    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949"]
Jul 30 20:22:57.521959 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:57.521941    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-d0b78d-77c5bff48-4m949"]
Jul 30 20:22:59.481501 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:59.481469    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="138994ed-5e12-47d5-b2db-77b139368ff4" path="/var/lib/kubelet/pods/138994ed-5e12-47d5-b2db-77b139368ff4/volumes"
Jul 30 20:22:59.481894 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:59.481841    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9eee382c-be79-4d2f-a5f7-d77a46032b42" path="/var/lib/kubelet/pods/9eee382c-be79-4d2f-a5f7-d77a46032b42/volumes"
Jul 30 20:22:59.482155 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:22:59.482143    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1ac57b3-751d-47ce-b6f6-b336202de070" path="/var/lib/kubelet/pods/d1ac57b3-751d-47ce-b6f6-b336202de070/volumes"
Jul 30 20:23:03.045797 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:03.045721    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"]
Jul 30 20:23:03.046208 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:03.045956    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v" podUID="f675c683-d9d8-43ab-af67-15805cdde81a" containerName="istio-proxy" containerID="cri-o://73824ff556fdd7a33eb5c29f61a044acbbc3dd315b433f2d19d0973c88b0a327" gracePeriod=30
Jul 30 20:23:03.703903 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:03.703865    2568 patch_prober.go:28] interesting pod/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 20:23:03.704065 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:03.703920    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v" podUID="f675c683-d9d8-43ab-af67-15805cdde81a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 20:23:08.306436 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.306411    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:23:08.452106 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.452013    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f675c683-d9d8-43ab-af67-15805cdde81a-istio-token\") pod \"f675c683-d9d8-43ab-af67-15805cdde81a\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") "
Jul 30 20:23:08.452106 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.452087    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f675c683-d9d8-43ab-af67-15805cdde81a-istiod-ca-cert\") pod \"f675c683-d9d8-43ab-af67-15805cdde81a\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") "
Jul 30 20:23:08.452321 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.452115    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-workload-socket\") pod \"f675c683-d9d8-43ab-af67-15805cdde81a\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") "
Jul 30 20:23:08.452321 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.452142    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-workload-certs\") pod \"f675c683-d9d8-43ab-af67-15805cdde81a\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") "
Jul 30 20:23:08.452321 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.452163    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-istio-data\") pod \"f675c683-d9d8-43ab-af67-15805cdde81a\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") "
Jul 30 20:23:08.452321 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.452193    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f675c683-d9d8-43ab-af67-15805cdde81a-istio-podinfo\") pod \"f675c683-d9d8-43ab-af67-15805cdde81a\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") "
Jul 30 20:23:08.452321 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.452224    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wth5v\" (UniqueName: \"kubernetes.io/projected/f675c683-d9d8-43ab-af67-15805cdde81a-kube-api-access-wth5v\") pod \"f675c683-d9d8-43ab-af67-15805cdde81a\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") "
Jul 30 20:23:08.452321 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.452264    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-istio-envoy\") pod \"f675c683-d9d8-43ab-af67-15805cdde81a\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") "
Jul 30 20:23:08.452321 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.452307    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-credential-socket\") pod \"f675c683-d9d8-43ab-af67-15805cdde81a\" (UID: \"f675c683-d9d8-43ab-af67-15805cdde81a\") "
Jul 30 20:23:08.452872 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.452840    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f675c683-d9d8-43ab-af67-15805cdde81a" (UID: "f675c683-d9d8-43ab-af67-15805cdde81a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:23:08.452971 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.452923    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f675c683-d9d8-43ab-af67-15805cdde81a" (UID: "f675c683-d9d8-43ab-af67-15805cdde81a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:23:08.453029 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.453002    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f675c683-d9d8-43ab-af67-15805cdde81a" (UID: "f675c683-d9d8-43ab-af67-15805cdde81a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:23:08.453585 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.453528    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-istio-data" (OuterVolumeSpecName: "istio-data") pod "f675c683-d9d8-43ab-af67-15805cdde81a" (UID: "f675c683-d9d8-43ab-af67-15805cdde81a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:23:08.453736 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.452526    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f675c683-d9d8-43ab-af67-15805cdde81a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f675c683-d9d8-43ab-af67-15805cdde81a" (UID: "f675c683-d9d8-43ab-af67-15805cdde81a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:23:08.454787 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.454764    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f675c683-d9d8-43ab-af67-15805cdde81a" (UID: "f675c683-d9d8-43ab-af67-15805cdde81a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:23:08.455023 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.454947    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f675c683-d9d8-43ab-af67-15805cdde81a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f675c683-d9d8-43ab-af67-15805cdde81a" (UID: "f675c683-d9d8-43ab-af67-15805cdde81a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 20:23:08.455023 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.454993    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f675c683-d9d8-43ab-af67-15805cdde81a-istio-token" (OuterVolumeSpecName: "istio-token") pod "f675c683-d9d8-43ab-af67-15805cdde81a" (UID: "f675c683-d9d8-43ab-af67-15805cdde81a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:23:08.455023 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.454993    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f675c683-d9d8-43ab-af67-15805cdde81a-kube-api-access-wth5v" (OuterVolumeSpecName: "kube-api-access-wth5v") pod "f675c683-d9d8-43ab-af67-15805cdde81a" (UID: "f675c683-d9d8-43ab-af67-15805cdde81a"). InnerVolumeSpecName "kube-api-access-wth5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:23:08.530276 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.530248    2568 generic.go:356] "Generic (PLEG): container finished" podID="f675c683-d9d8-43ab-af67-15805cdde81a" containerID="73824ff556fdd7a33eb5c29f61a044acbbc3dd315b433f2d19d0973c88b0a327" exitCode=0
Jul 30 20:23:08.530404 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.530300    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"
Jul 30 20:23:08.530404 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.530341    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v" event={"ID":"f675c683-d9d8-43ab-af67-15805cdde81a","Type":"ContainerDied","Data":"73824ff556fdd7a33eb5c29f61a044acbbc3dd315b433f2d19d0973c88b0a327"}
Jul 30 20:23:08.530404 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.530397    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v" event={"ID":"f675c683-d9d8-43ab-af67-15805cdde81a","Type":"ContainerDied","Data":"dbe33adf90943e6ca48f9004f01385e81fa2fd2fbc2ef0f2f898f4fa91568f87"}
Jul 30 20:23:08.530509 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.530420    2568 scope.go:117] "RemoveContainer" containerID="73824ff556fdd7a33eb5c29f61a044acbbc3dd315b433f2d19d0973c88b0a327"
Jul 30 20:23:08.539854 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.539838    2568 scope.go:117] "RemoveContainer" containerID="0b115547171139fd455676e72e44a8990075e9ce2d77b0e67f0220d4a289e441"
Jul 30 20:23:08.548354 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.548335    2568 scope.go:117] "RemoveContainer" containerID="73824ff556fdd7a33eb5c29f61a044acbbc3dd315b433f2d19d0973c88b0a327"
Jul 30 20:23:08.548653 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:23:08.548632    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73824ff556fdd7a33eb5c29f61a044acbbc3dd315b433f2d19d0973c88b0a327\": container with ID starting with 73824ff556fdd7a33eb5c29f61a044acbbc3dd315b433f2d19d0973c88b0a327 not found: ID does not exist" containerID="73824ff556fdd7a33eb5c29f61a044acbbc3dd315b433f2d19d0973c88b0a327"
Jul 30 20:23:08.548714 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.548665    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73824ff556fdd7a33eb5c29f61a044acbbc3dd315b433f2d19d0973c88b0a327"} err="failed to get container status \"73824ff556fdd7a33eb5c29f61a044acbbc3dd315b433f2d19d0973c88b0a327\": rpc error: code = NotFound desc = could not find container \"73824ff556fdd7a33eb5c29f61a044acbbc3dd315b433f2d19d0973c88b0a327\": container with ID starting with 73824ff556fdd7a33eb5c29f61a044acbbc3dd315b433f2d19d0973c88b0a327 not found: ID does not exist"
Jul 30 20:23:08.548714 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.548682    2568 scope.go:117] "RemoveContainer" containerID="0b115547171139fd455676e72e44a8990075e9ce2d77b0e67f0220d4a289e441"
Jul 30 20:23:08.548934 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:23:08.548918    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b115547171139fd455676e72e44a8990075e9ce2d77b0e67f0220d4a289e441\": container with ID starting with 0b115547171139fd455676e72e44a8990075e9ce2d77b0e67f0220d4a289e441 not found: ID does not exist" containerID="0b115547171139fd455676e72e44a8990075e9ce2d77b0e67f0220d4a289e441"
Jul 30 20:23:08.548993 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.548937    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b115547171139fd455676e72e44a8990075e9ce2d77b0e67f0220d4a289e441"} err="failed to get container status \"0b115547171139fd455676e72e44a8990075e9ce2d77b0e67f0220d4a289e441\": rpc error: code = NotFound desc = could not find container \"0b115547171139fd455676e72e44a8990075e9ce2d77b0e67f0220d4a289e441\": container with ID starting with 0b115547171139fd455676e72e44a8990075e9ce2d77b0e67f0220d4a289e441 not found: ID does not exist"
Jul 30 20:23:08.553519 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.553497    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-workload-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:23:08.553519 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.553521    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-workload-certs\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:23:08.553659 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.553551    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-istio-data\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:23:08.553659 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.553560    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f675c683-d9d8-43ab-af67-15805cdde81a-istio-podinfo\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:23:08.553659 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.553587    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wth5v\" (UniqueName: \"kubernetes.io/projected/f675c683-d9d8-43ab-af67-15805cdde81a-kube-api-access-wth5v\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:23:08.553659 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.553598    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-istio-envoy\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:23:08.553659 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.553606    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f675c683-d9d8-43ab-af67-15805cdde81a-credential-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:23:08.553659 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.553614    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f675c683-d9d8-43ab-af67-15805cdde81a-istio-token\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:23:08.553659 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.553622    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f675c683-d9d8-43ab-af67-15805cdde81a-istiod-ca-cert\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:23:08.554433 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.554415    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"]
Jul 30 20:23:08.560259 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:08.560240    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-d0b78d-openshift-default-67f8f975b6-xxt8v"]
Jul 30 20:23:09.481449 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:09.481420    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f675c683-d9d8-43ab-af67-15805cdde81a" path="/var/lib/kubelet/pods/f675c683-d9d8-43ab-af67-15805cdde81a/volumes"
Jul 30 20:23:19.061860 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:19.061826    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc"]
Jul 30 20:23:19.062270 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:19.062065    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc" podUID="6c4872e6-5a96-4d8e-9035-fa014bd7c4a7" containerName="payload-processing" containerID="cri-o://72aa1e6ee8e4366ac6f34bd0e30f65e5883f02cb843e01b02ab200ddc40ec2ab" gracePeriod=30
Jul 30 20:23:19.314681 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:19.314623    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc"
Jul 30 20:23:19.352744 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:19.352714    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sm6g7\" (UniqueName: \"kubernetes.io/projected/6c4872e6-5a96-4d8e-9035-fa014bd7c4a7-kube-api-access-sm6g7\") pod \"6c4872e6-5a96-4d8e-9035-fa014bd7c4a7\" (UID: \"6c4872e6-5a96-4d8e-9035-fa014bd7c4a7\") "
Jul 30 20:23:19.352866 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:19.352796    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c4872e6-5a96-4d8e-9035-fa014bd7c4a7-plugins-config-volume\") pod \"6c4872e6-5a96-4d8e-9035-fa014bd7c4a7\" (UID: \"6c4872e6-5a96-4d8e-9035-fa014bd7c4a7\") "
Jul 30 20:23:19.353145 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:19.353123    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c4872e6-5a96-4d8e-9035-fa014bd7c4a7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6c4872e6-5a96-4d8e-9035-fa014bd7c4a7" (UID: "6c4872e6-5a96-4d8e-9035-fa014bd7c4a7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:23:19.354981 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:19.354959    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c4872e6-5a96-4d8e-9035-fa014bd7c4a7-kube-api-access-sm6g7" (OuterVolumeSpecName: "kube-api-access-sm6g7") pod "6c4872e6-5a96-4d8e-9035-fa014bd7c4a7" (UID: "6c4872e6-5a96-4d8e-9035-fa014bd7c4a7"). InnerVolumeSpecName "kube-api-access-sm6g7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:23:19.454455 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:19.454432    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sm6g7\" (UniqueName: \"kubernetes.io/projected/6c4872e6-5a96-4d8e-9035-fa014bd7c4a7-kube-api-access-sm6g7\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:23:19.454455 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:19.454453    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c4872e6-5a96-4d8e-9035-fa014bd7c4a7-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:23:19.588207 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:19.588138    2568 generic.go:356] "Generic (PLEG): container finished" podID="6c4872e6-5a96-4d8e-9035-fa014bd7c4a7" containerID="72aa1e6ee8e4366ac6f34bd0e30f65e5883f02cb843e01b02ab200ddc40ec2ab" exitCode=0
Jul 30 20:23:19.588207 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:19.588181    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc"
Jul 30 20:23:19.588207 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:19.588185    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc" event={"ID":"6c4872e6-5a96-4d8e-9035-fa014bd7c4a7","Type":"ContainerDied","Data":"72aa1e6ee8e4366ac6f34bd0e30f65e5883f02cb843e01b02ab200ddc40ec2ab"}
Jul 30 20:23:19.588394 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:19.588238    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc" event={"ID":"6c4872e6-5a96-4d8e-9035-fa014bd7c4a7","Type":"ContainerDied","Data":"b98a429dc1db26aab9a5278722fb225319842fb034bf18d0675851203b38efa4"}
Jul 30 20:23:19.588394 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:19.588267    2568 scope.go:117] "RemoveContainer" containerID="72aa1e6ee8e4366ac6f34bd0e30f65e5883f02cb843e01b02ab200ddc40ec2ab"
Jul 30 20:23:19.597173 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:19.597157    2568 scope.go:117] "RemoveContainer" containerID="72aa1e6ee8e4366ac6f34bd0e30f65e5883f02cb843e01b02ab200ddc40ec2ab"
Jul 30 20:23:19.597424 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:23:19.597406    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72aa1e6ee8e4366ac6f34bd0e30f65e5883f02cb843e01b02ab200ddc40ec2ab\": container with ID starting with 72aa1e6ee8e4366ac6f34bd0e30f65e5883f02cb843e01b02ab200ddc40ec2ab not found: ID does not exist" containerID="72aa1e6ee8e4366ac6f34bd0e30f65e5883f02cb843e01b02ab200ddc40ec2ab"
Jul 30 20:23:19.597470 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:19.597431    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72aa1e6ee8e4366ac6f34bd0e30f65e5883f02cb843e01b02ab200ddc40ec2ab"} err="failed to get container status \"72aa1e6ee8e4366ac6f34bd0e30f65e5883f02cb843e01b02ab200ddc40ec2ab\": rpc error: code = NotFound desc = could not find container \"72aa1e6ee8e4366ac6f34bd0e30f65e5883f02cb843e01b02ab200ddc40ec2ab\": container with ID starting with 72aa1e6ee8e4366ac6f34bd0e30f65e5883f02cb843e01b02ab200ddc40ec2ab not found: ID does not exist"
Jul 30 20:23:19.605516 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:19.605496    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc"]
Jul 30 20:23:19.608849 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:19.608829    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-671642-b7d785674-cqmfc"]
Jul 30 20:23:21.481573 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:21.481531    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c4872e6-5a96-4d8e-9035-fa014bd7c4a7" path="/var/lib/kubelet/pods/6c4872e6-5a96-4d8e-9035-fa014bd7c4a7/volumes"
Jul 30 20:23:25.484315 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:25.484282    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"]
Jul 30 20:23:25.484830 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:25.484504    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv" podUID="88d347ae-4843-4593-b892-bde7c41498a8" containerName="istio-proxy" containerID="cri-o://76a20fd83b070d73bbfe48b0b6e8fd275fd5fe9f2f763f5c83c4c0bd1fb62b2f" gracePeriod=30
Jul 30 20:23:26.351249 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.351217    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"]
Jul 30 20:23:26.351818 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.351800    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1ac57b3-751d-47ce-b6f6-b336202de070" containerName="payload-pre-processing"
Jul 30 20:23:26.351818 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.351820    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1ac57b3-751d-47ce-b6f6-b336202de070" containerName="payload-pre-processing"
Jul 30 20:23:26.351991 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.351833    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f675c683-d9d8-43ab-af67-15805cdde81a" containerName="istio-proxy"
Jul 30 20:23:26.351991 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.351839    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f675c683-d9d8-43ab-af67-15805cdde81a" containerName="istio-proxy"
Jul 30 20:23:26.351991 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.351852    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="138994ed-5e12-47d5-b2db-77b139368ff4" containerName="maas-api"
Jul 30 20:23:26.351991 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.351857    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="138994ed-5e12-47d5-b2db-77b139368ff4" containerName="maas-api"
Jul 30 20:23:26.351991 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.351865    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c4872e6-5a96-4d8e-9035-fa014bd7c4a7" containerName="payload-processing"
Jul 30 20:23:26.351991 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.351870    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c4872e6-5a96-4d8e-9035-fa014bd7c4a7" containerName="payload-processing"
Jul 30 20:23:26.351991 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.351876    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9eee382c-be79-4d2f-a5f7-d77a46032b42" containerName="payload-processing"
Jul 30 20:23:26.351991 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.351882    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eee382c-be79-4d2f-a5f7-d77a46032b42" containerName="payload-processing"
Jul 30 20:23:26.351991 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.351899    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f675c683-d9d8-43ab-af67-15805cdde81a" containerName="istio-proxy"
Jul 30 20:23:26.351991 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.351907    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f675c683-d9d8-43ab-af67-15805cdde81a" containerName="istio-proxy"
Jul 30 20:23:26.352322 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.352000    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f675c683-d9d8-43ab-af67-15805cdde81a" containerName="istio-proxy"
Jul 30 20:23:26.352322 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.352009    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1ac57b3-751d-47ce-b6f6-b336202de070" containerName="payload-pre-processing"
Jul 30 20:23:26.352322 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.352016    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9eee382c-be79-4d2f-a5f7-d77a46032b42" containerName="payload-processing"
Jul 30 20:23:26.352322 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.352024    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c4872e6-5a96-4d8e-9035-fa014bd7c4a7" containerName="payload-processing"
Jul 30 20:23:26.352322 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.352032    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="138994ed-5e12-47d5-b2db-77b139368ff4" containerName="maas-api"
Jul 30 20:23:26.356452 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.356431    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.358994 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.358970    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-474e8f-openshift-default-dockercfg-zzjvx\""
Jul 30 20:23:26.368240 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.368212    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"]
Jul 30 20:23:26.411839 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.411817    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-istio-envoy\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.411949 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.411844    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58df9142-731a-4288-ad45-f4a1207ab315-istiod-ca-cert\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.411949 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.411882    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58df9142-731a-4288-ad45-f4a1207ab315-istio-token\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.411949 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.411907    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-workload-certs\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.411949 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.411929    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-credential-socket\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.412153 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.411954    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwkvx\" (UniqueName: \"kubernetes.io/projected/58df9142-731a-4288-ad45-f4a1207ab315-kube-api-access-fwkvx\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.412153 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.412021    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-istio-data\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.412153 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.412089    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-workload-socket\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.412292 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.412154    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58df9142-731a-4288-ad45-f4a1207ab315-istio-podinfo\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.513583 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.513534    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-workload-certs\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.514052 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.513587    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-credential-socket\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.514052 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.513628    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwkvx\" (UniqueName: \"kubernetes.io/projected/58df9142-731a-4288-ad45-f4a1207ab315-kube-api-access-fwkvx\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.514052 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.513663    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-istio-data\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.514052 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.513699    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-workload-socket\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.514052 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.513747    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58df9142-731a-4288-ad45-f4a1207ab315-istio-podinfo\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.514052 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.513807    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-istio-envoy\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.514052 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.513832    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58df9142-731a-4288-ad45-f4a1207ab315-istiod-ca-cert\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.514052 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.513895    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58df9142-731a-4288-ad45-f4a1207ab315-istio-token\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.514052 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.513925    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-workload-certs\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.514052 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.514028    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-credential-socket\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.514448 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.514153    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-workload-socket\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.514448 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.514388    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-istio-data\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.514538 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.514498    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58df9142-731a-4288-ad45-f4a1207ab315-istiod-ca-cert\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.515962 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.515944    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-istio-envoy\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.516225 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.516207    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58df9142-731a-4288-ad45-f4a1207ab315-istio-podinfo\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.521581 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.521547    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58df9142-731a-4288-ad45-f4a1207ab315-istio-token\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.522011 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.521991    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwkvx\" (UniqueName: \"kubernetes.io/projected/58df9142-731a-4288-ad45-f4a1207ab315-kube-api-access-fwkvx\") pod \"e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") " pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.669978 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.669894    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:26.805315 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.805282    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"]
Jul 30 20:23:26.806734 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:23:26.806712    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58df9142_731a_4288_ad45_f4a1207ab315.slice/crio-bfc6dc681c728b81ccb992ff714e34e8adda893ff5f4cb75a56094279df7176c WatchSource:0}: Error finding container bfc6dc681c728b81ccb992ff714e34e8adda893ff5f4cb75a56094279df7176c: Status 404 returned error can't find the container with id bfc6dc681c728b81ccb992ff714e34e8adda893ff5f4cb75a56094279df7176c
Jul 30 20:23:26.808865 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.808834    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:23:26.808936 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.808899    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:23:26.808936 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:26.808926    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:23:27.634304 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:27.634263    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc" event={"ID":"58df9142-731a-4288-ad45-f4a1207ab315","Type":"ContainerStarted","Data":"049b4a3e3814459b31fd974ca17dda11867fd2f9adff981257bc646d20aba8e4"}
Jul 30 20:23:27.634693 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:27.634325    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc" event={"ID":"58df9142-731a-4288-ad45-f4a1207ab315","Type":"ContainerStarted","Data":"bfc6dc681c728b81ccb992ff714e34e8adda893ff5f4cb75a56094279df7176c"}
Jul 30 20:23:27.656593 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:27.656531    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc" podStartSLOduration=1.656516668 podStartE2EDuration="1.656516668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:23:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:23:27.653709229 +0000 UTC m=+2628.753790417" watchObservedRunningTime="2026-07-30 20:23:27.656516668 +0000 UTC m=+2628.756597854"
Jul 30 20:23:27.670707 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:27.670683    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:27.675834 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:27.675814    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:28.640196 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:28.640164    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:28.641679 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:28.641647    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:30.653984 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.653955    2568 generic.go:356] "Generic (PLEG): container finished" podID="88d347ae-4843-4593-b892-bde7c41498a8" containerID="76a20fd83b070d73bbfe48b0b6e8fd275fd5fe9f2f763f5c83c4c0bd1fb62b2f" exitCode=0
Jul 30 20:23:30.654396 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.654030    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv" event={"ID":"88d347ae-4843-4593-b892-bde7c41498a8","Type":"ContainerDied","Data":"76a20fd83b070d73bbfe48b0b6e8fd275fd5fe9f2f763f5c83c4c0bd1fb62b2f"}
Jul 30 20:23:30.654396 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.654104    2568 scope.go:117] "RemoveContainer" containerID="3e895e29829bbaa584ef470f763a5f2acc70ce4a617df116b486d9103a5777f5"
Jul 30 20:23:30.675994 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.675967    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"]
Jul 30 20:23:30.676710 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.676691    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f675c683-d9d8-43ab-af67-15805cdde81a" containerName="istio-proxy"
Jul 30 20:23:30.681364 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.681347    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"
Jul 30 20:23:30.684367 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.684315    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-474e8f-serving-cert\""
Jul 30 20:23:30.692978 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.692666    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"]
Jul 30 20:23:30.752911 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.752842    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb\" (UID: \"2ec33da1-b03b-4486-aff3-d4b9b3cc80e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"
Jul 30 20:23:30.753108 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.753084    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvp2n\" (UniqueName: \"kubernetes.io/projected/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9-kube-api-access-dvp2n\") pod \"maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb\" (UID: \"2ec33da1-b03b-4486-aff3-d4b9b3cc80e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"
Jul 30 20:23:30.753190 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.753135    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9-maas-api-tls\") pod \"maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb\" (UID: \"2ec33da1-b03b-4486-aff3-d4b9b3cc80e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"
Jul 30 20:23:30.757216 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.757198    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:23:30.853613 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.853583    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88d347ae-4843-4593-b892-bde7c41498a8-istio-token\") pod \"88d347ae-4843-4593-b892-bde7c41498a8\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") "
Jul 30 20:23:30.853794 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.853664    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zz7v\" (UniqueName: \"kubernetes.io/projected/88d347ae-4843-4593-b892-bde7c41498a8-kube-api-access-7zz7v\") pod \"88d347ae-4843-4593-b892-bde7c41498a8\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") "
Jul 30 20:23:30.853840 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.853769    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88d347ae-4843-4593-b892-bde7c41498a8-istiod-ca-cert\") pod \"88d347ae-4843-4593-b892-bde7c41498a8\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") "
Jul 30 20:23:30.853882 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.853860    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-workload-certs\") pod \"88d347ae-4843-4593-b892-bde7c41498a8\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") "
Jul 30 20:23:30.853917 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.853886    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-workload-socket\") pod \"88d347ae-4843-4593-b892-bde7c41498a8\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") "
Jul 30 20:23:30.853969 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.853927    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-istio-data\") pod \"88d347ae-4843-4593-b892-bde7c41498a8\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") "
Jul 30 20:23:30.853969 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.853963    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-credential-socket\") pod \"88d347ae-4843-4593-b892-bde7c41498a8\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") "
Jul 30 20:23:30.854076 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.853997    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-istio-envoy\") pod \"88d347ae-4843-4593-b892-bde7c41498a8\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") "
Jul 30 20:23:30.854076 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.854027    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88d347ae-4843-4593-b892-bde7c41498a8-istio-podinfo\") pod \"88d347ae-4843-4593-b892-bde7c41498a8\" (UID: \"88d347ae-4843-4593-b892-bde7c41498a8\") "
Jul 30 20:23:30.854193 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.854097    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88d347ae-4843-4593-b892-bde7c41498a8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "88d347ae-4843-4593-b892-bde7c41498a8" (UID: "88d347ae-4843-4593-b892-bde7c41498a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:23:30.854193 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.854129    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "88d347ae-4843-4593-b892-bde7c41498a8" (UID: "88d347ae-4843-4593-b892-bde7c41498a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:23:30.854365 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.854178    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "88d347ae-4843-4593-b892-bde7c41498a8" (UID: "88d347ae-4843-4593-b892-bde7c41498a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:23:30.854365 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.854287    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "88d347ae-4843-4593-b892-bde7c41498a8" (UID: "88d347ae-4843-4593-b892-bde7c41498a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:23:30.854365 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.854215    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvp2n\" (UniqueName: \"kubernetes.io/projected/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9-kube-api-access-dvp2n\") pod \"maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb\" (UID: \"2ec33da1-b03b-4486-aff3-d4b9b3cc80e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"
Jul 30 20:23:30.854588 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.854413    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9-maas-api-tls\") pod \"maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb\" (UID: \"2ec33da1-b03b-4486-aff3-d4b9b3cc80e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"
Jul 30 20:23:30.854588 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.854521    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb\" (UID: \"2ec33da1-b03b-4486-aff3-d4b9b3cc80e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"
Jul 30 20:23:30.854707 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:23:30.854644    2568 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-serving-cert: secret "maas-api-e2e-shared-a-474e8f-serving-cert" not found
Jul 30 20:23:30.854707 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.854686    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88d347ae-4843-4593-b892-bde7c41498a8-istiod-ca-cert\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:23:30.854707 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.854703    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-workload-certs\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:23:30.854871 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:23:30.854721    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9-maas-api-tls podName:2ec33da1-b03b-4486-aff3-d4b9b3cc80e9 nodeName:}" failed. No retries permitted until 2026-07-30 20:23:31.354696868 +0000 UTC m=+2632.454778033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9-maas-api-tls") pod "maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb" (UID: "2ec33da1-b03b-4486-aff3-d4b9b3cc80e9") : secret "maas-api-e2e-shared-a-474e8f-serving-cert" not found
Jul 30 20:23:30.854871 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.854743    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-workload-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:23:30.854871 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.854765    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-credential-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:23:30.855047 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.854907    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-istio-data" (OuterVolumeSpecName: "istio-data") pod "88d347ae-4843-4593-b892-bde7c41498a8" (UID: "88d347ae-4843-4593-b892-bde7c41498a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:23:30.855263 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.855244    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb\" (UID: \"2ec33da1-b03b-4486-aff3-d4b9b3cc80e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"
Jul 30 20:23:30.855981 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.855951    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88d347ae-4843-4593-b892-bde7c41498a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "88d347ae-4843-4593-b892-bde7c41498a8" (UID: "88d347ae-4843-4593-b892-bde7c41498a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:23:30.856253 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.856229    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88d347ae-4843-4593-b892-bde7c41498a8-kube-api-access-7zz7v" (OuterVolumeSpecName: "kube-api-access-7zz7v") pod "88d347ae-4843-4593-b892-bde7c41498a8" (UID: "88d347ae-4843-4593-b892-bde7c41498a8"). InnerVolumeSpecName "kube-api-access-7zz7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:23:30.856372 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.856311    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/88d347ae-4843-4593-b892-bde7c41498a8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "88d347ae-4843-4593-b892-bde7c41498a8" (UID: "88d347ae-4843-4593-b892-bde7c41498a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 20:23:30.856442 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.856396    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "88d347ae-4843-4593-b892-bde7c41498a8" (UID: "88d347ae-4843-4593-b892-bde7c41498a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:23:30.862559 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.862382    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvp2n\" (UniqueName: \"kubernetes.io/projected/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9-kube-api-access-dvp2n\") pod \"maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb\" (UID: \"2ec33da1-b03b-4486-aff3-d4b9b3cc80e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"
Jul 30 20:23:30.956073 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.956053    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-istio-envoy\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:23:30.956073 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.956074    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88d347ae-4843-4593-b892-bde7c41498a8-istio-podinfo\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:23:30.956208 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.956083    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88d347ae-4843-4593-b892-bde7c41498a8-istio-token\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:23:30.956208 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.956092    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zz7v\" (UniqueName: \"kubernetes.io/projected/88d347ae-4843-4593-b892-bde7c41498a8-kube-api-access-7zz7v\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:23:30.956208 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:30.956100    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88d347ae-4843-4593-b892-bde7c41498a8-istio-data\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:23:31.290486 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.290453    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q"]
Jul 30 20:23:31.291018 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.291000    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88d347ae-4843-4593-b892-bde7c41498a8" containerName="istio-proxy"
Jul 30 20:23:31.291086 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.291021    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="88d347ae-4843-4593-b892-bde7c41498a8" containerName="istio-proxy"
Jul 30 20:23:31.291086 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.291033    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88d347ae-4843-4593-b892-bde7c41498a8" containerName="istio-proxy"
Jul 30 20:23:31.291086 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.291038    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="88d347ae-4843-4593-b892-bde7c41498a8" containerName="istio-proxy"
Jul 30 20:23:31.291204 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.291116    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="88d347ae-4843-4593-b892-bde7c41498a8" containerName="istio-proxy"
Jul 30 20:23:31.291204 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.291126    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="88d347ae-4843-4593-b892-bde7c41498a8" containerName="istio-proxy"
Jul 30 20:23:31.295399 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.295383    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q"
Jul 30 20:23:31.297940 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.297920    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-474e8f\""
Jul 30 20:23:31.303053 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.303030    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q"]
Jul 30 20:23:31.339615 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.336629    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9"]
Jul 30 20:23:31.344032 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.344005    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9"
Jul 30 20:23:31.348792 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.348762    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-474e8f-dockercfg-6z8tp\""
Jul 30 20:23:31.351610 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.351585    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9"]
Jul 30 20:23:31.360742 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.360681    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/107449eb-d24e-4317-8a79-8e994fa3562b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q\" (UID: \"107449eb-d24e-4317-8a79-8e994fa3562b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q"
Jul 30 20:23:31.360742 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.360729    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l52xj\" (UniqueName: \"kubernetes.io/projected/107449eb-d24e-4317-8a79-8e994fa3562b-kube-api-access-l52xj\") pod \"payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q\" (UID: \"107449eb-d24e-4317-8a79-8e994fa3562b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q"
Jul 30 20:23:31.361161 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.360816    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9-maas-api-tls\") pod \"maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb\" (UID: \"2ec33da1-b03b-4486-aff3-d4b9b3cc80e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"
Jul 30 20:23:31.363641 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.363608    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9-maas-api-tls\") pod \"maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb\" (UID: \"2ec33da1-b03b-4486-aff3-d4b9b3cc80e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"
Jul 30 20:23:31.462039 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.461999    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cf5ec77-df84-46a3-ae96-09e89718fab8-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9\" (UID: \"3cf5ec77-df84-46a3-ae96-09e89718fab8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9"
Jul 30 20:23:31.462233 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.462072    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/107449eb-d24e-4317-8a79-8e994fa3562b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q\" (UID: \"107449eb-d24e-4317-8a79-8e994fa3562b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q"
Jul 30 20:23:31.462233 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.462101    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l52xj\" (UniqueName: \"kubernetes.io/projected/107449eb-d24e-4317-8a79-8e994fa3562b-kube-api-access-l52xj\") pod \"payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q\" (UID: \"107449eb-d24e-4317-8a79-8e994fa3562b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q"
Jul 30 20:23:31.462233 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.462165    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8snm2\" (UniqueName: \"kubernetes.io/projected/3cf5ec77-df84-46a3-ae96-09e89718fab8-kube-api-access-8snm2\") pod \"payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9\" (UID: \"3cf5ec77-df84-46a3-ae96-09e89718fab8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9"
Jul 30 20:23:31.462991 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.462961    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/107449eb-d24e-4317-8a79-8e994fa3562b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q\" (UID: \"107449eb-d24e-4317-8a79-8e994fa3562b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q"
Jul 30 20:23:31.469444 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.469417    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l52xj\" (UniqueName: \"kubernetes.io/projected/107449eb-d24e-4317-8a79-8e994fa3562b-kube-api-access-l52xj\") pod \"payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q\" (UID: \"107449eb-d24e-4317-8a79-8e994fa3562b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q"
Jul 30 20:23:31.563332 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.563300    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8snm2\" (UniqueName: \"kubernetes.io/projected/3cf5ec77-df84-46a3-ae96-09e89718fab8-kube-api-access-8snm2\") pod \"payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9\" (UID: \"3cf5ec77-df84-46a3-ae96-09e89718fab8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9"
Jul 30 20:23:31.563458 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.563446    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cf5ec77-df84-46a3-ae96-09e89718fab8-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9\" (UID: \"3cf5ec77-df84-46a3-ae96-09e89718fab8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9"
Jul 30 20:23:31.564168 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.564144    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cf5ec77-df84-46a3-ae96-09e89718fab8-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9\" (UID: \"3cf5ec77-df84-46a3-ae96-09e89718fab8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9"
Jul 30 20:23:31.571163 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.571133    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8snm2\" (UniqueName: \"kubernetes.io/projected/3cf5ec77-df84-46a3-ae96-09e89718fab8-kube-api-access-8snm2\") pod \"payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9\" (UID: \"3cf5ec77-df84-46a3-ae96-09e89718fab8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9"
Jul 30 20:23:31.597847 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.597822    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"
Jul 30 20:23:31.607822 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.607802    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q"
Jul 30 20:23:31.658149 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.657715    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9"
Jul 30 20:23:31.669462 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.668930    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv" event={"ID":"88d347ae-4843-4593-b892-bde7c41498a8","Type":"ContainerDied","Data":"a79d60d1a91eb3ab3998f491e0864cf438308c630a5c6ff521404705f9a52a28"}
Jul 30 20:23:31.669462 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.669010    2568 scope.go:117] "RemoveContainer" containerID="76a20fd83b070d73bbfe48b0b6e8fd275fd5fe9f2f763f5c83c4c0bd1fb62b2f"
Jul 30 20:23:31.669462 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.669194    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"
Jul 30 20:23:31.692865 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.692833    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"]
Jul 30 20:23:31.695035 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.695013    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-671642-openshift-default-bb46cd7c8-wtjrv"]
Jul 30 20:23:31.762620 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.762558    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"]
Jul 30 20:23:31.764189 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:23:31.764158    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec33da1_b03b_4486_aff3_d4b9b3cc80e9.slice/crio-ead2614a807f73a910920fb96f8318092fec400b6909c34a06af524a32432e99 WatchSource:0}: Error finding container ead2614a807f73a910920fb96f8318092fec400b6909c34a06af524a32432e99: Status 404 returned error can't find the container with id ead2614a807f73a910920fb96f8318092fec400b6909c34a06af524a32432e99
Jul 30 20:23:31.999429 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:31.999404    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q"]
Jul 30 20:23:32.000592 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:23:32.000554    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod107449eb_d24e_4317_8a79_8e994fa3562b.slice/crio-c9fa36f61cb6c9c43df04b22684409b15136750717b99f5a4f637e60962b45ff WatchSource:0}: Error finding container c9fa36f61cb6c9c43df04b22684409b15136750717b99f5a4f637e60962b45ff: Status 404 returned error can't find the container with id c9fa36f61cb6c9c43df04b22684409b15136750717b99f5a4f637e60962b45ff
Jul 30 20:23:32.035480 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:32.035453    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9"]
Jul 30 20:23:32.037473 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:23:32.037449    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf5ec77_df84_46a3_ae96_09e89718fab8.slice/crio-29a8f28d53ac93444cf843a121120d28ca488e6e1c79c16b14fa2ac642f48c7e WatchSource:0}: Error finding container 29a8f28d53ac93444cf843a121120d28ca488e6e1c79c16b14fa2ac642f48c7e: Status 404 returned error can't find the container with id 29a8f28d53ac93444cf843a121120d28ca488e6e1c79c16b14fa2ac642f48c7e
Jul 30 20:23:32.677415 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:32.677366    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9" event={"ID":"3cf5ec77-df84-46a3-ae96-09e89718fab8","Type":"ContainerStarted","Data":"0ef946971090238444f499cfd8fae7a7d107e53a18e3fb52560a5cc8665268e8"}
Jul 30 20:23:32.677902 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:32.677424    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9" event={"ID":"3cf5ec77-df84-46a3-ae96-09e89718fab8","Type":"ContainerStarted","Data":"29a8f28d53ac93444cf843a121120d28ca488e6e1c79c16b14fa2ac642f48c7e"}
Jul 30 20:23:32.677902 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:32.677474    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9"
Jul 30 20:23:32.679052 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:32.679009    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q" event={"ID":"107449eb-d24e-4317-8a79-8e994fa3562b","Type":"ContainerStarted","Data":"542de79dc0027806219c4bf99b3150283f408dd1b186248bdbbd3cd742f30e88"}
Jul 30 20:23:32.679173 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:32.679072    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q"
Jul 30 20:23:32.679173 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:32.679091    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q" event={"ID":"107449eb-d24e-4317-8a79-8e994fa3562b","Type":"ContainerStarted","Data":"c9fa36f61cb6c9c43df04b22684409b15136750717b99f5a4f637e60962b45ff"}
Jul 30 20:23:32.680608 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:32.680549    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb" event={"ID":"2ec33da1-b03b-4486-aff3-d4b9b3cc80e9","Type":"ContainerStarted","Data":"7f9a452033fbfedd72e51b99d1e115e4cdabd04588f72207452dd2ba887d159d"}
Jul 30 20:23:32.680739 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:32.680642    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"
Jul 30 20:23:32.680739 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:32.680668    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb" event={"ID":"2ec33da1-b03b-4486-aff3-d4b9b3cc80e9","Type":"ContainerStarted","Data":"ead2614a807f73a910920fb96f8318092fec400b6909c34a06af524a32432e99"}
Jul 30 20:23:32.694339 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:32.694302    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9" podStartSLOduration=1.694289476 podStartE2EDuration="1.694289476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:23:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:23:32.692871396 +0000 UTC m=+2633.792952587" watchObservedRunningTime="2026-07-30 20:23:32.694289476 +0000 UTC m=+2633.794370662"
Jul 30 20:23:32.710713 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:32.710655    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb" podStartSLOduration=2.313044623 podStartE2EDuration="2.710641665s" totalImagesPullingTime="397.597042ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:23:32.70871138 +0000 UTC m=+2633.808792568" watchObservedRunningTime="2026-07-30 20:23:32.710641665 +0000 UTC m=+2633.810722852"
Jul 30 20:23:32.724682 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:32.724646    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q" podStartSLOduration=1.724634731 podStartE2EDuration="1.724634731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:23:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:23:32.723691653 +0000 UTC m=+2633.823772843" watchObservedRunningTime="2026-07-30 20:23:32.724634731 +0000 UTC m=+2633.824715918"
Jul 30 20:23:33.483663 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:33.483630    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88d347ae-4843-4593-b892-bde7c41498a8" path="/var/lib/kubelet/pods/88d347ae-4843-4593-b892-bde7c41498a8/volumes"
Jul 30 20:23:38.692023 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:38.691995    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"
Jul 30 20:23:39.889144 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:39.889113    2568 scope.go:117] "RemoveContainer" containerID="664845dee919e77dfccdb8dbd2cf26fa421f8ba27146272e0de758ec6caac741"
Jul 30 20:23:43.642084 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:43.642010    2568 patch_prober.go:28] interesting pod/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Jul 30 20:23:43.642475 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:43.642078    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc" podUID="58df9142-731a-4288-ad45-f4a1207ab315" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Jul 30 20:23:43.689370 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:43.689342    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q"
Jul 30 20:23:43.689712 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:43.689692    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9"
Jul 30 20:23:43.745895 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:43.745808    2568 generic.go:356] "Generic (PLEG): container finished" podID="58df9142-731a-4288-ad45-f4a1207ab315" containerID="049b4a3e3814459b31fd974ca17dda11867fd2f9adff981257bc646d20aba8e4" exitCode=0
Jul 30 20:23:43.746040 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:43.745901    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc" event={"ID":"58df9142-731a-4288-ad45-f4a1207ab315","Type":"ContainerDied","Data":"049b4a3e3814459b31fd974ca17dda11867fd2f9adff981257bc646d20aba8e4"}
Jul 30 20:23:43.746393 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:43.746374    2568 scope.go:117] "RemoveContainer" containerID="049b4a3e3814459b31fd974ca17dda11867fd2f9adff981257bc646d20aba8e4"
Jul 30 20:23:43.747592 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:43.747540    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:23:43.747698 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:43.747641    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:23:43.747762 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:43.747695    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:23:44.757622 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:44.757558    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc" event={"ID":"58df9142-731a-4288-ad45-f4a1207ab315","Type":"ContainerStarted","Data":"912626e36a704f7eff4878a9016ac78e4d2b4b8729db54271836e36231b3db84"}
Jul 30 20:23:45.670551 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:45.670520    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:45.670759 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:45.670741    2568 patch_prober.go:28] interesting pod/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Jul 30 20:23:45.670807 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:45.670783    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc" podUID="58df9142-731a-4288-ad45-f4a1207ab315" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Jul 30 20:23:46.671009 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:46.670979    2568 patch_prober.go:28] interesting pod/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Jul 30 20:23:46.671374 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:46.671030    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc" podUID="58df9142-731a-4288-ad45-f4a1207ab315" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Jul 30 20:23:47.670261 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:47.670232    2568 patch_prober.go:28] interesting pod/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Jul 30 20:23:47.670438 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:47.670283    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc" podUID="58df9142-731a-4288-ad45-f4a1207ab315" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Jul 30 20:23:48.671284 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:48.671243    2568 patch_prober.go:28] interesting pod/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Jul 30 20:23:48.671717 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:48.671302    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc" podUID="58df9142-731a-4288-ad45-f4a1207ab315" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Jul 30 20:23:49.675474 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:49.675443    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:49.675908 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:49.675792    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:49.676458 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:49.676439    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:23:55.147638 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.147594    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"]
Jul 30 20:23:55.152026 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.152002    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.154590 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.154551    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-808798-openshift-default-dockercfg-lhsnc\""
Jul 30 20:23:55.161993 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.161972    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"]
Jul 30 20:23:55.311241 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.311208    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-istio-envoy\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.311241 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.311244    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58cd60c2-d357-42f5-882c-4a64755463ba-istiod-ca-cert\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.311460 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.311333    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-credential-socket\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.311460 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.311386    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-workload-certs\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.311460 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.311429    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-istio-data\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.311460 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.311452    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58cd60c2-d357-42f5-882c-4a64755463ba-istio-podinfo\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.311645 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.311479    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58cd60c2-d357-42f5-882c-4a64755463ba-istio-token\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.311645 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.311542    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf74h\" (UniqueName: \"kubernetes.io/projected/58cd60c2-d357-42f5-882c-4a64755463ba-kube-api-access-qf74h\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.311645 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.311601    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-workload-socket\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.413183 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.413087    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-istio-envoy\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.413183 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.413123    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58cd60c2-d357-42f5-882c-4a64755463ba-istiod-ca-cert\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.413420 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.413203    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-credential-socket\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.413420 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.413237    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-workload-certs\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.413420 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.413276    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-istio-data\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.413420 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.413304    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58cd60c2-d357-42f5-882c-4a64755463ba-istio-podinfo\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.413420 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.413333    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58cd60c2-d357-42f5-882c-4a64755463ba-istio-token\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.413420 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.413366    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf74h\" (UniqueName: \"kubernetes.io/projected/58cd60c2-d357-42f5-882c-4a64755463ba-kube-api-access-qf74h\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.413420 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.413391    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-workload-socket\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.414049 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.414019    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58cd60c2-d357-42f5-882c-4a64755463ba-istiod-ca-cert\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.414179 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.414136    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-credential-socket\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.414235 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.414190    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-workload-socket\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.414235 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.414204    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-workload-certs\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.414309 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.414275    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-istio-data\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.415466 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.415445    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-istio-envoy\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.415726 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.415708    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58cd60c2-d357-42f5-882c-4a64755463ba-istio-podinfo\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.421228 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.421205    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58cd60c2-d357-42f5-882c-4a64755463ba-istio-token\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.421645 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.421626    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf74h\" (UniqueName: \"kubernetes.io/projected/58cd60c2-d357-42f5-882c-4a64755463ba-kube-api-access-qf74h\") pod \"e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") " pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.464359 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.464336    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:55.599615 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.599590    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"]
Jul 30 20:23:55.601052 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:23:55.601020    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58cd60c2_d357_42f5_882c_4a64755463ba.slice/crio-3befe59039c7db713ff8ceaf3feb8bb93fb2ae0fc4a836937cd765a1c74d19c8 WatchSource:0}: Error finding container 3befe59039c7db713ff8ceaf3feb8bb93fb2ae0fc4a836937cd765a1c74d19c8: Status 404 returned error can't find the container with id 3befe59039c7db713ff8ceaf3feb8bb93fb2ae0fc4a836937cd765a1c74d19c8
Jul 30 20:23:55.603477 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.603445    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:23:55.603593 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.603549    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:23:55.603664 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.603613    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:23:55.827064 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.827033    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz" event={"ID":"58cd60c2-d357-42f5-882c-4a64755463ba","Type":"ContainerStarted","Data":"79964791b634df9d0195a2896d0e373e0daccd9ae28bf252381344f5e733ab58"}
Jul 30 20:23:55.827217 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.827086    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz" event={"ID":"58cd60c2-d357-42f5-882c-4a64755463ba","Type":"ContainerStarted","Data":"3befe59039c7db713ff8ceaf3feb8bb93fb2ae0fc4a836937cd765a1c74d19c8"}
Jul 30 20:23:55.848919 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:55.848864    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz" podStartSLOduration=0.848844328 podStartE2EDuration="848.844328ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:23:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:23:55.845890852 +0000 UTC m=+2656.945972038" watchObservedRunningTime="2026-07-30 20:23:55.848844328 +0000 UTC m=+2656.948925515"
Jul 30 20:23:56.464919 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:56.464889    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:56.469957 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:56.469931    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:56.832868 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:56.832842    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:56.833674 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:56.833648    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:23:59.493651 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:59.493617    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6"]
Jul 30 20:23:59.497733 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:59.497714    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6"
Jul 30 20:23:59.500731 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:59.500709    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-808798-dockercfg-6wkzt\""
Jul 30 20:23:59.500825 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:59.500781    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-808798\""
Jul 30 20:23:59.508151 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:59.508127    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6"]
Jul 30 20:23:59.551010 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:59.550688    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ck2m\" (UniqueName: \"kubernetes.io/projected/830b94d7-8ed5-4412-b9f5-bb444f395418-kube-api-access-4ck2m\") pod \"payload-processing-e2e-shared-b-808798-65df8645db-fg7k6\" (UID: \"830b94d7-8ed5-4412-b9f5-bb444f395418\") " pod="openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6"
Jul 30 20:23:59.551010 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:59.550837    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/830b94d7-8ed5-4412-b9f5-bb444f395418-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-808798-65df8645db-fg7k6\" (UID: \"830b94d7-8ed5-4412-b9f5-bb444f395418\") " pod="openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6"
Jul 30 20:23:59.651782 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:59.651743    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ck2m\" (UniqueName: \"kubernetes.io/projected/830b94d7-8ed5-4412-b9f5-bb444f395418-kube-api-access-4ck2m\") pod \"payload-processing-e2e-shared-b-808798-65df8645db-fg7k6\" (UID: \"830b94d7-8ed5-4412-b9f5-bb444f395418\") " pod="openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6"
Jul 30 20:23:59.651982 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:59.651859    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/830b94d7-8ed5-4412-b9f5-bb444f395418-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-808798-65df8645db-fg7k6\" (UID: \"830b94d7-8ed5-4412-b9f5-bb444f395418\") " pod="openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6"
Jul 30 20:23:59.652542 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:59.652518    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/830b94d7-8ed5-4412-b9f5-bb444f395418-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-808798-65df8645db-fg7k6\" (UID: \"830b94d7-8ed5-4412-b9f5-bb444f395418\") " pod="openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6"
Jul 30 20:23:59.659914 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:59.659882    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ck2m\" (UniqueName: \"kubernetes.io/projected/830b94d7-8ed5-4412-b9f5-bb444f395418-kube-api-access-4ck2m\") pod \"payload-processing-e2e-shared-b-808798-65df8645db-fg7k6\" (UID: \"830b94d7-8ed5-4412-b9f5-bb444f395418\") " pod="openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6"
Jul 30 20:23:59.810755 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:23:59.810725    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6"
Jul 30 20:24:00.153786 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:00.153757    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6"]
Jul 30 20:24:00.155135 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:24:00.155099    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod830b94d7_8ed5_4412_b9f5_bb444f395418.slice/crio-c91b240a5c0b37d928688aab4b95b1d942cd8fb04e5658378b2a69f517455d47 WatchSource:0}: Error finding container c91b240a5c0b37d928688aab4b95b1d942cd8fb04e5658378b2a69f517455d47: Status 404 returned error can't find the container with id c91b240a5c0b37d928688aab4b95b1d942cd8fb04e5658378b2a69f517455d47
Jul 30 20:24:00.859017 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:00.858980    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6" event={"ID":"830b94d7-8ed5-4412-b9f5-bb444f395418","Type":"ContainerStarted","Data":"59b0de1769e055426135f39e8d66e5dd7a71f78bc9e3f425c5ec686b1b66cf2a"}
Jul 30 20:24:00.859427 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:00.859035    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6" event={"ID":"830b94d7-8ed5-4412-b9f5-bb444f395418","Type":"ContainerStarted","Data":"c91b240a5c0b37d928688aab4b95b1d942cd8fb04e5658378b2a69f517455d47"}
Jul 30 20:24:00.859427 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:00.859066    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6"
Jul 30 20:24:00.875667 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:00.875621    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6" podStartSLOduration=1.8756007000000001 podStartE2EDuration="1.8756007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:23:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:24:00.873372673 +0000 UTC m=+2661.973453861" watchObservedRunningTime="2026-07-30 20:24:00.8756007 +0000 UTC m=+2661.975681901"
Jul 30 20:24:11.866149 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:11.866109    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6"
Jul 30 20:24:12.875732 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:12.875691    2568 patch_prober.go:28] interesting pod/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 30 20:24:12.876115 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:12.875747    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz" podUID="58cd60c2-d357-42f5-882c-4a64755463ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 30 20:24:13.929381 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:13.929352    2568 generic.go:356] "Generic (PLEG): container finished" podID="58cd60c2-d357-42f5-882c-4a64755463ba" containerID="79964791b634df9d0195a2896d0e373e0daccd9ae28bf252381344f5e733ab58" exitCode=0
Jul 30 20:24:13.929828 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:13.929437    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz" event={"ID":"58cd60c2-d357-42f5-882c-4a64755463ba","Type":"ContainerDied","Data":"79964791b634df9d0195a2896d0e373e0daccd9ae28bf252381344f5e733ab58"}
Jul 30 20:24:13.929879 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:13.929848    2568 scope.go:117] "RemoveContainer" containerID="79964791b634df9d0195a2896d0e373e0daccd9ae28bf252381344f5e733ab58"
Jul 30 20:24:13.930889 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:13.930852    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:24:13.930957 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:13.930937    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:24:13.931000 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:13.930980    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:24:14.936557 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:14.936529    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz" event={"ID":"58cd60c2-d357-42f5-882c-4a64755463ba","Type":"ContainerStarted","Data":"7e803b03d93682715b594146b0c604ef7524e133dd9ba84b44e4ead3e5805f5f"}
Jul 30 20:24:15.465344 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:15.465299    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:24:15.465546 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:15.465428    2568 patch_prober.go:28] interesting pod/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Jul 30 20:24:15.465546 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:15.465472    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz" podUID="58cd60c2-d357-42f5-882c-4a64755463ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Jul 30 20:24:16.464948 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:16.464901    2568 patch_prober.go:28] interesting pod/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Jul 30 20:24:16.465331 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:16.464973    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz" podUID="58cd60c2-d357-42f5-882c-4a64755463ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Jul 30 20:24:17.466037 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:17.466003    2568 patch_prober.go:28] interesting pod/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Jul 30 20:24:17.466539 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:17.466060    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz" podUID="58cd60c2-d357-42f5-882c-4a64755463ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Jul 30 20:24:18.465352 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:18.465304    2568 patch_prober.go:28] interesting pod/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Jul 30 20:24:18.465592 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:18.465379    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz" podUID="58cd60c2-d357-42f5-882c-4a64755463ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Jul 30 20:24:19.468861 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:19.468831    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:24:19.469222 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:19.469147    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:24:19.469911 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:24:19.469894    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:34:47.893387 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:47.893349    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db"]
Jul 30 20:34:47.898018 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:47.897995    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db"
Jul 30 20:34:47.900521 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:47.900498    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-7f2993-serving-cert\""
Jul 30 20:34:47.908112 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:47.908086    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db"]
Jul 30 20:34:47.976185 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:47.976154    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbtzg\" (UniqueName: \"kubernetes.io/projected/f6b3a864-7d54-4660-aad7-41ced344fac3-kube-api-access-mbtzg\") pod \"maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db\" (UID: \"f6b3a864-7d54-4660-aad7-41ced344fac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db"
Jul 30 20:34:47.976312 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:47.976201    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6b3a864-7d54-4660-aad7-41ced344fac3-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db\" (UID: \"f6b3a864-7d54-4660-aad7-41ced344fac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db"
Jul 30 20:34:47.976368 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:47.976337    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6b3a864-7d54-4660-aad7-41ced344fac3-maas-api-tls\") pod \"maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db\" (UID: \"f6b3a864-7d54-4660-aad7-41ced344fac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db"
Jul 30 20:34:48.077654 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.077616    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6b3a864-7d54-4660-aad7-41ced344fac3-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db\" (UID: \"f6b3a864-7d54-4660-aad7-41ced344fac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db"
Jul 30 20:34:48.077821 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.077764    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6b3a864-7d54-4660-aad7-41ced344fac3-maas-api-tls\") pod \"maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db\" (UID: \"f6b3a864-7d54-4660-aad7-41ced344fac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db"
Jul 30 20:34:48.077821 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.077817    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbtzg\" (UniqueName: \"kubernetes.io/projected/f6b3a864-7d54-4660-aad7-41ced344fac3-kube-api-access-mbtzg\") pod \"maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db\" (UID: \"f6b3a864-7d54-4660-aad7-41ced344fac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db"
Jul 30 20:34:48.078391 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.078360    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6b3a864-7d54-4660-aad7-41ced344fac3-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db\" (UID: \"f6b3a864-7d54-4660-aad7-41ced344fac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db"
Jul 30 20:34:48.080126 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.080102    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6b3a864-7d54-4660-aad7-41ced344fac3-maas-api-tls\") pod \"maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db\" (UID: \"f6b3a864-7d54-4660-aad7-41ced344fac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db"
Jul 30 20:34:48.086089 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.086065    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbtzg\" (UniqueName: \"kubernetes.io/projected/f6b3a864-7d54-4660-aad7-41ced344fac3-kube-api-access-mbtzg\") pod \"maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db\" (UID: \"f6b3a864-7d54-4660-aad7-41ced344fac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db"
Jul 30 20:34:48.211012 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.210943    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db"
Jul 30 20:34:48.347535 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.347468    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db"]
Jul 30 20:34:48.351094 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:34:48.351068    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6b3a864_7d54_4660_aad7_41ced344fac3.slice/crio-1fdf358c5cbed4f10777379b0224c3664ddad954674f0dd73f34666fe3e688a9 WatchSource:0}: Error finding container 1fdf358c5cbed4f10777379b0224c3664ddad954674f0dd73f34666fe3e688a9: Status 404 returned error can't find the container with id 1fdf358c5cbed4f10777379b0224c3664ddad954674f0dd73f34666fe3e688a9
Jul 30 20:34:48.354227 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.354205    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:34:48.444310 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.444277    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db" event={"ID":"f6b3a864-7d54-4660-aad7-41ced344fac3","Type":"ContainerStarted","Data":"1fdf358c5cbed4f10777379b0224c3664ddad954674f0dd73f34666fe3e688a9"}
Jul 30 20:34:48.486719 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.486596    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87"]
Jul 30 20:34:48.491802 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.491784    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87"
Jul 30 20:34:48.494214 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.494194    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-7f2993\""
Jul 30 20:34:48.500364 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.500322    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87"]
Jul 30 20:34:48.582622 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.582591    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpzm7\" (UniqueName: \"kubernetes.io/projected/85bc8fd0-3e72-416e-a032-f8358cb4ca67-kube-api-access-fpzm7\") pod \"payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87\" (UID: \"85bc8fd0-3e72-416e-a032-f8358cb4ca67\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87"
Jul 30 20:34:48.582785 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.582728    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85bc8fd0-3e72-416e-a032-f8358cb4ca67-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87\" (UID: \"85bc8fd0-3e72-416e-a032-f8358cb4ca67\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87"
Jul 30 20:34:48.683550 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.683509    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpzm7\" (UniqueName: \"kubernetes.io/projected/85bc8fd0-3e72-416e-a032-f8358cb4ca67-kube-api-access-fpzm7\") pod \"payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87\" (UID: \"85bc8fd0-3e72-416e-a032-f8358cb4ca67\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87"
Jul 30 20:34:48.683884 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.683683    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85bc8fd0-3e72-416e-a032-f8358cb4ca67-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87\" (UID: \"85bc8fd0-3e72-416e-a032-f8358cb4ca67\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87"
Jul 30 20:34:48.684349 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.684330    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85bc8fd0-3e72-416e-a032-f8358cb4ca67-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87\" (UID: \"85bc8fd0-3e72-416e-a032-f8358cb4ca67\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87"
Jul 30 20:34:48.691609 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.691555    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpzm7\" (UniqueName: \"kubernetes.io/projected/85bc8fd0-3e72-416e-a032-f8358cb4ca67-kube-api-access-fpzm7\") pod \"payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87\" (UID: \"85bc8fd0-3e72-416e-a032-f8358cb4ca67\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87"
Jul 30 20:34:48.804858 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.804836    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87"
Jul 30 20:34:48.945317 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:48.945292    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87"]
Jul 30 20:34:48.953756 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:34:48.953723    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85bc8fd0_3e72_416e_a032_f8358cb4ca67.slice/crio-ebb3e3b3e16bb5800f9ae18da60616d7cb1a379611b537fafddcafd9fafb5444 WatchSource:0}: Error finding container ebb3e3b3e16bb5800f9ae18da60616d7cb1a379611b537fafddcafd9fafb5444: Status 404 returned error can't find the container with id ebb3e3b3e16bb5800f9ae18da60616d7cb1a379611b537fafddcafd9fafb5444
Jul 30 20:34:49.453734 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:49.453241    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db" event={"ID":"f6b3a864-7d54-4660-aad7-41ced344fac3","Type":"ContainerStarted","Data":"dc3bda345fdc1fc32e35483cc5cdb6304a6e37d4bd8115d13982f8d6a3e1c291"}
Jul 30 20:34:49.453734 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:49.453310    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db"
Jul 30 20:34:49.455136 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:49.455109    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87" event={"ID":"85bc8fd0-3e72-416e-a032-f8358cb4ca67","Type":"ContainerStarted","Data":"085ae2f5b9486a3d66afcb11620e5e41d5147af7bd5a03d2478300aa930224a4"}
Jul 30 20:34:49.455291 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:49.455153    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87" event={"ID":"85bc8fd0-3e72-416e-a032-f8358cb4ca67","Type":"ContainerStarted","Data":"ebb3e3b3e16bb5800f9ae18da60616d7cb1a379611b537fafddcafd9fafb5444"}
Jul 30 20:34:49.455291 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:49.455191    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87"
Jul 30 20:34:49.470678 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:49.470625    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db" podStartSLOduration=1.918425263 podStartE2EDuration="2.470607504s" totalImagesPullingTime="552.182241ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:34:49.469680429 +0000 UTC m=+3310.569761616" watchObservedRunningTime="2026-07-30 20:34:49.470607504 +0000 UTC m=+3310.570688694"
Jul 30 20:34:49.484767 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:49.484729    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87" podStartSLOduration=1.4847169519999999 podStartE2EDuration="1.484716952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:34:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:34:49.483043571 +0000 UTC m=+3310.583124758" watchObservedRunningTime="2026-07-30 20:34:49.484716952 +0000 UTC m=+3310.584798138"
Jul 30 20:34:55.466885 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:34:55.466846    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db"
Jul 30 20:35:00.463358 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:35:00.463327    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87"
Jul 30 20:35:17.927911 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:35:17.927835    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq"]
Jul 30 20:35:17.931817 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:35:17.931795    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq"
Jul 30 20:35:17.936551 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:35:17.936525    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-9d3c06\""
Jul 30 20:35:17.936662 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:35:17.936633    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-9d3c06-dockercfg-xd542\""
Jul 30 20:35:17.943931 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:35:17.943907    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq"]
Jul 30 20:35:18.047515 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:35:18.047481    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74bbn\" (UniqueName: \"kubernetes.io/projected/cb8ab5cd-df26-460b-a347-877891cfb85f-kube-api-access-74bbn\") pod \"payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq\" (UID: \"cb8ab5cd-df26-460b-a347-877891cfb85f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq"
Jul 30 20:35:18.047515 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:35:18.047527    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb8ab5cd-df26-460b-a347-877891cfb85f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq\" (UID: \"cb8ab5cd-df26-460b-a347-877891cfb85f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq"
Jul 30 20:35:18.148875 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:35:18.148836    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74bbn\" (UniqueName: \"kubernetes.io/projected/cb8ab5cd-df26-460b-a347-877891cfb85f-kube-api-access-74bbn\") pod \"payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq\" (UID: \"cb8ab5cd-df26-460b-a347-877891cfb85f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq"
Jul 30 20:35:18.148875 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:35:18.148876    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb8ab5cd-df26-460b-a347-877891cfb85f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq\" (UID: \"cb8ab5cd-df26-460b-a347-877891cfb85f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq"
Jul 30 20:35:18.149667 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:35:18.149643    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb8ab5cd-df26-460b-a347-877891cfb85f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq\" (UID: \"cb8ab5cd-df26-460b-a347-877891cfb85f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq"
Jul 30 20:35:18.159317 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:35:18.159288    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74bbn\" (UniqueName: \"kubernetes.io/projected/cb8ab5cd-df26-460b-a347-877891cfb85f-kube-api-access-74bbn\") pod \"payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq\" (UID: \"cb8ab5cd-df26-460b-a347-877891cfb85f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq"
Jul 30 20:35:18.244955 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:35:18.244880    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq"
Jul 30 20:35:18.383231 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:35:18.383204    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq"]
Jul 30 20:35:18.385319 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:35:18.385297    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb8ab5cd_df26_460b_a347_877891cfb85f.slice/crio-acac043ae9f9bf4d9973d114f2dae9fcde119ffc17deb7cdf85a9c4f90cf7b47 WatchSource:0}: Error finding container acac043ae9f9bf4d9973d114f2dae9fcde119ffc17deb7cdf85a9c4f90cf7b47: Status 404 returned error can't find the container with id acac043ae9f9bf4d9973d114f2dae9fcde119ffc17deb7cdf85a9c4f90cf7b47
Jul 30 20:35:18.625113 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:35:18.625082    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq" event={"ID":"cb8ab5cd-df26-460b-a347-877891cfb85f","Type":"ContainerStarted","Data":"a16be1a92c89e84919a6deffad837f5deee8fad020a980491d47c5b0e18bca7d"}
Jul 30 20:35:18.625304 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:35:18.625140    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq" event={"ID":"cb8ab5cd-df26-460b-a347-877891cfb85f","Type":"ContainerStarted","Data":"acac043ae9f9bf4d9973d114f2dae9fcde119ffc17deb7cdf85a9c4f90cf7b47"}
Jul 30 20:35:18.625304 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:35:18.625171    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq"
Jul 30 20:35:18.654265 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:35:18.654220    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq" podStartSLOduration=1.654204443 podStartE2EDuration="1.654204443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:35:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:35:18.65231136 +0000 UTC m=+3339.752392548" watchObservedRunningTime="2026-07-30 20:35:18.654204443 +0000 UTC m=+3339.754285647"
Jul 30 20:35:29.631941 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:35:29.631914    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq"
Jul 30 20:35:47.904624 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:35:47.904596    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-h2ldz_e0a217c8-b65d-4969-b065-e411d5be06f9/payload-processing/0.log"
Jul 30 20:35:48.030167 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:35:48.030126    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq_cb8ab5cd-df26-460b-a347-877891cfb85f/payload-processing/0.log"
Jul 30 20:36:38.206446 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:38.206367    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-h2ldz_e0a217c8-b65d-4969-b065-e411d5be06f9/payload-processing/0.log"
Jul 30 20:36:38.340005 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:38.339971    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq_cb8ab5cd-df26-460b-a347-877891cfb85f/payload-processing/0.log"
Jul 30 20:36:43.317864 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:43.317831    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4"]
Jul 30 20:36:43.322153 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:43.322127    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4"
Jul 30 20:36:43.324842 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:43.324819    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-556562-serving-cert\""
Jul 30 20:36:43.334949 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:43.334925    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4"]
Jul 30 20:36:43.493781 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:43.493752    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc70bf7e-4451-489c-b014-45603abaf815-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4\" (UID: \"bc70bf7e-4451-489c-b014-45603abaf815\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4"
Jul 30 20:36:43.493961 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:43.493788    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc70bf7e-4451-489c-b014-45603abaf815-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4\" (UID: \"bc70bf7e-4451-489c-b014-45603abaf815\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4"
Jul 30 20:36:43.493961 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:43.493850    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgw29\" (UniqueName: \"kubernetes.io/projected/bc70bf7e-4451-489c-b014-45603abaf815-kube-api-access-hgw29\") pod \"maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4\" (UID: \"bc70bf7e-4451-489c-b014-45603abaf815\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4"
Jul 30 20:36:43.595482 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:43.595399    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc70bf7e-4451-489c-b014-45603abaf815-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4\" (UID: \"bc70bf7e-4451-489c-b014-45603abaf815\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4"
Jul 30 20:36:43.595482 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:43.595444    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc70bf7e-4451-489c-b014-45603abaf815-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4\" (UID: \"bc70bf7e-4451-489c-b014-45603abaf815\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4"
Jul 30 20:36:43.595740 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:43.595517    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgw29\" (UniqueName: \"kubernetes.io/projected/bc70bf7e-4451-489c-b014-45603abaf815-kube-api-access-hgw29\") pod \"maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4\" (UID: \"bc70bf7e-4451-489c-b014-45603abaf815\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4"
Jul 30 20:36:43.596216 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:43.596185    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc70bf7e-4451-489c-b014-45603abaf815-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4\" (UID: \"bc70bf7e-4451-489c-b014-45603abaf815\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4"
Jul 30 20:36:43.598066 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:43.598046    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc70bf7e-4451-489c-b014-45603abaf815-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4\" (UID: \"bc70bf7e-4451-489c-b014-45603abaf815\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4"
Jul 30 20:36:43.604314 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:43.604294    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgw29\" (UniqueName: \"kubernetes.io/projected/bc70bf7e-4451-489c-b014-45603abaf815-kube-api-access-hgw29\") pod \"maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4\" (UID: \"bc70bf7e-4451-489c-b014-45603abaf815\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4"
Jul 30 20:36:43.636322 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:43.636304    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4"
Jul 30 20:36:43.782085 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:43.782053    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4"]
Jul 30 20:36:43.782833 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:36:43.782811    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc70bf7e_4451_489c_b014_45603abaf815.slice/crio-b476c9351de45e52a8d0f9a43e332d1b8f5c8498b3908b021bae28b67d2b56da WatchSource:0}: Error finding container b476c9351de45e52a8d0f9a43e332d1b8f5c8498b3908b021bae28b67d2b56da: Status 404 returned error can't find the container with id b476c9351de45e52a8d0f9a43e332d1b8f5c8498b3908b021bae28b67d2b56da
Jul 30 20:36:44.111652 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.111610    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4" event={"ID":"bc70bf7e-4451-489c-b014-45603abaf815","Type":"ContainerStarted","Data":"b476c9351de45e52a8d0f9a43e332d1b8f5c8498b3908b021bae28b67d2b56da"}
Jul 30 20:36:44.117584 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.117544    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c"]
Jul 30 20:36:44.123105 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.123085    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c"
Jul 30 20:36:44.125920 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.125897    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-556562\""
Jul 30 20:36:44.132440 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.132417    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c"]
Jul 30 20:36:44.152474 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.152447    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp"]
Jul 30 20:36:44.157009 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.156988    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp"
Jul 30 20:36:44.160442 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.160421    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-556562-dockercfg-jdf4b\""
Jul 30 20:36:44.167516 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.167492    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp"]
Jul 30 20:36:44.201425 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.201394    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2586dcd8-3a7e-4b1d-b94e-061ff68e61ce-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c\" (UID: \"2586dcd8-3a7e-4b1d-b94e-061ff68e61ce\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c"
Jul 30 20:36:44.201538 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.201438    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fvhs\" (UniqueName: \"kubernetes.io/projected/2586dcd8-3a7e-4b1d-b94e-061ff68e61ce-kube-api-access-9fvhs\") pod \"payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c\" (UID: \"2586dcd8-3a7e-4b1d-b94e-061ff68e61ce\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c"
Jul 30 20:36:44.302728 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.302690    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2586dcd8-3a7e-4b1d-b94e-061ff68e61ce-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c\" (UID: \"2586dcd8-3a7e-4b1d-b94e-061ff68e61ce\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c"
Jul 30 20:36:44.302920 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.302749    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fvhs\" (UniqueName: \"kubernetes.io/projected/2586dcd8-3a7e-4b1d-b94e-061ff68e61ce-kube-api-access-9fvhs\") pod \"payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c\" (UID: \"2586dcd8-3a7e-4b1d-b94e-061ff68e61ce\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c"
Jul 30 20:36:44.302920 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.302783    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6769816-3c88-4a2f-ac74-c02b0bbe6df3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp\" (UID: \"f6769816-3c88-4a2f-ac74-c02b0bbe6df3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp"
Jul 30 20:36:44.302920 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.302866    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq6kl\" (UniqueName: \"kubernetes.io/projected/f6769816-3c88-4a2f-ac74-c02b0bbe6df3-kube-api-access-hq6kl\") pod \"payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp\" (UID: \"f6769816-3c88-4a2f-ac74-c02b0bbe6df3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp"
Jul 30 20:36:44.303395 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.303376    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2586dcd8-3a7e-4b1d-b94e-061ff68e61ce-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c\" (UID: \"2586dcd8-3a7e-4b1d-b94e-061ff68e61ce\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c"
Jul 30 20:36:44.310795 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.310767    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fvhs\" (UniqueName: \"kubernetes.io/projected/2586dcd8-3a7e-4b1d-b94e-061ff68e61ce-kube-api-access-9fvhs\") pod \"payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c\" (UID: \"2586dcd8-3a7e-4b1d-b94e-061ff68e61ce\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c"
Jul 30 20:36:44.404082 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.403990    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq6kl\" (UniqueName: \"kubernetes.io/projected/f6769816-3c88-4a2f-ac74-c02b0bbe6df3-kube-api-access-hq6kl\") pod \"payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp\" (UID: \"f6769816-3c88-4a2f-ac74-c02b0bbe6df3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp"
Jul 30 20:36:44.404446 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.404094    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6769816-3c88-4a2f-ac74-c02b0bbe6df3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp\" (UID: \"f6769816-3c88-4a2f-ac74-c02b0bbe6df3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp"
Jul 30 20:36:44.404773 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.404754    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6769816-3c88-4a2f-ac74-c02b0bbe6df3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp\" (UID: \"f6769816-3c88-4a2f-ac74-c02b0bbe6df3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp"
Jul 30 20:36:44.413245 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.413221    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq6kl\" (UniqueName: \"kubernetes.io/projected/f6769816-3c88-4a2f-ac74-c02b0bbe6df3-kube-api-access-hq6kl\") pod \"payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp\" (UID: \"f6769816-3c88-4a2f-ac74-c02b0bbe6df3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp"
Jul 30 20:36:44.436675 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.436646    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c"
Jul 30 20:36:44.469989 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.469955    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp"
Jul 30 20:36:44.605233 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.605201    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c"]
Jul 30 20:36:44.606968 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:36:44.606926    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2586dcd8_3a7e_4b1d_b94e_061ff68e61ce.slice/crio-168fb169b3635dce7d2e51da47507762d61e302022f59b3ef2e0a6e9b402b8b0 WatchSource:0}: Error finding container 168fb169b3635dce7d2e51da47507762d61e302022f59b3ef2e0a6e9b402b8b0: Status 404 returned error can't find the container with id 168fb169b3635dce7d2e51da47507762d61e302022f59b3ef2e0a6e9b402b8b0
Jul 30 20:36:44.848626 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:44.848546    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp"]
Jul 30 20:36:44.849759 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:36:44.849728    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6769816_3c88_4a2f_ac74_c02b0bbe6df3.slice/crio-0108ca5dc3ab4cdba1c2a875d812e1e65c4e23d7bf1930ce332077244b7035a9 WatchSource:0}: Error finding container 0108ca5dc3ab4cdba1c2a875d812e1e65c4e23d7bf1930ce332077244b7035a9: Status 404 returned error can't find the container with id 0108ca5dc3ab4cdba1c2a875d812e1e65c4e23d7bf1930ce332077244b7035a9
Jul 30 20:36:45.119158 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:45.119118    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4" event={"ID":"bc70bf7e-4451-489c-b014-45603abaf815","Type":"ContainerStarted","Data":"655ef587a0061269f7f85c8a091975b199f76a429bd14eba66856b6b482ece64"}
Jul 30 20:36:45.119358 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:45.119182    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4"
Jul 30 20:36:45.120848 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:45.120820    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c" event={"ID":"2586dcd8-3a7e-4b1d-b94e-061ff68e61ce","Type":"ContainerStarted","Data":"672db56ea46a7c1b4e7613a07d1852b0d5a524521d305c977f625af5a7c84d4b"}
Jul 30 20:36:45.120990 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:45.120868    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c" event={"ID":"2586dcd8-3a7e-4b1d-b94e-061ff68e61ce","Type":"ContainerStarted","Data":"168fb169b3635dce7d2e51da47507762d61e302022f59b3ef2e0a6e9b402b8b0"}
Jul 30 20:36:45.120990 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:45.120898    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c"
Jul 30 20:36:45.122455 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:45.122433    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp" event={"ID":"f6769816-3c88-4a2f-ac74-c02b0bbe6df3","Type":"ContainerStarted","Data":"f27ab16d8c7e9e4c18526e3bc5737bdf75585c0cbbc656194f4b4f0e28fb9d83"}
Jul 30 20:36:45.122560 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:45.122471    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp" event={"ID":"f6769816-3c88-4a2f-ac74-c02b0bbe6df3","Type":"ContainerStarted","Data":"0108ca5dc3ab4cdba1c2a875d812e1e65c4e23d7bf1930ce332077244b7035a9"}
Jul 30 20:36:45.122560 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:45.122507    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp"
Jul 30 20:36:45.135326 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:45.135288    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4" podStartSLOduration=1.7331321640000001 podStartE2EDuration="2.135274971s" totalImagesPullingTime="402.142807ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:36:45.134177308 +0000 UTC m=+3426.234258496" watchObservedRunningTime="2026-07-30 20:36:45.135274971 +0000 UTC m=+3426.235356158"
Jul 30 20:36:45.151494 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:45.151447    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp" podStartSLOduration=1.151432847 podStartE2EDuration="1.151432847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:36:45.149525519 +0000 UTC m=+3426.249606732" watchObservedRunningTime="2026-07-30 20:36:45.151432847 +0000 UTC m=+3426.251514034"
Jul 30 20:36:45.166009 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:45.165929    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c" podStartSLOduration=1.165917287 podStartE2EDuration="1.165917287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:36:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:36:45.163838811 +0000 UTC m=+3426.263920022" watchObservedRunningTime="2026-07-30 20:36:45.165917287 +0000 UTC m=+3426.265998505"
Jul 30 20:36:51.133391 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:51.133357    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4"
Jul 30 20:36:56.129921 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:56.129888    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c"
Jul 30 20:36:56.130328 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:36:56.130024    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp"
Jul 30 20:37:14.018102 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.016862    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4"]
Jul 30 20:37:14.018102 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.017119    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4" podUID="bc70bf7e-4451-489c-b014-45603abaf815" containerName="maas-api" containerID="cri-o://655ef587a0061269f7f85c8a091975b199f76a429bd14eba66856b6b482ece64" gracePeriod=30
Jul 30 20:37:14.069106 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.069069    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp"]
Jul 30 20:37:14.069360 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.069311    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp" podUID="f6769816-3c88-4a2f-ac74-c02b0bbe6df3" containerName="payload-processing" containerID="cri-o://f27ab16d8c7e9e4c18526e3bc5737bdf75585c0cbbc656194f4b4f0e28fb9d83" gracePeriod=30
Jul 30 20:37:14.075469 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.075442    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c"]
Jul 30 20:37:14.075715 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.075692    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c" podUID="2586dcd8-3a7e-4b1d-b94e-061ff68e61ce" containerName="payload-pre-processing" containerID="cri-o://672db56ea46a7c1b4e7613a07d1852b0d5a524521d305c977f625af5a7c84d4b" gracePeriod=30
Jul 30 20:37:14.318751 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.318588    2568 generic.go:356] "Generic (PLEG): container finished" podID="2586dcd8-3a7e-4b1d-b94e-061ff68e61ce" containerID="672db56ea46a7c1b4e7613a07d1852b0d5a524521d305c977f625af5a7c84d4b" exitCode=0
Jul 30 20:37:14.318751 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.318597    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c" event={"ID":"2586dcd8-3a7e-4b1d-b94e-061ff68e61ce","Type":"ContainerDied","Data":"672db56ea46a7c1b4e7613a07d1852b0d5a524521d305c977f625af5a7c84d4b"}
Jul 30 20:37:14.320388 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.320365    2568 generic.go:356] "Generic (PLEG): container finished" podID="f6769816-3c88-4a2f-ac74-c02b0bbe6df3" containerID="f27ab16d8c7e9e4c18526e3bc5737bdf75585c0cbbc656194f4b4f0e28fb9d83" exitCode=0
Jul 30 20:37:14.320528 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.320421    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp" event={"ID":"f6769816-3c88-4a2f-ac74-c02b0bbe6df3","Type":"ContainerDied","Data":"f27ab16d8c7e9e4c18526e3bc5737bdf75585c0cbbc656194f4b4f0e28fb9d83"}
Jul 30 20:37:14.322329 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.322204    2568 generic.go:356] "Generic (PLEG): container finished" podID="bc70bf7e-4451-489c-b014-45603abaf815" containerID="655ef587a0061269f7f85c8a091975b199f76a429bd14eba66856b6b482ece64" exitCode=0
Jul 30 20:37:14.322329 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.322258    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4" event={"ID":"bc70bf7e-4451-489c-b014-45603abaf815","Type":"ContainerDied","Data":"655ef587a0061269f7f85c8a091975b199f76a429bd14eba66856b6b482ece64"}
Jul 30 20:37:14.360876 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.360850    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp"
Jul 30 20:37:14.422941 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.422916    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4"
Jul 30 20:37:14.426263 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.426246    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c"
Jul 30 20:37:14.523153 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.523114    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hq6kl\" (UniqueName: \"kubernetes.io/projected/f6769816-3c88-4a2f-ac74-c02b0bbe6df3-kube-api-access-hq6kl\") pod \"f6769816-3c88-4a2f-ac74-c02b0bbe6df3\" (UID: \"f6769816-3c88-4a2f-ac74-c02b0bbe6df3\") "
Jul 30 20:37:14.523339 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.523173    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc70bf7e-4451-489c-b014-45603abaf815-maas-api-tls\") pod \"bc70bf7e-4451-489c-b014-45603abaf815\" (UID: \"bc70bf7e-4451-489c-b014-45603abaf815\") "
Jul 30 20:37:14.523339 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.523207    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fvhs\" (UniqueName: \"kubernetes.io/projected/2586dcd8-3a7e-4b1d-b94e-061ff68e61ce-kube-api-access-9fvhs\") pod \"2586dcd8-3a7e-4b1d-b94e-061ff68e61ce\" (UID: \"2586dcd8-3a7e-4b1d-b94e-061ff68e61ce\") "
Jul 30 20:37:14.523339 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.523232    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc70bf7e-4451-489c-b014-45603abaf815-openshift-service-ca\") pod \"bc70bf7e-4451-489c-b014-45603abaf815\" (UID: \"bc70bf7e-4451-489c-b014-45603abaf815\") "
Jul 30 20:37:14.523339 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.523289    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgw29\" (UniqueName: \"kubernetes.io/projected/bc70bf7e-4451-489c-b014-45603abaf815-kube-api-access-hgw29\") pod \"bc70bf7e-4451-489c-b014-45603abaf815\" (UID: \"bc70bf7e-4451-489c-b014-45603abaf815\") "
Jul 30 20:37:14.523599 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.523416    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6769816-3c88-4a2f-ac74-c02b0bbe6df3-plugins-config-volume\") pod \"f6769816-3c88-4a2f-ac74-c02b0bbe6df3\" (UID: \"f6769816-3c88-4a2f-ac74-c02b0bbe6df3\") "
Jul 30 20:37:14.523599 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.523467    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2586dcd8-3a7e-4b1d-b94e-061ff68e61ce-plugins-config-volume\") pod \"2586dcd8-3a7e-4b1d-b94e-061ff68e61ce\" (UID: \"2586dcd8-3a7e-4b1d-b94e-061ff68e61ce\") "
Jul 30 20:37:14.523819 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.523788    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc70bf7e-4451-489c-b014-45603abaf815-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bc70bf7e-4451-489c-b014-45603abaf815" (UID: "bc70bf7e-4451-489c-b014-45603abaf815"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:37:14.523897 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.523877    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6769816-3c88-4a2f-ac74-c02b0bbe6df3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f6769816-3c88-4a2f-ac74-c02b0bbe6df3" (UID: "f6769816-3c88-4a2f-ac74-c02b0bbe6df3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:37:14.524153 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.524130    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2586dcd8-3a7e-4b1d-b94e-061ff68e61ce-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2586dcd8-3a7e-4b1d-b94e-061ff68e61ce" (UID: "2586dcd8-3a7e-4b1d-b94e-061ff68e61ce"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:37:14.524274 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.524260    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc70bf7e-4451-489c-b014-45603abaf815-openshift-service-ca\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:37:14.524334 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.524281    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6769816-3c88-4a2f-ac74-c02b0bbe6df3-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:37:14.524334 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.524297    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2586dcd8-3a7e-4b1d-b94e-061ff68e61ce-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:37:14.525499 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.525476    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc70bf7e-4451-489c-b014-45603abaf815-kube-api-access-hgw29" (OuterVolumeSpecName: "kube-api-access-hgw29") pod "bc70bf7e-4451-489c-b014-45603abaf815" (UID: "bc70bf7e-4451-489c-b014-45603abaf815"). InnerVolumeSpecName "kube-api-access-hgw29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:37:14.525613 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.525521    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6769816-3c88-4a2f-ac74-c02b0bbe6df3-kube-api-access-hq6kl" (OuterVolumeSpecName: "kube-api-access-hq6kl") pod "f6769816-3c88-4a2f-ac74-c02b0bbe6df3" (UID: "f6769816-3c88-4a2f-ac74-c02b0bbe6df3"). InnerVolumeSpecName "kube-api-access-hq6kl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:37:14.525855 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.525839    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2586dcd8-3a7e-4b1d-b94e-061ff68e61ce-kube-api-access-9fvhs" (OuterVolumeSpecName: "kube-api-access-9fvhs") pod "2586dcd8-3a7e-4b1d-b94e-061ff68e61ce" (UID: "2586dcd8-3a7e-4b1d-b94e-061ff68e61ce"). InnerVolumeSpecName "kube-api-access-9fvhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:37:14.525855 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.525844    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc70bf7e-4451-489c-b014-45603abaf815-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bc70bf7e-4451-489c-b014-45603abaf815" (UID: "bc70bf7e-4451-489c-b014-45603abaf815"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:37:14.625836 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.625749    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc70bf7e-4451-489c-b014-45603abaf815-maas-api-tls\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:37:14.625836 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.625781    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fvhs\" (UniqueName: \"kubernetes.io/projected/2586dcd8-3a7e-4b1d-b94e-061ff68e61ce-kube-api-access-9fvhs\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:37:14.625836 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.625794    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgw29\" (UniqueName: \"kubernetes.io/projected/bc70bf7e-4451-489c-b014-45603abaf815-kube-api-access-hgw29\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:37:14.625836 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:14.625807    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hq6kl\" (UniqueName: \"kubernetes.io/projected/f6769816-3c88-4a2f-ac74-c02b0bbe6df3-kube-api-access-hq6kl\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:37:15.328747 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:15.328718    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4"
Jul 30 20:37:15.329200 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:15.328745    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4" event={"ID":"bc70bf7e-4451-489c-b014-45603abaf815","Type":"ContainerDied","Data":"b476c9351de45e52a8d0f9a43e332d1b8f5c8498b3908b021bae28b67d2b56da"}
Jul 30 20:37:15.329200 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:15.328808    2568 scope.go:117] "RemoveContainer" containerID="655ef587a0061269f7f85c8a091975b199f76a429bd14eba66856b6b482ece64"
Jul 30 20:37:15.330282 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:15.330259    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c"
Jul 30 20:37:15.330378 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:15.330262    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c" event={"ID":"2586dcd8-3a7e-4b1d-b94e-061ff68e61ce","Type":"ContainerDied","Data":"168fb169b3635dce7d2e51da47507762d61e302022f59b3ef2e0a6e9b402b8b0"}
Jul 30 20:37:15.331612 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:15.331588    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp"
Jul 30 20:37:15.331721 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:15.331588    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp" event={"ID":"f6769816-3c88-4a2f-ac74-c02b0bbe6df3","Type":"ContainerDied","Data":"0108ca5dc3ab4cdba1c2a875d812e1e65c4e23d7bf1930ce332077244b7035a9"}
Jul 30 20:37:15.347054 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:15.347031    2568 scope.go:117] "RemoveContainer" containerID="672db56ea46a7c1b4e7613a07d1852b0d5a524521d305c977f625af5a7c84d4b"
Jul 30 20:37:15.358940 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:15.358912    2568 scope.go:117] "RemoveContainer" containerID="f27ab16d8c7e9e4c18526e3bc5737bdf75585c0cbbc656194f4b4f0e28fb9d83"
Jul 30 20:37:15.366206 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:15.366181    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c"]
Jul 30 20:37:15.372036 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:15.372016    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-556562-6fc9cd5fcb-6bl9c"]
Jul 30 20:37:15.382167 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:15.382148    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4"]
Jul 30 20:37:15.386366 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:15.386342    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-556562-64d96db4b4-qrjc4"]
Jul 30 20:37:15.396390 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:15.396366    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp"]
Jul 30 20:37:15.399938 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:15.399920    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-556562-54dd65b666-rl7sp"]
Jul 30 20:37:15.481919 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:15.481891    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2586dcd8-3a7e-4b1d-b94e-061ff68e61ce" path="/var/lib/kubelet/pods/2586dcd8-3a7e-4b1d-b94e-061ff68e61ce/volumes"
Jul 30 20:37:15.482353 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:15.482339    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc70bf7e-4451-489c-b014-45603abaf815" path="/var/lib/kubelet/pods/bc70bf7e-4451-489c-b014-45603abaf815/volumes"
Jul 30 20:37:15.482688 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:15.482675    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6769816-3c88-4a2f-ac74-c02b0bbe6df3" path="/var/lib/kubelet/pods/f6769816-3c88-4a2f-ac74-c02b0bbe6df3/volumes"
Jul 30 20:37:39.928150 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:39.928101    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db"]
Jul 30 20:37:39.929028 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:39.928968    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db" podUID="f6b3a864-7d54-4660-aad7-41ced344fac3" containerName="maas-api" containerID="cri-o://dc3bda345fdc1fc32e35483cc5cdb6304a6e37d4bd8115d13982f8d6a3e1c291" gracePeriod=30
Jul 30 20:37:39.986740 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:39.986697    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87"]
Jul 30 20:37:40.232646 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.232616    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db"
Jul 30 20:37:40.275524 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.275491    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6b3a864-7d54-4660-aad7-41ced344fac3-maas-api-tls\") pod \"f6b3a864-7d54-4660-aad7-41ced344fac3\" (UID: \"f6b3a864-7d54-4660-aad7-41ced344fac3\") "
Jul 30 20:37:40.275749 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.275625    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6b3a864-7d54-4660-aad7-41ced344fac3-openshift-service-ca\") pod \"f6b3a864-7d54-4660-aad7-41ced344fac3\" (UID: \"f6b3a864-7d54-4660-aad7-41ced344fac3\") "
Jul 30 20:37:40.275749 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.275739    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbtzg\" (UniqueName: \"kubernetes.io/projected/f6b3a864-7d54-4660-aad7-41ced344fac3-kube-api-access-mbtzg\") pod \"f6b3a864-7d54-4660-aad7-41ced344fac3\" (UID: \"f6b3a864-7d54-4660-aad7-41ced344fac3\") "
Jul 30 20:37:40.276047 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.276021    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6b3a864-7d54-4660-aad7-41ced344fac3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f6b3a864-7d54-4660-aad7-41ced344fac3" (UID: "f6b3a864-7d54-4660-aad7-41ced344fac3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:37:40.278040 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.278006    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6b3a864-7d54-4660-aad7-41ced344fac3-kube-api-access-mbtzg" (OuterVolumeSpecName: "kube-api-access-mbtzg") pod "f6b3a864-7d54-4660-aad7-41ced344fac3" (UID: "f6b3a864-7d54-4660-aad7-41ced344fac3"). InnerVolumeSpecName "kube-api-access-mbtzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:37:40.278040 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.278033    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6b3a864-7d54-4660-aad7-41ced344fac3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f6b3a864-7d54-4660-aad7-41ced344fac3" (UID: "f6b3a864-7d54-4660-aad7-41ced344fac3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:37:40.376731 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.376697    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6b3a864-7d54-4660-aad7-41ced344fac3-openshift-service-ca\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:37:40.376731 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.376723    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbtzg\" (UniqueName: \"kubernetes.io/projected/f6b3a864-7d54-4660-aad7-41ced344fac3-kube-api-access-mbtzg\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:37:40.376731 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.376734    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6b3a864-7d54-4660-aad7-41ced344fac3-maas-api-tls\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:37:40.481803 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.481712    2568 generic.go:356] "Generic (PLEG): container finished" podID="f6b3a864-7d54-4660-aad7-41ced344fac3" containerID="dc3bda345fdc1fc32e35483cc5cdb6304a6e37d4bd8115d13982f8d6a3e1c291" exitCode=0
Jul 30 20:37:40.481803 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.481751    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db"
Jul 30 20:37:40.482002 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.481794    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db" event={"ID":"f6b3a864-7d54-4660-aad7-41ced344fac3","Type":"ContainerDied","Data":"dc3bda345fdc1fc32e35483cc5cdb6304a6e37d4bd8115d13982f8d6a3e1c291"}
Jul 30 20:37:40.482002 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.481857    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db" event={"ID":"f6b3a864-7d54-4660-aad7-41ced344fac3","Type":"ContainerDied","Data":"1fdf358c5cbed4f10777379b0224c3664ddad954674f0dd73f34666fe3e688a9"}
Jul 30 20:37:40.482002 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.481885    2568 scope.go:117] "RemoveContainer" containerID="dc3bda345fdc1fc32e35483cc5cdb6304a6e37d4bd8115d13982f8d6a3e1c291"
Jul 30 20:37:40.482175 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.482018    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87" podUID="85bc8fd0-3e72-416e-a032-f8358cb4ca67" containerName="payload-pre-processing" containerID="cri-o://085ae2f5b9486a3d66afcb11620e5e41d5147af7bd5a03d2478300aa930224a4" gracePeriod=30
Jul 30 20:37:40.493714 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.493694    2568 scope.go:117] "RemoveContainer" containerID="dc3bda345fdc1fc32e35483cc5cdb6304a6e37d4bd8115d13982f8d6a3e1c291"
Jul 30 20:37:40.494039 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:37:40.494021    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc3bda345fdc1fc32e35483cc5cdb6304a6e37d4bd8115d13982f8d6a3e1c291\": container with ID starting with dc3bda345fdc1fc32e35483cc5cdb6304a6e37d4bd8115d13982f8d6a3e1c291 not found: ID does not exist" containerID="dc3bda345fdc1fc32e35483cc5cdb6304a6e37d4bd8115d13982f8d6a3e1c291"
Jul 30 20:37:40.494103 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.494046    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc3bda345fdc1fc32e35483cc5cdb6304a6e37d4bd8115d13982f8d6a3e1c291"} err="failed to get container status \"dc3bda345fdc1fc32e35483cc5cdb6304a6e37d4bd8115d13982f8d6a3e1c291\": rpc error: code = NotFound desc = could not find container \"dc3bda345fdc1fc32e35483cc5cdb6304a6e37d4bd8115d13982f8d6a3e1c291\": container with ID starting with dc3bda345fdc1fc32e35483cc5cdb6304a6e37d4bd8115d13982f8d6a3e1c291 not found: ID does not exist"
Jul 30 20:37:40.575988 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.575952    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db"]
Jul 30 20:37:40.580276 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.580245    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7f2993-cc9b88d7d-h58db"]
Jul 30 20:37:40.752436 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.752411    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87"
Jul 30 20:37:40.881560 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.881522    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpzm7\" (UniqueName: \"kubernetes.io/projected/85bc8fd0-3e72-416e-a032-f8358cb4ca67-kube-api-access-fpzm7\") pod \"85bc8fd0-3e72-416e-a032-f8358cb4ca67\" (UID: \"85bc8fd0-3e72-416e-a032-f8358cb4ca67\") "
Jul 30 20:37:40.881753 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.881688    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85bc8fd0-3e72-416e-a032-f8358cb4ca67-plugins-config-volume\") pod \"85bc8fd0-3e72-416e-a032-f8358cb4ca67\" (UID: \"85bc8fd0-3e72-416e-a032-f8358cb4ca67\") "
Jul 30 20:37:40.882058 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.882025    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85bc8fd0-3e72-416e-a032-f8358cb4ca67-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "85bc8fd0-3e72-416e-a032-f8358cb4ca67" (UID: "85bc8fd0-3e72-416e-a032-f8358cb4ca67"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:37:40.883651 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.883629    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85bc8fd0-3e72-416e-a032-f8358cb4ca67-kube-api-access-fpzm7" (OuterVolumeSpecName: "kube-api-access-fpzm7") pod "85bc8fd0-3e72-416e-a032-f8358cb4ca67" (UID: "85bc8fd0-3e72-416e-a032-f8358cb4ca67"). InnerVolumeSpecName "kube-api-access-fpzm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:37:40.983363 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.983322    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85bc8fd0-3e72-416e-a032-f8358cb4ca67-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:37:40.983363 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:40.983355    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpzm7\" (UniqueName: \"kubernetes.io/projected/85bc8fd0-3e72-416e-a032-f8358cb4ca67-kube-api-access-fpzm7\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:37:41.482092 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:41.482049    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6b3a864-7d54-4660-aad7-41ced344fac3" path="/var/lib/kubelet/pods/f6b3a864-7d54-4660-aad7-41ced344fac3/volumes"
Jul 30 20:37:41.489635 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:41.489603    2568 generic.go:356] "Generic (PLEG): container finished" podID="85bc8fd0-3e72-416e-a032-f8358cb4ca67" containerID="085ae2f5b9486a3d66afcb11620e5e41d5147af7bd5a03d2478300aa930224a4" exitCode=0
Jul 30 20:37:41.489814 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:41.489642    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87" event={"ID":"85bc8fd0-3e72-416e-a032-f8358cb4ca67","Type":"ContainerDied","Data":"085ae2f5b9486a3d66afcb11620e5e41d5147af7bd5a03d2478300aa930224a4"}
Jul 30 20:37:41.489880 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:41.489834    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87" event={"ID":"85bc8fd0-3e72-416e-a032-f8358cb4ca67","Type":"ContainerDied","Data":"ebb3e3b3e16bb5800f9ae18da60616d7cb1a379611b537fafddcafd9fafb5444"}
Jul 30 20:37:41.489880 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:41.489666    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87"
Jul 30 20:37:41.489971 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:41.489872    2568 scope.go:117] "RemoveContainer" containerID="085ae2f5b9486a3d66afcb11620e5e41d5147af7bd5a03d2478300aa930224a4"
Jul 30 20:37:41.499014 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:41.498998    2568 scope.go:117] "RemoveContainer" containerID="085ae2f5b9486a3d66afcb11620e5e41d5147af7bd5a03d2478300aa930224a4"
Jul 30 20:37:41.499264 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:37:41.499247    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"085ae2f5b9486a3d66afcb11620e5e41d5147af7bd5a03d2478300aa930224a4\": container with ID starting with 085ae2f5b9486a3d66afcb11620e5e41d5147af7bd5a03d2478300aa930224a4 not found: ID does not exist" containerID="085ae2f5b9486a3d66afcb11620e5e41d5147af7bd5a03d2478300aa930224a4"
Jul 30 20:37:41.499312 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:41.499272    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"085ae2f5b9486a3d66afcb11620e5e41d5147af7bd5a03d2478300aa930224a4"} err="failed to get container status \"085ae2f5b9486a3d66afcb11620e5e41d5147af7bd5a03d2478300aa930224a4\": rpc error: code = NotFound desc = could not find container \"085ae2f5b9486a3d66afcb11620e5e41d5147af7bd5a03d2478300aa930224a4\": container with ID starting with 085ae2f5b9486a3d66afcb11620e5e41d5147af7bd5a03d2478300aa930224a4 not found: ID does not exist"
Jul 30 20:37:41.508541 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:41.508508    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87"]
Jul 30 20:37:41.510838 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:41.510811    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-7f2993-7fd58488bd-sjx87"]
Jul 30 20:37:43.481959 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:37:43.481928    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85bc8fd0-3e72-416e-a032-f8358cb4ca67" path="/var/lib/kubelet/pods/85bc8fd0-3e72-416e-a032-f8358cb4ca67/volumes"
Jul 30 20:38:43.030548 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.030509    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d3c06-2fxlh"]
Jul 30 20:38:43.031233 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.031213    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85bc8fd0-3e72-416e-a032-f8358cb4ca67" containerName="payload-pre-processing"
Jul 30 20:38:43.031233 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.031233    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="85bc8fd0-3e72-416e-a032-f8358cb4ca67" containerName="payload-pre-processing"
Jul 30 20:38:43.031366 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.031253    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6b3a864-7d54-4660-aad7-41ced344fac3" containerName="maas-api"
Jul 30 20:38:43.031366 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.031259    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6b3a864-7d54-4660-aad7-41ced344fac3" containerName="maas-api"
Jul 30 20:38:43.031366 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.031272    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc70bf7e-4451-489c-b014-45603abaf815" containerName="maas-api"
Jul 30 20:38:43.031366 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.031278    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc70bf7e-4451-489c-b014-45603abaf815" containerName="maas-api"
Jul 30 20:38:43.031366 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.031288    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6769816-3c88-4a2f-ac74-c02b0bbe6df3" containerName="payload-processing"
Jul 30 20:38:43.031366 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.031293    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6769816-3c88-4a2f-ac74-c02b0bbe6df3" containerName="payload-processing"
Jul 30 20:38:43.031366 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.031304    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2586dcd8-3a7e-4b1d-b94e-061ff68e61ce" containerName="payload-pre-processing"
Jul 30 20:38:43.031366 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.031309    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2586dcd8-3a7e-4b1d-b94e-061ff68e61ce" containerName="payload-pre-processing"
Jul 30 20:38:43.031733 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.031381    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2586dcd8-3a7e-4b1d-b94e-061ff68e61ce" containerName="payload-pre-processing"
Jul 30 20:38:43.031733 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.031391    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6769816-3c88-4a2f-ac74-c02b0bbe6df3" containerName="payload-processing"
Jul 30 20:38:43.031733 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.031400    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="85bc8fd0-3e72-416e-a032-f8358cb4ca67" containerName="payload-pre-processing"
Jul 30 20:38:43.031733 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.031406    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc70bf7e-4451-489c-b014-45603abaf815" containerName="maas-api"
Jul 30 20:38:43.031733 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.031416    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6b3a864-7d54-4660-aad7-41ced344fac3" containerName="maas-api"
Jul 30 20:38:43.036174 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.036159    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d3c06-2fxlh"
Jul 30 20:38:43.038862 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.038830    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mgdxn\""
Jul 30 20:38:43.040151 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.040124    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d3c06-2fxlh"]
Jul 30 20:38:43.151025 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.150996    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1c47a6-ccff-49b5-81d2-422c6569c748-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-9d3c06-2fxlh\" (UID: \"2d1c47a6-ccff-49b5-81d2-422c6569c748\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d3c06-2fxlh"
Jul 30 20:38:43.251515 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.251488    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1c47a6-ccff-49b5-81d2-422c6569c748-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-9d3c06-2fxlh\" (UID: \"2d1c47a6-ccff-49b5-81d2-422c6569c748\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d3c06-2fxlh"
Jul 30 20:38:43.252190 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.252165    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1c47a6-ccff-49b5-81d2-422c6569c748-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-9d3c06-2fxlh\" (UID: \"2d1c47a6-ccff-49b5-81d2-422c6569c748\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d3c06-2fxlh"
Jul 30 20:38:43.350544 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.350522    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d3c06-2fxlh"
Jul 30 20:38:43.485271 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.485241    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d3c06-2fxlh"]
Jul 30 20:38:43.486939 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:38:43.486910    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d1c47a6_ccff_49b5_81d2_422c6569c748.slice/crio-785ae1698e672ce60a5ae75f116941a0e5569e1e574669a0c38648db00e47a1f WatchSource:0}: Error finding container 785ae1698e672ce60a5ae75f116941a0e5569e1e574669a0c38648db00e47a1f: Status 404 returned error can't find the container with id 785ae1698e672ce60a5ae75f116941a0e5569e1e574669a0c38648db00e47a1f
Jul 30 20:38:43.838281 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.838251    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d3c06-2fxlh" event={"ID":"2d1c47a6-ccff-49b5-81d2-422c6569c748","Type":"ContainerStarted","Data":"4f4aab862f070fed1838b19f2ef4def65ba0b33f71eb65cd9906deb2c9c3d57d"}
Jul 30 20:38:43.838405 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.838315    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d3c06-2fxlh" event={"ID":"2d1c47a6-ccff-49b5-81d2-422c6569c748","Type":"ContainerStarted","Data":"785ae1698e672ce60a5ae75f116941a0e5569e1e574669a0c38648db00e47a1f"}
Jul 30 20:38:43.854863 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:43.854822    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d3c06-2fxlh" podStartSLOduration=0.854809026 podStartE2EDuration="854.809026ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:38:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:38:43.852098198 +0000 UTC m=+3544.952179382" watchObservedRunningTime="2026-07-30 20:38:43.854809026 +0000 UTC m=+3544.954890214"
Jul 30 20:38:44.846235 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:44.846195    2568 generic.go:356] "Generic (PLEG): container finished" podID="2d1c47a6-ccff-49b5-81d2-422c6569c748" containerID="4f4aab862f070fed1838b19f2ef4def65ba0b33f71eb65cd9906deb2c9c3d57d" exitCode=0
Jul 30 20:38:44.846700 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:44.846276    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d3c06-2fxlh" event={"ID":"2d1c47a6-ccff-49b5-81d2-422c6569c748","Type":"ContainerDied","Data":"4f4aab862f070fed1838b19f2ef4def65ba0b33f71eb65cd9906deb2c9c3d57d"}
Jul 30 20:38:45.992076 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:45.992047    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d3c06-2fxlh"
Jul 30 20:38:46.081869 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:46.081844    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1c47a6-ccff-49b5-81d2-422c6569c748-maas-api-service-ca\") pod \"2d1c47a6-ccff-49b5-81d2-422c6569c748\" (UID: \"2d1c47a6-ccff-49b5-81d2-422c6569c748\") "
Jul 30 20:38:46.082180 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:46.082159    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d1c47a6-ccff-49b5-81d2-422c6569c748-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2d1c47a6-ccff-49b5-81d2-422c6569c748" (UID: "2d1c47a6-ccff-49b5-81d2-422c6569c748"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:38:46.182847 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:46.182789    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d1c47a6-ccff-49b5-81d2-422c6569c748-maas-api-service-ca\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:38:46.859531 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:46.859502    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d3c06-2fxlh"
Jul 30 20:38:46.859531 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:46.859526    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d3c06-2fxlh" event={"ID":"2d1c47a6-ccff-49b5-81d2-422c6569c748","Type":"ContainerDied","Data":"785ae1698e672ce60a5ae75f116941a0e5569e1e574669a0c38648db00e47a1f"}
Jul 30 20:38:46.859763 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:46.859591    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="785ae1698e672ce60a5ae75f116941a0e5569e1e574669a0c38648db00e47a1f"
Jul 30 20:38:53.521100 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:53.521063    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq"]
Jul 30 20:38:53.521641 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:53.521292    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq" podUID="cb8ab5cd-df26-460b-a347-877891cfb85f" containerName="payload-processing" containerID="cri-o://a16be1a92c89e84919a6deffad837f5deee8fad020a980491d47c5b0e18bca7d" gracePeriod=30
Jul 30 20:38:53.665248 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:53.665211    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d3c06-2fxlh"]
Jul 30 20:38:53.667443 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:53.667421    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9d3c06-2fxlh"]
Jul 30 20:38:53.786026 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:53.785969    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq"
Jul 30 20:38:53.852641 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:53.852611    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74bbn\" (UniqueName: \"kubernetes.io/projected/cb8ab5cd-df26-460b-a347-877891cfb85f-kube-api-access-74bbn\") pod \"cb8ab5cd-df26-460b-a347-877891cfb85f\" (UID: \"cb8ab5cd-df26-460b-a347-877891cfb85f\") "
Jul 30 20:38:53.852802 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:53.852679    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb8ab5cd-df26-460b-a347-877891cfb85f-plugins-config-volume\") pod \"cb8ab5cd-df26-460b-a347-877891cfb85f\" (UID: \"cb8ab5cd-df26-460b-a347-877891cfb85f\") "
Jul 30 20:38:53.853075 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:53.853049    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb8ab5cd-df26-460b-a347-877891cfb85f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cb8ab5cd-df26-460b-a347-877891cfb85f" (UID: "cb8ab5cd-df26-460b-a347-877891cfb85f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:38:53.854888 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:53.854861    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb8ab5cd-df26-460b-a347-877891cfb85f-kube-api-access-74bbn" (OuterVolumeSpecName: "kube-api-access-74bbn") pod "cb8ab5cd-df26-460b-a347-877891cfb85f" (UID: "cb8ab5cd-df26-460b-a347-877891cfb85f"). InnerVolumeSpecName "kube-api-access-74bbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:38:53.897254 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:53.897231    2568 generic.go:356] "Generic (PLEG): container finished" podID="cb8ab5cd-df26-460b-a347-877891cfb85f" containerID="a16be1a92c89e84919a6deffad837f5deee8fad020a980491d47c5b0e18bca7d" exitCode=0
Jul 30 20:38:53.897366 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:53.897272    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq" event={"ID":"cb8ab5cd-df26-460b-a347-877891cfb85f","Type":"ContainerDied","Data":"a16be1a92c89e84919a6deffad837f5deee8fad020a980491d47c5b0e18bca7d"}
Jul 30 20:38:53.897366 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:53.897276    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq"
Jul 30 20:38:53.897366 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:53.897310    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq" event={"ID":"cb8ab5cd-df26-460b-a347-877891cfb85f","Type":"ContainerDied","Data":"acac043ae9f9bf4d9973d114f2dae9fcde119ffc17deb7cdf85a9c4f90cf7b47"}
Jul 30 20:38:53.897366 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:53.897331    2568 scope.go:117] "RemoveContainer" containerID="a16be1a92c89e84919a6deffad837f5deee8fad020a980491d47c5b0e18bca7d"
Jul 30 20:38:53.907361 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:53.907339    2568 scope.go:117] "RemoveContainer" containerID="a16be1a92c89e84919a6deffad837f5deee8fad020a980491d47c5b0e18bca7d"
Jul 30 20:38:53.907612 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:38:53.907560    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a16be1a92c89e84919a6deffad837f5deee8fad020a980491d47c5b0e18bca7d\": container with ID starting with a16be1a92c89e84919a6deffad837f5deee8fad020a980491d47c5b0e18bca7d not found: ID does not exist" containerID="a16be1a92c89e84919a6deffad837f5deee8fad020a980491d47c5b0e18bca7d"
Jul 30 20:38:53.907725 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:53.907618    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a16be1a92c89e84919a6deffad837f5deee8fad020a980491d47c5b0e18bca7d"} err="failed to get container status \"a16be1a92c89e84919a6deffad837f5deee8fad020a980491d47c5b0e18bca7d\": rpc error: code = NotFound desc = could not find container \"a16be1a92c89e84919a6deffad837f5deee8fad020a980491d47c5b0e18bca7d\": container with ID starting with a16be1a92c89e84919a6deffad837f5deee8fad020a980491d47c5b0e18bca7d not found: ID does not exist"
Jul 30 20:38:53.918518 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:53.918485    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq"]
Jul 30 20:38:53.924463 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:53.924444    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-9d3c06-5f6fc6f5c4-ldnrq"]
Jul 30 20:38:53.953676 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:53.953641    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb8ab5cd-df26-460b-a347-877891cfb85f-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:38:53.953817 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:53.953701    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74bbn\" (UniqueName: \"kubernetes.io/projected/cb8ab5cd-df26-460b-a347-877891cfb85f-kube-api-access-74bbn\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:38:55.482275 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:55.482240    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d1c47a6-ccff-49b5-81d2-422c6569c748" path="/var/lib/kubelet/pods/2d1c47a6-ccff-49b5-81d2-422c6569c748/volumes"
Jul 30 20:38:55.482661 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:38:55.482631    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb8ab5cd-df26-460b-a347-877891cfb85f" path="/var/lib/kubelet/pods/cb8ab5cd-df26-460b-a347-877891cfb85f/volumes"
Jul 30 20:39:10.707948 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:10.707915    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"]
Jul 30 20:39:10.708439 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:10.708165    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb" podUID="2ec33da1-b03b-4486-aff3-d4b9b3cc80e9" containerName="maas-api" containerID="cri-o://7f9a452033fbfedd72e51b99d1e115e4cdabd04588f72207452dd2ba887d159d" gracePeriod=30
Jul 30 20:39:10.767234 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:10.767202    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9"]
Jul 30 20:39:10.767808 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:10.767481    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9" podUID="3cf5ec77-df84-46a3-ae96-09e89718fab8" containerName="payload-processing" containerID="cri-o://0ef946971090238444f499cfd8fae7a7d107e53a18e3fb52560a5cc8665268e8" gracePeriod=30
Jul 30 20:39:10.776382 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:10.776352    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q"]
Jul 30 20:39:10.777519 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:10.777010    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q" podUID="107449eb-d24e-4317-8a79-8e994fa3562b" containerName="payload-pre-processing" containerID="cri-o://542de79dc0027806219c4bf99b3150283f408dd1b186248bdbbd3cd742f30e88" gracePeriod=30
Jul 30 20:39:10.995805 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:10.995723    2568 generic.go:356] "Generic (PLEG): container finished" podID="3cf5ec77-df84-46a3-ae96-09e89718fab8" containerID="0ef946971090238444f499cfd8fae7a7d107e53a18e3fb52560a5cc8665268e8" exitCode=0
Jul 30 20:39:10.995963 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:10.995796    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9" event={"ID":"3cf5ec77-df84-46a3-ae96-09e89718fab8","Type":"ContainerDied","Data":"0ef946971090238444f499cfd8fae7a7d107e53a18e3fb52560a5cc8665268e8"}
Jul 30 20:39:10.997543 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:10.997519    2568 generic.go:356] "Generic (PLEG): container finished" podID="107449eb-d24e-4317-8a79-8e994fa3562b" containerID="542de79dc0027806219c4bf99b3150283f408dd1b186248bdbbd3cd742f30e88" exitCode=0
Jul 30 20:39:10.997653 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:10.997595    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q" event={"ID":"107449eb-d24e-4317-8a79-8e994fa3562b","Type":"ContainerDied","Data":"542de79dc0027806219c4bf99b3150283f408dd1b186248bdbbd3cd742f30e88"}
Jul 30 20:39:10.999198 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:10.999177    2568 generic.go:356] "Generic (PLEG): container finished" podID="2ec33da1-b03b-4486-aff3-d4b9b3cc80e9" containerID="7f9a452033fbfedd72e51b99d1e115e4cdabd04588f72207452dd2ba887d159d" exitCode=0
Jul 30 20:39:10.999301 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:10.999240    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb" event={"ID":"2ec33da1-b03b-4486-aff3-d4b9b3cc80e9","Type":"ContainerDied","Data":"7f9a452033fbfedd72e51b99d1e115e4cdabd04588f72207452dd2ba887d159d"}
Jul 30 20:39:11.056087 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.056059    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9"
Jul 30 20:39:11.085459 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.085432    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q"
Jul 30 20:39:11.093197 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.093179    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"
Jul 30 20:39:11.112552 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.112531    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cf5ec77-df84-46a3-ae96-09e89718fab8-plugins-config-volume\") pod \"3cf5ec77-df84-46a3-ae96-09e89718fab8\" (UID: \"3cf5ec77-df84-46a3-ae96-09e89718fab8\") "
Jul 30 20:39:11.112664 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.112647    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8snm2\" (UniqueName: \"kubernetes.io/projected/3cf5ec77-df84-46a3-ae96-09e89718fab8-kube-api-access-8snm2\") pod \"3cf5ec77-df84-46a3-ae96-09e89718fab8\" (UID: \"3cf5ec77-df84-46a3-ae96-09e89718fab8\") "
Jul 30 20:39:11.112894 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.112872    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cf5ec77-df84-46a3-ae96-09e89718fab8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3cf5ec77-df84-46a3-ae96-09e89718fab8" (UID: "3cf5ec77-df84-46a3-ae96-09e89718fab8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:39:11.114659 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.114635    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf5ec77-df84-46a3-ae96-09e89718fab8-kube-api-access-8snm2" (OuterVolumeSpecName: "kube-api-access-8snm2") pod "3cf5ec77-df84-46a3-ae96-09e89718fab8" (UID: "3cf5ec77-df84-46a3-ae96-09e89718fab8"). InnerVolumeSpecName "kube-api-access-8snm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:39:11.214138 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.214113    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/107449eb-d24e-4317-8a79-8e994fa3562b-plugins-config-volume\") pod \"107449eb-d24e-4317-8a79-8e994fa3562b\" (UID: \"107449eb-d24e-4317-8a79-8e994fa3562b\") "
Jul 30 20:39:11.214348 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.214222    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l52xj\" (UniqueName: \"kubernetes.io/projected/107449eb-d24e-4317-8a79-8e994fa3562b-kube-api-access-l52xj\") pod \"107449eb-d24e-4317-8a79-8e994fa3562b\" (UID: \"107449eb-d24e-4317-8a79-8e994fa3562b\") "
Jul 30 20:39:11.214348 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.214245    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvp2n\" (UniqueName: \"kubernetes.io/projected/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9-kube-api-access-dvp2n\") pod \"2ec33da1-b03b-4486-aff3-d4b9b3cc80e9\" (UID: \"2ec33da1-b03b-4486-aff3-d4b9b3cc80e9\") "
Jul 30 20:39:11.214348 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.214271    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9-maas-api-tls\") pod \"2ec33da1-b03b-4486-aff3-d4b9b3cc80e9\" (UID: \"2ec33da1-b03b-4486-aff3-d4b9b3cc80e9\") "
Jul 30 20:39:11.214348 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.214316    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9-openshift-service-ca\") pod \"2ec33da1-b03b-4486-aff3-d4b9b3cc80e9\" (UID: \"2ec33da1-b03b-4486-aff3-d4b9b3cc80e9\") "
Jul 30 20:39:11.214593 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.214497    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/107449eb-d24e-4317-8a79-8e994fa3562b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "107449eb-d24e-4317-8a79-8e994fa3562b" (UID: "107449eb-d24e-4317-8a79-8e994fa3562b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:39:11.214757 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.214735    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3cf5ec77-df84-46a3-ae96-09e89718fab8-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:11.214833 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.214750    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2ec33da1-b03b-4486-aff3-d4b9b3cc80e9" (UID: "2ec33da1-b03b-4486-aff3-d4b9b3cc80e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:39:11.214833 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.214764    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8snm2\" (UniqueName: \"kubernetes.io/projected/3cf5ec77-df84-46a3-ae96-09e89718fab8-kube-api-access-8snm2\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:11.214833 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.214780    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/107449eb-d24e-4317-8a79-8e994fa3562b-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:11.216408 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.216388    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2ec33da1-b03b-4486-aff3-d4b9b3cc80e9" (UID: "2ec33da1-b03b-4486-aff3-d4b9b3cc80e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:39:11.216493 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.216450    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9-kube-api-access-dvp2n" (OuterVolumeSpecName: "kube-api-access-dvp2n") pod "2ec33da1-b03b-4486-aff3-d4b9b3cc80e9" (UID: "2ec33da1-b03b-4486-aff3-d4b9b3cc80e9"). InnerVolumeSpecName "kube-api-access-dvp2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:39:11.216493 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.216480    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/107449eb-d24e-4317-8a79-8e994fa3562b-kube-api-access-l52xj" (OuterVolumeSpecName: "kube-api-access-l52xj") pod "107449eb-d24e-4317-8a79-8e994fa3562b" (UID: "107449eb-d24e-4317-8a79-8e994fa3562b"). InnerVolumeSpecName "kube-api-access-l52xj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:39:11.315326 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.315305    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l52xj\" (UniqueName: \"kubernetes.io/projected/107449eb-d24e-4317-8a79-8e994fa3562b-kube-api-access-l52xj\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:11.315413 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.315327    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvp2n\" (UniqueName: \"kubernetes.io/projected/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9-kube-api-access-dvp2n\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:11.315413 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.315339    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9-maas-api-tls\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:11.315413 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:11.315347    2568 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9-openshift-service-ca\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:12.006086 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:12.006011    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9"
Jul 30 20:39:12.006521 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:12.005999    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9" event={"ID":"3cf5ec77-df84-46a3-ae96-09e89718fab8","Type":"ContainerDied","Data":"29a8f28d53ac93444cf843a121120d28ca488e6e1c79c16b14fa2ac642f48c7e"}
Jul 30 20:39:12.006990 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:12.006189    2568 scope.go:117] "RemoveContainer" containerID="0ef946971090238444f499cfd8fae7a7d107e53a18e3fb52560a5cc8665268e8"
Jul 30 20:39:12.007598 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:12.007537    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q" event={"ID":"107449eb-d24e-4317-8a79-8e994fa3562b","Type":"ContainerDied","Data":"c9fa36f61cb6c9c43df04b22684409b15136750717b99f5a4f637e60962b45ff"}
Jul 30 20:39:12.007703 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:12.007542    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q"
Jul 30 20:39:12.009127 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:12.009111    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"
Jul 30 20:39:12.009208 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:12.009144    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb" event={"ID":"2ec33da1-b03b-4486-aff3-d4b9b3cc80e9","Type":"ContainerDied","Data":"ead2614a807f73a910920fb96f8318092fec400b6909c34a06af524a32432e99"}
Jul 30 20:39:12.017391 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:12.017376    2568 scope.go:117] "RemoveContainer" containerID="542de79dc0027806219c4bf99b3150283f408dd1b186248bdbbd3cd742f30e88"
Jul 30 20:39:12.025672 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:12.025650    2568 scope.go:117] "RemoveContainer" containerID="7f9a452033fbfedd72e51b99d1e115e4cdabd04588f72207452dd2ba887d159d"
Jul 30 20:39:12.031613 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:12.031594    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q"]
Jul 30 20:39:12.037108 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:12.037089    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-474e8f-76867c68d-q2z9q"]
Jul 30 20:39:12.047384 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:12.047362    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"]
Jul 30 20:39:12.051515 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:12.051495    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-474e8f-7869f96696-6g9tb"]
Jul 30 20:39:12.060959 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:12.060941    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9"]
Jul 30 20:39:12.064748 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:12.064729    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-474e8f-69f4d66db-qhjw9"]
Jul 30 20:39:13.481812 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:13.481782    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="107449eb-d24e-4317-8a79-8e994fa3562b" path="/var/lib/kubelet/pods/107449eb-d24e-4317-8a79-8e994fa3562b/volumes"
Jul 30 20:39:13.482179 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:13.482166    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ec33da1-b03b-4486-aff3-d4b9b3cc80e9" path="/var/lib/kubelet/pods/2ec33da1-b03b-4486-aff3-d4b9b3cc80e9/volumes"
Jul 30 20:39:13.482478 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:13.482466    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cf5ec77-df84-46a3-ae96-09e89718fab8" path="/var/lib/kubelet/pods/3cf5ec77-df84-46a3-ae96-09e89718fab8/volumes"
Jul 30 20:39:17.384751 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:17.384717    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"]
Jul 30 20:39:17.385173 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:17.384945    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc" podUID="58df9142-731a-4288-ad45-f4a1207ab315" containerName="istio-proxy" containerID="cri-o://912626e36a704f7eff4878a9016ac78e4d2b4b8729db54271836e36231b3db84" gracePeriod=30
Jul 30 20:39:19.677769 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:19.677733    2568 patch_prober.go:28] interesting pod/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 20:39:19.678127 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:19.677785    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc" podUID="58df9142-731a-4288-ad45-f4a1207ab315" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 20:39:22.641187 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.641164    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:39:22.716889 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.716821    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-workload-socket\") pod \"58df9142-731a-4288-ad45-f4a1207ab315\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") "
Jul 30 20:39:22.716889 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.716877    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-istio-data\") pod \"58df9142-731a-4288-ad45-f4a1207ab315\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") "
Jul 30 20:39:22.717077 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.716904    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-credential-socket\") pod \"58df9142-731a-4288-ad45-f4a1207ab315\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") "
Jul 30 20:39:22.717077 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.716925    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-workload-certs\") pod \"58df9142-731a-4288-ad45-f4a1207ab315\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") "
Jul 30 20:39:22.717077 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.716957    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58df9142-731a-4288-ad45-f4a1207ab315-istio-podinfo\") pod \"58df9142-731a-4288-ad45-f4a1207ab315\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") "
Jul 30 20:39:22.717077 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.717032    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-istio-envoy\") pod \"58df9142-731a-4288-ad45-f4a1207ab315\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") "
Jul 30 20:39:22.717279 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.717080    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58df9142-731a-4288-ad45-f4a1207ab315-istiod-ca-cert\") pod \"58df9142-731a-4288-ad45-f4a1207ab315\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") "
Jul 30 20:39:22.717279 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.717084    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "58df9142-731a-4288-ad45-f4a1207ab315" (UID: "58df9142-731a-4288-ad45-f4a1207ab315"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:39:22.717279 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.717116    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwkvx\" (UniqueName: \"kubernetes.io/projected/58df9142-731a-4288-ad45-f4a1207ab315-kube-api-access-fwkvx\") pod \"58df9142-731a-4288-ad45-f4a1207ab315\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") "
Jul 30 20:39:22.717279 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.717168    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "58df9142-731a-4288-ad45-f4a1207ab315" (UID: "58df9142-731a-4288-ad45-f4a1207ab315"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:39:22.717279 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.717195    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "58df9142-731a-4288-ad45-f4a1207ab315" (UID: "58df9142-731a-4288-ad45-f4a1207ab315"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:39:22.717279 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.717253    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58df9142-731a-4288-ad45-f4a1207ab315-istio-token\") pod \"58df9142-731a-4288-ad45-f4a1207ab315\" (UID: \"58df9142-731a-4288-ad45-f4a1207ab315\") "
Jul 30 20:39:22.717622 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.717473    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58df9142-731a-4288-ad45-f4a1207ab315-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "58df9142-731a-4288-ad45-f4a1207ab315" (UID: "58df9142-731a-4288-ad45-f4a1207ab315"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:39:22.717765 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.717743    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-workload-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:22.717824 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.717771    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-credential-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:22.717824 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.717787    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-workload-certs\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:22.717824 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.717800    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58df9142-731a-4288-ad45-f4a1207ab315-istiod-ca-cert\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:22.718044 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.718020    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-istio-data" (OuterVolumeSpecName: "istio-data") pod "58df9142-731a-4288-ad45-f4a1207ab315" (UID: "58df9142-731a-4288-ad45-f4a1207ab315"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:39:22.719254 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.719206    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/58df9142-731a-4288-ad45-f4a1207ab315-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "58df9142-731a-4288-ad45-f4a1207ab315" (UID: "58df9142-731a-4288-ad45-f4a1207ab315"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 20:39:22.719254 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.719225    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58df9142-731a-4288-ad45-f4a1207ab315-kube-api-access-fwkvx" (OuterVolumeSpecName: "kube-api-access-fwkvx") pod "58df9142-731a-4288-ad45-f4a1207ab315" (UID: "58df9142-731a-4288-ad45-f4a1207ab315"). InnerVolumeSpecName "kube-api-access-fwkvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:39:22.719376 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.719281    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58df9142-731a-4288-ad45-f4a1207ab315-istio-token" (OuterVolumeSpecName: "istio-token") pod "58df9142-731a-4288-ad45-f4a1207ab315" (UID: "58df9142-731a-4288-ad45-f4a1207ab315"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:39:22.719376 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.719306    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "58df9142-731a-4288-ad45-f4a1207ab315" (UID: "58df9142-731a-4288-ad45-f4a1207ab315"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:39:22.818406 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.818384    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58df9142-731a-4288-ad45-f4a1207ab315-istio-token\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:22.818406 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.818404    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-istio-data\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:22.818536 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.818414    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58df9142-731a-4288-ad45-f4a1207ab315-istio-podinfo\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:22.818536 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.818422    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58df9142-731a-4288-ad45-f4a1207ab315-istio-envoy\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:22.818536 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:22.818430    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwkvx\" (UniqueName: \"kubernetes.io/projected/58df9142-731a-4288-ad45-f4a1207ab315-kube-api-access-fwkvx\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:23.073688 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:23.073653    2568 generic.go:356] "Generic (PLEG): container finished" podID="58df9142-731a-4288-ad45-f4a1207ab315" containerID="912626e36a704f7eff4878a9016ac78e4d2b4b8729db54271836e36231b3db84" exitCode=0
Jul 30 20:39:23.073866 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:23.073727    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"
Jul 30 20:39:23.073866 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:23.073750    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc" event={"ID":"58df9142-731a-4288-ad45-f4a1207ab315","Type":"ContainerDied","Data":"912626e36a704f7eff4878a9016ac78e4d2b4b8729db54271836e36231b3db84"}
Jul 30 20:39:23.073866 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:23.073801    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc" event={"ID":"58df9142-731a-4288-ad45-f4a1207ab315","Type":"ContainerDied","Data":"bfc6dc681c728b81ccb992ff714e34e8adda893ff5f4cb75a56094279df7176c"}
Jul 30 20:39:23.073866 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:23.073824    2568 scope.go:117] "RemoveContainer" containerID="912626e36a704f7eff4878a9016ac78e4d2b4b8729db54271836e36231b3db84"
Jul 30 20:39:23.083835 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:23.083820    2568 scope.go:117] "RemoveContainer" containerID="049b4a3e3814459b31fd974ca17dda11867fd2f9adff981257bc646d20aba8e4"
Jul 30 20:39:23.091811 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:23.091797    2568 scope.go:117] "RemoveContainer" containerID="912626e36a704f7eff4878a9016ac78e4d2b4b8729db54271836e36231b3db84"
Jul 30 20:39:23.092049 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:39:23.092032    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"912626e36a704f7eff4878a9016ac78e4d2b4b8729db54271836e36231b3db84\": container with ID starting with 912626e36a704f7eff4878a9016ac78e4d2b4b8729db54271836e36231b3db84 not found: ID does not exist" containerID="912626e36a704f7eff4878a9016ac78e4d2b4b8729db54271836e36231b3db84"
Jul 30 20:39:23.092102 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:23.092054    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"912626e36a704f7eff4878a9016ac78e4d2b4b8729db54271836e36231b3db84"} err="failed to get container status \"912626e36a704f7eff4878a9016ac78e4d2b4b8729db54271836e36231b3db84\": rpc error: code = NotFound desc = could not find container \"912626e36a704f7eff4878a9016ac78e4d2b4b8729db54271836e36231b3db84\": container with ID starting with 912626e36a704f7eff4878a9016ac78e4d2b4b8729db54271836e36231b3db84 not found: ID does not exist"
Jul 30 20:39:23.092102 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:23.092069    2568 scope.go:117] "RemoveContainer" containerID="049b4a3e3814459b31fd974ca17dda11867fd2f9adff981257bc646d20aba8e4"
Jul 30 20:39:23.092286 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:39:23.092270    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"049b4a3e3814459b31fd974ca17dda11867fd2f9adff981257bc646d20aba8e4\": container with ID starting with 049b4a3e3814459b31fd974ca17dda11867fd2f9adff981257bc646d20aba8e4 not found: ID does not exist" containerID="049b4a3e3814459b31fd974ca17dda11867fd2f9adff981257bc646d20aba8e4"
Jul 30 20:39:23.092340 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:23.092297    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"049b4a3e3814459b31fd974ca17dda11867fd2f9adff981257bc646d20aba8e4"} err="failed to get container status \"049b4a3e3814459b31fd974ca17dda11867fd2f9adff981257bc646d20aba8e4\": rpc error: code = NotFound desc = could not find container \"049b4a3e3814459b31fd974ca17dda11867fd2f9adff981257bc646d20aba8e4\": container with ID starting with 049b4a3e3814459b31fd974ca17dda11867fd2f9adff981257bc646d20aba8e4 not found: ID does not exist"
Jul 30 20:39:23.096778 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:23.096756    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"]
Jul 30 20:39:23.100327 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:23.100308    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-474e8f-openshift-default-5dbb44888d-8pqdc"]
Jul 30 20:39:23.481502 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:23.481440    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58df9142-731a-4288-ad45-f4a1207ab315" path="/var/lib/kubelet/pods/58df9142-731a-4288-ad45-f4a1207ab315/volumes"
Jul 30 20:39:24.608516 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:24.608483    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6"]
Jul 30 20:39:24.608943 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:24.608785    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6" podUID="830b94d7-8ed5-4412-b9f5-bb444f395418" containerName="payload-processing" containerID="cri-o://59b0de1769e055426135f39e8d66e5dd7a71f78bc9e3f425c5ec686b1b66cf2a" gracePeriod=30
Jul 30 20:39:24.878474 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:24.878448    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6"
Jul 30 20:39:25.037628 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:25.037597    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/830b94d7-8ed5-4412-b9f5-bb444f395418-plugins-config-volume\") pod \"830b94d7-8ed5-4412-b9f5-bb444f395418\" (UID: \"830b94d7-8ed5-4412-b9f5-bb444f395418\") "
Jul 30 20:39:25.037806 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:25.037788    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ck2m\" (UniqueName: \"kubernetes.io/projected/830b94d7-8ed5-4412-b9f5-bb444f395418-kube-api-access-4ck2m\") pod \"830b94d7-8ed5-4412-b9f5-bb444f395418\" (UID: \"830b94d7-8ed5-4412-b9f5-bb444f395418\") "
Jul 30 20:39:25.038040 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:25.038015    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/830b94d7-8ed5-4412-b9f5-bb444f395418-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "830b94d7-8ed5-4412-b9f5-bb444f395418" (UID: "830b94d7-8ed5-4412-b9f5-bb444f395418"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:39:25.038149 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:25.038134    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/830b94d7-8ed5-4412-b9f5-bb444f395418-plugins-config-volume\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:25.039858 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:25.039822    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/830b94d7-8ed5-4412-b9f5-bb444f395418-kube-api-access-4ck2m" (OuterVolumeSpecName: "kube-api-access-4ck2m") pod "830b94d7-8ed5-4412-b9f5-bb444f395418" (UID: "830b94d7-8ed5-4412-b9f5-bb444f395418"). InnerVolumeSpecName "kube-api-access-4ck2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:39:25.094991 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:25.094962    2568 generic.go:356] "Generic (PLEG): container finished" podID="830b94d7-8ed5-4412-b9f5-bb444f395418" containerID="59b0de1769e055426135f39e8d66e5dd7a71f78bc9e3f425c5ec686b1b66cf2a" exitCode=0
Jul 30 20:39:25.095099 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:25.095013    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6"
Jul 30 20:39:25.095099 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:25.095054    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6" event={"ID":"830b94d7-8ed5-4412-b9f5-bb444f395418","Type":"ContainerDied","Data":"59b0de1769e055426135f39e8d66e5dd7a71f78bc9e3f425c5ec686b1b66cf2a"}
Jul 30 20:39:25.095173 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:25.095111    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6" event={"ID":"830b94d7-8ed5-4412-b9f5-bb444f395418","Type":"ContainerDied","Data":"c91b240a5c0b37d928688aab4b95b1d942cd8fb04e5658378b2a69f517455d47"}
Jul 30 20:39:25.095173 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:25.095136    2568 scope.go:117] "RemoveContainer" containerID="59b0de1769e055426135f39e8d66e5dd7a71f78bc9e3f425c5ec686b1b66cf2a"
Jul 30 20:39:25.103911 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:25.103890    2568 scope.go:117] "RemoveContainer" containerID="59b0de1769e055426135f39e8d66e5dd7a71f78bc9e3f425c5ec686b1b66cf2a"
Jul 30 20:39:25.104159 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:39:25.104141    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59b0de1769e055426135f39e8d66e5dd7a71f78bc9e3f425c5ec686b1b66cf2a\": container with ID starting with 59b0de1769e055426135f39e8d66e5dd7a71f78bc9e3f425c5ec686b1b66cf2a not found: ID does not exist" containerID="59b0de1769e055426135f39e8d66e5dd7a71f78bc9e3f425c5ec686b1b66cf2a"
Jul 30 20:39:25.104213 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:25.104167    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59b0de1769e055426135f39e8d66e5dd7a71f78bc9e3f425c5ec686b1b66cf2a"} err="failed to get container status \"59b0de1769e055426135f39e8d66e5dd7a71f78bc9e3f425c5ec686b1b66cf2a\": rpc error: code = NotFound desc = could not find container \"59b0de1769e055426135f39e8d66e5dd7a71f78bc9e3f425c5ec686b1b66cf2a\": container with ID starting with 59b0de1769e055426135f39e8d66e5dd7a71f78bc9e3f425c5ec686b1b66cf2a not found: ID does not exist"
Jul 30 20:39:25.115588 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:25.115529    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6"]
Jul 30 20:39:25.119189 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:25.119170    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-808798-65df8645db-fg7k6"]
Jul 30 20:39:25.139428 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:25.139406    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ck2m\" (UniqueName: \"kubernetes.io/projected/830b94d7-8ed5-4412-b9f5-bb444f395418-kube-api-access-4ck2m\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:25.481274 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:25.481205    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="830b94d7-8ed5-4412-b9f5-bb444f395418" path="/var/lib/kubelet/pods/830b94d7-8ed5-4412-b9f5-bb444f395418/volumes"
Jul 30 20:39:31.350575 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:31.350468    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"]
Jul 30 20:39:31.351028 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:31.350774    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz" podUID="58cd60c2-d357-42f5-882c-4a64755463ba" containerName="istio-proxy" containerID="cri-o://7e803b03d93682715b594146b0c604ef7524e133dd9ba84b44e4ead3e5805f5f" gracePeriod=30
Jul 30 20:39:34.471242 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:34.471210    2568 patch_prober.go:28] interesting pod/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 20:39:34.471608 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:34.471275    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz" podUID="58cd60c2-d357-42f5-882c-4a64755463ba" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 20:39:36.609576 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.609540    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:39:36.736416 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.736344    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-istio-envoy\") pod \"58cd60c2-d357-42f5-882c-4a64755463ba\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") "
Jul 30 20:39:36.736416 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.736397    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-credential-socket\") pod \"58cd60c2-d357-42f5-882c-4a64755463ba\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") "
Jul 30 20:39:36.736653 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.736422    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58cd60c2-d357-42f5-882c-4a64755463ba-istio-podinfo\") pod \"58cd60c2-d357-42f5-882c-4a64755463ba\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") "
Jul 30 20:39:36.736653 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.736445    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qf74h\" (UniqueName: \"kubernetes.io/projected/58cd60c2-d357-42f5-882c-4a64755463ba-kube-api-access-qf74h\") pod \"58cd60c2-d357-42f5-882c-4a64755463ba\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") "
Jul 30 20:39:36.736653 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.736482    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58cd60c2-d357-42f5-882c-4a64755463ba-istio-token\") pod \"58cd60c2-d357-42f5-882c-4a64755463ba\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") "
Jul 30 20:39:36.736653 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.736530    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58cd60c2-d357-42f5-882c-4a64755463ba-istiod-ca-cert\") pod \"58cd60c2-d357-42f5-882c-4a64755463ba\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") "
Jul 30 20:39:36.736653 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.736577    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-istio-data\") pod \"58cd60c2-d357-42f5-882c-4a64755463ba\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") "
Jul 30 20:39:36.736653 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.736641    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-workload-certs\") pod \"58cd60c2-d357-42f5-882c-4a64755463ba\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") "
Jul 30 20:39:36.736969 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.736665    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-workload-socket\") pod \"58cd60c2-d357-42f5-882c-4a64755463ba\" (UID: \"58cd60c2-d357-42f5-882c-4a64755463ba\") "
Jul 30 20:39:36.736969 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.736743    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "58cd60c2-d357-42f5-882c-4a64755463ba" (UID: "58cd60c2-d357-42f5-882c-4a64755463ba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:39:36.737077 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.736973    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "58cd60c2-d357-42f5-882c-4a64755463ba" (UID: "58cd60c2-d357-42f5-882c-4a64755463ba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:39:36.737077 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.737002    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-credential-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:36.737207 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.737183    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58cd60c2-d357-42f5-882c-4a64755463ba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "58cd60c2-d357-42f5-882c-4a64755463ba" (UID: "58cd60c2-d357-42f5-882c-4a64755463ba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:39:36.737247 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.737200    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "58cd60c2-d357-42f5-882c-4a64755463ba" (UID: "58cd60c2-d357-42f5-882c-4a64755463ba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:39:36.737442 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.737412    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-istio-data" (OuterVolumeSpecName: "istio-data") pod "58cd60c2-d357-42f5-882c-4a64755463ba" (UID: "58cd60c2-d357-42f5-882c-4a64755463ba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:39:36.738657 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.738633    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/58cd60c2-d357-42f5-882c-4a64755463ba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "58cd60c2-d357-42f5-882c-4a64755463ba" (UID: "58cd60c2-d357-42f5-882c-4a64755463ba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 20:39:36.738798 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.738782    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58cd60c2-d357-42f5-882c-4a64755463ba-istio-token" (OuterVolumeSpecName: "istio-token") pod "58cd60c2-d357-42f5-882c-4a64755463ba" (UID: "58cd60c2-d357-42f5-882c-4a64755463ba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:39:36.738963 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.738927    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "58cd60c2-d357-42f5-882c-4a64755463ba" (UID: "58cd60c2-d357-42f5-882c-4a64755463ba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:39:36.738963 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.738950    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58cd60c2-d357-42f5-882c-4a64755463ba-kube-api-access-qf74h" (OuterVolumeSpecName: "kube-api-access-qf74h") pod "58cd60c2-d357-42f5-882c-4a64755463ba" (UID: "58cd60c2-d357-42f5-882c-4a64755463ba"). InnerVolumeSpecName "kube-api-access-qf74h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:39:36.837915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.837892    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-workload-certs\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:36.837915 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.837913    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-workload-socket\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:36.838049 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.837922    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-istio-envoy\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:36.838049 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.837930    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58cd60c2-d357-42f5-882c-4a64755463ba-istio-podinfo\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:36.838049 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.837938    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qf74h\" (UniqueName: \"kubernetes.io/projected/58cd60c2-d357-42f5-882c-4a64755463ba-kube-api-access-qf74h\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:36.838049 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.837947    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58cd60c2-d357-42f5-882c-4a64755463ba-istio-token\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:36.838049 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.837954    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58cd60c2-d357-42f5-882c-4a64755463ba-istiod-ca-cert\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:36.838049 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:36.837962    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58cd60c2-d357-42f5-882c-4a64755463ba-istio-data\") on node \"ip-10-0-134-200.ec2.internal\" DevicePath \"\""
Jul 30 20:39:37.170238 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:37.170205    2568 generic.go:356] "Generic (PLEG): container finished" podID="58cd60c2-d357-42f5-882c-4a64755463ba" containerID="7e803b03d93682715b594146b0c604ef7524e133dd9ba84b44e4ead3e5805f5f" exitCode=0
Jul 30 20:39:37.170420 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:37.170246    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz" event={"ID":"58cd60c2-d357-42f5-882c-4a64755463ba","Type":"ContainerDied","Data":"7e803b03d93682715b594146b0c604ef7524e133dd9ba84b44e4ead3e5805f5f"}
Jul 30 20:39:37.170420 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:37.170255    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"
Jul 30 20:39:37.170420 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:37.170342    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz" event={"ID":"58cd60c2-d357-42f5-882c-4a64755463ba","Type":"ContainerDied","Data":"3befe59039c7db713ff8ceaf3feb8bb93fb2ae0fc4a836937cd765a1c74d19c8"}
Jul 30 20:39:37.170420 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:37.170377    2568 scope.go:117] "RemoveContainer" containerID="7e803b03d93682715b594146b0c604ef7524e133dd9ba84b44e4ead3e5805f5f"
Jul 30 20:39:37.179354 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:37.179334    2568 scope.go:117] "RemoveContainer" containerID="79964791b634df9d0195a2896d0e373e0daccd9ae28bf252381344f5e733ab58"
Jul 30 20:39:37.187225 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:37.187205    2568 scope.go:117] "RemoveContainer" containerID="7e803b03d93682715b594146b0c604ef7524e133dd9ba84b44e4ead3e5805f5f"
Jul 30 20:39:37.187461 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:39:37.187443    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e803b03d93682715b594146b0c604ef7524e133dd9ba84b44e4ead3e5805f5f\": container with ID starting with 7e803b03d93682715b594146b0c604ef7524e133dd9ba84b44e4ead3e5805f5f not found: ID does not exist" containerID="7e803b03d93682715b594146b0c604ef7524e133dd9ba84b44e4ead3e5805f5f"
Jul 30 20:39:37.187541 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:37.187472    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e803b03d93682715b594146b0c604ef7524e133dd9ba84b44e4ead3e5805f5f"} err="failed to get container status \"7e803b03d93682715b594146b0c604ef7524e133dd9ba84b44e4ead3e5805f5f\": rpc error: code = NotFound desc = could not find container \"7e803b03d93682715b594146b0c604ef7524e133dd9ba84b44e4ead3e5805f5f\": container with ID starting with 7e803b03d93682715b594146b0c604ef7524e133dd9ba84b44e4ead3e5805f5f not found: ID does not exist"
Jul 30 20:39:37.187541 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:37.187496    2568 scope.go:117] "RemoveContainer" containerID="79964791b634df9d0195a2896d0e373e0daccd9ae28bf252381344f5e733ab58"
Jul 30 20:39:37.187754 ip-10-0-134-200 kubenswrapper[2568]: E0730 20:39:37.187739    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79964791b634df9d0195a2896d0e373e0daccd9ae28bf252381344f5e733ab58\": container with ID starting with 79964791b634df9d0195a2896d0e373e0daccd9ae28bf252381344f5e733ab58 not found: ID does not exist" containerID="79964791b634df9d0195a2896d0e373e0daccd9ae28bf252381344f5e733ab58"
Jul 30 20:39:37.187797 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:37.187759    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79964791b634df9d0195a2896d0e373e0daccd9ae28bf252381344f5e733ab58"} err="failed to get container status \"79964791b634df9d0195a2896d0e373e0daccd9ae28bf252381344f5e733ab58\": rpc error: code = NotFound desc = could not find container \"79964791b634df9d0195a2896d0e373e0daccd9ae28bf252381344f5e733ab58\": container with ID starting with 79964791b634df9d0195a2896d0e373e0daccd9ae28bf252381344f5e733ab58 not found: ID does not exist"
Jul 30 20:39:37.192261 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:37.192241    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"]
Jul 30 20:39:37.195848 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:37.195829    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-808798-openshift-default-c8df954d8-8nfsz"]
Jul 30 20:39:37.318647 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:37.318629    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-75t4z_ed838cb5-ae93-4f33-9e11-0d1145fb603b/manager/0.log"
Jul 30 20:39:37.431536 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:37.431516    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wf9rx_e4984952-9dfd-4305-9954-1dd28ddc83f0/manager/0.log"
Jul 30 20:39:37.480963 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:37.480943    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58cd60c2-d357-42f5-882c-4a64755463ba" path="/var/lib/kubelet/pods/58cd60c2-d357-42f5-882c-4a64755463ba/volumes"
Jul 30 20:39:37.547935 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:37.547912    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-699f5fd477-bhrcr_51789d5b-c60e-41cc-b2e6-c50eb239199d/manager/0.log"
Jul 30 20:39:38.140026 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:38.140000    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d686446bf-vvf7q_a9db0278-056c-47ac-8575-d3183a8cb549/copy-manifests/0.log"
Jul 30 20:39:38.152768 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:38.152727    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d686446bf-vvf7q_a9db0278-056c-47ac-8575-d3183a8cb549/manager/0.log"
Jul 30 20:39:38.508818 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:38.508745    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-864bc7fb5b-kml4s_235618b5-f895-49bf-a8e4-e4a179b65ab5/maas-api/0.log"
Jul 30 20:39:38.616877 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:38.616850    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29757360-hfjqm_5ee34187-89e4-45bb-9014-9585ede2aee9/cleanup/0.log"
Jul 30 20:39:38.723417 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:38.723389    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29757375-6lktw_48a6d1ea-c2db-4c92-82df-3607d76fea06/cleanup/0.log"
Jul 30 20:39:38.945838 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:38.945798    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-sctjv_ae346908-019b-4da8-9c34-eb5b51a0ac79/postgres/0.log"
Jul 30 20:39:40.455953 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:40.455878    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8fsqv_95594a2c-7312-4ff5-a6a7-86dc8ba30afb/manager/0.log"
Jul 30 20:39:40.694158 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:40.694132    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fb9tr_cb7c0759-bb4d-4591-bf48-f7c2f208ce76/registry-server/0.log"
Jul 30 20:39:40.815509 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:40.815483    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9vlbs_99b09bf3-7413-4d1a-8e69-0b8641ce874e/manager/0.log"
Jul 30 20:39:41.412683 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:41.412654    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj_e1eb677b-07ad-4579-990a-84128090a91c/istio-proxy/0.log"
Jul 30 20:39:41.888927 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:41.888902    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-smgm7_9b6b4a26-6f99-4420-ba66-a35acba56cb9/istio-proxy/1.log"
Jul 30 20:39:42.126781 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:42.126753    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-h2ldz_e0a217c8-b65d-4969-b065-e411d5be06f9/payload-processing/0.log"
Jul 30 20:39:42.809480 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:42.809446    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-2rgs7_7657a3a3-5d3d-471d-acff-158272bc746a/main/0.log"
Jul 30 20:39:51.608744 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:51.608716    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mv7nq_a6e31fef-83df-4b5f-9af8-c207817e875d/global-pull-secret-syncer/0.log"
Jul 30 20:39:51.702034 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:51.702007    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9gpps_8cb73230-50ef-4678-adb0-5b410131ece0/konnectivity-agent/0.log"
Jul 30 20:39:51.755887 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:51.755858    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-200.ec2.internal_3dc51865d6685864a4b4f2bd96b4a37b/haproxy/0.log"
Jul 30 20:39:57.427017 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:57.426989    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8fsqv_95594a2c-7312-4ff5-a6a7-86dc8ba30afb/manager/0.log"
Jul 30 20:39:57.499522 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:57.499495    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fb9tr_cb7c0759-bb4d-4591-bf48-f7c2f208ce76/registry-server/0.log"
Jul 30 20:39:57.571918 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:57.571895    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-9vlbs_99b09bf3-7413-4d1a-8e69-0b8641ce874e/manager/0.log"
Jul 30 20:39:59.319801 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:59.319772    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35/alertmanager/0.log"
Jul 30 20:39:59.342897 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:59.342878    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35/config-reloader/0.log"
Jul 30 20:39:59.363457 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:59.363435    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35/kube-rbac-proxy-web/0.log"
Jul 30 20:39:59.389047 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:59.389028    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35/kube-rbac-proxy/0.log"
Jul 30 20:39:59.417273 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:59.417253    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35/kube-rbac-proxy-metric/0.log"
Jul 30 20:39:59.440972 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:59.440952    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35/prom-label-proxy/0.log"
Jul 30 20:39:59.468649 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:59.468632    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8fe2f6b4-ee77-46f3-a0d3-e5ca0c7f5f35/init-config-reloader/0.log"
Jul 30 20:39:59.545709 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:59.545687    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-64bm9_c1abfd2c-697d-4db7-a92b-cb9c60db3067/kube-state-metrics/0.log"
Jul 30 20:39:59.563805 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:59.563782    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-64bm9_c1abfd2c-697d-4db7-a92b-cb9c60db3067/kube-rbac-proxy-main/0.log"
Jul 30 20:39:59.585198 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:59.585147    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-64bm9_c1abfd2c-697d-4db7-a92b-cb9c60db3067/kube-rbac-proxy-self/0.log"
Jul 30 20:39:59.616392 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:59.616370    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-865f79dbd6-5752d_0eae0ee6-4f33-41de-a109-360fb82637fa/metrics-server/0.log"
Jul 30 20:39:59.658198 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:59.658177    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-dg6rh_5114dce3-f997-48e9-aeed-f034be235611/monitoring-plugin/0.log"
Jul 30 20:39:59.781983 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:59.781963    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nf77v_0a49e79d-01ee-4c00-ac27-6ad38345c98d/node-exporter/0.log"
Jul 30 20:39:59.803179 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:59.803159    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nf77v_0a49e79d-01ee-4c00-ac27-6ad38345c98d/kube-rbac-proxy/0.log"
Jul 30 20:39:59.823325 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:59.823303    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nf77v_0a49e79d-01ee-4c00-ac27-6ad38345c98d/init-textfile/0.log"
Jul 30 20:39:59.928009 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:59.927981    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-mgzfq_5c113a31-c028-4bd8-8d55-98f3384f3d6a/kube-rbac-proxy-main/0.log"
Jul 30 20:39:59.952078 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:59.952055    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-mgzfq_5c113a31-c028-4bd8-8d55-98f3384f3d6a/kube-rbac-proxy-self/0.log"
Jul 30 20:39:59.976448 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:39:59.976426    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-mgzfq_5c113a31-c028-4bd8-8d55-98f3384f3d6a/openshift-state-metrics/0.log"
Jul 30 20:40:00.019491 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:00.019454    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_50b96075-3c5b-4e0f-901b-1828b4264bd5/prometheus/0.log"
Jul 30 20:40:00.043548 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:00.043527    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_50b96075-3c5b-4e0f-901b-1828b4264bd5/config-reloader/0.log"
Jul 30 20:40:00.063286 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:00.063270    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_50b96075-3c5b-4e0f-901b-1828b4264bd5/thanos-sidecar/0.log"
Jul 30 20:40:00.085372 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:00.085358    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_50b96075-3c5b-4e0f-901b-1828b4264bd5/kube-rbac-proxy-web/0.log"
Jul 30 20:40:00.107472 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:00.107445    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_50b96075-3c5b-4e0f-901b-1828b4264bd5/kube-rbac-proxy/0.log"
Jul 30 20:40:00.130084 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:00.130029    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_50b96075-3c5b-4e0f-901b-1828b4264bd5/kube-rbac-proxy-thanos/0.log"
Jul 30 20:40:00.151755 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:00.151738    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_50b96075-3c5b-4e0f-901b-1828b4264bd5/init-config-reloader/0.log"
Jul 30 20:40:00.178113 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:00.178095    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-c9q7c_be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0/prometheus-operator/0.log"
Jul 30 20:40:00.240682 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:00.240663    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-c9q7c_be8ccaee-b8c1-488d-9c07-b59e1f9ca5b0/kube-rbac-proxy/0.log"
Jul 30 20:40:00.349655 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:00.349635    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65bf9b5695-qjp89_bae1c786-aa44-4572-ad3a-96e9bb8d8605/telemeter-client/0.log"
Jul 30 20:40:00.372407 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:00.372387    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65bf9b5695-qjp89_bae1c786-aa44-4572-ad3a-96e9bb8d8605/reload/0.log"
Jul 30 20:40:00.407643 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:00.407592    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65bf9b5695-qjp89_bae1c786-aa44-4572-ad3a-96e9bb8d8605/kube-rbac-proxy/0.log"
Jul 30 20:40:00.436529 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:00.436510    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79c646665d-br8xc_74d4facc-2b39-4dd8-8378-681d49d12197/thanos-query/0.log"
Jul 30 20:40:00.455253 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:00.455231    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79c646665d-br8xc_74d4facc-2b39-4dd8-8378-681d49d12197/kube-rbac-proxy-web/0.log"
Jul 30 20:40:00.476357 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:00.476336    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79c646665d-br8xc_74d4facc-2b39-4dd8-8378-681d49d12197/kube-rbac-proxy/0.log"
Jul 30 20:40:00.498086 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:00.498068    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79c646665d-br8xc_74d4facc-2b39-4dd8-8378-681d49d12197/prom-label-proxy/0.log"
Jul 30 20:40:00.518777 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:00.518760    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79c646665d-br8xc_74d4facc-2b39-4dd8-8378-681d49d12197/kube-rbac-proxy-rules/0.log"
Jul 30 20:40:00.544044 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:00.544028    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79c646665d-br8xc_74d4facc-2b39-4dd8-8378-681d49d12197/kube-rbac-proxy-metrics/0.log"
Jul 30 20:40:01.472654 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.472626    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"]
Jul 30 20:40:01.473052 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473040    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58df9142-731a-4288-ad45-f4a1207ab315" containerName="istio-proxy"
Jul 30 20:40:01.473052 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473054    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="58df9142-731a-4288-ad45-f4a1207ab315" containerName="istio-proxy"
Jul 30 20:40:01.473126 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473064    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ec33da1-b03b-4486-aff3-d4b9b3cc80e9" containerName="maas-api"
Jul 30 20:40:01.473126 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473070    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ec33da1-b03b-4486-aff3-d4b9b3cc80e9" containerName="maas-api"
Jul 30 20:40:01.473126 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473078    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb8ab5cd-df26-460b-a347-877891cfb85f" containerName="payload-processing"
Jul 30 20:40:01.473126 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473084    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb8ab5cd-df26-460b-a347-877891cfb85f" containerName="payload-processing"
Jul 30 20:40:01.473126 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473090    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d1c47a6-ccff-49b5-81d2-422c6569c748" containerName="revoke-keys"
Jul 30 20:40:01.473126 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473095    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d1c47a6-ccff-49b5-81d2-422c6569c748" containerName="revoke-keys"
Jul 30 20:40:01.473126 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473109    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="830b94d7-8ed5-4412-b9f5-bb444f395418" containerName="payload-processing"
Jul 30 20:40:01.473126 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473115    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="830b94d7-8ed5-4412-b9f5-bb444f395418" containerName="payload-processing"
Jul 30 20:40:01.473126 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473122    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58cd60c2-d357-42f5-882c-4a64755463ba" containerName="istio-proxy"
Jul 30 20:40:01.473126 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473126    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="58cd60c2-d357-42f5-882c-4a64755463ba" containerName="istio-proxy"
Jul 30 20:40:01.473439 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473135    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="107449eb-d24e-4317-8a79-8e994fa3562b" containerName="payload-pre-processing"
Jul 30 20:40:01.473439 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473141    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="107449eb-d24e-4317-8a79-8e994fa3562b" containerName="payload-pre-processing"
Jul 30 20:40:01.473439 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473151    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf5ec77-df84-46a3-ae96-09e89718fab8" containerName="payload-processing"
Jul 30 20:40:01.473439 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473156    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf5ec77-df84-46a3-ae96-09e89718fab8" containerName="payload-processing"
Jul 30 20:40:01.473439 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473163    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58cd60c2-d357-42f5-882c-4a64755463ba" containerName="istio-proxy"
Jul 30 20:40:01.473439 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473169    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="58cd60c2-d357-42f5-882c-4a64755463ba" containerName="istio-proxy"
Jul 30 20:40:01.473439 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473225    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d1c47a6-ccff-49b5-81d2-422c6569c748" containerName="revoke-keys"
Jul 30 20:40:01.473439 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473233    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="58df9142-731a-4288-ad45-f4a1207ab315" containerName="istio-proxy"
Jul 30 20:40:01.473439 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473240    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="107449eb-d24e-4317-8a79-8e994fa3562b" containerName="payload-pre-processing"
Jul 30 20:40:01.473439 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473247    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="58df9142-731a-4288-ad45-f4a1207ab315" containerName="istio-proxy"
Jul 30 20:40:01.473439 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473253    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="58cd60c2-d357-42f5-882c-4a64755463ba" containerName="istio-proxy"
Jul 30 20:40:01.473439 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473257    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="830b94d7-8ed5-4412-b9f5-bb444f395418" containerName="payload-processing"
Jul 30 20:40:01.473439 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473264    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cf5ec77-df84-46a3-ae96-09e89718fab8" containerName="payload-processing"
Jul 30 20:40:01.473439 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473269    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ec33da1-b03b-4486-aff3-d4b9b3cc80e9" containerName="maas-api"
Jul 30 20:40:01.473439 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473274    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="58cd60c2-d357-42f5-882c-4a64755463ba" containerName="istio-proxy"
Jul 30 20:40:01.473439 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.473279    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb8ab5cd-df26-460b-a347-877891cfb85f" containerName="payload-processing"
Jul 30 20:40:01.476778 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.476757    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"
Jul 30 20:40:01.479542 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.479522    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v4f7q\"/\"openshift-service-ca.crt\""
Jul 30 20:40:01.479691 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.479595    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-v4f7q\"/\"default-dockercfg-g22vb\""
Jul 30 20:40:01.480678 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.480660    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v4f7q\"/\"kube-root-ca.crt\""
Jul 30 20:40:01.496405 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.496382    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"]
Jul 30 20:40:01.545086 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.545065    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9fd0075a-3d22-422a-b11a-2c7adb2ee65f-proc\") pod \"perf-node-gather-daemonset-llc9p\" (UID: \"9fd0075a-3d22-422a-b11a-2c7adb2ee65f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"
Jul 30 20:40:01.545202 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.545125    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fd0075a-3d22-422a-b11a-2c7adb2ee65f-lib-modules\") pod \"perf-node-gather-daemonset-llc9p\" (UID: \"9fd0075a-3d22-422a-b11a-2c7adb2ee65f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"
Jul 30 20:40:01.545253 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.545211    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsf9r\" (UniqueName: \"kubernetes.io/projected/9fd0075a-3d22-422a-b11a-2c7adb2ee65f-kube-api-access-jsf9r\") pod \"perf-node-gather-daemonset-llc9p\" (UID: \"9fd0075a-3d22-422a-b11a-2c7adb2ee65f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"
Jul 30 20:40:01.545253 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.545247    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9fd0075a-3d22-422a-b11a-2c7adb2ee65f-podres\") pod \"perf-node-gather-daemonset-llc9p\" (UID: \"9fd0075a-3d22-422a-b11a-2c7adb2ee65f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"
Jul 30 20:40:01.545321 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.545276    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fd0075a-3d22-422a-b11a-2c7adb2ee65f-sys\") pod \"perf-node-gather-daemonset-llc9p\" (UID: \"9fd0075a-3d22-422a-b11a-2c7adb2ee65f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"
Jul 30 20:40:01.646217 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.646190    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9fd0075a-3d22-422a-b11a-2c7adb2ee65f-proc\") pod \"perf-node-gather-daemonset-llc9p\" (UID: \"9fd0075a-3d22-422a-b11a-2c7adb2ee65f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"
Jul 30 20:40:01.646346 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.646247    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fd0075a-3d22-422a-b11a-2c7adb2ee65f-lib-modules\") pod \"perf-node-gather-daemonset-llc9p\" (UID: \"9fd0075a-3d22-422a-b11a-2c7adb2ee65f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"
Jul 30 20:40:01.646346 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.646294    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsf9r\" (UniqueName: \"kubernetes.io/projected/9fd0075a-3d22-422a-b11a-2c7adb2ee65f-kube-api-access-jsf9r\") pod \"perf-node-gather-daemonset-llc9p\" (UID: \"9fd0075a-3d22-422a-b11a-2c7adb2ee65f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"
Jul 30 20:40:01.646346 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.646322    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9fd0075a-3d22-422a-b11a-2c7adb2ee65f-podres\") pod \"perf-node-gather-daemonset-llc9p\" (UID: \"9fd0075a-3d22-422a-b11a-2c7adb2ee65f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"
Jul 30 20:40:01.646346 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.646299    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9fd0075a-3d22-422a-b11a-2c7adb2ee65f-proc\") pod \"perf-node-gather-daemonset-llc9p\" (UID: \"9fd0075a-3d22-422a-b11a-2c7adb2ee65f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"
Jul 30 20:40:01.646532 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.646355    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fd0075a-3d22-422a-b11a-2c7adb2ee65f-sys\") pod \"perf-node-gather-daemonset-llc9p\" (UID: \"9fd0075a-3d22-422a-b11a-2c7adb2ee65f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"
Jul 30 20:40:01.646532 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.646405    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fd0075a-3d22-422a-b11a-2c7adb2ee65f-lib-modules\") pod \"perf-node-gather-daemonset-llc9p\" (UID: \"9fd0075a-3d22-422a-b11a-2c7adb2ee65f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"
Jul 30 20:40:01.646532 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.646416    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9fd0075a-3d22-422a-b11a-2c7adb2ee65f-podres\") pod \"perf-node-gather-daemonset-llc9p\" (UID: \"9fd0075a-3d22-422a-b11a-2c7adb2ee65f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"
Jul 30 20:40:01.646532 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.646497    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fd0075a-3d22-422a-b11a-2c7adb2ee65f-sys\") pod \"perf-node-gather-daemonset-llc9p\" (UID: \"9fd0075a-3d22-422a-b11a-2c7adb2ee65f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"
Jul 30 20:40:01.654412 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.654395    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsf9r\" (UniqueName: \"kubernetes.io/projected/9fd0075a-3d22-422a-b11a-2c7adb2ee65f-kube-api-access-jsf9r\") pod \"perf-node-gather-daemonset-llc9p\" (UID: \"9fd0075a-3d22-422a-b11a-2c7adb2ee65f\") " pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"
Jul 30 20:40:01.787959 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.787906    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"
Jul 30 20:40:01.923068 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:01.923043    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"]
Jul 30 20:40:01.924149 ip-10-0-134-200 kubenswrapper[2568]: W0730 20:40:01.924129    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9fd0075a_3d22_422a_b11a_2c7adb2ee65f.slice/crio-22b48c1f1d736201af66ba820bd2a5fc9cf997b8abf25855e736e8e229281c74 WatchSource:0}: Error finding container 22b48c1f1d736201af66ba820bd2a5fc9cf997b8abf25855e736e8e229281c74: Status 404 returned error can't find the container with id 22b48c1f1d736201af66ba820bd2a5fc9cf997b8abf25855e736e8e229281c74
Jul 30 20:40:02.311203 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:02.311173    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p" event={"ID":"9fd0075a-3d22-422a-b11a-2c7adb2ee65f","Type":"ContainerStarted","Data":"0eafcdee53e7c27d0a75e19fe4060b0f32e58799d5582a59b23f0fa14abdac59"}
Jul 30 20:40:02.311326 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:02.311218    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p" event={"ID":"9fd0075a-3d22-422a-b11a-2c7adb2ee65f","Type":"ContainerStarted","Data":"22b48c1f1d736201af66ba820bd2a5fc9cf997b8abf25855e736e8e229281c74"}
Jul 30 20:40:02.311326 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:02.311258    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"
Jul 30 20:40:02.327056 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:02.327017    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p" podStartSLOduration=1.327005304 podStartE2EDuration="1.327005304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:40:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:40:02.325835852 +0000 UTC m=+3623.425917039" watchObservedRunningTime="2026-07-30 20:40:02.327005304 +0000 UTC m=+3623.427086490"
Jul 30 20:40:04.462684 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:04.462657    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6pcrs_44cc3183-f50b-469f-a5e9-a27e039583ff/dns/0.log"
Jul 30 20:40:04.529415 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:04.529381    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6pcrs_44cc3183-f50b-469f-a5e9-a27e039583ff/kube-rbac-proxy/0.log"
Jul 30 20:40:04.684607 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:04.684561    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zpc52_d757dd80-c33b-454b-9de0-4440157edd68/dns-node-resolver/0.log"
Jul 30 20:40:05.344501 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:05.344458    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2jrpc_82ec3276-358b-4dbf-bc7f-74ab582afa50/node-ca/0.log"
Jul 30 20:40:06.325417 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:06.325384    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj_e1eb677b-07ad-4579-990a-84128090a91c/istio-proxy/0.log"
Jul 30 20:40:06.584541 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:06.584444    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-smgm7_9b6b4a26-6f99-4420-ba66-a35acba56cb9/istio-proxy/0.log"
Jul 30 20:40:06.607609 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:06.607584    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-smgm7_9b6b4a26-6f99-4420-ba66-a35acba56cb9/istio-proxy/1.log"
Jul 30 20:40:06.685490 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:06.685464    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-h2ldz_e0a217c8-b65d-4969-b065-e411d5be06f9/payload-processing/0.log"
Jul 30 20:40:07.526854 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:07.526825    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xkf9t_5eb89f1c-020e-42b9-b5e7-84ab77c0d4ce/serve-healthcheck-canary/0.log"
Jul 30 20:40:08.060159 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:08.060119    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jrfg8_752cf85f-98ea-4bd7-8a53-0fc42191f080/kube-rbac-proxy/0.log"
Jul 30 20:40:08.082889 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:08.082862    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jrfg8_752cf85f-98ea-4bd7-8a53-0fc42191f080/exporter/0.log"
Jul 30 20:40:08.105319 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:08.105300    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jrfg8_752cf85f-98ea-4bd7-8a53-0fc42191f080/extractor/0.log"
Jul 30 20:40:08.326914 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:08.326838    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-v4f7q/perf-node-gather-daemonset-llc9p"
Jul 30 20:40:10.489220 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:10.489190    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-75t4z_ed838cb5-ae93-4f33-9e11-0d1145fb603b/manager/0.log"
Jul 30 20:40:10.701730 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:10.701634    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wf9rx_e4984952-9dfd-4305-9954-1dd28ddc83f0/manager/0.log"
Jul 30 20:40:10.850604 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:10.850578    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-699f5fd477-bhrcr_51789d5b-c60e-41cc-b2e6-c50eb239199d/manager/0.log"
Jul 30 20:40:11.205177 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:11.205151    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d686446bf-vvf7q_a9db0278-056c-47ac-8575-d3183a8cb549/manager/0.log"
Jul 30 20:40:11.228104 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:11.228088    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d686446bf-vvf7q_a9db0278-056c-47ac-8575-d3183a8cb549/copy-manifests/0.log"
Jul 30 20:40:11.543696 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:11.543673    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj_e1eb677b-07ad-4579-990a-84128090a91c/istio-proxy/0.log"
Jul 30 20:40:11.731500 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:11.731477    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-smgm7_9b6b4a26-6f99-4420-ba66-a35acba56cb9/istio-proxy/0.log"
Jul 30 20:40:11.760159 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:11.760097    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-smgm7_9b6b4a26-6f99-4420-ba66-a35acba56cb9/istio-proxy/1.log"
Jul 30 20:40:11.814762 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:11.814740    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-h2ldz_e0a217c8-b65d-4969-b065-e411d5be06f9/payload-processing/0.log"
Jul 30 20:40:12.460630 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:12.460592    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-996655b6d-ngctb_7d3cfe10-0e72-4219-a912-f805302ec836/manager/0.log"
Jul 30 20:40:13.185285 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:13.185254    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-t4ssj_e1eb677b-07ad-4579-990a-84128090a91c/istio-proxy/0.log"
Jul 30 20:40:13.365664 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:13.365588    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-smgm7_9b6b4a26-6f99-4420-ba66-a35acba56cb9/istio-proxy/0.log"
Jul 30 20:40:13.393678 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:13.393647    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-smgm7_9b6b4a26-6f99-4420-ba66-a35acba56cb9/istio-proxy/1.log"
Jul 30 20:40:13.447657 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:13.447616    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-h2ldz_e0a217c8-b65d-4969-b065-e411d5be06f9/payload-processing/0.log"
Jul 30 20:40:18.587814 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:18.587790    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qnlc6_f2f94aa8-23b3-4c33-beb7-8aebeac90767/kube-multus-additional-cni-plugins/0.log"
Jul 30 20:40:18.607169 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:18.607146    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qnlc6_f2f94aa8-23b3-4c33-beb7-8aebeac90767/egress-router-binary-copy/0.log"
Jul 30 20:40:18.624903 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:18.624887    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qnlc6_f2f94aa8-23b3-4c33-beb7-8aebeac90767/cni-plugins/0.log"
Jul 30 20:40:18.642581 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:18.642547    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qnlc6_f2f94aa8-23b3-4c33-beb7-8aebeac90767/bond-cni-plugin/0.log"
Jul 30 20:40:18.660849 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:18.660831    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qnlc6_f2f94aa8-23b3-4c33-beb7-8aebeac90767/routeoverride-cni/0.log"
Jul 30 20:40:18.678495 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:18.678480    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qnlc6_f2f94aa8-23b3-4c33-beb7-8aebeac90767/whereabouts-cni-bincopy/0.log"
Jul 30 20:40:18.696739 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:18.696721    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qnlc6_f2f94aa8-23b3-4c33-beb7-8aebeac90767/whereabouts-cni/0.log"
Jul 30 20:40:18.740421 ip-10-0-134-200 kubenswrapper[2568]: I0730 20:40:18.740402    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mh5vv_d69b93d6-a4ba-421e-808a-2b07c9c4ccb9/kube-multus/0.log"