Sep 11 00:56:05.521986 ip-10-0-133-50 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 11 00:56:05.521996 ip-10-0-133-50 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 11 00:56:05.522003 ip-10-0-133-50 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 11 00:56:05.522156 ip-10-0-133-50 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 11 00:56:15.634355 ip-10-0-133-50 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 11 00:56:15.634371 ip-10-0-133-50 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f488fc2536b9457e9445e6edce82a020 --
Sep 11 00:58:02.841112 ip-10-0-133-50 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 00:58:03.269937 ip-10-0-133-50 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 00:58:03.269937 ip-10-0-133-50 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 00:58:03.269937 ip-10-0-133-50 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 00:58:03.269937 ip-10-0-133-50 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 00:58:03.269937 ip-10-0-133-50 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 00:58:03.272453 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.272361    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 00:58:03.276376 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276359    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 00:58:03.276376 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276376    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 00:58:03.276437 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276380    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 00:58:03.276437 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276383    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 00:58:03.276437 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276386    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 00:58:03.276437 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276389    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 00:58:03.276437 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276392    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 00:58:03.276437 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276395    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 00:58:03.276437 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276398    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 00:58:03.276437 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276401    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 00:58:03.276437 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276404    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 00:58:03.276437 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276408    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 00:58:03.276437 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276411    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 00:58:03.276437 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276414    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 00:58:03.276437 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276417    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 00:58:03.276437 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276419    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 00:58:03.276437 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276422    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 00:58:03.276437 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276425    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 00:58:03.276437 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276427    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 00:58:03.276437 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276430    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 00:58:03.276437 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276434    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 00:58:03.276437 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276436    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 00:58:03.276920 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276439    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 00:58:03.276920 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276441    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 00:58:03.276920 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276445    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 00:58:03.276920 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276448    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 00:58:03.276920 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276450    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 00:58:03.276920 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276453    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 00:58:03.276920 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276456    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 00:58:03.276920 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276458    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 00:58:03.276920 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276461    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 00:58:03.276920 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276464    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 00:58:03.276920 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276466    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 00:58:03.276920 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276469    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 00:58:03.276920 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276471    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 00:58:03.276920 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276474    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 00:58:03.276920 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276476    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 00:58:03.276920 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276479    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 00:58:03.276920 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276482    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 00:58:03.276920 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276485    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 00:58:03.276920 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276487    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 00:58:03.276920 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276490    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 00:58:03.277402 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276492    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 00:58:03.277402 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276495    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 00:58:03.277402 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276497    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 00:58:03.277402 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276500    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 00:58:03.277402 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276503    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 00:58:03.277402 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276505    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 00:58:03.277402 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276508    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 00:58:03.277402 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276510    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 00:58:03.277402 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276513    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 00:58:03.277402 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276515    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 00:58:03.277402 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276518    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 00:58:03.277402 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276520    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 00:58:03.277402 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276524    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 00:58:03.277402 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276527    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 00:58:03.277402 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276530    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 00:58:03.277402 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276533    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 00:58:03.277402 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276535    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 00:58:03.277402 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276538    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 00:58:03.277402 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276541    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 00:58:03.277402 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276544    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 00:58:03.277899 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276546    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 00:58:03.277899 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276549    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 00:58:03.277899 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276552    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 00:58:03.277899 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276554    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 00:58:03.277899 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276557    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 00:58:03.277899 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276559    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 00:58:03.277899 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276562    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 00:58:03.277899 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276564    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 00:58:03.277899 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276567    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 00:58:03.277899 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276571    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 00:58:03.277899 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276575    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 00:58:03.277899 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276578    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 00:58:03.277899 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276581    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 00:58:03.277899 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276585    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 00:58:03.277899 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276590    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 00:58:03.277899 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276593    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 00:58:03.277899 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276595    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 00:58:03.277899 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276599    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 00:58:03.278329 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276602    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 00:58:03.278329 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276605    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 00:58:03.278329 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276608    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 00:58:03.278329 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276611    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 00:58:03.278329 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276613    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 00:58:03.278329 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276616    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 00:58:03.278329 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276620    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 00:58:03.278329 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276623    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 00:58:03.278329 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276628    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 00:58:03.278329 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276631    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 00:58:03.278329 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276634    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 00:58:03.278329 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276637    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 00:58:03.278329 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276640    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 00:58:03.278329 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276645    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 00:58:03.278329 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276647    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 00:58:03.278329 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276651    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 00:58:03.278329 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276654    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 00:58:03.278329 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276657    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 00:58:03.278329 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.276660    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 00:58:03.279073 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279061    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 00:58:03.279073 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279072    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 00:58:03.279133 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279076    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 00:58:03.279133 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279079    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 00:58:03.279133 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279082    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 00:58:03.279133 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279085    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 00:58:03.279133 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279089    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 00:58:03.279133 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279092    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 00:58:03.279133 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279095    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 00:58:03.279133 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279097    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 00:58:03.279133 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279100    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 00:58:03.279133 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279110    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 00:58:03.279133 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279113    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 00:58:03.279133 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279116    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 00:58:03.279133 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279118    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 00:58:03.279133 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279121    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 00:58:03.279133 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279123    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 00:58:03.279133 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279126    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 00:58:03.279133 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279129    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 00:58:03.279133 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279132    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 00:58:03.279133 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279135    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 00:58:03.279133 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279138    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 00:58:03.279651 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279141    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 00:58:03.279651 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279144    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 00:58:03.279651 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279148    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 00:58:03.279651 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279152    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 00:58:03.279651 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279155    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 00:58:03.279651 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279158    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 00:58:03.279651 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279160    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 00:58:03.279651 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279163    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 00:58:03.279651 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279166    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 00:58:03.279651 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279168    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 00:58:03.279651 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279171    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 00:58:03.279651 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279173    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 00:58:03.279651 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279176    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 00:58:03.279651 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279179    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 00:58:03.279651 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279182    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 00:58:03.279651 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279184    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 00:58:03.279651 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279187    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 00:58:03.279651 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279190    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 00:58:03.279651 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279192    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 00:58:03.279651 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279195    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 00:58:03.280483 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279197    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 00:58:03.280483 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279200    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 00:58:03.280483 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279203    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 00:58:03.280483 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279205    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 00:58:03.280483 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279208    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 00:58:03.280483 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279210    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 00:58:03.280483 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279213    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 00:58:03.280483 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279215    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 00:58:03.280483 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279218    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 00:58:03.280483 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279221    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 00:58:03.280483 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279224    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 00:58:03.280483 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279226    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 00:58:03.280483 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279229    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 00:58:03.280483 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279232    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 00:58:03.280483 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279235    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 00:58:03.280483 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279238    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 00:58:03.280483 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279242    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 00:58:03.280483 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279246    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 00:58:03.280483 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279249    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 00:58:03.281050 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279252    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 00:58:03.281050 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279254    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 00:58:03.281050 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279257    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 00:58:03.281050 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279260    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 00:58:03.281050 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279262    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 00:58:03.281050 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279265    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 00:58:03.281050 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279267    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 00:58:03.281050 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279270    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 00:58:03.281050 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279272    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 00:58:03.281050 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279275    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 00:58:03.281050 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279278    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 00:58:03.281050 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279285    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 00:58:03.281050 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279288    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 00:58:03.281050 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279290    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 00:58:03.281050 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279293    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 00:58:03.281050 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279295    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 00:58:03.281050 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279298    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 00:58:03.281050 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279300    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 00:58:03.281050 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279303    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 00:58:03.281514 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279307    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 00:58:03.281514 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279310    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 00:58:03.281514 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279313    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 00:58:03.281514 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279316    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 00:58:03.281514 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279319    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 00:58:03.281514 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279322    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 00:58:03.281514 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279326    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 00:58:03.281514 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279329    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 00:58:03.281514 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279332    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 00:58:03.281514 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279335    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 00:58:03.281514 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279337    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 00:58:03.281514 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279341    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 00:58:03.281514 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279344    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 00:58:03.281514 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279346    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 00:58:03.281514 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279349    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 00:58:03.281514 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279352    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 00:58:03.281514 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279354    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 00:58:03.281514 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279357    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 00:58:03.281514 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.279359    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 00:58:03.282000 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280881    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 00:58:03.282000 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280893    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 00:58:03.282000 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280897    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 00:58:03.282000 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280901    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 00:58:03.282000 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280904    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 00:58:03.282000 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280907    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 00:58:03.282000 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280910    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 00:58:03.282000 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280913    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 00:58:03.282000 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280916    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 00:58:03.282000 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280919    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 00:58:03.282000 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280922    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 00:58:03.282000 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280924    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 00:58:03.282000 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280927    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 00:58:03.282000 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280929    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 00:58:03.282000 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280932    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 00:58:03.282000 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280935    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 00:58:03.282000 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280939    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 00:58:03.282000 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280943    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 00:58:03.282000 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280946    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 00:58:03.282000 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280949    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 00:58:03.282519 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280953    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 00:58:03.282519 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280957    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 00:58:03.282519 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280960    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 00:58:03.282519 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280964    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 00:58:03.282519 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280967    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 00:58:03.282519 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280970    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 00:58:03.282519 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280973    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 00:58:03.282519 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280976    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 00:58:03.282519 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280979    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 00:58:03.282519 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280981    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 00:58:03.282519 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280984    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 00:58:03.282519 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280987    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 00:58:03.282519 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280989    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 00:58:03.282519 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280993    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 00:58:03.282519 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280995    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 00:58:03.282519 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.280998    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 00:58:03.282519 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281001    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 00:58:03.282519 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281004    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 00:58:03.282519 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281007    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 00:58:03.282519 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281010    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 00:58:03.283023 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281013    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 00:58:03.283023 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281015    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 00:58:03.283023 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281018    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 00:58:03.283023 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281021    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 00:58:03.283023 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281025    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 00:58:03.283023 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281029    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 00:58:03.283023 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281032    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 00:58:03.283023 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281035    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 00:58:03.283023 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281038    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 00:58:03.283023 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281041    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 00:58:03.283023 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281044    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 00:58:03.283023 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281046    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 00:58:03.283023 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281049    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 00:58:03.283023 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281052    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 00:58:03.283023 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281055    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 00:58:03.283023 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281057    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 00:58:03.283023 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281060    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 00:58:03.283023 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281063    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 00:58:03.283023 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281066    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 00:58:03.283489 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281068    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 00:58:03.283489 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281071    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 00:58:03.283489 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281073    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 00:58:03.283489 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281076    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 00:58:03.283489 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281079    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 00:58:03.283489 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281081    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 00:58:03.283489 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281084    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 00:58:03.283489 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281087    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 00:58:03.283489 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281090    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 00:58:03.283489 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281093    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 00:58:03.283489 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281095    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 00:58:03.283489 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281098    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 00:58:03.283489 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281102    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 00:58:03.283489 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281104    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 00:58:03.283489 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281107    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 00:58:03.283489 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281109    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 00:58:03.283489 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281112    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 00:58:03.283489 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281115    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 00:58:03.283489 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281117    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 00:58:03.283489 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281120    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 00:58:03.284015 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281122    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 00:58:03.284015 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281125    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 00:58:03.284015 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281127    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 00:58:03.284015 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281130    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 00:58:03.284015 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281133    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 00:58:03.284015 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281136    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 00:58:03.284015 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281138    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 00:58:03.284015 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281140    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 00:58:03.284015 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281143    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 00:58:03.284015 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281146    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 00:58:03.284015 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281149    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 00:58:03.284015 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281152    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 00:58:03.284015 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281154    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 00:58:03.284015 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281157    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 00:58:03.284015 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281159    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 00:58:03.284015 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281162    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 00:58:03.284015 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281165    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 00:58:03.284015 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281167    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 00:58:03.284015 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281171    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 00:58:03.284015 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281174    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281254    2565 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281290    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281297    2565 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281302    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281307    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281310    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281314    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281319    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281322    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281325    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281329    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281332    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281335    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281338    2565 flags.go:64] FLAG: --cgroup-root=""
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281341    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281344    2565 flags.go:64] FLAG: --client-ca-file=""
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281347    2565 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281354    2565 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281359    2565 flags.go:64] FLAG: --cluster-domain=""
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281362    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281365    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281368    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281372    2565 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 00:58:03.284490 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281376    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281379    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281381    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281385    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281388    2565 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281391    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281394    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281398    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281401    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281405    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281408    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281411    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281414    2565 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281417    2565 flags.go:64] FLAG: --enable-server="true"
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281420    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281426    2565 flags.go:64] FLAG: --event-burst="100"
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281429    2565 flags.go:64] FLAG: --event-qps="50"
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281432    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281435    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281438    2565 flags.go:64] FLAG: --eviction-hard=""
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281441    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281444    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281447    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281450    2565 flags.go:64] FLAG: --eviction-soft=""
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281453    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 00:58:03.285085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281456    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281459    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281462    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281465    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281468    2565 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281471    2565 flags.go:64] FLAG: --feature-gates=""
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281475    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281478    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281481    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281484    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281487    2565 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281491    2565 flags.go:64] FLAG: --help="false"
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281494    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-133-50.ec2.internal"
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281497    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281500    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281503    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281507    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281510    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281513    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281516    2565 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281519    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281523    2565 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281526    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281529    2565 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 00:58:03.285698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281532    2565 flags.go:64] FLAG: --kube-reserved=""
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281535    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281540    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281544    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281548    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281553    2565 flags.go:64] FLAG: --lock-file=""
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281557    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281561    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281566    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281572    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281576    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281579    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281582    2565 flags.go:64] FLAG: --logging-format="text"
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281586    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281589    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281592    2565 flags.go:64] FLAG: --manifest-url=""
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281596    2565 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281600    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281603    2565 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281607    2565 flags.go:64] FLAG: --max-pods="110"
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281610    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281613    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281616    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281620    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281623    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 00:58:03.286299 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281626    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281629    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281637    2565 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281640    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281644    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281647    2565 flags.go:64] FLAG: --pod-cidr=""
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281650    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281655    2565 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281658    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281661    2565 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281665    2565 flags.go:64] FLAG: --port="10250"
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281668    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281671    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00e42818d559d69c6"
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281674    2565 flags.go:64] FLAG: --qos-reserved=""
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281677    2565 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281680    2565 flags.go:64] FLAG: --register-node="true"
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281683    2565 flags.go:64] FLAG: --register-with-taints=""
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281687    2565 flags.go:64] FLAG: --registry-burst="10"
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281689    2565 flags.go:64] FLAG: --registry-qps="5"
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281693    2565 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281696    2565 flags.go:64] FLAG: --reserved-memory=""
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281700    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281703    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281706    2565 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281709    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 00:58:03.286940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281712    2565 flags.go:64] FLAG: --runonce="false"
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281715    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281718    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281721    2565 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281725    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281727    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281730    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281734    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281737    2565 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281740    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281742    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281745    2565 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281749    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281752    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281755    2565 flags.go:64] FLAG: --system-cgroups=""
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281758    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281764    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281767    2565 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281769    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281773    2565 flags.go:64] FLAG: --tls-min-version=""
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281776    2565 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281779    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281782    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281785    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281788    2565 flags.go:64] FLAG: --v="2"
Sep 11 00:58:03.287659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281792    2565 flags.go:64] FLAG: --version="false"
Sep 11 00:58:03.288292 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281796    2565 flags.go:64] FLAG: --vmodule=""
Sep 11 00:58:03.288292 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281801    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 00:58:03.288292 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.281804    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 00:58:03.288292 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281944    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 00:58:03.288292 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281949    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 00:58:03.288292 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281953    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 00:58:03.288292 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281956    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 00:58:03.288292 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281959    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 00:58:03.288292 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281962    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 00:58:03.288292 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281965    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 00:58:03.288292 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281967    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 00:58:03.288292 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281970    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 00:58:03.288292 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281973    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 00:58:03.288292 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281976    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 00:58:03.288292 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281978    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 00:58:03.288292 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281981    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 00:58:03.288292 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281984    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 00:58:03.288292 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281987    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 00:58:03.288292 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281990    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 00:58:03.288292 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281992    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 00:58:03.288782 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281995    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 00:58:03.288782 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.281997    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 00:58:03.288782 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282000    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 00:58:03.288782 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282003    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 00:58:03.288782 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282005    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 00:58:03.288782 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282008    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 00:58:03.288782 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282010    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 00:58:03.288782 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282013    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 00:58:03.288782 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282016    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 00:58:03.288782 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282018    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 00:58:03.288782 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282021    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 00:58:03.288782 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282024    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 00:58:03.288782 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282029    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 00:58:03.288782 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282032    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 00:58:03.288782 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282035    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 00:58:03.288782 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282039    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 00:58:03.288782 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282041    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 00:58:03.288782 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282044    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 00:58:03.288782 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282047    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 00:58:03.288782 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282049    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 00:58:03.289331 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282052    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 00:58:03.289331 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282056    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 00:58:03.289331 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282059    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 00:58:03.289331 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282062    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 00:58:03.289331 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282065    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 00:58:03.289331 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282068    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 00:58:03.289331 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282071    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 00:58:03.289331 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282073    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 00:58:03.289331 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282076    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 00:58:03.289331 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282079    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 00:58:03.289331 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282081    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 00:58:03.289331 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282084    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 00:58:03.289331 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282086    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 00:58:03.289331 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282089    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 00:58:03.289331 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282092    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 00:58:03.289331 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282094    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 00:58:03.289331 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282097    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 00:58:03.289331 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282099    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 00:58:03.289331 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282102    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 00:58:03.289798 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282104    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 00:58:03.289798 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282107    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 00:58:03.289798 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282110    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 00:58:03.289798 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282112    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 00:58:03.289798 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282117    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 00:58:03.289798 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282121    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 00:58:03.289798 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282124    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 00:58:03.289798 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282126    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 00:58:03.289798 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282129    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 00:58:03.289798 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282132    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 00:58:03.289798 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282135    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 00:58:03.289798 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282137    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 00:58:03.289798 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282140    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 00:58:03.289798 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282142    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 00:58:03.289798 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282145    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 00:58:03.289798 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282148    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 00:58:03.289798 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282150    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 00:58:03.289798 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282153    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 00:58:03.289798 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282155    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 00:58:03.289798 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282158    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 00:58:03.290301 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282161    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 00:58:03.290301 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282163    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 00:58:03.290301 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282166    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 00:58:03.290301 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282168    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 00:58:03.290301 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282171    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 00:58:03.290301 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282173    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 00:58:03.290301 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282176    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 00:58:03.290301 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282178    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 00:58:03.290301 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282181    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 00:58:03.290301 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282184    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 00:58:03.290301 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282186    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 00:58:03.290301 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282189    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 00:58:03.290301 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282192    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 00:58:03.290301 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282196    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 00:58:03.290301 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282199    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 00:58:03.290301 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282202    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 00:58:03.290301 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282207    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 00:58:03.290301 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282212    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 00:58:03.290301 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282215    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 00:58:03.290777 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282217    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 00:58:03.290777 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282220    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 00:58:03.290777 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282224    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 00:58:03.290777 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.282227    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 00:58:03.290777 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.282979    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 00:58:03.290777 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.290512    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 00:58:03.290777 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.290527    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 00:58:03.290777 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.290549    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 00:58:03.290777 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.290555    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 00:58:03.290777 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290610    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 00:58:03.290777 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290616    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 00:58:03.290777 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290620    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 00:58:03.290777 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290623    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 00:58:03.290777 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290626    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 00:58:03.290777 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290629    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 00:58:03.291199 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290632    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 00:58:03.291199 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290635    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 00:58:03.291199 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290638    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 00:58:03.291199 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290641    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 00:58:03.291199 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290644    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 00:58:03.291199 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290646    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 00:58:03.291199 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290649    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 00:58:03.291199 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290652    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 00:58:03.291199 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290654    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 00:58:03.291199 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290657    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 00:58:03.291199 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290660    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 00:58:03.291199 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290663    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 00:58:03.291199 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290666    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 00:58:03.291199 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290668    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 00:58:03.291199 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290671    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 00:58:03.291199 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290673    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 00:58:03.291199 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290676    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 00:58:03.291199 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290679    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 00:58:03.291199 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290681    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 00:58:03.291199 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290684    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 00:58:03.291672 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290686    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 00:58:03.291672 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290689    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 00:58:03.291672 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290692    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 00:58:03.291672 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290697    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 00:58:03.291672 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290700    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 00:58:03.291672 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290702    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 00:58:03.291672 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290705    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 00:58:03.291672 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290708    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 00:58:03.291672 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290711    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 00:58:03.291672 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290713    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 00:58:03.291672 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290715    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 00:58:03.291672 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290718    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 00:58:03.291672 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290720    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 00:58:03.291672 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290723    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 00:58:03.291672 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290725    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 00:58:03.291672 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290728    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 00:58:03.291672 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290730    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 00:58:03.291672 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290733    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 00:58:03.291672 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290744    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 00:58:03.292253 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290747    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 00:58:03.292253 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290750    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 00:58:03.292253 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290752    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 00:58:03.292253 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290755    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 00:58:03.292253 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290758    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 00:58:03.292253 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290760    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 00:58:03.292253 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290763    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 00:58:03.292253 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290767    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 00:58:03.292253 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290771    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 00:58:03.292253 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290774    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 00:58:03.292253 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290777    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 00:58:03.292253 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290780    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 00:58:03.292253 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290784    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 00:58:03.292253 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290787    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 00:58:03.292253 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290790    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 00:58:03.292253 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290793    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 00:58:03.292253 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290797    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 00:58:03.292253 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290801    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 00:58:03.292253 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290804    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 00:58:03.292710 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290807    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 00:58:03.292710 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290809    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 00:58:03.292710 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290826    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 00:58:03.292710 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290830    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 00:58:03.292710 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290834    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 00:58:03.292710 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290838    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 00:58:03.292710 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290841    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 00:58:03.292710 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290844    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 00:58:03.292710 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290847    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 00:58:03.292710 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290849    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 00:58:03.292710 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290852    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 00:58:03.292710 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290854    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 00:58:03.292710 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290857    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 00:58:03.292710 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290860    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 00:58:03.292710 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290863    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 00:58:03.292710 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290865    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 00:58:03.292710 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290868    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 00:58:03.292710 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290870    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 00:58:03.292710 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290873    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 00:58:03.292710 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290876    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 00:58:03.293207 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290878    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 00:58:03.293207 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290882    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 00:58:03.293207 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290885    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 00:58:03.293207 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290887    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 00:58:03.293207 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290890    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 00:58:03.293207 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290894    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 00:58:03.293207 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290897    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 00:58:03.293207 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290900    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 00:58:03.293207 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290904    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 00:58:03.293207 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290908    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 00:58:03.293207 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290911    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 00:58:03.293207 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290919    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 00:58:03.293207 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290922    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 00:58:03.293207 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290925    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 00:58:03.293207 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.290927    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 00:58:03.293571 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.290932    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 00:58:03.293571 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291047    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 00:58:03.293571 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291052    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 00:58:03.293571 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291056    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 00:58:03.293571 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291058    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 00:58:03.293571 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291061    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 00:58:03.293571 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291064    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 00:58:03.293571 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291066    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 00:58:03.293571 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291069    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 00:58:03.293571 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291071    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 00:58:03.293571 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291074    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 00:58:03.293571 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291076    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 00:58:03.293571 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291079    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 00:58:03.293571 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291082    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 00:58:03.293571 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291084    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 00:58:03.293967 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291088    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 00:58:03.293967 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291091    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 00:58:03.293967 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291094    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 00:58:03.293967 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291097    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 00:58:03.293967 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291100    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 00:58:03.293967 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291102    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 00:58:03.293967 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291105    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 00:58:03.293967 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291107    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 00:58:03.293967 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291110    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 00:58:03.293967 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291113    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 00:58:03.293967 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291116    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 00:58:03.293967 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291118    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 00:58:03.293967 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291121    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 00:58:03.293967 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291124    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 00:58:03.293967 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291127    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 00:58:03.293967 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291130    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 00:58:03.293967 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291132    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 00:58:03.293967 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291135    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 00:58:03.293967 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291138    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 00:58:03.293967 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291140    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 00:58:03.294462 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291143    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 00:58:03.294462 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291145    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 00:58:03.294462 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291148    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 00:58:03.294462 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291150    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 00:58:03.294462 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291153    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 00:58:03.294462 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291155    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 00:58:03.294462 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291158    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 00:58:03.294462 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291160    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 00:58:03.294462 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291163    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 00:58:03.294462 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291165    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 00:58:03.294462 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291168    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 00:58:03.294462 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291170    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 00:58:03.294462 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291173    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 00:58:03.294462 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291177    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 00:58:03.294462 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291180    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 00:58:03.294462 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291183    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 00:58:03.294462 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291186    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 00:58:03.294462 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291189    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 00:58:03.294462 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291192    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 00:58:03.294462 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291194    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 00:58:03.294983 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291197    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 00:58:03.294983 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291199    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 00:58:03.294983 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291202    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 00:58:03.294983 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291205    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 00:58:03.294983 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291208    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 00:58:03.294983 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291211    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 00:58:03.294983 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291214    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 00:58:03.294983 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291216    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 00:58:03.294983 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291219    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 00:58:03.294983 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291222    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 00:58:03.294983 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291224    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 00:58:03.294983 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291227    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 00:58:03.294983 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291229    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 00:58:03.294983 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291232    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 00:58:03.294983 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291234    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 00:58:03.294983 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291237    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 00:58:03.294983 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291239    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 00:58:03.294983 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291242    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 00:58:03.294983 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291244    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 00:58:03.294983 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291247    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 00:58:03.295471 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291249    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 00:58:03.295471 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291252    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 00:58:03.295471 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291256    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 00:58:03.295471 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291259    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 00:58:03.295471 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291262    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 00:58:03.295471 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291265    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 00:58:03.295471 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291268    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 00:58:03.295471 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291271    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 00:58:03.295471 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291273    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 00:58:03.295471 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291276    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 00:58:03.295471 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291279    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 00:58:03.295471 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291282    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 00:58:03.295471 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291284    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 00:58:03.295471 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291287    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 00:58:03.295471 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291290    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 00:58:03.295471 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291292    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 00:58:03.295471 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291295    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 00:58:03.295471 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291298    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 00:58:03.295471 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291300    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 00:58:03.295990 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291303    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 00:58:03.295990 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291306    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 00:58:03.295990 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291308    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 00:58:03.295990 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291311    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 00:58:03.295990 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291313    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 00:58:03.295990 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:03.291316    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 00:58:03.295990 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.291321    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 00:58:03.295990 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.291455    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 00:58:03.295990 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.293763    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 00:58:03.295990 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.294839    2565 server.go:1019] "Starting client certificate rotation"
Sep 11 00:58:03.295990 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.294940    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 00:58:03.295990 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.294976    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 00:58:03.297859 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.297838    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 00:58:03.304132 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.304111    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 00:58:03.315462 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.315436    2565 log.go:25] "Validated CRI v1 runtime API"
Sep 11 00:58:03.320198 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.320180    2565 log.go:25] "Validated CRI v1 image API"
Sep 11 00:58:03.321116 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.321097    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 00:58:03.323362 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.323340    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 00:58:03.323681 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.323662    2565 fs.go:135] Filesystem UUIDs: map[54c891d0-61f4-4b81-b9bb-46802f5b75dc:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 88aaba7d-b117-4cef-8a1e-3c52659dda5e:/dev/nvme0n1p4]
Sep 11 00:58:03.323714 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.323681    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 00:58:03.330340 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.330227    2565 manager.go:216] Machine: {Timestamp:2026-09-11 00:58:03.32799256 +0000 UTC m=+0.376080797 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098387 MemoryCapacity:33164468224 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26cfb67cc87304bc2603cc11aeaae9 SystemUUID:ec26cfb6-7cc8-7304-bc26-03cc11aeaae9 BootID:f488fc25-36b9-457e-9445-e6edce82a020 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582234112 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:85:e2:e5:4f:71 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:85:e2:e5:4f:71 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:a9:00:5a:4b:81 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164468224 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 00:58:03.330340 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.330334    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 00:58:03.330443 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.330423    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 00:58:03.333799 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.333771    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 00:58:03.333963 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.333803    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-50.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 00:58:03.335270 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.335259    2565 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 00:58:03.335307 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.335273    2565 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 00:58:03.335307 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.335280    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 00:58:03.336105 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.336095    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 00:58:03.337343 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.337333    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 00:58:03.341713 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.341701    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 00:58:03.341852 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.341842    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 00:58:03.341882 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.341874    2565 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 00:58:03.341910 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.341884    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 00:58:03.341910 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.341900    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 00:58:03.341910 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.341909    2565 kubelet.go:398] "Adding apiserver pod source"
Sep 11 00:58:03.341996 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.341918    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 00:58:03.342331 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.342319    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 00:58:03.342371 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.342337    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 00:58:03.345087 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.345069    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 00:58:03.345305 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.345289    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g6r9k"
Sep 11 00:58:03.348034 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.348018    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 00:58:03.348120 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.348057    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 00:58:03.350086 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.350070    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 00:58:03.350152 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.350097    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 00:58:03.350152 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.350113    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 00:58:03.350152 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.350121    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 00:58:03.350152 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.350133    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 00:58:03.350152 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.350142    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 00:58:03.350338 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.350161    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 00:58:03.350338 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.350170    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 00:58:03.350338 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.350179    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 00:58:03.350338 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.350187    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 00:58:03.350338 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.350210    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 00:58:03.350338 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.350219    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 00:58:03.351095 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.351083    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 00:58:03.351161 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.351097    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 00:58:03.352054 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.352020    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g6r9k"
Sep 11 00:58:03.352315 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:03.352287    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-50.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 00:58:03.352377 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:03.352288    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 00:58:03.355057 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.355041    2565 server.go:1268] "Started kubelet"
Sep 11 00:58:03.355187 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.355121    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 00:58:03.355240 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.355152    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 00:58:03.355290 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.355273    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 00:58:03.356031 ip-10-0-133-50 systemd[1]: Started Kubernetes Kubelet.
Sep 11 00:58:03.357748 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.357708    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 00:58:03.360179 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.360119    2565 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 00:58:03.363261 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:03.363231    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 00:58:03.366853 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.366836    2565 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-133-50.ec2.internal" not found
Sep 11 00:58:03.368343 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.368321    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 00:58:03.368343 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.368329    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 00:58:03.368489 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:03.368454    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-50.ec2.internal\" not found"
Sep 11 00:58:03.369055 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.368986    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 00:58:03.369055 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.369003    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 00:58:03.369055 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.369005    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 00:58:03.369239 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.369066    2565 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 00:58:03.369239 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.369074    2565 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 00:58:03.369239 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.369208    2565 factory.go:55] Registering systemd factory
Sep 11 00:58:03.369239 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.369222    2565 factory.go:223] Registration of the systemd container factory successfully
Sep 11 00:58:03.369434 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.369421    2565 factory.go:153] Registering CRI-O factory
Sep 11 00:58:03.369493 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.369438    2565 factory.go:223] Registration of the crio container factory successfully
Sep 11 00:58:03.369545 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.369493    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 00:58:03.369545 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.369518    2565 factory.go:103] Registering Raw factory
Sep 11 00:58:03.369545 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.369535    2565 manager.go:1196] Started watching for new ooms in manager
Sep 11 00:58:03.369907 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.369894    2565 manager.go:349] Starting recovery of all containers
Sep 11 00:58:03.370453 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.370431    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 00:58:03.374523 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:03.374501    2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-50.ec2.internal\" not found" node="ip-10-0-133-50.ec2.internal"
Sep 11 00:58:03.381088 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.381069    2565 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-133-50.ec2.internal" not found
Sep 11 00:58:03.382543 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.382371    2565 manager.go:354] Recovery completed
Sep 11 00:58:03.388658 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.388644    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 00:58:03.390911 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.390894    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 00:58:03.390987 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.390934    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 00:58:03.390987 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.390945    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeHasSufficientPID"
Sep 11 00:58:03.391571 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.391556    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 00:58:03.391571 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.391568    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 00:58:03.391571 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.391570    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 00:58:03.391723 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.391590    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 00:58:03.393760 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.393745    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 00:58:03.393851 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.393774    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 00:58:03.393851 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.393787    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeHasSufficientPID"
Sep 11 00:58:03.393851 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.393843    2565 policy_none.go:49] "None policy: Start"
Sep 11 00:58:03.393963 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.393856    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 00:58:03.393963 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.393866    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 00:58:03.395905 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.395890    2565 policy_none.go:47] "Start"
Sep 11 00:58:03.419396 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.419380    2565 manager.go:337] "Starting Device Plugin manager"
Sep 11 00:58:03.419505 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:03.419433    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 00:58:03.419505 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.419446    2565 server.go:87] "Starting device plugin registration server"
Sep 11 00:58:03.419790 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.419776    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 00:58:03.419870 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.419795    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 00:58:03.419922 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.419903    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 00:58:03.419988 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.419976    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 00:58:03.420044 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.419989    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 00:58:03.420786 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:03.420768    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 00:58:03.420901 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:03.420839    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-50.ec2.internal\" not found"
Sep 11 00:58:03.437371 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.437353    2565 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-133-50.ec2.internal" not found
Sep 11 00:58:03.463693 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.463665    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 00:58:03.464802 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.464773    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 00:58:03.464908 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.464857    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 00:58:03.464908 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.464895    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 00:58:03.465009 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:03.465000    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 00:58:03.466732 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.466714    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 00:58:03.520643 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.520518    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 00:58:03.524504 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.524487    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 00:58:03.524578 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.524522    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 00:58:03.524578 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.524539    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeHasSufficientPID"
Sep 11 00:58:03.524578 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.524562    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-50.ec2.internal"
Sep 11 00:58:03.531802 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.531785    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-50.ec2.internal"
Sep 11 00:58:03.531861 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:03.531805    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-50.ec2.internal\": node \"ip-10-0-133-50.ec2.internal\" not found"
Sep 11 00:58:03.551570 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:03.551550    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-50.ec2.internal\" not found"
Sep 11 00:58:03.565645 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.565620    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-50.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-50.ec2.internal"]
Sep 11 00:58:03.565710 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.565693    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 00:58:03.566609 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.566589    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 00:58:03.566680 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.566627    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 00:58:03.566680 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.566642    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeHasSufficientPID"
Sep 11 00:58:03.569007 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.568993    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 00:58:03.569134 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.569117    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-50.ec2.internal"
Sep 11 00:58:03.569174 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.569170    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 00:58:03.569443 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.569427    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81e66132437108534a5882107d478a11-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-50.ec2.internal\" (UID: \"81e66132437108534a5882107d478a11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-50.ec2.internal"
Sep 11 00:58:03.569501 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.569457    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4fb1adafb19db39c244c8db6f1113504-config\") pod \"kube-apiserver-proxy-ip-10-0-133-50.ec2.internal\" (UID: \"4fb1adafb19db39c244c8db6f1113504\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-50.ec2.internal"
Sep 11 00:58:03.569501 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.569482    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/81e66132437108534a5882107d478a11-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-50.ec2.internal\" (UID: \"81e66132437108534a5882107d478a11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-50.ec2.internal"
Sep 11 00:58:03.569864 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.569849    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 00:58:03.569918 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.569881    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 00:58:03.569918 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.569893    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeHasSufficientPID"
Sep 11 00:58:03.569978 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.569854    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 00:58:03.569978 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.569945    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 00:58:03.569978 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.569955    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeHasSufficientPID"
Sep 11 00:58:03.572085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.572070    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-50.ec2.internal"
Sep 11 00:58:03.572155 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.572098    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 00:58:03.572933 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.572914    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 00:58:03.573016 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.572945    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 00:58:03.573016 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.572960    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeHasSufficientPID"
Sep 11 00:58:03.595623 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:03.595601    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-50.ec2.internal\" not found" node="ip-10-0-133-50.ec2.internal"
Sep 11 00:58:03.600068 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:03.600046    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-50.ec2.internal\" not found" node="ip-10-0-133-50.ec2.internal"
Sep 11 00:58:03.652141 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:03.652113    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-50.ec2.internal\" not found"
Sep 11 00:58:03.669669 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.669641    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/81e66132437108534a5882107d478a11-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-50.ec2.internal\" (UID: \"81e66132437108534a5882107d478a11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-50.ec2.internal"
Sep 11 00:58:03.669766 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.669674    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81e66132437108534a5882107d478a11-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-50.ec2.internal\" (UID: \"81e66132437108534a5882107d478a11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-50.ec2.internal"
Sep 11 00:58:03.669766 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.669691    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4fb1adafb19db39c244c8db6f1113504-config\") pod \"kube-apiserver-proxy-ip-10-0-133-50.ec2.internal\" (UID: \"4fb1adafb19db39c244c8db6f1113504\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-50.ec2.internal"
Sep 11 00:58:03.669766 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.669736    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4fb1adafb19db39c244c8db6f1113504-config\") pod \"kube-apiserver-proxy-ip-10-0-133-50.ec2.internal\" (UID: \"4fb1adafb19db39c244c8db6f1113504\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-50.ec2.internal"
Sep 11 00:58:03.669766 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.669738    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/81e66132437108534a5882107d478a11-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-50.ec2.internal\" (UID: \"81e66132437108534a5882107d478a11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-50.ec2.internal"
Sep 11 00:58:03.669936 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.669746    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81e66132437108534a5882107d478a11-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-50.ec2.internal\" (UID: \"81e66132437108534a5882107d478a11\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-50.ec2.internal"
Sep 11 00:58:03.752361 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:03.752326    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-50.ec2.internal\" not found"
Sep 11 00:58:03.853139 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:03.853066    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-50.ec2.internal\" not found"
Sep 11 00:58:03.898548 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.898518    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-50.ec2.internal"
Sep 11 00:58:03.902157 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:03.902141    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-50.ec2.internal"
Sep 11 00:58:03.953528 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:03.953495    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-50.ec2.internal\" not found"
Sep 11 00:58:04.057000 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:04.056968    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-50.ec2.internal\" not found"
Sep 11 00:58:04.157609 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:04.157518    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-50.ec2.internal\" not found"
Sep 11 00:58:04.257746 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:04.257715    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-50.ec2.internal\" not found"
Sep 11 00:58:04.294659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:04.294622    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 00:58:04.295178 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:04.294808    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 00:58:04.295178 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:04.294845    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 00:58:04.358868 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:04.358827    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-50.ec2.internal\" not found"
Sep 11 00:58:04.359030 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:04.358849    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 00:53:03 +0000 UTC" deadline="2028-04-24 11:54:00.985334881 +0000 UTC"
Sep 11 00:58:04.359030 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:04.358898    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14194h55m56.626439625s"
Sep 11 00:58:04.459513 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:04.459444    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-50.ec2.internal\" not found"
Sep 11 00:58:04.560462 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:04.560424    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-50.ec2.internal\" not found"
Sep 11 00:58:04.610633 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:04.610595    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb1adafb19db39c244c8db6f1113504.slice/crio-9c879c9f3a4886cfd3b62e349c9b6431de350bc174c7e9aa0d1a991763566efd WatchSource:0}: Error finding container 9c879c9f3a4886cfd3b62e349c9b6431de350bc174c7e9aa0d1a991763566efd: Status 404 returned error can't find the container with id 9c879c9f3a4886cfd3b62e349c9b6431de350bc174c7e9aa0d1a991763566efd
Sep 11 00:58:04.617045 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:04.617025    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81e66132437108534a5882107d478a11.slice/crio-76407dc7fe5737f5f880a1ec40dc429c70452f94b586a897c79f03cf4f97eabe WatchSource:0}: Error finding container 76407dc7fe5737f5f880a1ec40dc429c70452f94b586a897c79f03cf4f97eabe: Status 404 returned error can't find the container with id 76407dc7fe5737f5f880a1ec40dc429c70452f94b586a897c79f03cf4f97eabe
Sep 11 00:58:04.617613 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:04.617595    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 00:58:04.661267 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:04.661235    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-50.ec2.internal\" not found"
Sep 11 00:58:04.764613 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:04.764532    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-50.ec2.internal\" not found"
Sep 11 00:58:04.856650 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:04.856622    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 00:58:04.865024 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:04.865006    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-50.ec2.internal\" not found"
Sep 11 00:58:04.865097 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:04.865035    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 00:58:04.868932 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:04.868918    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-50.ec2.internal"
Sep 11 00:58:04.879803 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:04.879785    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 00:58:04.881003 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:04.880990    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-50.ec2.internal"
Sep 11 00:58:04.887396 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:04.887380    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 00:58:05.208028 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.207952    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 00:58:05.342602 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.342561    2565 apiserver.go:52] "Watching apiserver"
Sep 11 00:58:05.351877 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.351833    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 00:58:05.352253 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.352229    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-50.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw","openshift-image-registry/node-ca-82qsg","openshift-multus/multus-additional-cni-plugins-s6mbf","openshift-network-diagnostics/network-check-target-fvsdv","openshift-network-operator/iptables-alerter-6zkrd","openshift-cluster-node-tuning-operator/tuned-dcjgt","openshift-dns/node-resolver-j54j2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-50.ec2.internal","openshift-multus/multus-fn26l","openshift-multus/network-metrics-daemon-zcgvb","openshift-ovn-kubernetes/ovnkube-node-z8dkq","kube-system/global-pull-secret-syncer-l5vqt","kube-system/konnectivity-agent-5v8vh"]
Sep 11 00:58:05.354935 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.354909    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.357846 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.357301    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:05.357846 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:05.357799    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vqt" podUID="32548afa-eedf-4970-8638-fabf8025db48"
Sep 11 00:58:05.360243 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.359828    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 00:58:05.360243 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.360098    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 00:58:05.361309 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.361291    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7ltgl\""
Sep 11 00:58:05.362691 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.362666    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-82qsg"
Sep 11 00:58:05.364657 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.364635    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.365958 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.365807    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h5msj\""
Sep 11 00:58:05.365958 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.365824    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 00:58:05.365958 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.365825    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 00:58:05.366173 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.366076    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 00:58:05.366575 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.366556    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 00:58:05.366722 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.366706    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4kzqs\""
Sep 11 00:58:05.367326 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.367310    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 00:58:05.367411 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.367355    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 00:58:05.367705 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.367589    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 00:58:05.367915 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.367873    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:05.368000 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.367934    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 00:58:05.368000 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:05.367948    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fvsdv" podUID="c503c185-5ecf-4968-b9dd-13045d83c29c"
Sep 11 00:58:05.369210 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.369189    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 00:58:05.370615 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.370596    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6zkrd"
Sep 11 00:58:05.372721 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.372615    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 00:58:05.373257 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.373033    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 00:58:05.373257 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.373041    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z7kn5\""
Sep 11 00:58:05.373257 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.373041    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 00:58:05.373257 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.373197    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5v8vh"
Sep 11 00:58:05.375446 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.375183    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 00:58:05.375684 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.375663    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j54j2"
Sep 11 00:58:05.376061 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.376039    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hccqm\""
Sep 11 00:58:05.376237 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.376213    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 00:58:05.378440 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.377748    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 00:58:05.378440 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.378224    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.379234 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.379187    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 00:58:05.379408 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.379391    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l9lcz\""
Sep 11 00:58:05.380590 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.380565    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/670aa39b-e38c-48b8-af6e-472baab4491b-host-slash\") pod \"iptables-alerter-6zkrd\" (UID: \"670aa39b-e38c-48b8-af6e-472baab4491b\") " pod="openshift-network-operator/iptables-alerter-6zkrd"
Sep 11 00:58:05.380689 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.380605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-etc-sysconfig\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.380689 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.380642    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-etc-sysctl-conf\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.380689 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.380665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-host\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.380893 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.380736    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/830feca5-59a2-4352-92ff-67852cf13bfd-cni-binary-copy\") pod \"multus-additional-cni-plugins-s6mbf\" (UID: \"830feca5-59a2-4352-92ff-67852cf13bfd\") " pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.380893 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.380764    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-etc-kubernetes\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.380893 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.380790    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw962\" (UniqueName: \"kubernetes.io/projected/1f60b232-db7b-49c6-b64e-94ff1b3873c6-kube-api-access-dw962\") pod \"node-ca-82qsg\" (UID: \"1f60b232-db7b-49c6-b64e-94ff1b3873c6\") " pod="openshift-image-registry/node-ca-82qsg"
Sep 11 00:58:05.380893 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.380814    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-etc-sysctl-d\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.380893 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.380838    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-lib-modules\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.381124 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.380871    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-var-lib-kubelet\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.381124 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.380919    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/32548afa-eedf-4970-8638-fabf8025db48-dbus\") pod \"global-pull-secret-syncer-l5vqt\" (UID: \"32548afa-eedf-4970-8638-fabf8025db48\") " pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:05.381124 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.380946    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/830feca5-59a2-4352-92ff-67852cf13bfd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s6mbf\" (UID: \"830feca5-59a2-4352-92ff-67852cf13bfd\") " pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.381124 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381005    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv8xh\" (UniqueName: \"kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh\") pod \"network-check-target-fvsdv\" (UID: \"c503c185-5ecf-4968-b9dd-13045d83c29c\") " pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:05.381124 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/670aa39b-e38c-48b8-af6e-472baab4491b-iptables-alerter-script\") pod \"iptables-alerter-6zkrd\" (UID: \"670aa39b-e38c-48b8-af6e-472baab4491b\") " pod="openshift-network-operator/iptables-alerter-6zkrd"
Sep 11 00:58:05.381124 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381074    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret\") pod \"global-pull-secret-syncer-l5vqt\" (UID: \"32548afa-eedf-4970-8638-fabf8025db48\") " pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:05.381124 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381101    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zttbk\" (UniqueName: \"kubernetes.io/projected/830feca5-59a2-4352-92ff-67852cf13bfd-kube-api-access-zttbk\") pod \"multus-additional-cni-plugins-s6mbf\" (UID: \"830feca5-59a2-4352-92ff-67852cf13bfd\") " pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.381345 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381124    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 00:58:05.381345 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.380879    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 00:58:05.381345 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381315    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d56n4\""
Sep 11 00:58:05.381485 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-run\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.381485 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381393    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-etc-modprobe-d\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.381485 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381439    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/830feca5-59a2-4352-92ff-67852cf13bfd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s6mbf\" (UID: \"830feca5-59a2-4352-92ff-67852cf13bfd\") " pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.381643 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381486    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 00:58:05.381643 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m27bm\" (UniqueName: \"kubernetes.io/projected/670aa39b-e38c-48b8-af6e-472baab4491b-kube-api-access-m27bm\") pod \"iptables-alerter-6zkrd\" (UID: \"670aa39b-e38c-48b8-af6e-472baab4491b\") " pod="openshift-network-operator/iptables-alerter-6zkrd"
Sep 11 00:58:05.381643 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381517    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 00:58:05.381643 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381525    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd0f9557-5529-4484-b9f2-9f17d425ebb2-tmp\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.381643 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381557    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blm8t\" (UniqueName: \"kubernetes.io/projected/cd0f9557-5529-4484-b9f2-9f17d425ebb2-kube-api-access-blm8t\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.381643 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f60b232-db7b-49c6-b64e-94ff1b3873c6-host\") pod \"node-ca-82qsg\" (UID: \"1f60b232-db7b-49c6-b64e-94ff1b3873c6\") " pod="openshift-image-registry/node-ca-82qsg"
Sep 11 00:58:05.381643 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381619    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1f60b232-db7b-49c6-b64e-94ff1b3873c6-serviceca\") pod \"node-ca-82qsg\" (UID: \"1f60b232-db7b-49c6-b64e-94ff1b3873c6\") " pod="openshift-image-registry/node-ca-82qsg"
Sep 11 00:58:05.381971 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381658    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/830feca5-59a2-4352-92ff-67852cf13bfd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s6mbf\" (UID: \"830feca5-59a2-4352-92ff-67852cf13bfd\") " pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.381971 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381679    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-sys\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.381971 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381697    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-etc-systemd\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.381971 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381729    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/830feca5-59a2-4352-92ff-67852cf13bfd-system-cni-dir\") pod \"multus-additional-cni-plugins-s6mbf\" (UID: \"830feca5-59a2-4352-92ff-67852cf13bfd\") " pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.381971 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381754    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cd0f9557-5529-4484-b9f2-9f17d425ebb2-etc-tuned\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.381971 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381781    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/32548afa-eedf-4970-8638-fabf8025db48-kubelet-config\") pod \"global-pull-secret-syncer-l5vqt\" (UID: \"32548afa-eedf-4970-8638-fabf8025db48\") " pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:05.381971 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.381801    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/830feca5-59a2-4352-92ff-67852cf13bfd-cnibin\") pod \"multus-additional-cni-plugins-s6mbf\" (UID: \"830feca5-59a2-4352-92ff-67852cf13bfd\") " pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.382867 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.382460    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.385012 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.384963    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xzpqj\""
Sep 11 00:58:05.385012 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.385000    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 00:58:05.385708 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.385684    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:05.386272 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:05.386237    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcgvb" podUID="544fdaa4-afa7-48dc-9e47-79cdb2200200"
Sep 11 00:58:05.388408 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.388384    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.391045 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.391027    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 00:58:05.392007 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.391463    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 00:58:05.392007 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.391489    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 00:58:05.392007 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.391521    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 00:58:05.392007 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.391532    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 00:58:05.392007 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.391538    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 00:58:05.392406 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.392380    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cmg5c\""
Sep 11 00:58:05.399525 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.399163    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dzfph"
Sep 11 00:58:05.407841 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.407817    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dzfph"
Sep 11 00:58:05.469862 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.469787    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 00:58:05.470552 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.470498    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-50.ec2.internal" event={"ID":"81e66132437108534a5882107d478a11","Type":"ContainerStarted","Data":"76407dc7fe5737f5f880a1ec40dc429c70452f94b586a897c79f03cf4f97eabe"}
Sep 11 00:58:05.472370 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.472344    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-50.ec2.internal" event={"ID":"4fb1adafb19db39c244c8db6f1113504","Type":"ContainerStarted","Data":"9c879c9f3a4886cfd3b62e349c9b6431de350bc174c7e9aa0d1a991763566efd"}
Sep 11 00:58:05.482716 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.482690    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m27bm\" (UniqueName: \"kubernetes.io/projected/670aa39b-e38c-48b8-af6e-472baab4491b-kube-api-access-m27bm\") pod \"iptables-alerter-6zkrd\" (UID: \"670aa39b-e38c-48b8-af6e-472baab4491b\") " pod="openshift-network-operator/iptables-alerter-6zkrd"
Sep 11 00:58:05.482869 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.482728    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/830feca5-59a2-4352-92ff-67852cf13bfd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s6mbf\" (UID: \"830feca5-59a2-4352-92ff-67852cf13bfd\") " pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.482869 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.482758    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-run-openvswitch\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.482869 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.482789    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-node-log\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.482869 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.482812    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-cnibin\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.483092 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.482850    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-host-var-lib-cni-bin\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.483092 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.482909    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/74a7013b-1f33-426c-9578-83ded48a984a-agent-certs\") pod \"konnectivity-agent-5v8vh\" (UID: \"74a7013b-1f33-426c-9578-83ded48a984a\") " pod="kube-system/konnectivity-agent-5v8vh"
Sep 11 00:58:05.483092 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.482938    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-sys\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.483092 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.482964    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-etc-systemd\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.483092 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.482992    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/830feca5-59a2-4352-92ff-67852cf13bfd-system-cni-dir\") pod \"multus-additional-cni-plugins-s6mbf\" (UID: \"830feca5-59a2-4352-92ff-67852cf13bfd\") " pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.483092 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483016    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-host-slash\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.483092 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483046    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-etc-openvswitch\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.483092 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483082    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd868fba-4915-4bed-9c1b-73c7b0231624-env-overrides\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.483480 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483109    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dlr9\" (UniqueName: \"kubernetes.io/projected/544fdaa4-afa7-48dc-9e47-79cdb2200200-kube-api-access-7dlr9\") pod \"network-metrics-daemon-zcgvb\" (UID: \"544fdaa4-afa7-48dc-9e47-79cdb2200200\") " pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:05.483480 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483138    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cd0f9557-5529-4484-b9f2-9f17d425ebb2-etc-tuned\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.483480 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483162    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-var-lib-openvswitch\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.483480 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483187    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-etc-kubernetes\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.483480 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483225    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgwrd\" (UniqueName: \"kubernetes.io/projected/fdb7c32b-2205-4f0d-9ea2-58c45a059200-kube-api-access-sgwrd\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.483480 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483254    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/670aa39b-e38c-48b8-af6e-472baab4491b-host-slash\") pod \"iptables-alerter-6zkrd\" (UID: \"670aa39b-e38c-48b8-af6e-472baab4491b\") " pod="openshift-network-operator/iptables-alerter-6zkrd"
Sep 11 00:58:05.483480 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483281    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-etc-sysctl-conf\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.483480 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-host\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.483480 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483334    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/830feca5-59a2-4352-92ff-67852cf13bfd-cni-binary-copy\") pod \"multus-additional-cni-plugins-s6mbf\" (UID: \"830feca5-59a2-4352-92ff-67852cf13bfd\") " pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.483480 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483362    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-etc-kubernetes\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.483480 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483446    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-host\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.484148 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483488    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/670aa39b-e38c-48b8-af6e-472baab4491b-host-slash\") pod \"iptables-alerter-6zkrd\" (UID: \"670aa39b-e38c-48b8-af6e-472baab4491b\") " pod="openshift-network-operator/iptables-alerter-6zkrd"
Sep 11 00:58:05.484148 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483511    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-etc-sysctl-conf\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.484148 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483555    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bdd051d0-68f0-449a-bd8c-5c1de79ec29d-hosts-file\") pod \"node-resolver-j54j2\" (UID: \"bdd051d0-68f0-449a-bd8c-5c1de79ec29d\") " pod="openshift-dns/node-resolver-j54j2"
Sep 11 00:58:05.484148 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483557    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-sys\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.484148 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-lib-modules\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.484148 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483595    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/32548afa-eedf-4970-8638-fabf8025db48-dbus\") pod \"global-pull-secret-syncer-l5vqt\" (UID: \"32548afa-eedf-4970-8638-fabf8025db48\") " pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:05.484148 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/830feca5-59a2-4352-92ff-67852cf13bfd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s6mbf\" (UID: \"830feca5-59a2-4352-92ff-67852cf13bfd\") " pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.484148 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv8xh\" (UniqueName: \"kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh\") pod \"network-check-target-fvsdv\" (UID: \"c503c185-5ecf-4968-b9dd-13045d83c29c\") " pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:05.484148 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483646    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/59502062-fcf4-45fa-a9a3-78e0b5cb2c6f-socket-dir\") pod \"aws-ebs-csi-driver-node-6fvqw\" (UID: \"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.484148 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483683    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-etc-kubernetes\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.484148 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483708    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/830feca5-59a2-4352-92ff-67852cf13bfd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s6mbf\" (UID: \"830feca5-59a2-4352-92ff-67852cf13bfd\") " pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.484148 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483727    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd868fba-4915-4bed-9c1b-73c7b0231624-ovnkube-config\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.484148 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483752    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/830feca5-59a2-4352-92ff-67852cf13bfd-cni-binary-copy\") pod \"multus-additional-cni-plugins-s6mbf\" (UID: \"830feca5-59a2-4352-92ff-67852cf13bfd\") " pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.484148 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483757    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd868fba-4915-4bed-9c1b-73c7b0231624-ovnkube-script-lib\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.484148 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483785    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-multus-cni-dir\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.484148 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zttbk\" (UniqueName: \"kubernetes.io/projected/830feca5-59a2-4352-92ff-67852cf13bfd-kube-api-access-zttbk\") pod \"multus-additional-cni-plugins-s6mbf\" (UID: \"830feca5-59a2-4352-92ff-67852cf13bfd\") " pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.484148 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483845    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/830feca5-59a2-4352-92ff-67852cf13bfd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s6mbf\" (UID: \"830feca5-59a2-4352-92ff-67852cf13bfd\") " pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.484953 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483850    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-lib-modules\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.484953 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483846    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-systemd-units\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.484953 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483905    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-host-cni-bin\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.484953 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483922    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/830feca5-59a2-4352-92ff-67852cf13bfd-system-cni-dir\") pod \"multus-additional-cni-plugins-s6mbf\" (UID: \"830feca5-59a2-4352-92ff-67852cf13bfd\") " pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.484953 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.483952    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-etc-systemd\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.484953 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484003    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fdb7c32b-2205-4f0d-9ea2-58c45a059200-cni-binary-copy\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.484953 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484014    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/32548afa-eedf-4970-8638-fabf8025db48-dbus\") pod \"global-pull-secret-syncer-l5vqt\" (UID: \"32548afa-eedf-4970-8638-fabf8025db48\") " pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:05.484953 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484040    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-multus-socket-dir-parent\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.484953 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484082    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-host-var-lib-cni-multus\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.484953 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484122    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-hostroot\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.484953 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484157    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-run\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.484953 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484219    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-run\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.484953 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/830feca5-59a2-4352-92ff-67852cf13bfd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s6mbf\" (UID: \"830feca5-59a2-4352-92ff-67852cf13bfd\") " pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.484953 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484308    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2sn6\" (UniqueName: \"kubernetes.io/projected/bdd051d0-68f0-449a-bd8c-5c1de79ec29d-kube-api-access-w2sn6\") pod \"node-resolver-j54j2\" (UID: \"bdd051d0-68f0-449a-bd8c-5c1de79ec29d\") " pod="openshift-dns/node-resolver-j54j2"
Sep 11 00:58:05.484953 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484329    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 00:58:05.484953 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484353    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-system-cni-dir\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.484953 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484397    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-multus-conf-dir\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.484953 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484423    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd0f9557-5529-4484-b9f2-9f17d425ebb2-tmp\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.485825 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484448    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blm8t\" (UniqueName: \"kubernetes.io/projected/cd0f9557-5529-4484-b9f2-9f17d425ebb2-kube-api-access-blm8t\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.485825 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484472    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f60b232-db7b-49c6-b64e-94ff1b3873c6-host\") pod \"node-ca-82qsg\" (UID: \"1f60b232-db7b-49c6-b64e-94ff1b3873c6\") " pod="openshift-image-registry/node-ca-82qsg"
Sep 11 00:58:05.485825 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484506    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1f60b232-db7b-49c6-b64e-94ff1b3873c6-serviceca\") pod \"node-ca-82qsg\" (UID: \"1f60b232-db7b-49c6-b64e-94ff1b3873c6\") " pod="openshift-image-registry/node-ca-82qsg"
Sep 11 00:58:05.485825 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484530    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-host-kubelet\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.485825 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484565    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-host-run-netns\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.485825 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484590    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-host-cni-netd\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.485825 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-host-run-k8s-cni-cncf-io\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.485825 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484642    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/74a7013b-1f33-426c-9578-83ded48a984a-konnectivity-ca\") pod \"konnectivity-agent-5v8vh\" (UID: \"74a7013b-1f33-426c-9578-83ded48a984a\") " pod="kube-system/konnectivity-agent-5v8vh"
Sep 11 00:58:05.485825 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484669    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/32548afa-eedf-4970-8638-fabf8025db48-kubelet-config\") pod \"global-pull-secret-syncer-l5vqt\" (UID: \"32548afa-eedf-4970-8638-fabf8025db48\") " pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:05.485825 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/830feca5-59a2-4352-92ff-67852cf13bfd-cnibin\") pod \"multus-additional-cni-plugins-s6mbf\" (UID: \"830feca5-59a2-4352-92ff-67852cf13bfd\") " pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.485825 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484722    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-294jw\" (UniqueName: \"kubernetes.io/projected/59502062-fcf4-45fa-a9a3-78e0b5cb2c6f-kube-api-access-294jw\") pod \"aws-ebs-csi-driver-node-6fvqw\" (UID: \"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.485825 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484750    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-host-var-lib-kubelet\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.485825 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484756    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/830feca5-59a2-4352-92ff-67852cf13bfd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s6mbf\" (UID: \"830feca5-59a2-4352-92ff-67852cf13bfd\") " pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.485825 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs\") pod \"network-metrics-daemon-zcgvb\" (UID: \"544fdaa4-afa7-48dc-9e47-79cdb2200200\") " pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:05.485825 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484813    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-etc-sysconfig\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.485825 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484878    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/59502062-fcf4-45fa-a9a3-78e0b5cb2c6f-etc-selinux\") pod \"aws-ebs-csi-driver-node-6fvqw\" (UID: \"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.485825 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484921    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/59502062-fcf4-45fa-a9a3-78e0b5cb2c6f-sys-fs\") pod \"aws-ebs-csi-driver-node-6fvqw\" (UID: \"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.486677 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-host-run-netns\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.486677 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.484982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-run-ovn\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.486677 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485010    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-host-run-ovn-kubernetes\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.486677 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485049    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw962\" (UniqueName: \"kubernetes.io/projected/1f60b232-db7b-49c6-b64e-94ff1b3873c6-kube-api-access-dw962\") pod \"node-ca-82qsg\" (UID: \"1f60b232-db7b-49c6-b64e-94ff1b3873c6\") " pod="openshift-image-registry/node-ca-82qsg"
Sep 11 00:58:05.486677 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485074    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.486677 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485108    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-etc-sysctl-d\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.486677 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485147    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-var-lib-kubelet\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.486677 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/59502062-fcf4-45fa-a9a3-78e0b5cb2c6f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6fvqw\" (UID: \"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.486677 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485204    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktnj2\" (UniqueName: \"kubernetes.io/projected/dd868fba-4915-4bed-9c1b-73c7b0231624-kube-api-access-ktnj2\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.486677 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485229    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-host-run-multus-certs\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.486677 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/670aa39b-e38c-48b8-af6e-472baab4491b-iptables-alerter-script\") pod \"iptables-alerter-6zkrd\" (UID: \"670aa39b-e38c-48b8-af6e-472baab4491b\") " pod="openshift-network-operator/iptables-alerter-6zkrd"
Sep 11 00:58:05.486677 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485348    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret\") pod \"global-pull-secret-syncer-l5vqt\" (UID: \"32548afa-eedf-4970-8638-fabf8025db48\") " pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:05.486677 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485374    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/59502062-fcf4-45fa-a9a3-78e0b5cb2c6f-device-dir\") pod \"aws-ebs-csi-driver-node-6fvqw\" (UID: \"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.486677 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485401    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdd051d0-68f0-449a-bd8c-5c1de79ec29d-tmp-dir\") pod \"node-resolver-j54j2\" (UID: \"bdd051d0-68f0-449a-bd8c-5c1de79ec29d\") " pod="openshift-dns/node-resolver-j54j2"
Sep 11 00:58:05.486677 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485424    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fdb7c32b-2205-4f0d-9ea2-58c45a059200-multus-daemon-config\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.486677 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485449    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-etc-modprobe-d\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.487360 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/59502062-fcf4-45fa-a9a3-78e0b5cb2c6f-registration-dir\") pod \"aws-ebs-csi-driver-node-6fvqw\" (UID: \"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.487360 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485497    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-run-systemd\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.487360 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485517    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-log-socket\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.487360 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485538    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd868fba-4915-4bed-9c1b-73c7b0231624-ovn-node-metrics-cert\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.487360 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485633    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/32548afa-eedf-4970-8638-fabf8025db48-kubelet-config\") pod \"global-pull-secret-syncer-l5vqt\" (UID: \"32548afa-eedf-4970-8638-fabf8025db48\") " pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:05.487360 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485762    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-etc-sysconfig\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.487360 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485802    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-etc-sysctl-d\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.487360 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485913    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-etc-modprobe-d\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.487360 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:05.485954    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 00:58:05.487360 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485957    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd0f9557-5529-4484-b9f2-9f17d425ebb2-var-lib-kubelet\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.487360 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.485992    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/830feca5-59a2-4352-92ff-67852cf13bfd-cnibin\") pod \"multus-additional-cni-plugins-s6mbf\" (UID: \"830feca5-59a2-4352-92ff-67852cf13bfd\") " pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.487360 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.486010    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f60b232-db7b-49c6-b64e-94ff1b3873c6-host\") pod \"node-ca-82qsg\" (UID: \"1f60b232-db7b-49c6-b64e-94ff1b3873c6\") " pod="openshift-image-registry/node-ca-82qsg"
Sep 11 00:58:05.487360 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:05.486109    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret podName:32548afa-eedf-4970-8638-fabf8025db48 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:05.986074745 +0000 UTC m=+3.034162967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret") pod "global-pull-secret-syncer-l5vqt" (UID: "32548afa-eedf-4970-8638-fabf8025db48") : object "kube-system"/"original-pull-secret" not registered
Sep 11 00:58:05.487360 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.486483    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/670aa39b-e38c-48b8-af6e-472baab4491b-iptables-alerter-script\") pod \"iptables-alerter-6zkrd\" (UID: \"670aa39b-e38c-48b8-af6e-472baab4491b\") " pod="openshift-network-operator/iptables-alerter-6zkrd"
Sep 11 00:58:05.487360 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.486504    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1f60b232-db7b-49c6-b64e-94ff1b3873c6-serviceca\") pod \"node-ca-82qsg\" (UID: \"1f60b232-db7b-49c6-b64e-94ff1b3873c6\") " pod="openshift-image-registry/node-ca-82qsg"
Sep 11 00:58:05.489758 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.489338    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd0f9557-5529-4484-b9f2-9f17d425ebb2-tmp\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.489758 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.489493    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cd0f9557-5529-4484-b9f2-9f17d425ebb2-etc-tuned\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.492608 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:05.492324    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 00:58:05.492608 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:05.492353    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 00:58:05.492608 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:05.492369    2565 projected.go:196] Error preparing data for projected volume kube-api-access-tv8xh for pod openshift-network-diagnostics/network-check-target-fvsdv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 00:58:05.492608 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:05.492438    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh podName:c503c185-5ecf-4968-b9dd-13045d83c29c nodeName:}" failed. No retries permitted until 2026-09-11 00:58:05.992419611 +0000 UTC m=+3.040507819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tv8xh" (UniqueName: "kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh") pod "network-check-target-fvsdv" (UID: "c503c185-5ecf-4968-b9dd-13045d83c29c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 00:58:05.496548 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.496023    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw962\" (UniqueName: \"kubernetes.io/projected/1f60b232-db7b-49c6-b64e-94ff1b3873c6-kube-api-access-dw962\") pod \"node-ca-82qsg\" (UID: \"1f60b232-db7b-49c6-b64e-94ff1b3873c6\") " pod="openshift-image-registry/node-ca-82qsg"
Sep 11 00:58:05.496548 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.496496    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zttbk\" (UniqueName: \"kubernetes.io/projected/830feca5-59a2-4352-92ff-67852cf13bfd-kube-api-access-zttbk\") pod \"multus-additional-cni-plugins-s6mbf\" (UID: \"830feca5-59a2-4352-92ff-67852cf13bfd\") " pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.496739 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.496687    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m27bm\" (UniqueName: \"kubernetes.io/projected/670aa39b-e38c-48b8-af6e-472baab4491b-kube-api-access-m27bm\") pod \"iptables-alerter-6zkrd\" (UID: \"670aa39b-e38c-48b8-af6e-472baab4491b\") " pod="openshift-network-operator/iptables-alerter-6zkrd"
Sep 11 00:58:05.497140 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.497113    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blm8t\" (UniqueName: \"kubernetes.io/projected/cd0f9557-5529-4484-b9f2-9f17d425ebb2-kube-api-access-blm8t\") pod \"tuned-dcjgt\" (UID: \"cd0f9557-5529-4484-b9f2-9f17d425ebb2\") " pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.586603 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.586571    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-host-kubelet\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.586798 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.586614    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-host-run-netns\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.586798 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.586641    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-host-cni-netd\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.586798 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.586666    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-host-run-k8s-cni-cncf-io\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.586798 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.586686    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-host-kubelet\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.586798 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.586704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/74a7013b-1f33-426c-9578-83ded48a984a-konnectivity-ca\") pod \"konnectivity-agent-5v8vh\" (UID: \"74a7013b-1f33-426c-9578-83ded48a984a\") " pod="kube-system/konnectivity-agent-5v8vh"
Sep 11 00:58:05.586798 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.586716    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-host-run-netns\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.586798 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.586733    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-294jw\" (UniqueName: \"kubernetes.io/projected/59502062-fcf4-45fa-a9a3-78e0b5cb2c6f-kube-api-access-294jw\") pod \"aws-ebs-csi-driver-node-6fvqw\" (UID: \"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.586798 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.586747    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-host-run-k8s-cni-cncf-io\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.586798 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.586724    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-host-cni-netd\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.586798 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.586780    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-host-var-lib-kubelet\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.587349 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.586812    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs\") pod \"network-metrics-daemon-zcgvb\" (UID: \"544fdaa4-afa7-48dc-9e47-79cdb2200200\") " pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:05.587349 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.586864    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/59502062-fcf4-45fa-a9a3-78e0b5cb2c6f-etc-selinux\") pod \"aws-ebs-csi-driver-node-6fvqw\" (UID: \"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.587349 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.586891    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/59502062-fcf4-45fa-a9a3-78e0b5cb2c6f-sys-fs\") pod \"aws-ebs-csi-driver-node-6fvqw\" (UID: \"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.587349 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.586888    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-host-var-lib-kubelet\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.587349 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.586945    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-host-run-netns\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.587349 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.586953    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/59502062-fcf4-45fa-a9a3-78e0b5cb2c6f-sys-fs\") pod \"aws-ebs-csi-driver-node-6fvqw\" (UID: \"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.587349 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.586980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-run-ovn\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.587349 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587004    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-host-run-netns\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.587349 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-host-run-ovn-kubernetes\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.587349 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587038    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-run-ovn\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.587349 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:05.587042    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 00:58:05.587349 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587045    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.587349 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587072    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-host-run-ovn-kubernetes\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.587349 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587077    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/59502062-fcf4-45fa-a9a3-78e0b5cb2c6f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6fvqw\" (UID: \"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.587349 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:05.587123    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs podName:544fdaa4-afa7-48dc-9e47-79cdb2200200 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:06.087098143 +0000 UTC m=+3.135186352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs") pod "network-metrics-daemon-zcgvb" (UID: "544fdaa4-afa7-48dc-9e47-79cdb2200200") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 00:58:05.587349 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktnj2\" (UniqueName: \"kubernetes.io/projected/dd868fba-4915-4bed-9c1b-73c7b0231624-kube-api-access-ktnj2\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.587349 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587157    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.588238 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587169    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-host-run-multus-certs\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.588238 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587170    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/59502062-fcf4-45fa-a9a3-78e0b5cb2c6f-etc-selinux\") pod \"aws-ebs-csi-driver-node-6fvqw\" (UID: \"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.588238 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587210    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/59502062-fcf4-45fa-a9a3-78e0b5cb2c6f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6fvqw\" (UID: \"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.588238 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587244    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-host-run-multus-certs\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.588238 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587318    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/59502062-fcf4-45fa-a9a3-78e0b5cb2c6f-device-dir\") pod \"aws-ebs-csi-driver-node-6fvqw\" (UID: \"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.588238 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587348    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdd051d0-68f0-449a-bd8c-5c1de79ec29d-tmp-dir\") pod \"node-resolver-j54j2\" (UID: \"bdd051d0-68f0-449a-bd8c-5c1de79ec29d\") " pod="openshift-dns/node-resolver-j54j2"
Sep 11 00:58:05.588238 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587372    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fdb7c32b-2205-4f0d-9ea2-58c45a059200-multus-daemon-config\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.588238 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587383    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/74a7013b-1f33-426c-9578-83ded48a984a-konnectivity-ca\") pod \"konnectivity-agent-5v8vh\" (UID: \"74a7013b-1f33-426c-9578-83ded48a984a\") " pod="kube-system/konnectivity-agent-5v8vh"
Sep 11 00:58:05.588238 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587395    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/59502062-fcf4-45fa-a9a3-78e0b5cb2c6f-device-dir\") pod \"aws-ebs-csi-driver-node-6fvqw\" (UID: \"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.588238 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/59502062-fcf4-45fa-a9a3-78e0b5cb2c6f-registration-dir\") pod \"aws-ebs-csi-driver-node-6fvqw\" (UID: \"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.588238 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587439    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-run-systemd\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.588238 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587466    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-log-socket\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.588238 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587512    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-run-systemd\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.588238 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587539    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-log-socket\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.588238 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587543    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/59502062-fcf4-45fa-a9a3-78e0b5cb2c6f-registration-dir\") pod \"aws-ebs-csi-driver-node-6fvqw\" (UID: \"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.588238 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587542    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd868fba-4915-4bed-9c1b-73c7b0231624-ovn-node-metrics-cert\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.588238 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-run-openvswitch\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.589122 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-node-log\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.589122 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587653    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-node-log\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.589122 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587663    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-run-openvswitch\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.589122 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-cnibin\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.589122 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587691    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdd051d0-68f0-449a-bd8c-5c1de79ec29d-tmp-dir\") pod \"node-resolver-j54j2\" (UID: \"bdd051d0-68f0-449a-bd8c-5c1de79ec29d\") " pod="openshift-dns/node-resolver-j54j2"
Sep 11 00:58:05.589122 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587709    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-host-var-lib-cni-bin\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.589122 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587736    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/74a7013b-1f33-426c-9578-83ded48a984a-agent-certs\") pod \"konnectivity-agent-5v8vh\" (UID: \"74a7013b-1f33-426c-9578-83ded48a984a\") " pod="kube-system/konnectivity-agent-5v8vh"
Sep 11 00:58:05.589122 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587751    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-cnibin\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.589122 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587781    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-host-slash\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.589122 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587784    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-host-var-lib-cni-bin\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.589122 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587808    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-etc-openvswitch\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.589122 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587874    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-host-slash\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.589122 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587917    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-etc-openvswitch\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.589122 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd868fba-4915-4bed-9c1b-73c7b0231624-env-overrides\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.589122 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.587960    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dlr9\" (UniqueName: \"kubernetes.io/projected/544fdaa4-afa7-48dc-9e47-79cdb2200200-kube-api-access-7dlr9\") pod \"network-metrics-daemon-zcgvb\" (UID: \"544fdaa4-afa7-48dc-9e47-79cdb2200200\") " pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:05.589122 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588011    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fdb7c32b-2205-4f0d-9ea2-58c45a059200-multus-daemon-config\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.589122 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-var-lib-openvswitch\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.589122 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-etc-kubernetes\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.590039 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgwrd\" (UniqueName: \"kubernetes.io/projected/fdb7c32b-2205-4f0d-9ea2-58c45a059200-kube-api-access-sgwrd\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.590039 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588161    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bdd051d0-68f0-449a-bd8c-5c1de79ec29d-hosts-file\") pod \"node-resolver-j54j2\" (UID: \"bdd051d0-68f0-449a-bd8c-5c1de79ec29d\") " pod="openshift-dns/node-resolver-j54j2"
Sep 11 00:58:05.590039 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588206    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/59502062-fcf4-45fa-a9a3-78e0b5cb2c6f-socket-dir\") pod \"aws-ebs-csi-driver-node-6fvqw\" (UID: \"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.590039 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588229    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-etc-kubernetes\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.590039 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588231    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd868fba-4915-4bed-9c1b-73c7b0231624-ovnkube-config\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.590039 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd868fba-4915-4bed-9c1b-73c7b0231624-ovnkube-script-lib\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.590039 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-multus-cni-dir\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.590039 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-systemd-units\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.590039 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588370    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-host-cni-bin\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.590039 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588397    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fdb7c32b-2205-4f0d-9ea2-58c45a059200-cni-binary-copy\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.590039 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-multus-socket-dir-parent\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.590039 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588450    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd868fba-4915-4bed-9c1b-73c7b0231624-env-overrides\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.590039 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588497    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-host-var-lib-cni-multus\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.590039 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588497    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-var-lib-openvswitch\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.590039 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-host-var-lib-cni-multus\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.590039 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-hostroot\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.590039 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588558    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2sn6\" (UniqueName: \"kubernetes.io/projected/bdd051d0-68f0-449a-bd8c-5c1de79ec29d-kube-api-access-w2sn6\") pod \"node-resolver-j54j2\" (UID: \"bdd051d0-68f0-449a-bd8c-5c1de79ec29d\") " pod="openshift-dns/node-resolver-j54j2"
Sep 11 00:58:05.590039 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-system-cni-dir\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.590949 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-multus-conf-dir\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.590949 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588670    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-multus-conf-dir\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.590949 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588703    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-hostroot\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.590949 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588745    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd868fba-4915-4bed-9c1b-73c7b0231624-ovnkube-config\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.590949 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.588961    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bdd051d0-68f0-449a-bd8c-5c1de79ec29d-hosts-file\") pod \"node-resolver-j54j2\" (UID: \"bdd051d0-68f0-449a-bd8c-5c1de79ec29d\") " pod="openshift-dns/node-resolver-j54j2"
Sep 11 00:58:05.590949 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.589040    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-system-cni-dir\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.590949 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.589070    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/59502062-fcf4-45fa-a9a3-78e0b5cb2c6f-socket-dir\") pod \"aws-ebs-csi-driver-node-6fvqw\" (UID: \"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.590949 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.589071    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd868fba-4915-4bed-9c1b-73c7b0231624-ovnkube-script-lib\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.590949 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.589108    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-host-cni-bin\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.590949 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.589134    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-multus-socket-dir-parent\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.590949 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.589152    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdb7c32b-2205-4f0d-9ea2-58c45a059200-multus-cni-dir\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.590949 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.589187    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd868fba-4915-4bed-9c1b-73c7b0231624-systemd-units\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.590949 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.589694    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fdb7c32b-2205-4f0d-9ea2-58c45a059200-cni-binary-copy\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.591662 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.591635    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd868fba-4915-4bed-9c1b-73c7b0231624-ovn-node-metrics-cert\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.592215 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.592191    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/74a7013b-1f33-426c-9578-83ded48a984a-agent-certs\") pod \"konnectivity-agent-5v8vh\" (UID: \"74a7013b-1f33-426c-9578-83ded48a984a\") " pod="kube-system/konnectivity-agent-5v8vh"
Sep 11 00:58:05.603929 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.603907    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-294jw\" (UniqueName: \"kubernetes.io/projected/59502062-fcf4-45fa-a9a3-78e0b5cb2c6f-kube-api-access-294jw\") pod \"aws-ebs-csi-driver-node-6fvqw\" (UID: \"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.609828 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.609799    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dlr9\" (UniqueName: \"kubernetes.io/projected/544fdaa4-afa7-48dc-9e47-79cdb2200200-kube-api-access-7dlr9\") pod \"network-metrics-daemon-zcgvb\" (UID: \"544fdaa4-afa7-48dc-9e47-79cdb2200200\") " pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:05.610253 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.610235    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgwrd\" (UniqueName: \"kubernetes.io/projected/fdb7c32b-2205-4f0d-9ea2-58c45a059200-kube-api-access-sgwrd\") pod \"multus-fn26l\" (UID: \"fdb7c32b-2205-4f0d-9ea2-58c45a059200\") " pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.610771 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.610751    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktnj2\" (UniqueName: \"kubernetes.io/projected/dd868fba-4915-4bed-9c1b-73c7b0231624-kube-api-access-ktnj2\") pod \"ovnkube-node-z8dkq\" (UID: \"dd868fba-4915-4bed-9c1b-73c7b0231624\") " pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.610934 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.610910    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2sn6\" (UniqueName: \"kubernetes.io/projected/bdd051d0-68f0-449a-bd8c-5c1de79ec29d-kube-api-access-w2sn6\") pod \"node-resolver-j54j2\" (UID: \"bdd051d0-68f0-449a-bd8c-5c1de79ec29d\") " pod="openshift-dns/node-resolver-j54j2"
Sep 11 00:58:05.672138 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.672103    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dcjgt"
Sep 11 00:58:05.683582 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.683561    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-82qsg"
Sep 11 00:58:05.694935 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.694915    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s6mbf"
Sep 11 00:58:05.704594 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.704569    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6zkrd"
Sep 11 00:58:05.711552 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.711535    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5v8vh"
Sep 11 00:58:05.718417 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.718396    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j54j2"
Sep 11 00:58:05.727248 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.727225    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw"
Sep 11 00:58:05.740032 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.740005    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fn26l"
Sep 11 00:58:05.745902 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.745878    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:05.764263 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.764241    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 00:58:05.993235 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.993156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv8xh\" (UniqueName: \"kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh\") pod \"network-check-target-fvsdv\" (UID: \"c503c185-5ecf-4968-b9dd-13045d83c29c\") " pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:05.993386 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:05.993243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret\") pod \"global-pull-secret-syncer-l5vqt\" (UID: \"32548afa-eedf-4970-8638-fabf8025db48\") " pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:05.993386 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:05.993344    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 00:58:05.993386 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:05.993357    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 00:58:05.993386 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:05.993365    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 00:58:05.993386 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:05.993378    2565 projected.go:196] Error preparing data for projected volume kube-api-access-tv8xh for pod openshift-network-diagnostics/network-check-target-fvsdv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 00:58:05.993574 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:05.993458    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret podName:32548afa-eedf-4970-8638-fabf8025db48 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:06.993406869 +0000 UTC m=+4.041495097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret") pod "global-pull-secret-syncer-l5vqt" (UID: "32548afa-eedf-4970-8638-fabf8025db48") : object "kube-system"/"original-pull-secret" not registered
Sep 11 00:58:05.993574 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:05.993477    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh podName:c503c185-5ecf-4968-b9dd-13045d83c29c nodeName:}" failed. No retries permitted until 2026-09-11 00:58:06.993467715 +0000 UTC m=+4.041555927 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv8xh" (UniqueName: "kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh") pod "network-check-target-fvsdv" (UID: "c503c185-5ecf-4968-b9dd-13045d83c29c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 00:58:06.094230 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:06.094198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs\") pod \"network-metrics-daemon-zcgvb\" (UID: \"544fdaa4-afa7-48dc-9e47-79cdb2200200\") " pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:06.094376 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:06.094342    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 00:58:06.094424 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:06.094404    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs podName:544fdaa4-afa7-48dc-9e47-79cdb2200200 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:07.094389399 +0000 UTC m=+4.142477602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs") pod "network-metrics-daemon-zcgvb" (UID: "544fdaa4-afa7-48dc-9e47-79cdb2200200") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 00:58:06.411965 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:06.411836    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 00:53:05 +0000 UTC" deadline="2028-03-28 13:18:51.940382158 +0000 UTC"
Sep 11 00:58:06.411965 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:06.411914    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13548h20m45.528471296s"
Sep 11 00:58:06.732444 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:06.732412    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod830feca5_59a2_4352_92ff_67852cf13bfd.slice/crio-8de6fef858fd7384fd6b1194730552297871232cad5e467e2e40fbcceaf9584e WatchSource:0}: Error finding container 8de6fef858fd7384fd6b1194730552297871232cad5e467e2e40fbcceaf9584e: Status 404 returned error can't find the container with id 8de6fef858fd7384fd6b1194730552297871232cad5e467e2e40fbcceaf9584e
Sep 11 00:58:06.733887 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:06.733862    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f60b232_db7b_49c6_b64e_94ff1b3873c6.slice/crio-1870f24a18536fd8efe551b5f7e44102ee770c52919be05b68d027b3b57adbf5 WatchSource:0}: Error finding container 1870f24a18536fd8efe551b5f7e44102ee770c52919be05b68d027b3b57adbf5: Status 404 returned error can't find the container with id 1870f24a18536fd8efe551b5f7e44102ee770c52919be05b68d027b3b57adbf5
Sep 11 00:58:06.735606 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:06.735584    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74a7013b_1f33_426c_9578_83ded48a984a.slice/crio-9a271b4826970261f299853ffbb0af7cf351a4e21b7a92df4fa0c6b2a509a499 WatchSource:0}: Error finding container 9a271b4826970261f299853ffbb0af7cf351a4e21b7a92df4fa0c6b2a509a499: Status 404 returned error can't find the container with id 9a271b4826970261f299853ffbb0af7cf351a4e21b7a92df4fa0c6b2a509a499
Sep 11 00:58:06.738487 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:06.738428    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd0f9557_5529_4484_b9f2_9f17d425ebb2.slice/crio-2bda17d32e345b5cf3849a742feeedc03810b076c819f92157b119da69d7ad9a WatchSource:0}: Error finding container 2bda17d32e345b5cf3849a742feeedc03810b076c819f92157b119da69d7ad9a: Status 404 returned error can't find the container with id 2bda17d32e345b5cf3849a742feeedc03810b076c819f92157b119da69d7ad9a
Sep 11 00:58:06.741425 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:06.741402    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59502062_fcf4_45fa_a9a3_78e0b5cb2c6f.slice/crio-e0dca82602a9f4f41866b513075ac0c414f0ba0f1e9776143cf5fc508cf6e3d2 WatchSource:0}: Error finding container e0dca82602a9f4f41866b513075ac0c414f0ba0f1e9776143cf5fc508cf6e3d2: Status 404 returned error can't find the container with id e0dca82602a9f4f41866b513075ac0c414f0ba0f1e9776143cf5fc508cf6e3d2
Sep 11 00:58:06.743135 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:06.742958    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb7c32b_2205_4f0d_9ea2_58c45a059200.slice/crio-15b2c7afd4a015a17becf99013bdc8d16987aabfd5deed68f656667a9041dfe2 WatchSource:0}: Error finding container 15b2c7afd4a015a17becf99013bdc8d16987aabfd5deed68f656667a9041dfe2: Status 404 returned error can't find the container with id 15b2c7afd4a015a17becf99013bdc8d16987aabfd5deed68f656667a9041dfe2
Sep 11 00:58:06.744338 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:06.744318    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd051d0_68f0_449a_bd8c_5c1de79ec29d.slice/crio-5fff4fb5c98297d2cec57ebffed2ccd09cf981e61736c9dc21fc88a26f267523 WatchSource:0}: Error finding container 5fff4fb5c98297d2cec57ebffed2ccd09cf981e61736c9dc21fc88a26f267523: Status 404 returned error can't find the container with id 5fff4fb5c98297d2cec57ebffed2ccd09cf981e61736c9dc21fc88a26f267523
Sep 11 00:58:06.745462 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:06.745359    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod670aa39b_e38c_48b8_af6e_472baab4491b.slice/crio-efd31f52846c19ac38b9e65ffa0319db39744f866674222720e5708bb624afb9 WatchSource:0}: Error finding container efd31f52846c19ac38b9e65ffa0319db39744f866674222720e5708bb624afb9: Status 404 returned error can't find the container with id efd31f52846c19ac38b9e65ffa0319db39744f866674222720e5708bb624afb9
Sep 11 00:58:06.747252 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:06.747230    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd868fba_4915_4bed_9c1b_73c7b0231624.slice/crio-e3635df9e8ea4f333a2ff45343f2c240f0d802edcf4e47c860cdea17023b97b3 WatchSource:0}: Error finding container e3635df9e8ea4f333a2ff45343f2c240f0d802edcf4e47c860cdea17023b97b3: Status 404 returned error can't find the container with id e3635df9e8ea4f333a2ff45343f2c240f0d802edcf4e47c860cdea17023b97b3
Sep 11 00:58:07.000740 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:07.000644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv8xh\" (UniqueName: \"kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh\") pod \"network-check-target-fvsdv\" (UID: \"c503c185-5ecf-4968-b9dd-13045d83c29c\") " pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:07.000740 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:07.000719    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret\") pod \"global-pull-secret-syncer-l5vqt\" (UID: \"32548afa-eedf-4970-8638-fabf8025db48\") " pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:07.000988 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:07.000846    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 00:58:07.000988 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:07.000868    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 00:58:07.000988 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:07.000878    2565 projected.go:196] Error preparing data for projected volume kube-api-access-tv8xh for pod openshift-network-diagnostics/network-check-target-fvsdv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 00:58:07.000988 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:07.000890    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 00:58:07.000988 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:07.000940    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh podName:c503c185-5ecf-4968-b9dd-13045d83c29c nodeName:}" failed. No retries permitted until 2026-09-11 00:58:09.00092431 +0000 UTC m=+6.049012543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv8xh" (UniqueName: "kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh") pod "network-check-target-fvsdv" (UID: "c503c185-5ecf-4968-b9dd-13045d83c29c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 00:58:07.000988 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:07.000957    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret podName:32548afa-eedf-4970-8638-fabf8025db48 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:09.000949415 +0000 UTC m=+6.049037631 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret") pod "global-pull-secret-syncer-l5vqt" (UID: "32548afa-eedf-4970-8638-fabf8025db48") : object "kube-system"/"original-pull-secret" not registered
Sep 11 00:58:07.101648 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:07.101596    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs\") pod \"network-metrics-daemon-zcgvb\" (UID: \"544fdaa4-afa7-48dc-9e47-79cdb2200200\") " pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:07.101790 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:07.101730    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 00:58:07.101865 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:07.101814    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs podName:544fdaa4-afa7-48dc-9e47-79cdb2200200 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:09.101796475 +0000 UTC m=+6.149884701 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs") pod "network-metrics-daemon-zcgvb" (UID: "544fdaa4-afa7-48dc-9e47-79cdb2200200") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 00:58:07.412856 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:07.412736    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 00:53:05 +0000 UTC" deadline="2028-06-17 00:18:29.867691828 +0000 UTC"
Sep 11 00:58:07.412856 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:07.412781    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15479h20m22.454915404s"
Sep 11 00:58:07.467422 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:07.466601    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:07.467422 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:07.466758    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcgvb" podUID="544fdaa4-afa7-48dc-9e47-79cdb2200200"
Sep 11 00:58:07.467422 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:07.466986    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:07.467422 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:07.467082    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vqt" podUID="32548afa-eedf-4970-8638-fabf8025db48"
Sep 11 00:58:07.467422 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:07.467150    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:07.467422 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:07.467221    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fvsdv" podUID="c503c185-5ecf-4968-b9dd-13045d83c29c"
Sep 11 00:58:07.493361 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:07.493265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6mbf" event={"ID":"830feca5-59a2-4352-92ff-67852cf13bfd","Type":"ContainerStarted","Data":"8de6fef858fd7384fd6b1194730552297871232cad5e467e2e40fbcceaf9584e"}
Sep 11 00:58:07.503926 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:07.503869    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6zkrd" event={"ID":"670aa39b-e38c-48b8-af6e-472baab4491b","Type":"ContainerStarted","Data":"efd31f52846c19ac38b9e65ffa0319db39744f866674222720e5708bb624afb9"}
Sep 11 00:58:07.515698 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:07.515663    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j54j2" event={"ID":"bdd051d0-68f0-449a-bd8c-5c1de79ec29d","Type":"ContainerStarted","Data":"5fff4fb5c98297d2cec57ebffed2ccd09cf981e61736c9dc21fc88a26f267523"}
Sep 11 00:58:07.529297 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:07.529263    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw" event={"ID":"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f","Type":"ContainerStarted","Data":"e0dca82602a9f4f41866b513075ac0c414f0ba0f1e9776143cf5fc508cf6e3d2"}
Sep 11 00:58:07.544349 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:07.544309    2565 generic.go:356] "Generic (PLEG): container finished" podID="81e66132437108534a5882107d478a11" containerID="4631e1995d6a69de6a74ddc93bb337ceb5c2d5d036c6b9490bbebfbeed814f58" exitCode=0
Sep 11 00:58:07.544657 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:07.544630    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-50.ec2.internal" event={"ID":"81e66132437108534a5882107d478a11","Type":"ContainerDied","Data":"4631e1995d6a69de6a74ddc93bb337ceb5c2d5d036c6b9490bbebfbeed814f58"}
Sep 11 00:58:07.562056 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:07.561376    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-50.ec2.internal" event={"ID":"4fb1adafb19db39c244c8db6f1113504","Type":"ContainerStarted","Data":"b4ac609119f9bde93180b8f18e93a7353e2a06680bdceeb215b627cb6163cb13"}
Sep 11 00:58:07.572591 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:07.572496    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq" event={"ID":"dd868fba-4915-4bed-9c1b-73c7b0231624","Type":"ContainerStarted","Data":"e3635df9e8ea4f333a2ff45343f2c240f0d802edcf4e47c860cdea17023b97b3"}
Sep 11 00:58:07.578430 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:07.578373    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-50.ec2.internal" podStartSLOduration=2.578352888 podStartE2EDuration="2.578352888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 00:58:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:58:07.57786226 +0000 UTC m=+4.625950510" watchObservedRunningTime="2026-09-11 00:58:07.578352888 +0000 UTC m=+4.626441116"
Sep 11 00:58:07.582899 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:07.582815    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fn26l" event={"ID":"fdb7c32b-2205-4f0d-9ea2-58c45a059200","Type":"ContainerStarted","Data":"15b2c7afd4a015a17becf99013bdc8d16987aabfd5deed68f656667a9041dfe2"}
Sep 11 00:58:07.603876 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:07.603804    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dcjgt" event={"ID":"cd0f9557-5529-4484-b9f2-9f17d425ebb2","Type":"ContainerStarted","Data":"2bda17d32e345b5cf3849a742feeedc03810b076c819f92157b119da69d7ad9a"}
Sep 11 00:58:07.617603 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:07.617567    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5v8vh" event={"ID":"74a7013b-1f33-426c-9578-83ded48a984a","Type":"ContainerStarted","Data":"9a271b4826970261f299853ffbb0af7cf351a4e21b7a92df4fa0c6b2a509a499"}
Sep 11 00:58:07.620701 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:07.620632    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-82qsg" event={"ID":"1f60b232-db7b-49c6-b64e-94ff1b3873c6","Type":"ContainerStarted","Data":"1870f24a18536fd8efe551b5f7e44102ee770c52919be05b68d027b3b57adbf5"}
Sep 11 00:58:08.636045 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:08.635873    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-50.ec2.internal" event={"ID":"81e66132437108534a5882107d478a11","Type":"ContainerStarted","Data":"567038d38ad30e714b33412bdd7402795e22dab80e3b6e149df7ebc3c24dbc93"}
Sep 11 00:58:09.019580 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:09.019491    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv8xh\" (UniqueName: \"kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh\") pod \"network-check-target-fvsdv\" (UID: \"c503c185-5ecf-4968-b9dd-13045d83c29c\") " pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:09.019801 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:09.019585    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret\") pod \"global-pull-secret-syncer-l5vqt\" (UID: \"32548afa-eedf-4970-8638-fabf8025db48\") " pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:09.019801 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:09.019715    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 00:58:09.019801 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:09.019780    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret podName:32548afa-eedf-4970-8638-fabf8025db48 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:13.01976096 +0000 UTC m=+10.067849176 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret") pod "global-pull-secret-syncer-l5vqt" (UID: "32548afa-eedf-4970-8638-fabf8025db48") : object "kube-system"/"original-pull-secret" not registered
Sep 11 00:58:09.020090 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:09.019885    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 00:58:09.020090 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:09.019902    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 00:58:09.020090 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:09.019914    2565 projected.go:196] Error preparing data for projected volume kube-api-access-tv8xh for pod openshift-network-diagnostics/network-check-target-fvsdv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 00:58:09.020090 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:09.019947    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh podName:c503c185-5ecf-4968-b9dd-13045d83c29c nodeName:}" failed. No retries permitted until 2026-09-11 00:58:13.019936851 +0000 UTC m=+10.068025067 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv8xh" (UniqueName: "kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh") pod "network-check-target-fvsdv" (UID: "c503c185-5ecf-4968-b9dd-13045d83c29c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 00:58:09.120802 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:09.120763    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs\") pod \"network-metrics-daemon-zcgvb\" (UID: \"544fdaa4-afa7-48dc-9e47-79cdb2200200\") " pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:09.120986 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:09.120967    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 00:58:09.121068 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:09.121053    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs podName:544fdaa4-afa7-48dc-9e47-79cdb2200200 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:13.121031436 +0000 UTC m=+10.169119661 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs") pod "network-metrics-daemon-zcgvb" (UID: "544fdaa4-afa7-48dc-9e47-79cdb2200200") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 00:58:09.468466 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:09.468391    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:09.468620 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:09.468530    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcgvb" podUID="544fdaa4-afa7-48dc-9e47-79cdb2200200"
Sep 11 00:58:09.468935 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:09.468916    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:09.469072 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:09.469006    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vqt" podUID="32548afa-eedf-4970-8638-fabf8025db48"
Sep 11 00:58:09.469072 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:09.469062    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:09.469194 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:09.469126    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fvsdv" podUID="c503c185-5ecf-4968-b9dd-13045d83c29c"
Sep 11 00:58:11.466469 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:11.465991    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:11.466469 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:11.466030    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:11.466469 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:11.466128    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fvsdv" podUID="c503c185-5ecf-4968-b9dd-13045d83c29c"
Sep 11 00:58:11.466469 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:11.465990    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:11.466469 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:11.466260    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vqt" podUID="32548afa-eedf-4970-8638-fabf8025db48"
Sep 11 00:58:11.466469 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:11.466346    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcgvb" podUID="544fdaa4-afa7-48dc-9e47-79cdb2200200"
Sep 11 00:58:13.054206 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:13.054171    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv8xh\" (UniqueName: \"kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh\") pod \"network-check-target-fvsdv\" (UID: \"c503c185-5ecf-4968-b9dd-13045d83c29c\") " pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:13.054628 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:13.054250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret\") pod \"global-pull-secret-syncer-l5vqt\" (UID: \"32548afa-eedf-4970-8638-fabf8025db48\") " pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:13.054628 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:13.054382    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 00:58:13.054628 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:13.054444    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret podName:32548afa-eedf-4970-8638-fabf8025db48 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:21.054425851 +0000 UTC m=+18.102514076 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret") pod "global-pull-secret-syncer-l5vqt" (UID: "32548afa-eedf-4970-8638-fabf8025db48") : object "kube-system"/"original-pull-secret" not registered
Sep 11 00:58:13.055248 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:13.055222    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 00:58:13.055339 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:13.055253    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 00:58:13.055339 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:13.055277    2565 projected.go:196] Error preparing data for projected volume kube-api-access-tv8xh for pod openshift-network-diagnostics/network-check-target-fvsdv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 00:58:13.055443 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:13.055361    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh podName:c503c185-5ecf-4968-b9dd-13045d83c29c nodeName:}" failed. No retries permitted until 2026-09-11 00:58:21.055341375 +0000 UTC m=+18.103429590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv8xh" (UniqueName: "kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh") pod "network-check-target-fvsdv" (UID: "c503c185-5ecf-4968-b9dd-13045d83c29c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 00:58:13.154949 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:13.154911    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs\") pod \"network-metrics-daemon-zcgvb\" (UID: \"544fdaa4-afa7-48dc-9e47-79cdb2200200\") " pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:13.155102 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:13.155056    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 00:58:13.155160 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:13.155129    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs podName:544fdaa4-afa7-48dc-9e47-79cdb2200200 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:21.155109732 +0000 UTC m=+18.203197948 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs") pod "network-metrics-daemon-zcgvb" (UID: "544fdaa4-afa7-48dc-9e47-79cdb2200200") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 00:58:13.466870 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:13.466773    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:13.466870 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:13.466829    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:13.467058 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:13.466773    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:13.467058 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:13.466907    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fvsdv" podUID="c503c185-5ecf-4968-b9dd-13045d83c29c"
Sep 11 00:58:13.467058 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:13.466989    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcgvb" podUID="544fdaa4-afa7-48dc-9e47-79cdb2200200"
Sep 11 00:58:13.467179 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:13.467057    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vqt" podUID="32548afa-eedf-4970-8638-fabf8025db48"
Sep 11 00:58:15.465395 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:15.465361    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:15.465877 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:15.465473    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vqt" podUID="32548afa-eedf-4970-8638-fabf8025db48"
Sep 11 00:58:15.465877 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:15.465361    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:15.465877 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:15.465501    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:15.465877 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:15.465605    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fvsdv" podUID="c503c185-5ecf-4968-b9dd-13045d83c29c"
Sep 11 00:58:15.465877 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:15.465675    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcgvb" podUID="544fdaa4-afa7-48dc-9e47-79cdb2200200"
Sep 11 00:58:17.466322 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:17.466217    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:17.466322 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:17.466231    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:17.466800 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:17.466342    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vqt" podUID="32548afa-eedf-4970-8638-fabf8025db48"
Sep 11 00:58:17.466800 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:17.466377    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fvsdv" podUID="c503c185-5ecf-4968-b9dd-13045d83c29c"
Sep 11 00:58:17.466800 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:17.466427    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:17.466800 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:17.466512    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcgvb" podUID="544fdaa4-afa7-48dc-9e47-79cdb2200200"
Sep 11 00:58:19.468233 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:19.468192    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:19.468671 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:19.468310    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:19.468671 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:19.468337    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:19.468671 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:19.468329    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcgvb" podUID="544fdaa4-afa7-48dc-9e47-79cdb2200200"
Sep 11 00:58:19.468671 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:19.468425    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vqt" podUID="32548afa-eedf-4970-8638-fabf8025db48"
Sep 11 00:58:19.468671 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:19.468508    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fvsdv" podUID="c503c185-5ecf-4968-b9dd-13045d83c29c"
Sep 11 00:58:21.112102 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:21.112072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv8xh\" (UniqueName: \"kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh\") pod \"network-check-target-fvsdv\" (UID: \"c503c185-5ecf-4968-b9dd-13045d83c29c\") " pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:21.112592 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:21.112127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret\") pod \"global-pull-secret-syncer-l5vqt\" (UID: \"32548afa-eedf-4970-8638-fabf8025db48\") " pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:21.112592 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:21.112276    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 00:58:21.112592 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:21.112312    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 00:58:21.112592 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:21.112336    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret podName:32548afa-eedf-4970-8638-fabf8025db48 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:37.112317148 +0000 UTC m=+34.160405367 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret") pod "global-pull-secret-syncer-l5vqt" (UID: "32548afa-eedf-4970-8638-fabf8025db48") : object "kube-system"/"original-pull-secret" not registered
Sep 11 00:58:21.112592 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:21.112339    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 00:58:21.112592 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:21.112369    2565 projected.go:196] Error preparing data for projected volume kube-api-access-tv8xh for pod openshift-network-diagnostics/network-check-target-fvsdv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 00:58:21.112592 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:21.112431    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh podName:c503c185-5ecf-4968-b9dd-13045d83c29c nodeName:}" failed. No retries permitted until 2026-09-11 00:58:37.112414763 +0000 UTC m=+34.160502965 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv8xh" (UniqueName: "kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh") pod "network-check-target-fvsdv" (UID: "c503c185-5ecf-4968-b9dd-13045d83c29c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 00:58:21.212972 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:21.212940    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs\") pod \"network-metrics-daemon-zcgvb\" (UID: \"544fdaa4-afa7-48dc-9e47-79cdb2200200\") " pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:21.213124 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:21.213103    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 00:58:21.213190 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:21.213176    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs podName:544fdaa4-afa7-48dc-9e47-79cdb2200200 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:37.21315594 +0000 UTC m=+34.261244155 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs") pod "network-metrics-daemon-zcgvb" (UID: "544fdaa4-afa7-48dc-9e47-79cdb2200200") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 00:58:21.465849 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:21.465754    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:21.465849 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:21.465764    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:21.466065 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:21.465905    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fvsdv" podUID="c503c185-5ecf-4968-b9dd-13045d83c29c"
Sep 11 00:58:21.466065 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:21.466007    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcgvb" podUID="544fdaa4-afa7-48dc-9e47-79cdb2200200"
Sep 11 00:58:21.466174 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:21.466068    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:21.466174 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:21.466164    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vqt" podUID="32548afa-eedf-4970-8638-fabf8025db48"
Sep 11 00:58:23.466416 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:23.466385    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:23.466798 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:23.466462    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:23.466798 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:23.466480    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fvsdv" podUID="c503c185-5ecf-4968-b9dd-13045d83c29c"
Sep 11 00:58:23.466798 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:23.466568    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcgvb" podUID="544fdaa4-afa7-48dc-9e47-79cdb2200200"
Sep 11 00:58:23.466798 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:23.466637    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:23.466798 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:23.466695    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vqt" podUID="32548afa-eedf-4970-8638-fabf8025db48"
Sep 11 00:58:24.690204 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:24.690049    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5v8vh" event={"ID":"74a7013b-1f33-426c-9578-83ded48a984a","Type":"ContainerStarted","Data":"10fb78a0f5d58434697d732044dcdffea1d162f46099cb6cac03df42e46ccf8a"}
Sep 11 00:58:24.709362 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:24.708953    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-50.ec2.internal" podStartSLOduration=19.708931429 podStartE2EDuration="19.708931429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 00:58:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:58:08.65027592 +0000 UTC m=+5.698364157" watchObservedRunningTime="2026-09-11 00:58:24.708931429 +0000 UTC m=+21.757019654"
Sep 11 00:58:24.709507 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:24.709459    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5v8vh" podStartSLOduration=11.31349187 podStartE2EDuration="21.709443814s" totalImagesPullingTime="10.395951944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:58:24.708535485 +0000 UTC m=+21.756623711" watchObservedRunningTime="2026-09-11 00:58:24.709443814 +0000 UTC m=+21.757532035"
Sep 11 00:58:24.725167 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:24.725034    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-82qsg" podStartSLOduration=3.989614122 podStartE2EDuration="21.725012727s" totalImagesPullingTime="17.735398605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 00:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:58:24.724807389 +0000 UTC m=+21.772895646" watchObservedRunningTime="2026-09-11 00:58:24.725012727 +0000 UTC m=+21.773100953"
Sep 11 00:58:25.465856 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:25.465661    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:25.466037 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:25.465670    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:25.466037 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:25.465966    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcgvb" podUID="544fdaa4-afa7-48dc-9e47-79cdb2200200"
Sep 11 00:58:25.466037 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:25.465725    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:25.466037 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:25.466007    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vqt" podUID="32548afa-eedf-4970-8638-fabf8025db48"
Sep 11 00:58:25.466240 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:25.466062    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fvsdv" podUID="c503c185-5ecf-4968-b9dd-13045d83c29c"
Sep 11 00:58:25.700062 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:25.700024    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq" event={"ID":"dd868fba-4915-4bed-9c1b-73c7b0231624","Type":"ContainerStarted","Data":"a6d4db6795960b327fb73c583ee054f95809849e0c3c75f0128b67038f7b8eb5"}
Sep 11 00:58:25.700679 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:25.700098    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq" event={"ID":"dd868fba-4915-4bed-9c1b-73c7b0231624","Type":"ContainerStarted","Data":"eedecebb4de6b2eb9f69ddd2e46a56715e37c38dd24a0f4459517e2326bb31ed"}
Sep 11 00:58:25.700679 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:25.700150    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq" event={"ID":"dd868fba-4915-4bed-9c1b-73c7b0231624","Type":"ContainerStarted","Data":"4c16d0bbe67b612d907fa8af759476454a290fd9cff8a7cdb8ecf1873e019077"}
Sep 11 00:58:25.700679 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:25.700180    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq" event={"ID":"dd868fba-4915-4bed-9c1b-73c7b0231624","Type":"ContainerStarted","Data":"526f8e74442f0b0f15572cd1f642b5addda9f379918ca47f79731b7d8f643f5b"}
Sep 11 00:58:25.700679 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:25.700207    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq" event={"ID":"dd868fba-4915-4bed-9c1b-73c7b0231624","Type":"ContainerStarted","Data":"e8489507d1a9764b06d6ea3c2ebcca704e71020a1033a934aae9e05e10ef4193"}
Sep 11 00:58:25.700679 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:25.700237    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq" event={"ID":"dd868fba-4915-4bed-9c1b-73c7b0231624","Type":"ContainerStarted","Data":"866b8640f228041135299b532ea8ae0d51fb14bcfde5cb78246110524c5ba55e"}
Sep 11 00:58:25.701410 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:25.701388    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fn26l" event={"ID":"fdb7c32b-2205-4f0d-9ea2-58c45a059200","Type":"ContainerStarted","Data":"bf3b1252923fd11ae5f39a79a546db82e0df522c1309587f3237c7ee17408735"}
Sep 11 00:58:25.702803 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:25.702783    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dcjgt" event={"ID":"cd0f9557-5529-4484-b9f2-9f17d425ebb2","Type":"ContainerStarted","Data":"f0b549554c756af673dacd87108e7536539d59871c4dffd23ee1b71f858345ae"}
Sep 11 00:58:25.704139 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:25.704116    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-82qsg" event={"ID":"1f60b232-db7b-49c6-b64e-94ff1b3873c6","Type":"ContainerStarted","Data":"acf9ff714fadd22dfb2c4807894ddee828880e5352d340dbc3611bc531ee9b2a"}
Sep 11 00:58:25.705719 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:25.705696    2565 generic.go:356] "Generic (PLEG): container finished" podID="830feca5-59a2-4352-92ff-67852cf13bfd" containerID="de6a406b77e592b04572b70b16abee15cdc679dd3cf58ff7dd4f4324a746ef68" exitCode=0
Sep 11 00:58:25.705801 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:25.705779    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6mbf" event={"ID":"830feca5-59a2-4352-92ff-67852cf13bfd","Type":"ContainerDied","Data":"de6a406b77e592b04572b70b16abee15cdc679dd3cf58ff7dd4f4324a746ef68"}
Sep 11 00:58:25.707198 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:25.707170    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j54j2" event={"ID":"bdd051d0-68f0-449a-bd8c-5c1de79ec29d","Type":"ContainerStarted","Data":"1066b086f7417de3338411d444c60eddebff3d37263c58393375a1a5f1282985"}
Sep 11 00:58:25.708524 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:25.708503    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw" event={"ID":"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f","Type":"ContainerStarted","Data":"8dfa9b6a1e9b20ef1003828c48095a7d644794c38c424aebeee0d78a2570a0bb"}
Sep 11 00:58:25.719107 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:25.719056    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fn26l" podStartSLOduration=4.9142736209999995 podStartE2EDuration="22.719043946s" totalImagesPullingTime="17.804770325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 00:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:58:25.718590366 +0000 UTC m=+22.766678591" watchObservedRunningTime="2026-09-11 00:58:25.719043946 +0000 UTC m=+22.767132170"
Sep 11 00:58:25.735526 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:25.735478    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dcjgt" podStartSLOduration=4.980675168 podStartE2EDuration="22.735465201s" totalImagesPullingTime="17.754790033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 00:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:58:25.735317783 +0000 UTC m=+22.783406026" watchObservedRunningTime="2026-09-11 00:58:25.735465201 +0000 UTC m=+22.783553426"
Sep 11 00:58:25.771309 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:25.771263    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j54j2" podStartSLOduration=5.024461694 podStartE2EDuration="22.771247853s" totalImagesPullingTime="17.746786159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 00:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:58:25.771022382 +0000 UTC m=+22.819110608" watchObservedRunningTime="2026-09-11 00:58:25.771247853 +0000 UTC m=+22.819336077"
Sep 11 00:58:25.925654 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:25.925627    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 00:58:26.372208 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:26.372170    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5v8vh"
Sep 11 00:58:26.432606 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:26.432510    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T00:58:25.925644221Z","UUID":"1e9608fc-6dc3-4688-b94b-b794ad1b2b9c","Handler":null,"Name":"","Endpoint":""}
Sep 11 00:58:26.434397 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:26.434359    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 00:58:26.434397 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:26.434397    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 00:58:26.712524 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:26.712446    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6zkrd" event={"ID":"670aa39b-e38c-48b8-af6e-472baab4491b","Type":"ContainerStarted","Data":"1219daf7610c3e44e5c517eb13d7d39395caaa6240990760236f486b8b7bcf7c"}
Sep 11 00:58:26.716300 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:26.716221    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw" event={"ID":"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f","Type":"ContainerStarted","Data":"a01c5f0e31bf24d9cf66a29a7ac0274b37983d8fe693425dc367b66e9c243a60"}
Sep 11 00:58:27.466232 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:27.465968    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:27.466391 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:27.466291    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vqt" podUID="32548afa-eedf-4970-8638-fabf8025db48"
Sep 11 00:58:27.466391 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:27.465971    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:27.466496 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:27.466040    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:27.466496 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:27.466395    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fvsdv" podUID="c503c185-5ecf-4968-b9dd-13045d83c29c"
Sep 11 00:58:27.466595 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:27.466519    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcgvb" podUID="544fdaa4-afa7-48dc-9e47-79cdb2200200"
Sep 11 00:58:27.725358 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:27.725274    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq" event={"ID":"dd868fba-4915-4bed-9c1b-73c7b0231624","Type":"ContainerStarted","Data":"93a9d3a38084f42a612fb73211fe066decde2cfcc373a9f77a49f05630b939cf"}
Sep 11 00:58:27.727574 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:27.727525    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw" event={"ID":"59502062-fcf4-45fa-a9a3-78e0b5cb2c6f","Type":"ContainerStarted","Data":"614e0a495e9c2b6033afa522c574d8e363a77410115bf5ed35e910dcf2905bc5"}
Sep 11 00:58:27.745207 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:27.745160    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6fvqw" podStartSLOduration=5.014516177 podStartE2EDuration="24.74514547s" totalImagesPullingTime="19.730629293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 00:58:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:58:27.744664591 +0000 UTC m=+24.792752836" watchObservedRunningTime="2026-09-11 00:58:27.74514547 +0000 UTC m=+24.793233694"
Sep 11 00:58:27.745427 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:27.745404    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6zkrd" podStartSLOduration=7.000307305 podStartE2EDuration="24.745398225s" totalImagesPullingTime="17.74509092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 00:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:58:26.727829159 +0000 UTC m=+23.775917403" watchObservedRunningTime="2026-09-11 00:58:27.745398225 +0000 UTC m=+24.793486448"
Sep 11 00:58:29.259638 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:29.259605    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5v8vh"
Sep 11 00:58:29.260195 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:29.260170    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5v8vh"
Sep 11 00:58:29.465777 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:29.465748    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:29.465953 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:29.465887    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fvsdv" podUID="c503c185-5ecf-4968-b9dd-13045d83c29c"
Sep 11 00:58:29.466321 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:29.466300    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:29.466420 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:29.466394    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcgvb" podUID="544fdaa4-afa7-48dc-9e47-79cdb2200200"
Sep 11 00:58:29.466546 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:29.466531    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:29.466625 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:29.466606    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vqt" podUID="32548afa-eedf-4970-8638-fabf8025db48"
Sep 11 00:58:29.732088 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:29.732068    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5v8vh"
Sep 11 00:58:30.737609 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:30.737401    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq" event={"ID":"dd868fba-4915-4bed-9c1b-73c7b0231624","Type":"ContainerStarted","Data":"4fc6c4eae5f4238dac83a7beef5a33ab35d3c690f9eae3222ec415348d189a8e"}
Sep 11 00:58:30.738112 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:30.737668    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:30.739323 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:30.739295    2565 generic.go:356] "Generic (PLEG): container finished" podID="830feca5-59a2-4352-92ff-67852cf13bfd" containerID="89ed6109bc42d9a126029c91182db7a378c4a5f6c7ddfbcb6d667b605a59d7f4" exitCode=0
Sep 11 00:58:30.739438 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:30.739330    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6mbf" event={"ID":"830feca5-59a2-4352-92ff-67852cf13bfd","Type":"ContainerDied","Data":"89ed6109bc42d9a126029c91182db7a378c4a5f6c7ddfbcb6d667b605a59d7f4"}
Sep 11 00:58:30.752892 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:30.752872    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:30.823868 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:30.823803    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq" podStartSLOduration=10.069904108 podStartE2EDuration="27.823790345s" totalImagesPullingTime="17.753886237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 00:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:58:30.791870061 +0000 UTC m=+27.839958304" watchObservedRunningTime="2026-09-11 00:58:30.823790345 +0000 UTC m=+27.871878597"
Sep 11 00:58:31.469499 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:31.469437    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:31.469499 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:31.469465    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:31.469712 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:31.469571    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcgvb" podUID="544fdaa4-afa7-48dc-9e47-79cdb2200200"
Sep 11 00:58:31.469712 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:31.469609    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:31.469712 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:31.469687    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vqt" podUID="32548afa-eedf-4970-8638-fabf8025db48"
Sep 11 00:58:31.469862 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:31.469760    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fvsdv" podUID="c503c185-5ecf-4968-b9dd-13045d83c29c"
Sep 11 00:58:31.741952 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:31.741925    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:31.742519 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:31.742006    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:31.764766 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:31.764746    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:58:31.893794 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:31.893761    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l5vqt"]
Sep 11 00:58:31.895841 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:31.893962    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:31.895841 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:31.894111    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vqt" podUID="32548afa-eedf-4970-8638-fabf8025db48"
Sep 11 00:58:31.896033 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:31.895966    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fvsdv"]
Sep 11 00:58:31.896033 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:31.896023    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zcgvb"]
Sep 11 00:58:31.896124 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:31.896114    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:31.896531 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:31.896354    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:31.896531 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:31.896434    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcgvb" podUID="544fdaa4-afa7-48dc-9e47-79cdb2200200"
Sep 11 00:58:31.896531 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:31.896480    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fvsdv" podUID="c503c185-5ecf-4968-b9dd-13045d83c29c"
Sep 11 00:58:32.745603 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:32.745573    2565 generic.go:356] "Generic (PLEG): container finished" podID="830feca5-59a2-4352-92ff-67852cf13bfd" containerID="d75daaa135bfb3fe429bcef9e02e0203d026a80d73025ab3480ec34030b10ff3" exitCode=0
Sep 11 00:58:32.746083 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:32.745647    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6mbf" event={"ID":"830feca5-59a2-4352-92ff-67852cf13bfd","Type":"ContainerDied","Data":"d75daaa135bfb3fe429bcef9e02e0203d026a80d73025ab3480ec34030b10ff3"}
Sep 11 00:58:33.459357 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:33.459333    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod830feca5_59a2_4352_92ff_67852cf13bfd.slice/crio-797b8e68a02cda09b53b4aa5891bb09fb7e319097255438d1c41003f2cc2a8a8.scope\": RecentStats: unable to find data in memory cache]"
Sep 11 00:58:33.466225 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:33.466207    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:33.466333 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:33.466284    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vqt" podUID="32548afa-eedf-4970-8638-fabf8025db48"
Sep 11 00:58:33.466381 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:33.466364    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:33.466489 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:33.466470    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fvsdv" podUID="c503c185-5ecf-4968-b9dd-13045d83c29c"
Sep 11 00:58:33.466528 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:33.466518    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:33.466606 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:33.466592    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcgvb" podUID="544fdaa4-afa7-48dc-9e47-79cdb2200200"
Sep 11 00:58:33.753142 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:33.753034    2565 generic.go:356] "Generic (PLEG): container finished" podID="830feca5-59a2-4352-92ff-67852cf13bfd" containerID="797b8e68a02cda09b53b4aa5891bb09fb7e319097255438d1c41003f2cc2a8a8" exitCode=0
Sep 11 00:58:33.753142 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:33.753086    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6mbf" event={"ID":"830feca5-59a2-4352-92ff-67852cf13bfd","Type":"ContainerDied","Data":"797b8e68a02cda09b53b4aa5891bb09fb7e319097255438d1c41003f2cc2a8a8"}
Sep 11 00:58:35.466093 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:35.466060    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:35.466618 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:35.466175    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:35.466618 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:35.466193    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fvsdv" podUID="c503c185-5ecf-4968-b9dd-13045d83c29c"
Sep 11 00:58:35.466618 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:35.466303    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zcgvb" podUID="544fdaa4-afa7-48dc-9e47-79cdb2200200"
Sep 11 00:58:35.466618 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:35.466363    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:35.466618 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:35.466436    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5vqt" podUID="32548afa-eedf-4970-8638-fabf8025db48"
Sep 11 00:58:37.125714 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.125669    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv8xh\" (UniqueName: \"kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh\") pod \"network-check-target-fvsdv\" (UID: \"c503c185-5ecf-4968-b9dd-13045d83c29c\") " pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:37.126204 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.125763    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret\") pod \"global-pull-secret-syncer-l5vqt\" (UID: \"32548afa-eedf-4970-8638-fabf8025db48\") " pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:37.126204 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:37.125885    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 00:58:37.126204 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:37.125897    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 00:58:37.126204 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:37.125910    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 00:58:37.126204 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:37.125921    2565 projected.go:196] Error preparing data for projected volume kube-api-access-tv8xh for pod openshift-network-diagnostics/network-check-target-fvsdv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 00:58:37.126204 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:37.125964    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret podName:32548afa-eedf-4970-8638-fabf8025db48 nodeName:}" failed. No retries permitted until 2026-09-11 00:59:09.125946437 +0000 UTC m=+66.174034662 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret") pod "global-pull-secret-syncer-l5vqt" (UID: "32548afa-eedf-4970-8638-fabf8025db48") : object "kube-system"/"original-pull-secret" not registered
Sep 11 00:58:37.126204 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:37.125983    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh podName:c503c185-5ecf-4968-b9dd-13045d83c29c nodeName:}" failed. No retries permitted until 2026-09-11 00:59:09.125974976 +0000 UTC m=+66.174063180 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tv8xh" (UniqueName: "kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh") pod "network-check-target-fvsdv" (UID: "c503c185-5ecf-4968-b9dd-13045d83c29c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 00:58:37.227183 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.227143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs\") pod \"network-metrics-daemon-zcgvb\" (UID: \"544fdaa4-afa7-48dc-9e47-79cdb2200200\") " pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:37.227360 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:37.227272    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 00:58:37.227360 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:37.227335    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs podName:544fdaa4-afa7-48dc-9e47-79cdb2200200 nodeName:}" failed. No retries permitted until 2026-09-11 00:59:09.227316983 +0000 UTC m=+66.275405205 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs") pod "network-metrics-daemon-zcgvb" (UID: "544fdaa4-afa7-48dc-9e47-79cdb2200200") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 00:58:37.274932 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.274907    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-50.ec2.internal" event="NodeReady"
Sep 11 00:58:37.275080 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.275029    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 00:58:37.338358 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.337546    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-k86cl"]
Sep 11 00:58:37.371846 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.371795    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-j6ntg"]
Sep 11 00:58:37.372025 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.371933    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-k86cl"
Sep 11 00:58:37.374269 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.374245    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-9skc4\""
Sep 11 00:58:37.374987 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.374791    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 11 00:58:37.374987 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.374885    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 11 00:58:37.374987 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.374914    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 11 00:58:37.375562 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.375386    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 11 00:58:37.380594 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.380575    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 11 00:58:37.385642 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.385624    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wdgrd"]
Sep 11 00:58:37.385766 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.385748    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-j6ntg"
Sep 11 00:58:37.388491 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.388462    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 11 00:58:37.388594 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.388574    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-pxhmf\""
Sep 11 00:58:37.388594 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.388579    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 11 00:58:37.388703 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.388665    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 00:58:37.388823 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.388796    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 00:58:37.394787 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.394760    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 11 00:58:37.405750 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.405729    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9w6zm"]
Sep 11 00:58:37.405870 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.405856    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wdgrd"
Sep 11 00:58:37.408220 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.408194    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 00:58:37.408220 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.408217    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q9kdp\""
Sep 11 00:58:37.408372 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.408198    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 00:58:37.423892 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.423872    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-k86cl"]
Sep 11 00:58:37.424015 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.423902    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-j6ntg"]
Sep 11 00:58:37.424015 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.423918    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wdgrd"]
Sep 11 00:58:37.424015 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.423942    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9w6zm"]
Sep 11 00:58:37.424131 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.424019    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9w6zm"
Sep 11 00:58:37.426466 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.426445    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w7vvh\""
Sep 11 00:58:37.426580 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.426531    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 00:58:37.426580 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.426539    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 00:58:37.426689 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.426659    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 00:58:37.435128 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.435106    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6dbc88f5d-5gkb5"]
Sep 11 00:58:37.451986 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.451956    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.452142 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.452119    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dbc88f5d-5gkb5"]
Sep 11 00:58:37.455108 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.455085    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-db2bf\""
Sep 11 00:58:37.455376 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.455225    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 00:58:37.455376 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.455334    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 00:58:37.456545 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.456524    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 00:58:37.461796 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.461773    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 00:58:37.466499 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.466475    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:58:37.466986 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.466967    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:58:37.467092 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.467077    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:58:37.469369 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.469336    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 00:58:37.470620 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.470595    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 00:58:37.470710 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.470595    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jwmm5\""
Sep 11 00:58:37.470710 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.470596    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 00:58:37.471188 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.471171    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lb8gv\""
Sep 11 00:58:37.471286 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.471173    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 00:58:37.529072 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529037    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/820508ab-5c1d-4ecd-bce6-d9885e8bab95-ca-trust-extracted\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.529198 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5vj4\" (UniqueName: \"kubernetes.io/projected/809b7e8f-d5a8-4dcf-a450-83222c1a5705-kube-api-access-x5vj4\") pod \"insights-operator-5844b856db-j6ntg\" (UID: \"809b7e8f-d5a8-4dcf-a450-83222c1a5705\") " pod="openshift-insights/insights-operator-5844b856db-j6ntg"
Sep 11 00:58:37.529198 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529108    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4058f2ae-f9bb-4e64-966a-b8c640efd48b-serving-cert\") pod \"console-operator-696884fb9c-k86cl\" (UID: \"4058f2ae-f9bb-4e64-966a-b8c640efd48b\") " pod="openshift-console-operator/console-operator-696884fb9c-k86cl"
Sep 11 00:58:37.529198 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529160    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/809b7e8f-d5a8-4dcf-a450-83222c1a5705-trusted-ca-bundle\") pod \"insights-operator-5844b856db-j6ntg\" (UID: \"809b7e8f-d5a8-4dcf-a450-83222c1a5705\") " pod="openshift-insights/insights-operator-5844b856db-j6ntg"
Sep 11 00:58:37.529361 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529222    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4jz2\" (UniqueName: \"kubernetes.io/projected/2fb70ace-f631-46c3-884b-b03c73a1a3d9-kube-api-access-p4jz2\") pod \"ingress-canary-9w6zm\" (UID: \"2fb70ace-f631-46c3-884b-b03c73a1a3d9\") " pod="openshift-ingress-canary/ingress-canary-9w6zm"
Sep 11 00:58:37.529361 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529296    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-bound-sa-token\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.529361 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529324    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz49x\" (UniqueName: \"kubernetes.io/projected/fb827ac4-285f-42c4-ac45-9a7c946ff085-kube-api-access-pz49x\") pod \"dns-default-wdgrd\" (UID: \"fb827ac4-285f-42c4-ac45-9a7c946ff085\") " pod="openshift-dns/dns-default-wdgrd"
Sep 11 00:58:37.529479 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529364    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4058f2ae-f9bb-4e64-966a-b8c640efd48b-trusted-ca\") pod \"console-operator-696884fb9c-k86cl\" (UID: \"4058f2ae-f9bb-4e64-966a-b8c640efd48b\") " pod="openshift-console-operator/console-operator-696884fb9c-k86cl"
Sep 11 00:58:37.529479 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529392    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/809b7e8f-d5a8-4dcf-a450-83222c1a5705-snapshots\") pod \"insights-operator-5844b856db-j6ntg\" (UID: \"809b7e8f-d5a8-4dcf-a450-83222c1a5705\") " pod="openshift-insights/insights-operator-5844b856db-j6ntg"
Sep 11 00:58:37.529479 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529425    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/809b7e8f-d5a8-4dcf-a450-83222c1a5705-serving-cert\") pod \"insights-operator-5844b856db-j6ntg\" (UID: \"809b7e8f-d5a8-4dcf-a450-83222c1a5705\") " pod="openshift-insights/insights-operator-5844b856db-j6ntg"
Sep 11 00:58:37.529479 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529463    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fb70ace-f631-46c3-884b-b03c73a1a3d9-cert\") pod \"ingress-canary-9w6zm\" (UID: \"2fb70ace-f631-46c3-884b-b03c73a1a3d9\") " pod="openshift-ingress-canary/ingress-canary-9w6zm"
Sep 11 00:58:37.529638 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529514    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/820508ab-5c1d-4ecd-bce6-d9885e8bab95-image-registry-private-configuration\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.529638 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrrb4\" (UniqueName: \"kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-kube-api-access-hrrb4\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.529638 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529567    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fb827ac4-285f-42c4-ac45-9a7c946ff085-config-volume\") pod \"dns-default-wdgrd\" (UID: \"fb827ac4-285f-42c4-ac45-9a7c946ff085\") " pod="openshift-dns/dns-default-wdgrd"
Sep 11 00:58:37.529638 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529590    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-tls\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.529638 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-certificates\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.529832 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529630    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/820508ab-5c1d-4ecd-bce6-d9885e8bab95-installation-pull-secrets\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.529832 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529668    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4058f2ae-f9bb-4e64-966a-b8c640efd48b-config\") pod \"console-operator-696884fb9c-k86cl\" (UID: \"4058f2ae-f9bb-4e64-966a-b8c640efd48b\") " pod="openshift-console-operator/console-operator-696884fb9c-k86cl"
Sep 11 00:58:37.529832 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529688    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjbjj\" (UniqueName: \"kubernetes.io/projected/4058f2ae-f9bb-4e64-966a-b8c640efd48b-kube-api-access-fjbjj\") pod \"console-operator-696884fb9c-k86cl\" (UID: \"4058f2ae-f9bb-4e64-966a-b8c640efd48b\") " pod="openshift-console-operator/console-operator-696884fb9c-k86cl"
Sep 11 00:58:37.529832 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb827ac4-285f-42c4-ac45-9a7c946ff085-tmp-dir\") pod \"dns-default-wdgrd\" (UID: \"fb827ac4-285f-42c4-ac45-9a7c946ff085\") " pod="openshift-dns/dns-default-wdgrd"
Sep 11 00:58:37.529832 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529729    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/809b7e8f-d5a8-4dcf-a450-83222c1a5705-tmp\") pod \"insights-operator-5844b856db-j6ntg\" (UID: \"809b7e8f-d5a8-4dcf-a450-83222c1a5705\") " pod="openshift-insights/insights-operator-5844b856db-j6ntg"
Sep 11 00:58:37.529832 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529792    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/820508ab-5c1d-4ecd-bce6-d9885e8bab95-trusted-ca\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.529832 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529825    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb827ac4-285f-42c4-ac45-9a7c946ff085-metrics-tls\") pod \"dns-default-wdgrd\" (UID: \"fb827ac4-285f-42c4-ac45-9a7c946ff085\") " pod="openshift-dns/dns-default-wdgrd"
Sep 11 00:58:37.530069 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.529853    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/809b7e8f-d5a8-4dcf-a450-83222c1a5705-service-ca-bundle\") pod \"insights-operator-5844b856db-j6ntg\" (UID: \"809b7e8f-d5a8-4dcf-a450-83222c1a5705\") " pod="openshift-insights/insights-operator-5844b856db-j6ntg"
Sep 11 00:58:37.631051 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.630969    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-tls\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.631051 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631010    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-certificates\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.631051 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631035    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/820508ab-5c1d-4ecd-bce6-d9885e8bab95-installation-pull-secrets\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.631319 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631058    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4058f2ae-f9bb-4e64-966a-b8c640efd48b-config\") pod \"console-operator-696884fb9c-k86cl\" (UID: \"4058f2ae-f9bb-4e64-966a-b8c640efd48b\") " pod="openshift-console-operator/console-operator-696884fb9c-k86cl"
Sep 11 00:58:37.631319 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631080    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjbjj\" (UniqueName: \"kubernetes.io/projected/4058f2ae-f9bb-4e64-966a-b8c640efd48b-kube-api-access-fjbjj\") pod \"console-operator-696884fb9c-k86cl\" (UID: \"4058f2ae-f9bb-4e64-966a-b8c640efd48b\") " pod="openshift-console-operator/console-operator-696884fb9c-k86cl"
Sep 11 00:58:37.631319 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631105    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb827ac4-285f-42c4-ac45-9a7c946ff085-tmp-dir\") pod \"dns-default-wdgrd\" (UID: \"fb827ac4-285f-42c4-ac45-9a7c946ff085\") " pod="openshift-dns/dns-default-wdgrd"
Sep 11 00:58:37.631319 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/809b7e8f-d5a8-4dcf-a450-83222c1a5705-tmp\") pod \"insights-operator-5844b856db-j6ntg\" (UID: \"809b7e8f-d5a8-4dcf-a450-83222c1a5705\") " pod="openshift-insights/insights-operator-5844b856db-j6ntg"
Sep 11 00:58:37.631319 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:37.631147    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 00:58:37.631319 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/820508ab-5c1d-4ecd-bce6-d9885e8bab95-trusted-ca\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.631319 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631188    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb827ac4-285f-42c4-ac45-9a7c946ff085-metrics-tls\") pod \"dns-default-wdgrd\" (UID: \"fb827ac4-285f-42c4-ac45-9a7c946ff085\") " pod="openshift-dns/dns-default-wdgrd"
Sep 11 00:58:37.631319 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631208    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/809b7e8f-d5a8-4dcf-a450-83222c1a5705-service-ca-bundle\") pod \"insights-operator-5844b856db-j6ntg\" (UID: \"809b7e8f-d5a8-4dcf-a450-83222c1a5705\") " pod="openshift-insights/insights-operator-5844b856db-j6ntg"
Sep 11 00:58:37.631319 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631241    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/820508ab-5c1d-4ecd-bce6-d9885e8bab95-ca-trust-extracted\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.631319 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631266    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5vj4\" (UniqueName: \"kubernetes.io/projected/809b7e8f-d5a8-4dcf-a450-83222c1a5705-kube-api-access-x5vj4\") pod \"insights-operator-5844b856db-j6ntg\" (UID: \"809b7e8f-d5a8-4dcf-a450-83222c1a5705\") " pod="openshift-insights/insights-operator-5844b856db-j6ntg"
Sep 11 00:58:37.631319 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4058f2ae-f9bb-4e64-966a-b8c640efd48b-serving-cert\") pod \"console-operator-696884fb9c-k86cl\" (UID: \"4058f2ae-f9bb-4e64-966a-b8c640efd48b\") " pod="openshift-console-operator/console-operator-696884fb9c-k86cl"
Sep 11 00:58:37.631319 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631321    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/809b7e8f-d5a8-4dcf-a450-83222c1a5705-trusted-ca-bundle\") pod \"insights-operator-5844b856db-j6ntg\" (UID: \"809b7e8f-d5a8-4dcf-a450-83222c1a5705\") " pod="openshift-insights/insights-operator-5844b856db-j6ntg"
Sep 11 00:58:37.631941 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631346    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4jz2\" (UniqueName: \"kubernetes.io/projected/2fb70ace-f631-46c3-884b-b03c73a1a3d9-kube-api-access-p4jz2\") pod \"ingress-canary-9w6zm\" (UID: \"2fb70ace-f631-46c3-884b-b03c73a1a3d9\") " pod="openshift-ingress-canary/ingress-canary-9w6zm"
Sep 11 00:58:37.631941 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631389    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-bound-sa-token\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.631941 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631415    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz49x\" (UniqueName: \"kubernetes.io/projected/fb827ac4-285f-42c4-ac45-9a7c946ff085-kube-api-access-pz49x\") pod \"dns-default-wdgrd\" (UID: \"fb827ac4-285f-42c4-ac45-9a7c946ff085\") " pod="openshift-dns/dns-default-wdgrd"
Sep 11 00:58:37.631941 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631453    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb827ac4-285f-42c4-ac45-9a7c946ff085-tmp-dir\") pod \"dns-default-wdgrd\" (UID: \"fb827ac4-285f-42c4-ac45-9a7c946ff085\") " pod="openshift-dns/dns-default-wdgrd"
Sep 11 00:58:37.631941 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4058f2ae-f9bb-4e64-966a-b8c640efd48b-trusted-ca\") pod \"console-operator-696884fb9c-k86cl\" (UID: \"4058f2ae-f9bb-4e64-966a-b8c640efd48b\") " pod="openshift-console-operator/console-operator-696884fb9c-k86cl"
Sep 11 00:58:37.631941 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/809b7e8f-d5a8-4dcf-a450-83222c1a5705-snapshots\") pod \"insights-operator-5844b856db-j6ntg\" (UID: \"809b7e8f-d5a8-4dcf-a450-83222c1a5705\") " pod="openshift-insights/insights-operator-5844b856db-j6ntg"
Sep 11 00:58:37.631941 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/809b7e8f-d5a8-4dcf-a450-83222c1a5705-serving-cert\") pod \"insights-operator-5844b856db-j6ntg\" (UID: \"809b7e8f-d5a8-4dcf-a450-83222c1a5705\") " pod="openshift-insights/insights-operator-5844b856db-j6ntg"
Sep 11 00:58:37.631941 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631594    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fb70ace-f631-46c3-884b-b03c73a1a3d9-cert\") pod \"ingress-canary-9w6zm\" (UID: \"2fb70ace-f631-46c3-884b-b03c73a1a3d9\") " pod="openshift-ingress-canary/ingress-canary-9w6zm"
Sep 11 00:58:37.631941 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631659    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/820508ab-5c1d-4ecd-bce6-d9885e8bab95-image-registry-private-configuration\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.631941 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631687    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrrb4\" (UniqueName: \"kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-kube-api-access-hrrb4\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.631941 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631699    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/820508ab-5c1d-4ecd-bce6-d9885e8bab95-ca-trust-extracted\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.631941 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fb827ac4-285f-42c4-ac45-9a7c946ff085-config-volume\") pod \"dns-default-wdgrd\" (UID: \"fb827ac4-285f-42c4-ac45-9a7c946ff085\") " pod="openshift-dns/dns-default-wdgrd"
Sep 11 00:58:37.631941 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631720    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-certificates\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.631941 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:37.631170    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dbc88f5d-5gkb5: secret "image-registry-tls" not found
Sep 11 00:58:37.631941 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:37.631858    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-tls podName:820508ab-5c1d-4ecd-bce6-d9885e8bab95 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:38.131840801 +0000 UTC m=+35.179929031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-tls") pod "image-registry-6dbc88f5d-5gkb5" (UID: "820508ab-5c1d-4ecd-bce6-d9885e8bab95") : secret "image-registry-tls" not found
Sep 11 00:58:37.631941 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.631909    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4058f2ae-f9bb-4e64-966a-b8c640efd48b-config\") pod \"console-operator-696884fb9c-k86cl\" (UID: \"4058f2ae-f9bb-4e64-966a-b8c640efd48b\") " pod="openshift-console-operator/console-operator-696884fb9c-k86cl"
Sep 11 00:58:37.632665 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.632218    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/809b7e8f-d5a8-4dcf-a450-83222c1a5705-snapshots\") pod \"insights-operator-5844b856db-j6ntg\" (UID: \"809b7e8f-d5a8-4dcf-a450-83222c1a5705\") " pod="openshift-insights/insights-operator-5844b856db-j6ntg"
Sep 11 00:58:37.632665 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.632271    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fb827ac4-285f-42c4-ac45-9a7c946ff085-config-volume\") pod \"dns-default-wdgrd\" (UID: \"fb827ac4-285f-42c4-ac45-9a7c946ff085\") " pod="openshift-dns/dns-default-wdgrd"
Sep 11 00:58:37.632665 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.632438    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4058f2ae-f9bb-4e64-966a-b8c640efd48b-trusted-ca\") pod \"console-operator-696884fb9c-k86cl\" (UID: \"4058f2ae-f9bb-4e64-966a-b8c640efd48b\") " pod="openshift-console-operator/console-operator-696884fb9c-k86cl"
Sep 11 00:58:37.632665 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.632655    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/809b7e8f-d5a8-4dcf-a450-83222c1a5705-tmp\") pod \"insights-operator-5844b856db-j6ntg\" (UID: \"809b7e8f-d5a8-4dcf-a450-83222c1a5705\") " pod="openshift-insights/insights-operator-5844b856db-j6ntg"
Sep 11 00:58:37.632832 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.632671    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/809b7e8f-d5a8-4dcf-a450-83222c1a5705-service-ca-bundle\") pod \"insights-operator-5844b856db-j6ntg\" (UID: \"809b7e8f-d5a8-4dcf-a450-83222c1a5705\") " pod="openshift-insights/insights-operator-5844b856db-j6ntg"
Sep 11 00:58:37.633125 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.632915    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/820508ab-5c1d-4ecd-bce6-d9885e8bab95-trusted-ca\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.633125 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:37.632949    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 00:58:37.633125 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:37.633072    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb827ac4-285f-42c4-ac45-9a7c946ff085-metrics-tls podName:fb827ac4-285f-42c4-ac45-9a7c946ff085 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:38.133057519 +0000 UTC m=+35.181145736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb827ac4-285f-42c4-ac45-9a7c946ff085-metrics-tls") pod "dns-default-wdgrd" (UID: "fb827ac4-285f-42c4-ac45-9a7c946ff085") : secret "dns-default-metrics-tls" not found
Sep 11 00:58:37.633125 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.633085    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/809b7e8f-d5a8-4dcf-a450-83222c1a5705-trusted-ca-bundle\") pod \"insights-operator-5844b856db-j6ntg\" (UID: \"809b7e8f-d5a8-4dcf-a450-83222c1a5705\") " pod="openshift-insights/insights-operator-5844b856db-j6ntg"
Sep 11 00:58:37.636987 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.636958    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/809b7e8f-d5a8-4dcf-a450-83222c1a5705-serving-cert\") pod \"insights-operator-5844b856db-j6ntg\" (UID: \"809b7e8f-d5a8-4dcf-a450-83222c1a5705\") " pod="openshift-insights/insights-operator-5844b856db-j6ntg"
Sep 11 00:58:37.637098 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.637000    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/820508ab-5c1d-4ecd-bce6-d9885e8bab95-image-registry-private-configuration\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.637254 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.637212    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/820508ab-5c1d-4ecd-bce6-d9885e8bab95-installation-pull-secrets\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.637254 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.637224    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fb70ace-f631-46c3-884b-b03c73a1a3d9-cert\") pod \"ingress-canary-9w6zm\" (UID: \"2fb70ace-f631-46c3-884b-b03c73a1a3d9\") " pod="openshift-ingress-canary/ingress-canary-9w6zm"
Sep 11 00:58:37.638380 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.638357    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4058f2ae-f9bb-4e64-966a-b8c640efd48b-serving-cert\") pod \"console-operator-696884fb9c-k86cl\" (UID: \"4058f2ae-f9bb-4e64-966a-b8c640efd48b\") " pod="openshift-console-operator/console-operator-696884fb9c-k86cl"
Sep 11 00:58:37.644373 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.644006    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjbjj\" (UniqueName: \"kubernetes.io/projected/4058f2ae-f9bb-4e64-966a-b8c640efd48b-kube-api-access-fjbjj\") pod \"console-operator-696884fb9c-k86cl\" (UID: \"4058f2ae-f9bb-4e64-966a-b8c640efd48b\") " pod="openshift-console-operator/console-operator-696884fb9c-k86cl"
Sep 11 00:58:37.644373 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.644064    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrrb4\" (UniqueName: \"kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-kube-api-access-hrrb4\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.646265 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.645291    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5vj4\" (UniqueName: \"kubernetes.io/projected/809b7e8f-d5a8-4dcf-a450-83222c1a5705-kube-api-access-x5vj4\") pod \"insights-operator-5844b856db-j6ntg\" (UID: \"809b7e8f-d5a8-4dcf-a450-83222c1a5705\") " pod="openshift-insights/insights-operator-5844b856db-j6ntg"
Sep 11 00:58:37.646265 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.645365    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4jz2\" (UniqueName: \"kubernetes.io/projected/2fb70ace-f631-46c3-884b-b03c73a1a3d9-kube-api-access-p4jz2\") pod \"ingress-canary-9w6zm\" (UID: \"2fb70ace-f631-46c3-884b-b03c73a1a3d9\") " pod="openshift-ingress-canary/ingress-canary-9w6zm"
Sep 11 00:58:37.648660 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.648641    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz49x\" (UniqueName: \"kubernetes.io/projected/fb827ac4-285f-42c4-ac45-9a7c946ff085-kube-api-access-pz49x\") pod \"dns-default-wdgrd\" (UID: \"fb827ac4-285f-42c4-ac45-9a7c946ff085\") " pod="openshift-dns/dns-default-wdgrd"
Sep 11 00:58:37.649436 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.649415    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-bound-sa-token\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:37.685480 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.685445    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-k86cl"
Sep 11 00:58:37.696600 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.696579    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-j6ntg"
Sep 11 00:58:37.735721 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:37.735698    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9w6zm"
Sep 11 00:58:38.005670 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:38.005590    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-j6ntg"]
Sep 11 00:58:38.007414 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:38.007386    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-k86cl"]
Sep 11 00:58:38.008540 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:38.008517    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod809b7e8f_d5a8_4dcf_a450_83222c1a5705.slice/crio-34480d53c4fc8d76a50bd78369178ee8ab603cd3a68ec8a728b754701e184b19 WatchSource:0}: Error finding container 34480d53c4fc8d76a50bd78369178ee8ab603cd3a68ec8a728b754701e184b19: Status 404 returned error can't find the container with id 34480d53c4fc8d76a50bd78369178ee8ab603cd3a68ec8a728b754701e184b19
Sep 11 00:58:38.010296 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:38.010276    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4058f2ae_f9bb_4e64_966a_b8c640efd48b.slice/crio-9fb37e2829a6383e5501bb8a5e76f16adbbbc9e9768921daa898f68a0d316359 WatchSource:0}: Error finding container 9fb37e2829a6383e5501bb8a5e76f16adbbbc9e9768921daa898f68a0d316359: Status 404 returned error can't find the container with id 9fb37e2829a6383e5501bb8a5e76f16adbbbc9e9768921daa898f68a0d316359
Sep 11 00:58:38.048371 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:38.048351    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9w6zm"]
Sep 11 00:58:38.050929 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:38.050906    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb70ace_f631_46c3_884b_b03c73a1a3d9.slice/crio-c0b33957e01094c2790c8a3944f0e0d73901d7706ca0a9ce0742f01479833ce5 WatchSource:0}: Error finding container c0b33957e01094c2790c8a3944f0e0d73901d7706ca0a9ce0742f01479833ce5: Status 404 returned error can't find the container with id c0b33957e01094c2790c8a3944f0e0d73901d7706ca0a9ce0742f01479833ce5
Sep 11 00:58:38.136984 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:38.136959    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-tls\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:38.137627 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:38.137000    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb827ac4-285f-42c4-ac45-9a7c946ff085-metrics-tls\") pod \"dns-default-wdgrd\" (UID: \"fb827ac4-285f-42c4-ac45-9a7c946ff085\") " pod="openshift-dns/dns-default-wdgrd"
Sep 11 00:58:38.137627 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:38.137131    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 00:58:38.137627 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:38.137151    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dbc88f5d-5gkb5: secret "image-registry-tls" not found
Sep 11 00:58:38.137627 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:38.137218    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-tls podName:820508ab-5c1d-4ecd-bce6-d9885e8bab95 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:39.137197916 +0000 UTC m=+36.185286140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-tls") pod "image-registry-6dbc88f5d-5gkb5" (UID: "820508ab-5c1d-4ecd-bce6-d9885e8bab95") : secret "image-registry-tls" not found
Sep 11 00:58:38.137627 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:38.137219    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 00:58:38.137627 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:38.137305    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb827ac4-285f-42c4-ac45-9a7c946ff085-metrics-tls podName:fb827ac4-285f-42c4-ac45-9a7c946ff085 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:39.137286668 +0000 UTC m=+36.185374900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb827ac4-285f-42c4-ac45-9a7c946ff085-metrics-tls") pod "dns-default-wdgrd" (UID: "fb827ac4-285f-42c4-ac45-9a7c946ff085") : secret "dns-default-metrics-tls" not found
Sep 11 00:58:38.767761 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:38.767683    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-k86cl" event={"ID":"4058f2ae-f9bb-4e64-966a-b8c640efd48b","Type":"ContainerStarted","Data":"9fb37e2829a6383e5501bb8a5e76f16adbbbc9e9768921daa898f68a0d316359"}
Sep 11 00:58:38.772217 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:38.772057    2565 generic.go:356] "Generic (PLEG): container finished" podID="830feca5-59a2-4352-92ff-67852cf13bfd" containerID="5477dd3a1923acf785dfdd529186007cf1c72073c6af6da3f3b1e7f5833fb36a" exitCode=0
Sep 11 00:58:38.772217 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:38.772155    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6mbf" event={"ID":"830feca5-59a2-4352-92ff-67852cf13bfd","Type":"ContainerDied","Data":"5477dd3a1923acf785dfdd529186007cf1c72073c6af6da3f3b1e7f5833fb36a"}
Sep 11 00:58:38.774744 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:38.774678    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9w6zm" event={"ID":"2fb70ace-f631-46c3-884b-b03c73a1a3d9","Type":"ContainerStarted","Data":"c0b33957e01094c2790c8a3944f0e0d73901d7706ca0a9ce0742f01479833ce5"}
Sep 11 00:58:38.776498 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:38.776365    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-j6ntg" event={"ID":"809b7e8f-d5a8-4dcf-a450-83222c1a5705","Type":"ContainerStarted","Data":"34480d53c4fc8d76a50bd78369178ee8ab603cd3a68ec8a728b754701e184b19"}
Sep 11 00:58:39.146614 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:39.146573    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-tls\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:39.147168 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:39.146634    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb827ac4-285f-42c4-ac45-9a7c946ff085-metrics-tls\") pod \"dns-default-wdgrd\" (UID: \"fb827ac4-285f-42c4-ac45-9a7c946ff085\") " pod="openshift-dns/dns-default-wdgrd"
Sep 11 00:58:39.147168 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:39.146749    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 00:58:39.147168 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:39.146797    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb827ac4-285f-42c4-ac45-9a7c946ff085-metrics-tls podName:fb827ac4-285f-42c4-ac45-9a7c946ff085 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:41.146783934 +0000 UTC m=+38.194872135 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb827ac4-285f-42c4-ac45-9a7c946ff085-metrics-tls") pod "dns-default-wdgrd" (UID: "fb827ac4-285f-42c4-ac45-9a7c946ff085") : secret "dns-default-metrics-tls" not found
Sep 11 00:58:39.147168 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:39.147027    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 00:58:39.147168 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:39.147045    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dbc88f5d-5gkb5: secret "image-registry-tls" not found
Sep 11 00:58:39.147168 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:39.147117    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-tls podName:820508ab-5c1d-4ecd-bce6-d9885e8bab95 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:41.147096938 +0000 UTC m=+38.195185167 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-tls") pod "image-registry-6dbc88f5d-5gkb5" (UID: "820508ab-5c1d-4ecd-bce6-d9885e8bab95") : secret "image-registry-tls" not found
Sep 11 00:58:39.782805 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:39.782771    2565 generic.go:356] "Generic (PLEG): container finished" podID="830feca5-59a2-4352-92ff-67852cf13bfd" containerID="f1a9678b1eb6dd722e5ccbd5498964be17e324c9804c41ad98fbabb11a4b10e1" exitCode=0
Sep 11 00:58:39.782980 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:39.782841    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6mbf" event={"ID":"830feca5-59a2-4352-92ff-67852cf13bfd","Type":"ContainerDied","Data":"f1a9678b1eb6dd722e5ccbd5498964be17e324c9804c41ad98fbabb11a4b10e1"}
Sep 11 00:58:41.166582 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:41.166536    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-tls\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:41.167071 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:41.166609    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb827ac4-285f-42c4-ac45-9a7c946ff085-metrics-tls\") pod \"dns-default-wdgrd\" (UID: \"fb827ac4-285f-42c4-ac45-9a7c946ff085\") " pod="openshift-dns/dns-default-wdgrd"
Sep 11 00:58:41.167071 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:41.166735    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 00:58:41.167071 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:41.166757    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 00:58:41.167071 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:41.166760    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dbc88f5d-5gkb5: secret "image-registry-tls" not found
Sep 11 00:58:41.167071 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:41.166841    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb827ac4-285f-42c4-ac45-9a7c946ff085-metrics-tls podName:fb827ac4-285f-42c4-ac45-9a7c946ff085 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:45.166804766 +0000 UTC m=+42.214892991 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb827ac4-285f-42c4-ac45-9a7c946ff085-metrics-tls") pod "dns-default-wdgrd" (UID: "fb827ac4-285f-42c4-ac45-9a7c946ff085") : secret "dns-default-metrics-tls" not found
Sep 11 00:58:41.167071 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:41.166861    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-tls podName:820508ab-5c1d-4ecd-bce6-d9885e8bab95 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:45.166850654 +0000 UTC m=+42.214938856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-tls") pod "image-registry-6dbc88f5d-5gkb5" (UID: "820508ab-5c1d-4ecd-bce6-d9885e8bab95") : secret "image-registry-tls" not found
Sep 11 00:58:41.790397 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:41.790364    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9w6zm" event={"ID":"2fb70ace-f631-46c3-884b-b03c73a1a3d9","Type":"ContainerStarted","Data":"90c8635c1884328898ba19cc4428196c586d7c34cac9042475f6e1d2addf077c"}
Sep 11 00:58:41.792142 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:41.792104    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-j6ntg" event={"ID":"809b7e8f-d5a8-4dcf-a450-83222c1a5705","Type":"ContainerStarted","Data":"3c562667185154d07ffd0415a73f7dfdec62650527cb5a35e85728d7626256a5"}
Sep 11 00:58:41.793875 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:41.793855    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/0.log"
Sep 11 00:58:41.794010 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:41.793984    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-k86cl" event={"ID":"4058f2ae-f9bb-4e64-966a-b8c640efd48b","Type":"ContainerStarted","Data":"38eaec2118116614e6ccd825d947feb64a6eeec31f17a19515bbb25961504f87"}
Sep 11 00:58:41.794156 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:41.794137    2565 scope.go:117] "RemoveContainer" containerID="38eaec2118116614e6ccd825d947feb64a6eeec31f17a19515bbb25961504f87"
Sep 11 00:58:41.797519 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:41.797501    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s6mbf" event={"ID":"830feca5-59a2-4352-92ff-67852cf13bfd","Type":"ContainerStarted","Data":"0d4c49975517e5af3b2142c7eaf5742aa156be74c80a7780f6984684eb9166d7"}
Sep 11 00:58:41.806776 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:41.806738    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9w6zm" podStartSLOduration=1.2927235160000001 podStartE2EDuration="4.806724322s" totalImagesPullingTime="3.514000806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:58:41.805597888 +0000 UTC m=+38.853686133" watchObservedRunningTime="2026-09-11 00:58:41.806724322 +0000 UTC m=+38.854812595"
Sep 11 00:58:41.842958 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:41.842892    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-j6ntg" podStartSLOduration=1.303318754 podStartE2EDuration="4.842871692s" totalImagesPullingTime="3.539552938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:58:41.841586928 +0000 UTC m=+38.889675175" watchObservedRunningTime="2026-09-11 00:58:41.842871692 +0000 UTC m=+38.890959918"
Sep 11 00:58:41.881886 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:41.881845    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s6mbf" podStartSLOduration=11.290129577 podStartE2EDuration="38.881828703s" totalImagesPullingTime="27.591699126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 00:58:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:58:41.880955528 +0000 UTC m=+38.929043763" watchObservedRunningTime="2026-09-11 00:58:41.881828703 +0000 UTC m=+38.929916934"
Sep 11 00:58:42.802161 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:42.802128    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/1.log"
Sep 11 00:58:42.802626 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:42.802607    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/0.log"
Sep 11 00:58:42.802667 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:42.802652    2565 generic.go:356] "Generic (PLEG): container finished" podID="4058f2ae-f9bb-4e64-966a-b8c640efd48b" containerID="38eaec2118116614e6ccd825d947feb64a6eeec31f17a19515bbb25961504f87" exitCode=255
Sep 11 00:58:42.802714 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:42.802669    2565 generic.go:356] "Generic (PLEG): container finished" podID="4058f2ae-f9bb-4e64-966a-b8c640efd48b" containerID="d415d586b7174a6e91e71ebd7fdc19b4eea60ce55712a0ef0bd618461c54261d" exitCode=255
Sep 11 00:58:42.802765 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:42.802750    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-k86cl" event={"ID":"4058f2ae-f9bb-4e64-966a-b8c640efd48b","Type":"ContainerDied","Data":"38eaec2118116614e6ccd825d947feb64a6eeec31f17a19515bbb25961504f87"}
Sep 11 00:58:42.802864 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:42.802849    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-k86cl" event={"ID":"4058f2ae-f9bb-4e64-966a-b8c640efd48b","Type":"ContainerDied","Data":"d415d586b7174a6e91e71ebd7fdc19b4eea60ce55712a0ef0bd618461c54261d"}
Sep 11 00:58:42.802929 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:42.802881    2565 scope.go:117] "RemoveContainer" containerID="38eaec2118116614e6ccd825d947feb64a6eeec31f17a19515bbb25961504f87"
Sep 11 00:58:42.803063 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:42.803042    2565 scope.go:117] "RemoveContainer" containerID="d415d586b7174a6e91e71ebd7fdc19b4eea60ce55712a0ef0bd618461c54261d"
Sep 11 00:58:42.803255 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:42.803232    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-k86cl_openshift-console-operator(4058f2ae-f9bb-4e64-966a-b8c640efd48b)\"" pod="openshift-console-operator/console-operator-696884fb9c-k86cl" podUID="4058f2ae-f9bb-4e64-966a-b8c640efd48b"
Sep 11 00:58:42.832217 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:42.832194    2565 scope.go:117] "RemoveContainer" containerID="38eaec2118116614e6ccd825d947feb64a6eeec31f17a19515bbb25961504f87"
Sep 11 00:58:42.832518 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:42.832497    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38eaec2118116614e6ccd825d947feb64a6eeec31f17a19515bbb25961504f87\": container with ID starting with 38eaec2118116614e6ccd825d947feb64a6eeec31f17a19515bbb25961504f87 not found: ID does not exist" containerID="38eaec2118116614e6ccd825d947feb64a6eeec31f17a19515bbb25961504f87"
Sep 11 00:58:42.832598 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:42.832531    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38eaec2118116614e6ccd825d947feb64a6eeec31f17a19515bbb25961504f87"} err="failed to get container status \"38eaec2118116614e6ccd825d947feb64a6eeec31f17a19515bbb25961504f87\": rpc error: code = NotFound desc = could not find container \"38eaec2118116614e6ccd825d947feb64a6eeec31f17a19515bbb25961504f87\": container with ID starting with 38eaec2118116614e6ccd825d947feb64a6eeec31f17a19515bbb25961504f87 not found: ID does not exist"
Sep 11 00:58:43.258485 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.258415    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xxjqk"]
Sep 11 00:58:43.292701 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.292664    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xxjqk"]
Sep 11 00:58:43.292876 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.292781    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:43.295547 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.295518    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 00:58:43.295736 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.295522    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 00:58:43.295873 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.295555    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-swjh6\""
Sep 11 00:58:43.384924 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.384883    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:43.385060 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.384957    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-crio-socket\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:43.385060 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.384984    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-582b2\" (UniqueName: \"kubernetes.io/projected/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-kube-api-access-582b2\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:43.385060 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.385007    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-data-volume\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:43.385060 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.385039    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:43.486209 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.486183    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:43.486338 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.486241    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:43.486338 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:43.486315    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 00:58:43.486338 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:43.486317    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 00:58:43.486455 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:43.486361    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-kube-rbac-proxy-cm podName:9f850aba-3fda-478d-ad3b-01ccaee5c3f4 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:43.986348481 +0000 UTC m=+41.034436682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xxjqk" (UID: "9f850aba-3fda-478d-ad3b-01ccaee5c3f4") : configmap "kube-rbac-proxy" not found
Sep 11 00:58:43.486455 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:43.486373    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-insights-runtime-extractor-tls podName:9f850aba-3fda-478d-ad3b-01ccaee5c3f4 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:43.98636699 +0000 UTC m=+41.034455191 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xxjqk" (UID: "9f850aba-3fda-478d-ad3b-01ccaee5c3f4") : secret "insights-runtime-extractor-tls" not found
Sep 11 00:58:43.486455 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.486384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-crio-socket\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:43.486455 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.486401    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-582b2\" (UniqueName: \"kubernetes.io/projected/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-kube-api-access-582b2\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:43.486455 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.486425    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-data-volume\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:43.486611 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.486587    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-crio-socket\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:43.486676 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.486661    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-data-volume\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:43.496806 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.496774    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-582b2\" (UniqueName: \"kubernetes.io/projected/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-kube-api-access-582b2\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:43.809444 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.809413    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/1.log"
Sep 11 00:58:43.809922 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.809798    2565 scope.go:117] "RemoveContainer" containerID="d415d586b7174a6e91e71ebd7fdc19b4eea60ce55712a0ef0bd618461c54261d"
Sep 11 00:58:43.810029 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:43.810007    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-k86cl_openshift-console-operator(4058f2ae-f9bb-4e64-966a-b8c640efd48b)\"" pod="openshift-console-operator/console-operator-696884fb9c-k86cl" podUID="4058f2ae-f9bb-4e64-966a-b8c640efd48b"
Sep 11 00:58:43.991017 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.990977    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:43.991209 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:43.991071    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:43.991209 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:43.991113    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 00:58:43.991209 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:43.991206    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-kube-rbac-proxy-cm podName:9f850aba-3fda-478d-ad3b-01ccaee5c3f4 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:44.991185415 +0000 UTC m=+42.039273634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xxjqk" (UID: "9f850aba-3fda-478d-ad3b-01ccaee5c3f4") : configmap "kube-rbac-proxy" not found
Sep 11 00:58:43.991367 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:43.991258    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 00:58:43.991367 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:43.991327    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-insights-runtime-extractor-tls podName:9f850aba-3fda-478d-ad3b-01ccaee5c3f4 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:44.991313546 +0000 UTC m=+42.039401748 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xxjqk" (UID: "9f850aba-3fda-478d-ad3b-01ccaee5c3f4") : secret "insights-runtime-extractor-tls" not found
Sep 11 00:58:45.001391 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:45.001348    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:45.001899 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:45.001415    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:45.001899 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:45.001492    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 00:58:45.001899 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:45.001581    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-kube-rbac-proxy-cm podName:9f850aba-3fda-478d-ad3b-01ccaee5c3f4 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:47.001559203 +0000 UTC m=+44.049647425 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xxjqk" (UID: "9f850aba-3fda-478d-ad3b-01ccaee5c3f4") : configmap "kube-rbac-proxy" not found
Sep 11 00:58:45.001899 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:45.001500    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 00:58:45.001899 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:45.001641    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-insights-runtime-extractor-tls podName:9f850aba-3fda-478d-ad3b-01ccaee5c3f4 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:47.001626804 +0000 UTC m=+44.049715005 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xxjqk" (UID: "9f850aba-3fda-478d-ad3b-01ccaee5c3f4") : secret "insights-runtime-extractor-tls" not found
Sep 11 00:58:45.203569 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:45.203530    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb827ac4-285f-42c4-ac45-9a7c946ff085-metrics-tls\") pod \"dns-default-wdgrd\" (UID: \"fb827ac4-285f-42c4-ac45-9a7c946ff085\") " pod="openshift-dns/dns-default-wdgrd"
Sep 11 00:58:45.203736 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:45.203616    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-tls\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:45.203736 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:45.203692    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 00:58:45.203736 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:45.203714    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 00:58:45.203736 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:45.203724    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6dbc88f5d-5gkb5: secret "image-registry-tls" not found
Sep 11 00:58:45.203874 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:45.203756    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb827ac4-285f-42c4-ac45-9a7c946ff085-metrics-tls podName:fb827ac4-285f-42c4-ac45-9a7c946ff085 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:53.203741406 +0000 UTC m=+50.251829611 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fb827ac4-285f-42c4-ac45-9a7c946ff085-metrics-tls") pod "dns-default-wdgrd" (UID: "fb827ac4-285f-42c4-ac45-9a7c946ff085") : secret "dns-default-metrics-tls" not found
Sep 11 00:58:45.203874 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:45.203772    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-tls podName:820508ab-5c1d-4ecd-bce6-d9885e8bab95 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:53.203765826 +0000 UTC m=+50.251854028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-tls") pod "image-registry-6dbc88f5d-5gkb5" (UID: "820508ab-5c1d-4ecd-bce6-d9885e8bab95") : secret "image-registry-tls" not found
Sep 11 00:58:46.013100 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:46.013070    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j54j2_bdd051d0-68f0-449a-bd8c-5c1de79ec29d/dns-node-resolver/0.log"
Sep 11 00:58:46.814333 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:46.814304    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-82qsg_1f60b232-db7b-49c6-b64e-94ff1b3873c6/node-ca/0.log"
Sep 11 00:58:47.019725 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:47.019692    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:47.020117 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:47.019774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:47.020117 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:47.019845    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 00:58:47.020117 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:47.019878    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 00:58:47.020117 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:47.019914    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-kube-rbac-proxy-cm podName:9f850aba-3fda-478d-ad3b-01ccaee5c3f4 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:51.019898702 +0000 UTC m=+48.067986920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xxjqk" (UID: "9f850aba-3fda-478d-ad3b-01ccaee5c3f4") : configmap "kube-rbac-proxy" not found
Sep 11 00:58:47.020117 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:47.019928    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-insights-runtime-extractor-tls podName:9f850aba-3fda-478d-ad3b-01ccaee5c3f4 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:51.019922106 +0000 UTC m=+48.068010308 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xxjqk" (UID: "9f850aba-3fda-478d-ad3b-01ccaee5c3f4") : secret "insights-runtime-extractor-tls" not found
Sep 11 00:58:47.611825 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:47.611787    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9w6zm_2fb70ace-f631-46c3-884b-b03c73a1a3d9/serve-healthcheck-canary/0.log"
Sep 11 00:58:47.685623 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:47.685588    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-k86cl"
Sep 11 00:58:47.685777 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:47.685645    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-k86cl"
Sep 11 00:58:47.686039 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:47.686015    2565 scope.go:117] "RemoveContainer" containerID="d415d586b7174a6e91e71ebd7fdc19b4eea60ce55712a0ef0bd618461c54261d"
Sep 11 00:58:47.686187 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:47.686168    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-k86cl_openshift-console-operator(4058f2ae-f9bb-4e64-966a-b8c640efd48b)\"" pod="openshift-console-operator/console-operator-696884fb9c-k86cl" podUID="4058f2ae-f9bb-4e64-966a-b8c640efd48b"
Sep 11 00:58:51.054022 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:51.053978    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:51.054557 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:51.054063    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:51.054557 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:51.054126    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 00:58:51.054557 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:51.054148    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 00:58:51.054557 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:51.054200    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-insights-runtime-extractor-tls podName:9f850aba-3fda-478d-ad3b-01ccaee5c3f4 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:59.05418521 +0000 UTC m=+56.102273413 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xxjqk" (UID: "9f850aba-3fda-478d-ad3b-01ccaee5c3f4") : secret "insights-runtime-extractor-tls" not found
Sep 11 00:58:51.054557 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:58:51.054216    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-kube-rbac-proxy-cm podName:9f850aba-3fda-478d-ad3b-01ccaee5c3f4 nodeName:}" failed. No retries permitted until 2026-09-11 00:58:59.054208523 +0000 UTC m=+56.102296725 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xxjqk" (UID: "9f850aba-3fda-478d-ad3b-01ccaee5c3f4") : configmap "kube-rbac-proxy" not found
Sep 11 00:58:53.273451 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:53.273412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-tls\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:53.273792 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:53.273517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb827ac4-285f-42c4-ac45-9a7c946ff085-metrics-tls\") pod \"dns-default-wdgrd\" (UID: \"fb827ac4-285f-42c4-ac45-9a7c946ff085\") " pod="openshift-dns/dns-default-wdgrd"
Sep 11 00:58:53.275799 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:53.275772    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fb827ac4-285f-42c4-ac45-9a7c946ff085-metrics-tls\") pod \"dns-default-wdgrd\" (UID: \"fb827ac4-285f-42c4-ac45-9a7c946ff085\") " pod="openshift-dns/dns-default-wdgrd"
Sep 11 00:58:53.275919 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:53.275899    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-tls\") pod \"image-registry-6dbc88f5d-5gkb5\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") " pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:53.315113 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:53.315080    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wdgrd"
Sep 11 00:58:53.363462 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:53.363438    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:53.613564 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:53.613529    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wdgrd"]
Sep 11 00:58:53.617743 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:53.617714    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb827ac4_285f_42c4_ac45_9a7c946ff085.slice/crio-05e44e6fb647c67fe03726a338fb0ef96e5ef1200ee70d4308ad52dbecf6a9b8 WatchSource:0}: Error finding container 05e44e6fb647c67fe03726a338fb0ef96e5ef1200ee70d4308ad52dbecf6a9b8: Status 404 returned error can't find the container with id 05e44e6fb647c67fe03726a338fb0ef96e5ef1200ee70d4308ad52dbecf6a9b8
Sep 11 00:58:53.670066 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:53.670037    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dbc88f5d-5gkb5"]
Sep 11 00:58:53.672948 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:53.672919    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod820508ab_5c1d_4ecd_bce6_d9885e8bab95.slice/crio-60ae2e928c2cd1b0cb3f8f7d195ad556afda540ab8b10ff1f8c4f97303331578 WatchSource:0}: Error finding container 60ae2e928c2cd1b0cb3f8f7d195ad556afda540ab8b10ff1f8c4f97303331578: Status 404 returned error can't find the container with id 60ae2e928c2cd1b0cb3f8f7d195ad556afda540ab8b10ff1f8c4f97303331578
Sep 11 00:58:53.836879 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:53.836842    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5" event={"ID":"820508ab-5c1d-4ecd-bce6-d9885e8bab95","Type":"ContainerStarted","Data":"956df73380b34d9136bf2e4ed0d255ada377201ec46e70a20a814a27aae8097e"}
Sep 11 00:58:53.837039 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:53.836929    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5" event={"ID":"820508ab-5c1d-4ecd-bce6-d9885e8bab95","Type":"ContainerStarted","Data":"60ae2e928c2cd1b0cb3f8f7d195ad556afda540ab8b10ff1f8c4f97303331578"}
Sep 11 00:58:53.837039 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:53.836961    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:58:53.837973 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:53.837949    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wdgrd" event={"ID":"fb827ac4-285f-42c4-ac45-9a7c946ff085","Type":"ContainerStarted","Data":"05e44e6fb647c67fe03726a338fb0ef96e5ef1200ee70d4308ad52dbecf6a9b8"}
Sep 11 00:58:53.855076 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:53.855027    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5" podStartSLOduration=16.855014038 podStartE2EDuration="16.855014038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:58:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:58:53.854760468 +0000 UTC m=+50.902848703" watchObservedRunningTime="2026-09-11 00:58:53.855014038 +0000 UTC m=+50.903102319"
Sep 11 00:58:55.845928 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:55.845892    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wdgrd" event={"ID":"fb827ac4-285f-42c4-ac45-9a7c946ff085","Type":"ContainerStarted","Data":"470966f82d63ef1de4363dc58ad5b9babc2da742082222e78505d2274eb7b5fd"}
Sep 11 00:58:55.846346 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:55.845941    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wdgrd" event={"ID":"fb827ac4-285f-42c4-ac45-9a7c946ff085","Type":"ContainerStarted","Data":"5ce668acb316352dcaebd1023fdce8e6b2f37bb327cf4c8b32466bbef9db306e"}
Sep 11 00:58:55.846346 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:55.846022    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wdgrd"
Sep 11 00:58:55.863991 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:55.863949    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wdgrd" podStartSLOduration=17.412034082 podStartE2EDuration="18.863935199s" totalImagesPullingTime="1.451901117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:58:55.862244646 +0000 UTC m=+52.910332958" watchObservedRunningTime="2026-09-11 00:58:55.863935199 +0000 UTC m=+52.912023458"
Sep 11 00:58:59.117772 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:59.117727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:59.118318 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:59.117789    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:59.118318 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:59.118276    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:59.120063 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:59.120039    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9f850aba-3fda-478d-ad3b-01ccaee5c3f4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xxjqk\" (UID: \"9f850aba-3fda-478d-ad3b-01ccaee5c3f4\") " pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:59.202123 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:59.202075    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xxjqk"
Sep 11 00:58:59.485263 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:59.485179    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xxjqk"]
Sep 11 00:58:59.488863 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:58:59.488837    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f850aba_3fda_478d_ad3b_01ccaee5c3f4.slice/crio-254dd36ff401050255c5bf2b2f2a4e9fe2f6a421da172cad5710d86e7cc0b596 WatchSource:0}: Error finding container 254dd36ff401050255c5bf2b2f2a4e9fe2f6a421da172cad5710d86e7cc0b596: Status 404 returned error can't find the container with id 254dd36ff401050255c5bf2b2f2a4e9fe2f6a421da172cad5710d86e7cc0b596
Sep 11 00:58:59.860137 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:59.860106    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxjqk" event={"ID":"9f850aba-3fda-478d-ad3b-01ccaee5c3f4","Type":"ContainerStarted","Data":"184693add4be2f023703d79e8f4a9f8149c42105c78eca2ce80c6753a1658388"}
Sep 11 00:58:59.860287 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:58:59.860161    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxjqk" event={"ID":"9f850aba-3fda-478d-ad3b-01ccaee5c3f4","Type":"ContainerStarted","Data":"254dd36ff401050255c5bf2b2f2a4e9fe2f6a421da172cad5710d86e7cc0b596"}
Sep 11 00:59:00.465638 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:00.465610    2565 scope.go:117] "RemoveContainer" containerID="d415d586b7174a6e91e71ebd7fdc19b4eea60ce55712a0ef0bd618461c54261d"
Sep 11 00:59:00.868192 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:00.868165    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/1.log"
Sep 11 00:59:00.868348 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:00.868277    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-k86cl" event={"ID":"4058f2ae-f9bb-4e64-966a-b8c640efd48b","Type":"ContainerStarted","Data":"2a38ea58a263db5619d80c81dbb0cb125a0e8247ce2df7d4ad9018634cfac1f0"}
Sep 11 00:59:00.868623 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:00.868540    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-k86cl"
Sep 11 00:59:00.870150 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:00.870124    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxjqk" event={"ID":"9f850aba-3fda-478d-ad3b-01ccaee5c3f4","Type":"ContainerStarted","Data":"068957a21416f50c2834f3c67bc1cb1607e41e58432fa4c6ba014e412b8bf2f8"}
Sep 11 00:59:00.884691 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:00.884649    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-k86cl" podStartSLOduration=20.344313779 podStartE2EDuration="23.884636787s" totalImagesPullingTime="3.540323008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:59:00.88390185 +0000 UTC m=+57.931990094" watchObservedRunningTime="2026-09-11 00:59:00.884636787 +0000 UTC m=+57.932725053"
Sep 11 00:59:01.224389 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:01.224303    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-k86cl"
Sep 11 00:59:02.877765 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:02.877731    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xxjqk" event={"ID":"9f850aba-3fda-478d-ad3b-01ccaee5c3f4","Type":"ContainerStarted","Data":"b046138253c2f85c87a8247ad281a8ebc203f7cbd27f3a68d03375d7107ae108"}
Sep 11 00:59:02.895108 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:02.895066    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xxjqk" podStartSLOduration=17.580761405 podStartE2EDuration="19.895051618s" totalImagesPullingTime="2.314290213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 00:58:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:59:02.893572686 +0000 UTC m=+59.941660930" watchObservedRunningTime="2026-09-11 00:59:02.895051618 +0000 UTC m=+59.943139842"
Sep 11 00:59:03.763885 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:03.763853    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z8dkq"
Sep 11 00:59:05.851232 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:05.851201    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wdgrd"
Sep 11 00:59:06.760548 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.760510    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95789c754-rn72x"]
Sep 11 00:59:06.762989 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.762966    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95789c754-rn72x"
Sep 11 00:59:06.766133 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.766111    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 11 00:59:06.766961 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.766939    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 11 00:59:06.767202 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.767185    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-r8ml5\""
Sep 11 00:59:06.767319 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.767301    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 11 00:59:06.767613 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.767595    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 11 00:59:06.786022 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.785997    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95789c754-rn72x"]
Sep 11 00:59:06.795294 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.795260    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6dbc88f5d-5gkb5"]
Sep 11 00:59:06.832492 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.832458    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67bcbf57bc-slv6g"]
Sep 11 00:59:06.835871 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.835848    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.875976 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.875951    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67bcbf57bc-slv6g"]
Sep 11 00:59:06.879753 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.879734    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bb214a58-3bf1-45da-8482-7b6790b8cef4-ca-trust-extracted\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.879871 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.879761    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb214a58-3bf1-45da-8482-7b6790b8cef4-trusted-ca\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.879871 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.879825    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bb214a58-3bf1-45da-8482-7b6790b8cef4-registry-certificates\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.879871 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.879846    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bb214a58-3bf1-45da-8482-7b6790b8cef4-image-registry-private-configuration\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.880013 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.879901    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/462dad59-5674-4c20-b8fd-aa5f20e5e6bc-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-95789c754-rn72x\" (UID: \"462dad59-5674-4c20-b8fd-aa5f20e5e6bc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95789c754-rn72x"
Sep 11 00:59:06.880013 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.879962    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb214a58-3bf1-45da-8482-7b6790b8cef4-registry-tls\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.880013 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.879978    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bb214a58-3bf1-45da-8482-7b6790b8cef4-installation-pull-secrets\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.880013 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.879994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb214a58-3bf1-45da-8482-7b6790b8cef4-bound-sa-token\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.880013 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.880008    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95mj7\" (UniqueName: \"kubernetes.io/projected/bb214a58-3bf1-45da-8482-7b6790b8cef4-kube-api-access-95mj7\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.880188 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.880024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-788wg\" (UniqueName: \"kubernetes.io/projected/462dad59-5674-4c20-b8fd-aa5f20e5e6bc-kube-api-access-788wg\") pod \"managed-serviceaccount-addon-agent-95789c754-rn72x\" (UID: \"462dad59-5674-4c20-b8fd-aa5f20e5e6bc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95789c754-rn72x"
Sep 11 00:59:06.981083 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.981049    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bb214a58-3bf1-45da-8482-7b6790b8cef4-registry-certificates\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.981083 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.981084    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bb214a58-3bf1-45da-8482-7b6790b8cef4-image-registry-private-configuration\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.981265 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.981104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/462dad59-5674-4c20-b8fd-aa5f20e5e6bc-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-95789c754-rn72x\" (UID: \"462dad59-5674-4c20-b8fd-aa5f20e5e6bc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95789c754-rn72x"
Sep 11 00:59:06.981265 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.981151    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb214a58-3bf1-45da-8482-7b6790b8cef4-registry-tls\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.981362 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.981258    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bb214a58-3bf1-45da-8482-7b6790b8cef4-installation-pull-secrets\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.981362 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.981302    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb214a58-3bf1-45da-8482-7b6790b8cef4-bound-sa-token\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.981362 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.981330    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95mj7\" (UniqueName: \"kubernetes.io/projected/bb214a58-3bf1-45da-8482-7b6790b8cef4-kube-api-access-95mj7\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.981362 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.981356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-788wg\" (UniqueName: \"kubernetes.io/projected/462dad59-5674-4c20-b8fd-aa5f20e5e6bc-kube-api-access-788wg\") pod \"managed-serviceaccount-addon-agent-95789c754-rn72x\" (UID: \"462dad59-5674-4c20-b8fd-aa5f20e5e6bc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95789c754-rn72x"
Sep 11 00:59:06.981566 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.981385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bb214a58-3bf1-45da-8482-7b6790b8cef4-ca-trust-extracted\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.981566 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.981409    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb214a58-3bf1-45da-8482-7b6790b8cef4-trusted-ca\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.981989 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.981964    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bb214a58-3bf1-45da-8482-7b6790b8cef4-registry-certificates\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.982333 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.982310    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bb214a58-3bf1-45da-8482-7b6790b8cef4-ca-trust-extracted\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.982600 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.982578    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bb214a58-3bf1-45da-8482-7b6790b8cef4-trusted-ca\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.983984 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.983955    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bb214a58-3bf1-45da-8482-7b6790b8cef4-installation-pull-secrets\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.984085 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.984021    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/462dad59-5674-4c20-b8fd-aa5f20e5e6bc-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-95789c754-rn72x\" (UID: \"462dad59-5674-4c20-b8fd-aa5f20e5e6bc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95789c754-rn72x"
Sep 11 00:59:06.984172 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.984143    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bb214a58-3bf1-45da-8482-7b6790b8cef4-registry-tls\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.984277 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.984258    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bb214a58-3bf1-45da-8482-7b6790b8cef4-image-registry-private-configuration\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.993235 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.993207    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-788wg\" (UniqueName: \"kubernetes.io/projected/462dad59-5674-4c20-b8fd-aa5f20e5e6bc-kube-api-access-788wg\") pod \"managed-serviceaccount-addon-agent-95789c754-rn72x\" (UID: \"462dad59-5674-4c20-b8fd-aa5f20e5e6bc\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95789c754-rn72x"
Sep 11 00:59:06.993406 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.993388    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb214a58-3bf1-45da-8482-7b6790b8cef4-bound-sa-token\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:06.994003 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:06.993972    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95mj7\" (UniqueName: \"kubernetes.io/projected/bb214a58-3bf1-45da-8482-7b6790b8cef4-kube-api-access-95mj7\") pod \"image-registry-67bcbf57bc-slv6g\" (UID: \"bb214a58-3bf1-45da-8482-7b6790b8cef4\") " pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:07.082182 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:07.082157    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95789c754-rn72x"
Sep 11 00:59:07.144232 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:07.144199    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:07.348491 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:07.348419    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95789c754-rn72x"]
Sep 11 00:59:07.351942 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:59:07.351917    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod462dad59_5674_4c20_b8fd_aa5f20e5e6bc.slice/crio-b1ccc9fa27661787ae9e4e8c5491dd0efed4d68812c636b19d91efe742e2f52a WatchSource:0}: Error finding container b1ccc9fa27661787ae9e4e8c5491dd0efed4d68812c636b19d91efe742e2f52a: Status 404 returned error can't find the container with id b1ccc9fa27661787ae9e4e8c5491dd0efed4d68812c636b19d91efe742e2f52a
Sep 11 00:59:07.416750 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:07.416607    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67bcbf57bc-slv6g"]
Sep 11 00:59:07.419194 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:59:07.419169    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb214a58_3bf1_45da_8482_7b6790b8cef4.slice/crio-9bc9734d87042c94061b03a8c92460f7d12f781681cb2ecd5c2278e2d90333ff WatchSource:0}: Error finding container 9bc9734d87042c94061b03a8c92460f7d12f781681cb2ecd5c2278e2d90333ff: Status 404 returned error can't find the container with id 9bc9734d87042c94061b03a8c92460f7d12f781681cb2ecd5c2278e2d90333ff
Sep 11 00:59:07.894033 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:07.893996    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95789c754-rn72x" event={"ID":"462dad59-5674-4c20-b8fd-aa5f20e5e6bc","Type":"ContainerStarted","Data":"b1ccc9fa27661787ae9e4e8c5491dd0efed4d68812c636b19d91efe742e2f52a"}
Sep 11 00:59:07.895479 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:07.895455    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g" event={"ID":"bb214a58-3bf1-45da-8482-7b6790b8cef4","Type":"ContainerStarted","Data":"6e202774bb6a1fc0f938e75502a827c82851f1d6181275e556e96e594279b764"}
Sep 11 00:59:07.895589 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:07.895526    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g" event={"ID":"bb214a58-3bf1-45da-8482-7b6790b8cef4","Type":"ContainerStarted","Data":"9bc9734d87042c94061b03a8c92460f7d12f781681cb2ecd5c2278e2d90333ff"}
Sep 11 00:59:07.895589 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:07.895568    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:07.915094 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:07.915053    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g" podStartSLOduration=1.915039117 podStartE2EDuration="1.915039117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:59:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:59:07.914365321 +0000 UTC m=+64.962453557" watchObservedRunningTime="2026-09-11 00:59:07.915039117 +0000 UTC m=+64.963127341"
Sep 11 00:59:09.199453 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:09.199419    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret\") pod \"global-pull-secret-syncer-l5vqt\" (UID: \"32548afa-eedf-4970-8638-fabf8025db48\") " pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:59:09.199810 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:09.199462    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv8xh\" (UniqueName: \"kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh\") pod \"network-check-target-fvsdv\" (UID: \"c503c185-5ecf-4968-b9dd-13045d83c29c\") " pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:59:09.201992 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:09.201975    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 00:59:09.202045 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:09.202004    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 00:59:09.211892 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:09.211869    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 00:59:09.212034 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:09.212016    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32548afa-eedf-4970-8638-fabf8025db48-original-pull-secret\") pod \"global-pull-secret-syncer-l5vqt\" (UID: \"32548afa-eedf-4970-8638-fabf8025db48\") " pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:59:09.222532 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:09.222511    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv8xh\" (UniqueName: \"kubernetes.io/projected/c503c185-5ecf-4968-b9dd-13045d83c29c-kube-api-access-tv8xh\") pod \"network-check-target-fvsdv\" (UID: \"c503c185-5ecf-4968-b9dd-13045d83c29c\") " pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:59:09.287320 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:09.287297    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jwmm5\""
Sep 11 00:59:09.290197 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:09.290182    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5vqt"
Sep 11 00:59:09.295206 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:09.295192    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:59:09.299975 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:09.299953    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs\") pod \"network-metrics-daemon-zcgvb\" (UID: \"544fdaa4-afa7-48dc-9e47-79cdb2200200\") " pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:59:09.302469 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:09.302451    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 00:59:09.312557 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:09.312537    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/544fdaa4-afa7-48dc-9e47-79cdb2200200-metrics-certs\") pod \"network-metrics-daemon-zcgvb\" (UID: \"544fdaa4-afa7-48dc-9e47-79cdb2200200\") " pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:59:09.560141 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:09.560106    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l5vqt"]
Sep 11 00:59:09.563032 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:09.563006    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fvsdv"]
Sep 11 00:59:09.563704 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:59:09.563678    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32548afa_eedf_4970_8638_fabf8025db48.slice/crio-da74a2ed0775509f540cd3259bbb81458426860307fbc5a5c1d15f5e8247ff97 WatchSource:0}: Error finding container da74a2ed0775509f540cd3259bbb81458426860307fbc5a5c1d15f5e8247ff97: Status 404 returned error can't find the container with id da74a2ed0775509f540cd3259bbb81458426860307fbc5a5c1d15f5e8247ff97
Sep 11 00:59:09.565489 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:59:09.565379    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc503c185_5ecf_4968_b9dd_13045d83c29c.slice/crio-59f4069ce8428a1a997c00c166247ed5bc0c579a007d5aee4365c2f82c4e93ee WatchSource:0}: Error finding container 59f4069ce8428a1a997c00c166247ed5bc0c579a007d5aee4365c2f82c4e93ee: Status 404 returned error can't find the container with id 59f4069ce8428a1a997c00c166247ed5bc0c579a007d5aee4365c2f82c4e93ee
Sep 11 00:59:09.580408 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:09.580388    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lb8gv\""
Sep 11 00:59:09.588256 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:09.588229    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zcgvb"
Sep 11 00:59:09.854413 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:09.854345    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zcgvb"]
Sep 11 00:59:09.857007 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:59:09.856985    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod544fdaa4_afa7_48dc_9e47_79cdb2200200.slice/crio-23a484496a446215c52f5718b47e9fbf1f32f190791cb0d67758c372337f56ae WatchSource:0}: Error finding container 23a484496a446215c52f5718b47e9fbf1f32f190791cb0d67758c372337f56ae: Status 404 returned error can't find the container with id 23a484496a446215c52f5718b47e9fbf1f32f190791cb0d67758c372337f56ae
Sep 11 00:59:09.903611 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:09.903578    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zcgvb" event={"ID":"544fdaa4-afa7-48dc-9e47-79cdb2200200","Type":"ContainerStarted","Data":"23a484496a446215c52f5718b47e9fbf1f32f190791cb0d67758c372337f56ae"}
Sep 11 00:59:09.904970 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:09.904939    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fvsdv" event={"ID":"c503c185-5ecf-4968-b9dd-13045d83c29c","Type":"ContainerStarted","Data":"59f4069ce8428a1a997c00c166247ed5bc0c579a007d5aee4365c2f82c4e93ee"}
Sep 11 00:59:09.906220 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:09.906185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l5vqt" event={"ID":"32548afa-eedf-4970-8638-fabf8025db48","Type":"ContainerStarted","Data":"da74a2ed0775509f540cd3259bbb81458426860307fbc5a5c1d15f5e8247ff97"}
Sep 11 00:59:11.922513 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:11.922392    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zcgvb" event={"ID":"544fdaa4-afa7-48dc-9e47-79cdb2200200","Type":"ContainerStarted","Data":"58fb3f7b241cf3adbd4bf47348987a8fc3abe9dc4e81b273839a9f960b8789a5"}
Sep 11 00:59:11.922513 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:11.922495    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zcgvb" event={"ID":"544fdaa4-afa7-48dc-9e47-79cdb2200200","Type":"ContainerStarted","Data":"4a4c65a48f3b43201c573ccf88115dc2dc3972e50b71835aaef018e1aaaf1e6c"}
Sep 11 00:59:11.938775 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:11.938719    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zcgvb" podStartSLOduration=67.925549377 podStartE2EDuration="1m8.938698045s" totalImagesPullingTime="1.013148668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:59:11.937881096 +0000 UTC m=+68.985969351" watchObservedRunningTime="2026-09-11 00:59:11.938698045 +0000 UTC m=+68.986786271"
Sep 11 00:59:13.432160 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.432123    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d99dcf4bd-r8m8s"]
Sep 11 00:59:13.435246 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.435212    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:13.437673 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.437653    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 00:59:13.438801 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.438775    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 00:59:13.438801 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.438793    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6f9nw\""
Sep 11 00:59:13.438978 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.438843    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 00:59:13.438978 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.438846    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 00:59:13.438978 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.438798    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 00:59:13.438978 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.438963    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 00:59:13.439133 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.438967    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 00:59:13.446707 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.446684    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d99dcf4bd-r8m8s"]
Sep 11 00:59:13.534868 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.534834    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d21d94b-5e96-49b8-8f81-6204601b78c6-console-config\") pod \"console-6d99dcf4bd-r8m8s\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") " pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:13.535034 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.534894    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d21d94b-5e96-49b8-8f81-6204601b78c6-oauth-serving-cert\") pod \"console-6d99dcf4bd-r8m8s\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") " pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:13.535034 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.534925    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d21d94b-5e96-49b8-8f81-6204601b78c6-service-ca\") pod \"console-6d99dcf4bd-r8m8s\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") " pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:13.535034 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.535015    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d21d94b-5e96-49b8-8f81-6204601b78c6-console-oauth-config\") pod \"console-6d99dcf4bd-r8m8s\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") " pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:13.535204 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.535097    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htd4t\" (UniqueName: \"kubernetes.io/projected/4d21d94b-5e96-49b8-8f81-6204601b78c6-kube-api-access-htd4t\") pod \"console-6d99dcf4bd-r8m8s\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") " pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:13.535204 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.535140    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d21d94b-5e96-49b8-8f81-6204601b78c6-console-serving-cert\") pod \"console-6d99dcf4bd-r8m8s\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") " pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:13.636189 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.636155    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d21d94b-5e96-49b8-8f81-6204601b78c6-console-config\") pod \"console-6d99dcf4bd-r8m8s\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") " pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:13.636366 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.636196    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d21d94b-5e96-49b8-8f81-6204601b78c6-oauth-serving-cert\") pod \"console-6d99dcf4bd-r8m8s\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") " pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:13.636366 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.636226    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d21d94b-5e96-49b8-8f81-6204601b78c6-service-ca\") pod \"console-6d99dcf4bd-r8m8s\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") " pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:13.636366 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.636276    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d21d94b-5e96-49b8-8f81-6204601b78c6-console-oauth-config\") pod \"console-6d99dcf4bd-r8m8s\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") " pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:13.636366 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.636313    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htd4t\" (UniqueName: \"kubernetes.io/projected/4d21d94b-5e96-49b8-8f81-6204601b78c6-kube-api-access-htd4t\") pod \"console-6d99dcf4bd-r8m8s\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") " pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:13.636366 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.636346    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d21d94b-5e96-49b8-8f81-6204601b78c6-console-serving-cert\") pod \"console-6d99dcf4bd-r8m8s\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") " pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:13.637094 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.637064    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d21d94b-5e96-49b8-8f81-6204601b78c6-console-config\") pod \"console-6d99dcf4bd-r8m8s\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") " pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:13.637230 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.637097    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d21d94b-5e96-49b8-8f81-6204601b78c6-oauth-serving-cert\") pod \"console-6d99dcf4bd-r8m8s\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") " pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:13.637230 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.637164    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d21d94b-5e96-49b8-8f81-6204601b78c6-service-ca\") pod \"console-6d99dcf4bd-r8m8s\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") " pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:13.639149 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.639099    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d21d94b-5e96-49b8-8f81-6204601b78c6-console-oauth-config\") pod \"console-6d99dcf4bd-r8m8s\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") " pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:13.639149 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.639138    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d21d94b-5e96-49b8-8f81-6204601b78c6-console-serving-cert\") pod \"console-6d99dcf4bd-r8m8s\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") " pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:13.644929 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.644910    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htd4t\" (UniqueName: \"kubernetes.io/projected/4d21d94b-5e96-49b8-8f81-6204601b78c6-kube-api-access-htd4t\") pod \"console-6d99dcf4bd-r8m8s\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") " pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:13.748105 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:13.748018    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:14.323880 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:14.323803    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d99dcf4bd-r8m8s"]
Sep 11 00:59:14.326323 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:59:14.326293    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d21d94b_5e96_49b8_8f81_6204601b78c6.slice/crio-3c448c3474b793c60d701af53a02262b502ece750fdffa1fd6b17e1f89292d7e WatchSource:0}: Error finding container 3c448c3474b793c60d701af53a02262b502ece750fdffa1fd6b17e1f89292d7e: Status 404 returned error can't find the container with id 3c448c3474b793c60d701af53a02262b502ece750fdffa1fd6b17e1f89292d7e
Sep 11 00:59:14.935895 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:14.935858    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fvsdv" event={"ID":"c503c185-5ecf-4968-b9dd-13045d83c29c","Type":"ContainerStarted","Data":"788c84d31b2b3a452cc89c4d619f61a44dfd71e523d1aa86ea188dd60c1e0718"}
Sep 11 00:59:14.936332 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:14.935976    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:59:14.937656 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:14.937628    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l5vqt" event={"ID":"32548afa-eedf-4970-8638-fabf8025db48","Type":"ContainerStarted","Data":"aacf24099f66e73520b7130a945ffecc400dea87d7886f6f27f798cade710426"}
Sep 11 00:59:14.938946 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:14.938921    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d99dcf4bd-r8m8s" event={"ID":"4d21d94b-5e96-49b8-8f81-6204601b78c6","Type":"ContainerStarted","Data":"3c448c3474b793c60d701af53a02262b502ece750fdffa1fd6b17e1f89292d7e"}
Sep 11 00:59:14.952721 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:14.952679    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fvsdv" podStartSLOduration=67.463786492 podStartE2EDuration="1m11.952664125s" totalImagesPullingTime="4.488877633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:59:14.95149095 +0000 UTC m=+71.999579174" watchObservedRunningTime="2026-09-11 00:59:14.952664125 +0000 UTC m=+72.000752350"
Sep 11 00:59:14.970364 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:14.970309    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-l5vqt" podStartSLOduration=67.471405236 podStartE2EDuration="1m11.97028784s" totalImagesPullingTime="4.498882604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 00:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:59:14.970004655 +0000 UTC m=+72.018092880" watchObservedRunningTime="2026-09-11 00:59:14.97028784 +0000 UTC m=+72.018376065"
Sep 11 00:59:16.801644 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:16.801612    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:59:16.980324 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:16.980290    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-trkvb"]
Sep 11 00:59:16.982101 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:16.982082    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-trkvb"
Sep 11 00:59:16.984296 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:16.984234    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5x8jl\""
Sep 11 00:59:16.984453 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:16.984437    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 00:59:16.984528 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:16.984450    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 11 00:59:16.984528 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:16.984435    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 11 00:59:16.984528 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:16.984496    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 00:59:16.984674 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:16.984580    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 00:59:16.991556 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:16.991526    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-trkvb"]
Sep 11 00:59:17.063957 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:17.063932    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4685ecfb-cdfd-41bb-96bc-2c93bec17273-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-trkvb\" (UID: \"4685ecfb-cdfd-41bb-96bc-2c93bec17273\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-trkvb"
Sep 11 00:59:17.064073 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:17.063976    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4685ecfb-cdfd-41bb-96bc-2c93bec17273-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-trkvb\" (UID: \"4685ecfb-cdfd-41bb-96bc-2c93bec17273\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-trkvb"
Sep 11 00:59:17.064073 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:17.064026    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4685ecfb-cdfd-41bb-96bc-2c93bec17273-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-trkvb\" (UID: \"4685ecfb-cdfd-41bb-96bc-2c93bec17273\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-trkvb"
Sep 11 00:59:17.064073 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:17.064056    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptzd2\" (UniqueName: \"kubernetes.io/projected/4685ecfb-cdfd-41bb-96bc-2c93bec17273-kube-api-access-ptzd2\") pod \"prometheus-operator-68bcd7f987-trkvb\" (UID: \"4685ecfb-cdfd-41bb-96bc-2c93bec17273\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-trkvb"
Sep 11 00:59:17.164376 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:17.164346    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4685ecfb-cdfd-41bb-96bc-2c93bec17273-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-trkvb\" (UID: \"4685ecfb-cdfd-41bb-96bc-2c93bec17273\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-trkvb"
Sep 11 00:59:17.164537 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:17.164382    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptzd2\" (UniqueName: \"kubernetes.io/projected/4685ecfb-cdfd-41bb-96bc-2c93bec17273-kube-api-access-ptzd2\") pod \"prometheus-operator-68bcd7f987-trkvb\" (UID: \"4685ecfb-cdfd-41bb-96bc-2c93bec17273\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-trkvb"
Sep 11 00:59:17.164537 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:17.164412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4685ecfb-cdfd-41bb-96bc-2c93bec17273-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-trkvb\" (UID: \"4685ecfb-cdfd-41bb-96bc-2c93bec17273\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-trkvb"
Sep 11 00:59:17.164537 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:17.164447    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4685ecfb-cdfd-41bb-96bc-2c93bec17273-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-trkvb\" (UID: \"4685ecfb-cdfd-41bb-96bc-2c93bec17273\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-trkvb"
Sep 11 00:59:17.165184 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:17.165160    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4685ecfb-cdfd-41bb-96bc-2c93bec17273-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-trkvb\" (UID: \"4685ecfb-cdfd-41bb-96bc-2c93bec17273\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-trkvb"
Sep 11 00:59:17.166769 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:17.166741    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4685ecfb-cdfd-41bb-96bc-2c93bec17273-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-trkvb\" (UID: \"4685ecfb-cdfd-41bb-96bc-2c93bec17273\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-trkvb"
Sep 11 00:59:17.166865 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:17.166770    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4685ecfb-cdfd-41bb-96bc-2c93bec17273-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-trkvb\" (UID: \"4685ecfb-cdfd-41bb-96bc-2c93bec17273\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-trkvb"
Sep 11 00:59:17.172366 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:17.172344    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptzd2\" (UniqueName: \"kubernetes.io/projected/4685ecfb-cdfd-41bb-96bc-2c93bec17273-kube-api-access-ptzd2\") pod \"prometheus-operator-68bcd7f987-trkvb\" (UID: \"4685ecfb-cdfd-41bb-96bc-2c93bec17273\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-trkvb"
Sep 11 00:59:17.292329 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:17.292287    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-trkvb"
Sep 11 00:59:17.564116 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:17.564056    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-trkvb"]
Sep 11 00:59:17.568201 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:59:17.568166    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4685ecfb_cdfd_41bb_96bc_2c93bec17273.slice/crio-701c36ba484c870d123b2e17fbf05b42b9346fc52308d9e4acc473431d970d34 WatchSource:0}: Error finding container 701c36ba484c870d123b2e17fbf05b42b9346fc52308d9e4acc473431d970d34: Status 404 returned error can't find the container with id 701c36ba484c870d123b2e17fbf05b42b9346fc52308d9e4acc473431d970d34
Sep 11 00:59:17.952567 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:17.952533    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d99dcf4bd-r8m8s" event={"ID":"4d21d94b-5e96-49b8-8f81-6204601b78c6","Type":"ContainerStarted","Data":"352119d60de7493b74f83cd836e36443b8f91f018b9bf411b88121d516f2313e"}
Sep 11 00:59:17.953782 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:17.953757    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-trkvb" event={"ID":"4685ecfb-cdfd-41bb-96bc-2c93bec17273","Type":"ContainerStarted","Data":"701c36ba484c870d123b2e17fbf05b42b9346fc52308d9e4acc473431d970d34"}
Sep 11 00:59:17.971855 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:17.971786    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d99dcf4bd-r8m8s" podStartSLOduration=2.3001648 podStartE2EDuration="4.971771716s" totalImagesPullingTime="2.671606916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:59:17.970300707 +0000 UTC m=+75.018388935" watchObservedRunningTime="2026-09-11 00:59:17.971771716 +0000 UTC m=+75.019859940"
Sep 11 00:59:18.963424 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:18.963324    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-trkvb" event={"ID":"4685ecfb-cdfd-41bb-96bc-2c93bec17273","Type":"ContainerStarted","Data":"2f85cbc6643e5571b5a09c21dc0e81d0ba2ef071bb1723ae1ab54cf4ef9b6300"}
Sep 11 00:59:18.963424 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:18.963412    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-trkvb" event={"ID":"4685ecfb-cdfd-41bb-96bc-2c93bec17273","Type":"ContainerStarted","Data":"ec4f4cf38afbc620fc070b3fedd6156c63d16c7196b04d9541efa2a2cf4b68f2"}
Sep 11 00:59:18.985325 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:18.985273    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-trkvb" podStartSLOduration=1.90858004 podStartE2EDuration="2.985256434s" totalImagesPullingTime="1.076676394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:59:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:59:18.984375834 +0000 UTC m=+76.032464069" watchObservedRunningTime="2026-09-11 00:59:18.985256434 +0000 UTC m=+76.033344657"
Sep 11 00:59:20.513594 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.513558    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7548b65dff-w488w"]
Sep 11 00:59:20.515779 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.515743    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.523722 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.523506    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 00:59:20.527180 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.527158    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7548b65dff-w488w"]
Sep 11 00:59:20.593155 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.593120    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzwlx\" (UniqueName: \"kubernetes.io/projected/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-kube-api-access-bzwlx\") pod \"console-7548b65dff-w488w\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") " pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.593327 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.593166    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-console-serving-cert\") pod \"console-7548b65dff-w488w\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") " pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.593327 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.593236    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-console-config\") pod \"console-7548b65dff-w488w\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") " pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.593327 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.593310    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-oauth-serving-cert\") pod \"console-7548b65dff-w488w\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") " pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.593474 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.593351    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-console-oauth-config\") pod \"console-7548b65dff-w488w\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") " pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.593474 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.593372    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-service-ca\") pod \"console-7548b65dff-w488w\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") " pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.593474 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.593398    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-trusted-ca-bundle\") pod \"console-7548b65dff-w488w\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") " pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.694019 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.693985    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-console-oauth-config\") pod \"console-7548b65dff-w488w\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") " pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.694019 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.694020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-service-ca\") pod \"console-7548b65dff-w488w\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") " pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.694238 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.694040    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-trusted-ca-bundle\") pod \"console-7548b65dff-w488w\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") " pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.694238 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.694184    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzwlx\" (UniqueName: \"kubernetes.io/projected/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-kube-api-access-bzwlx\") pod \"console-7548b65dff-w488w\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") " pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.694342 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.694252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-console-serving-cert\") pod \"console-7548b65dff-w488w\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") " pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.694342 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.694295    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-console-config\") pod \"console-7548b65dff-w488w\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") " pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.694342 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.694339    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-oauth-serving-cert\") pod \"console-7548b65dff-w488w\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") " pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.694935 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.694874    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-service-ca\") pod \"console-7548b65dff-w488w\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") " pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.695054 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.694938    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-trusted-ca-bundle\") pod \"console-7548b65dff-w488w\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") " pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.695122 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.695076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-oauth-serving-cert\") pod \"console-7548b65dff-w488w\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") " pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.695180 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.695140    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-console-config\") pod \"console-7548b65dff-w488w\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") " pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.696948 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.696923    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-console-oauth-config\") pod \"console-7548b65dff-w488w\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") " pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.697164 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.697139    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-console-serving-cert\") pod \"console-7548b65dff-w488w\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") " pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.703723 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.703705    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzwlx\" (UniqueName: \"kubernetes.io/projected/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-kube-api-access-bzwlx\") pod \"console-7548b65dff-w488w\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") " pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:20.826667 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:20.826629    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:21.347744 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.347717    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gglvp"]
Sep 11 00:59:21.349764 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.349743    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.352584 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.352562    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 00:59:21.352704 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.352605    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 00:59:21.353191 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.353174    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 00:59:21.353486 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.353470    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t5pv6\""
Sep 11 00:59:21.400401 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.400375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-node-exporter-wtmp\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.400569 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.400418    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-node-exporter-accelerators-collector-config\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.400569 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.400460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.400569 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.400486    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-node-exporter-tls\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.400569 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.400507    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-sys\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.400569 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.400529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-node-exporter-textfile\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.400569 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.400561    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-metrics-client-ca\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.400854 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.400611    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-root\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.400854 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.400664    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6pvk\" (UniqueName: \"kubernetes.io/projected/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-kube-api-access-x6pvk\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.501327 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.501294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-root\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.501327 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.501331    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6pvk\" (UniqueName: \"kubernetes.io/projected/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-kube-api-access-x6pvk\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.501561 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.501369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-node-exporter-wtmp\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.501561 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.501400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-node-exporter-accelerators-collector-config\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.501561 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.501416    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-root\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.501561 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.501432    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.501561 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.501473    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-node-exporter-tls\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.501561 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.501505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-sys\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.501561 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.501547    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-sys\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.502020 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.501570    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-node-exporter-textfile\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.502020 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.501589    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-node-exporter-wtmp\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.502020 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.501670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-metrics-client-ca\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.502020 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.501969    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-node-exporter-textfile\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.502227 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.502165    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-node-exporter-accelerators-collector-config\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.502227 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.502200    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-metrics-client-ca\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.504139 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.504115    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-node-exporter-tls\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.504463 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.504334    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.508892 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.508871    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6pvk\" (UniqueName: \"kubernetes.io/projected/b6e7ae42-9c2b-4d44-b6b2-d8aaea563812-kube-api-access-x6pvk\") pod \"node-exporter-gglvp\" (UID: \"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812\") " pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.660007 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.659941    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gglvp"
Sep 11 00:59:21.674688 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:59:21.674658    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6e7ae42_9c2b_4d44_b6b2_d8aaea563812.slice/crio-d48f36e6e5df954ea575e1280005e84a21cbe9e5f5830f94b2115bf60d35a176 WatchSource:0}: Error finding container d48f36e6e5df954ea575e1280005e84a21cbe9e5f5830f94b2115bf60d35a176: Status 404 returned error can't find the container with id d48f36e6e5df954ea575e1280005e84a21cbe9e5f5830f94b2115bf60d35a176
Sep 11 00:59:21.931387 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.931035    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7548b65dff-w488w"]
Sep 11 00:59:21.933666 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:59:21.933638    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a0e2a61_8d04_4fcf_b5b5_06c8e433a3cb.slice/crio-ecabb844e3b15479189cdd98aad79a9cc03243bb3c4d03fcb561c4c25b5430c7 WatchSource:0}: Error finding container ecabb844e3b15479189cdd98aad79a9cc03243bb3c4d03fcb561c4c25b5430c7: Status 404 returned error can't find the container with id ecabb844e3b15479189cdd98aad79a9cc03243bb3c4d03fcb561c4c25b5430c7
Sep 11 00:59:21.976338 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.976307    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95789c754-rn72x" event={"ID":"462dad59-5674-4c20-b8fd-aa5f20e5e6bc","Type":"ContainerStarted","Data":"8f1e82e49e380e64a06735c3229673666dfa90ce2fdc01e30d336fc304a870a6"}
Sep 11 00:59:21.982314 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.982281    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gglvp" event={"ID":"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812","Type":"ContainerStarted","Data":"d48f36e6e5df954ea575e1280005e84a21cbe9e5f5830f94b2115bf60d35a176"}
Sep 11 00:59:21.983623 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:21.983602    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7548b65dff-w488w" event={"ID":"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb","Type":"ContainerStarted","Data":"ecabb844e3b15479189cdd98aad79a9cc03243bb3c4d03fcb561c4c25b5430c7"}
Sep 11 00:59:22.989600 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:22.989517    2565 generic.go:356] "Generic (PLEG): container finished" podID="b6e7ae42-9c2b-4d44-b6b2-d8aaea563812" containerID="dcb3fa8c3015753ef9b27d684af7b79024faf474f7cdf2d5ff677ae7cdce8a39" exitCode=0
Sep 11 00:59:22.989600 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:22.989590    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gglvp" event={"ID":"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812","Type":"ContainerDied","Data":"dcb3fa8c3015753ef9b27d684af7b79024faf474f7cdf2d5ff677ae7cdce8a39"}
Sep 11 00:59:22.991380 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:22.991358    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7548b65dff-w488w" event={"ID":"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb","Type":"ContainerStarted","Data":"49ebfeae8c90ca4d16a343578b9704fae636111229e3011fec1496bcf0414b11"}
Sep 11 00:59:23.009197 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:23.009156    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-95789c754-rn72x" podStartSLOduration=2.642043246 podStartE2EDuration="17.009141364s" totalImagesPullingTime="14.367098118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:59:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:59:21.99327708 +0000 UTC m=+79.041365304" watchObservedRunningTime="2026-09-11 00:59:23.009141364 +0000 UTC m=+80.057229588"
Sep 11 00:59:23.025146 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:23.025108    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7548b65dff-w488w" podStartSLOduration=3.02509539 podStartE2EDuration="3.02509539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:59:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:59:23.023794766 +0000 UTC m=+80.071883014" watchObservedRunningTime="2026-09-11 00:59:23.02509539 +0000 UTC m=+80.073183614"
Sep 11 00:59:23.748267 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:23.748233    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:23.748440 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:23.748291    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:23.753062 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:23.753036    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:23.996633 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:23.996590    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gglvp" event={"ID":"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812","Type":"ContainerStarted","Data":"11fe301b2cc07a44ccfec8a6c21c8ab3cf25eaf0e85f97e6ce21a4a6ad953dcf"}
Sep 11 00:59:23.997029 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:23.996650    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gglvp" event={"ID":"b6e7ae42-9c2b-4d44-b6b2-d8aaea563812","Type":"ContainerStarted","Data":"0ee5094aeac613271f76dc6f2d2888c099a5e7d07644d20eae77cd5118127ef2"}
Sep 11 00:59:24.000519 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.000453    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 00:59:24.013577 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.013535    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gglvp" podStartSLOduration=1.999762532 podStartE2EDuration="3.01352009s" totalImagesPullingTime="953.958382ms" totalInitContainerRuntime="59.799176ms" isStatefulPod=true podCreationTimestamp="2026-09-11 00:59:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:59:24.012624342 +0000 UTC m=+81.060712579" watchObservedRunningTime="2026-09-11 00:59:24.01352009 +0000 UTC m=+81.061608313"
Sep 11 00:59:24.332809 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.332771    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"]
Sep 11 00:59:24.336107 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.336087    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.339740 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.339685    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 11 00:59:24.339903 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.339772    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 11 00:59:24.340132 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.340109    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 11 00:59:24.340215 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.340193    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b61j8vncteoee\""
Sep 11 00:59:24.340931 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.340911    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 11 00:59:24.341016 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.340986    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 11 00:59:24.344038 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.341840    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-2xftr\""
Sep 11 00:59:24.350706 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.350683    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"]
Sep 11 00:59:24.430597 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.430564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26604ae6-2950-4a33-aa11-f14c952f5fbe-secret-grpc-tls\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.430748 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.430607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/26604ae6-2950-4a33-aa11-f14c952f5fbe-secret-thanos-querier-tls\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.430748 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.430635    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/26604ae6-2950-4a33-aa11-f14c952f5fbe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.430748 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.430689    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26604ae6-2950-4a33-aa11-f14c952f5fbe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.430748 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.430735    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26604ae6-2950-4a33-aa11-f14c952f5fbe-metrics-client-ca\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.430948 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.430754    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqws5\" (UniqueName: \"kubernetes.io/projected/26604ae6-2950-4a33-aa11-f14c952f5fbe-kube-api-access-rqws5\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.430948 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.430780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/26604ae6-2950-4a33-aa11-f14c952f5fbe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.430948 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.430849    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26604ae6-2950-4a33-aa11-f14c952f5fbe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.531597 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.531556    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26604ae6-2950-4a33-aa11-f14c952f5fbe-secret-grpc-tls\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.531797 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.531615    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/26604ae6-2950-4a33-aa11-f14c952f5fbe-secret-thanos-querier-tls\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.531797 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.531635    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/26604ae6-2950-4a33-aa11-f14c952f5fbe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.531797 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.531653    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26604ae6-2950-4a33-aa11-f14c952f5fbe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.531797 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.531679    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26604ae6-2950-4a33-aa11-f14c952f5fbe-metrics-client-ca\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.531797 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.531696    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqws5\" (UniqueName: \"kubernetes.io/projected/26604ae6-2950-4a33-aa11-f14c952f5fbe-kube-api-access-rqws5\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.531797 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.531718    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/26604ae6-2950-4a33-aa11-f14c952f5fbe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.531797 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.531744    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26604ae6-2950-4a33-aa11-f14c952f5fbe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.532564 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.532532    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26604ae6-2950-4a33-aa11-f14c952f5fbe-metrics-client-ca\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.534386 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.534358    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/26604ae6-2950-4a33-aa11-f14c952f5fbe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.534493 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.534358    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26604ae6-2950-4a33-aa11-f14c952f5fbe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.534722 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.534692    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/26604ae6-2950-4a33-aa11-f14c952f5fbe-secret-thanos-querier-tls\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.534722 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.534711    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/26604ae6-2950-4a33-aa11-f14c952f5fbe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.534864 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.534696    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26604ae6-2950-4a33-aa11-f14c952f5fbe-secret-grpc-tls\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.534915 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.534898    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26604ae6-2950-4a33-aa11-f14c952f5fbe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.540095 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.540078    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqws5\" (UniqueName: \"kubernetes.io/projected/26604ae6-2950-4a33-aa11-f14c952f5fbe-kube-api-access-rqws5\") pod \"thanos-querier-756d6fd8fc-zpklt\" (UID: \"26604ae6-2950-4a33-aa11-f14c952f5fbe\") " pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.648244 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.648163    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:24.929123 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:24.929031    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"]
Sep 11 00:59:24.932672 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:59:24.932640    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26604ae6_2950_4a33_aa11_f14c952f5fbe.slice/crio-b7e933a5b19ce6f5b2b8f80e63c917c626adb6e35cd9e0fff3ab7aa60d765d9b WatchSource:0}: Error finding container b7e933a5b19ce6f5b2b8f80e63c917c626adb6e35cd9e0fff3ab7aa60d765d9b: Status 404 returned error can't find the container with id b7e933a5b19ce6f5b2b8f80e63c917c626adb6e35cd9e0fff3ab7aa60d765d9b
Sep 11 00:59:25.001555 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.001524    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt" event={"ID":"26604ae6-2950-4a33-aa11-f14c952f5fbe","Type":"ContainerStarted","Data":"b7e933a5b19ce6f5b2b8f80e63c917c626adb6e35cd9e0fff3ab7aa60d765d9b"}
Sep 11 00:59:25.659880 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.659845    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-f9fcbd86b-45dql"]
Sep 11 00:59:25.662831 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.662798    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.665268 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.665241    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 00:59:25.666198 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.666178    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 11 00:59:25.666502 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.666482    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-65fj4\""
Sep 11 00:59:25.666589 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.666502    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-c87g4dotuvtq9\""
Sep 11 00:59:25.666589 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.666508    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 11 00:59:25.666668 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.666590    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 11 00:59:25.679240 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.679216    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f9fcbd86b-45dql"]
Sep 11 00:59:25.741512 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.741474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d-secret-metrics-server-tls\") pod \"metrics-server-f9fcbd86b-45dql\" (UID: \"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d\") " pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.741693 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.741525    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cghrj\" (UniqueName: \"kubernetes.io/projected/dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d-kube-api-access-cghrj\") pod \"metrics-server-f9fcbd86b-45dql\" (UID: \"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d\") " pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.741693 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.741592    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d-client-ca-bundle\") pod \"metrics-server-f9fcbd86b-45dql\" (UID: \"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d\") " pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.741693 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.741650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d-metrics-server-audit-profiles\") pod \"metrics-server-f9fcbd86b-45dql\" (UID: \"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d\") " pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.741899 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.741715    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d-secret-metrics-server-client-certs\") pod \"metrics-server-f9fcbd86b-45dql\" (UID: \"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d\") " pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.741899 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.741745    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f9fcbd86b-45dql\" (UID: \"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d\") " pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.741899 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.741779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d-audit-log\") pod \"metrics-server-f9fcbd86b-45dql\" (UID: \"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d\") " pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.843003 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.842860    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d-client-ca-bundle\") pod \"metrics-server-f9fcbd86b-45dql\" (UID: \"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d\") " pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.843003 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.842925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d-metrics-server-audit-profiles\") pod \"metrics-server-f9fcbd86b-45dql\" (UID: \"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d\") " pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.843003 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.842980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d-secret-metrics-server-client-certs\") pod \"metrics-server-f9fcbd86b-45dql\" (UID: \"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d\") " pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.843262 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.843011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f9fcbd86b-45dql\" (UID: \"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d\") " pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.843262 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.843046    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d-audit-log\") pod \"metrics-server-f9fcbd86b-45dql\" (UID: \"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d\") " pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.843262 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.843095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d-secret-metrics-server-tls\") pod \"metrics-server-f9fcbd86b-45dql\" (UID: \"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d\") " pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.843262 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.843133    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cghrj\" (UniqueName: \"kubernetes.io/projected/dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d-kube-api-access-cghrj\") pod \"metrics-server-f9fcbd86b-45dql\" (UID: \"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d\") " pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.843879 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.843852    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d-audit-log\") pod \"metrics-server-f9fcbd86b-45dql\" (UID: \"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d\") " pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.844116 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.844068    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f9fcbd86b-45dql\" (UID: \"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d\") " pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.844267 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.844231    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d-metrics-server-audit-profiles\") pod \"metrics-server-f9fcbd86b-45dql\" (UID: \"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d\") " pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.845951 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.845927    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d-secret-metrics-server-client-certs\") pod \"metrics-server-f9fcbd86b-45dql\" (UID: \"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d\") " pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.846033 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.845961    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d-client-ca-bundle\") pod \"metrics-server-f9fcbd86b-45dql\" (UID: \"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d\") " pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.846033 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.845931    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d-secret-metrics-server-tls\") pod \"metrics-server-f9fcbd86b-45dql\" (UID: \"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d\") " pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.851588 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.851558    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cghrj\" (UniqueName: \"kubernetes.io/projected/dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d-kube-api-access-cghrj\") pod \"metrics-server-f9fcbd86b-45dql\" (UID: \"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d\") " pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:25.973006 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:25.972914    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:26.131943 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.131911    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-mlggs"]
Sep 11 00:59:26.135418 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.135396    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mlggs"
Sep 11 00:59:26.137725 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.137687    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 11 00:59:26.137878 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.137868    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4qmzb\""
Sep 11 00:59:26.143066 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.143040    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-mlggs"]
Sep 11 00:59:26.245860 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.245755    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0212033-2228-43eb-87dd-6f7d2faed57c-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-mlggs\" (UID: \"e0212033-2228-43eb-87dd-6f7d2faed57c\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mlggs"
Sep 11 00:59:26.245860 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.245829    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmdsl\" (UniqueName: \"kubernetes.io/projected/e0212033-2228-43eb-87dd-6f7d2faed57c-kube-api-access-lmdsl\") pod \"monitoring-plugin-5d85778b9d-mlggs\" (UID: \"e0212033-2228-43eb-87dd-6f7d2faed57c\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mlggs"
Sep 11 00:59:26.254916 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.254875    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f9fcbd86b-45dql"]
Sep 11 00:59:26.347351 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.347315    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0212033-2228-43eb-87dd-6f7d2faed57c-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-mlggs\" (UID: \"e0212033-2228-43eb-87dd-6f7d2faed57c\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mlggs"
Sep 11 00:59:26.347550 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.347376    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmdsl\" (UniqueName: \"kubernetes.io/projected/e0212033-2228-43eb-87dd-6f7d2faed57c-kube-api-access-lmdsl\") pod \"monitoring-plugin-5d85778b9d-mlggs\" (UID: \"e0212033-2228-43eb-87dd-6f7d2faed57c\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mlggs"
Sep 11 00:59:26.350153 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.350132    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0212033-2228-43eb-87dd-6f7d2faed57c-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-mlggs\" (UID: \"e0212033-2228-43eb-87dd-6f7d2faed57c\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mlggs"
Sep 11 00:59:26.355958 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.355935    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmdsl\" (UniqueName: \"kubernetes.io/projected/e0212033-2228-43eb-87dd-6f7d2faed57c-kube-api-access-lmdsl\") pod \"monitoring-plugin-5d85778b9d-mlggs\" (UID: \"e0212033-2228-43eb-87dd-6f7d2faed57c\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mlggs"
Sep 11 00:59:26.447890 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.447854    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mlggs"
Sep 11 00:59:26.532751 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.532669    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7548b65dff-w488w"]
Sep 11 00:59:26.566537 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.566507    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d9b4676db-6xx2k"]
Sep 11 00:59:26.569984 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.569953    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.588765 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.588699    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d9b4676db-6xx2k"]
Sep 11 00:59:26.649902 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.649858    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-service-ca\") pod \"console-5d9b4676db-6xx2k\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") " pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.649902 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.649903    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-trusted-ca-bundle\") pod \"console-5d9b4676db-6xx2k\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") " pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.650126 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.649974    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-console-config\") pod \"console-5d9b4676db-6xx2k\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") " pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.650126 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.650072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-console-oauth-config\") pod \"console-5d9b4676db-6xx2k\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") " pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.650126 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.650123    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-oauth-serving-cert\") pod \"console-5d9b4676db-6xx2k\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") " pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.650246 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.650147    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8cw4\" (UniqueName: \"kubernetes.io/projected/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-kube-api-access-x8cw4\") pod \"console-5d9b4676db-6xx2k\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") " pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.650246 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.650208    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-console-serving-cert\") pod \"console-5d9b4676db-6xx2k\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") " pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.751286 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.751244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-console-oauth-config\") pod \"console-5d9b4676db-6xx2k\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") " pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.751469 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.751322    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-oauth-serving-cert\") pod \"console-5d9b4676db-6xx2k\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") " pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.751469 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.751340    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8cw4\" (UniqueName: \"kubernetes.io/projected/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-kube-api-access-x8cw4\") pod \"console-5d9b4676db-6xx2k\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") " pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.751469 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.751397    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-console-serving-cert\") pod \"console-5d9b4676db-6xx2k\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") " pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.751469 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.751420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-service-ca\") pod \"console-5d9b4676db-6xx2k\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") " pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.751469 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.751442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-trusted-ca-bundle\") pod \"console-5d9b4676db-6xx2k\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") " pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.751659 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.751492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-console-config\") pod \"console-5d9b4676db-6xx2k\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") " pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.752279 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.752227    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-console-config\") pod \"console-5d9b4676db-6xx2k\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") " pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.752482 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.752456    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-oauth-serving-cert\") pod \"console-5d9b4676db-6xx2k\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") " pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.752482 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.752473    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-service-ca\") pod \"console-5d9b4676db-6xx2k\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") " pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.752681 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.752644    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-trusted-ca-bundle\") pod \"console-5d9b4676db-6xx2k\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") " pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.754310 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.754284    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-console-oauth-config\") pod \"console-5d9b4676db-6xx2k\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") " pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.754648 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.754625    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-console-serving-cert\") pod \"console-5d9b4676db-6xx2k\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") " pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.761939 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.761889    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8cw4\" (UniqueName: \"kubernetes.io/projected/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-kube-api-access-x8cw4\") pod \"console-5d9b4676db-6xx2k\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") " pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:26.779188 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:59:26.779165    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc1b1e93_50d3_4de1_b7c4_c0cee6702b1d.slice/crio-ae1fa0c4b71d0675a99ad5b94091c752e6a9c818d71b0aa830f1463898343a25 WatchSource:0}: Error finding container ae1fa0c4b71d0675a99ad5b94091c752e6a9c818d71b0aa830f1463898343a25: Status 404 returned error can't find the container with id ae1fa0c4b71d0675a99ad5b94091c752e6a9c818d71b0aa830f1463898343a25
Sep 11 00:59:26.880918 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:26.880883    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:27.010765 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:27.010736    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql" event={"ID":"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d","Type":"ContainerStarted","Data":"ae1fa0c4b71d0675a99ad5b94091c752e6a9c818d71b0aa830f1463898343a25"}
Sep 11 00:59:27.012737 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:27.012705    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt" event={"ID":"26604ae6-2950-4a33-aa11-f14c952f5fbe","Type":"ContainerStarted","Data":"38b4c534879795a31dda15f46759227d027492ab4e8431fd720b034966b75e05"}
Sep 11 00:59:27.012846 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:27.012759    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt" event={"ID":"26604ae6-2950-4a33-aa11-f14c952f5fbe","Type":"ContainerStarted","Data":"f89d677d95b85f1b3b780b5a7fab0815117742c4688697d188a463e5e985f98c"}
Sep 11 00:59:27.048418 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:27.048395    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-mlggs"]
Sep 11 00:59:27.051030 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:59:27.051006    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0212033_2228_43eb_87dd_6f7d2faed57c.slice/crio-d38ef78127c6e63ea332ece9383927b41b0c91a3205c1fdd2434a38efe9c8bf0 WatchSource:0}: Error finding container d38ef78127c6e63ea332ece9383927b41b0c91a3205c1fdd2434a38efe9c8bf0: Status 404 returned error can't find the container with id d38ef78127c6e63ea332ece9383927b41b0c91a3205c1fdd2434a38efe9c8bf0
Sep 11 00:59:27.160978 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:27.160932    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d9b4676db-6xx2k"]
Sep 11 00:59:27.164491 ip-10-0-133-50 kubenswrapper[2565]: W0911 00:59:27.164466    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b0d9276_7128_47cb_97cd_980a0ffcf6eb.slice/crio-8440e5e81dde61f936f3b9a6a7841e49bba6c22db2b9c5b1acc4ee88241659ff WatchSource:0}: Error finding container 8440e5e81dde61f936f3b9a6a7841e49bba6c22db2b9c5b1acc4ee88241659ff: Status 404 returned error can't find the container with id 8440e5e81dde61f936f3b9a6a7841e49bba6c22db2b9c5b1acc4ee88241659ff
Sep 11 00:59:28.021940 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:28.021887    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt" event={"ID":"26604ae6-2950-4a33-aa11-f14c952f5fbe","Type":"ContainerStarted","Data":"2adf89ca7f995011b42a1d0ec6b9f9052234005cf29be9e5658aced0ba1035e2"}
Sep 11 00:59:28.023250 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:28.023219    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mlggs" event={"ID":"e0212033-2228-43eb-87dd-6f7d2faed57c","Type":"ContainerStarted","Data":"d38ef78127c6e63ea332ece9383927b41b0c91a3205c1fdd2434a38efe9c8bf0"}
Sep 11 00:59:28.025247 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:28.025008    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9b4676db-6xx2k" event={"ID":"6b0d9276-7128-47cb-97cd-980a0ffcf6eb","Type":"ContainerStarted","Data":"d31f98e8a025fb54f9e2797e87abea604848bb5f335358b35be34f47f3dfd225"}
Sep 11 00:59:28.025247 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:28.025051    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9b4676db-6xx2k" event={"ID":"6b0d9276-7128-47cb-97cd-980a0ffcf6eb","Type":"ContainerStarted","Data":"8440e5e81dde61f936f3b9a6a7841e49bba6c22db2b9c5b1acc4ee88241659ff"}
Sep 11 00:59:28.046111 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:28.046054    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d9b4676db-6xx2k" podStartSLOduration=2.046036107 podStartE2EDuration="2.046036107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:59:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:59:28.044105447 +0000 UTC m=+85.092193691" watchObservedRunningTime="2026-09-11 00:59:28.046036107 +0000 UTC m=+85.094124410"
Sep 11 00:59:28.904311 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:28.904286    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67bcbf57bc-slv6g"
Sep 11 00:59:29.030483 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:29.030382    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql" event={"ID":"dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d","Type":"ContainerStarted","Data":"ad01289f0d63c476450a3d82443bf1275494bdd84d568342c868201c0791d73c"}
Sep 11 00:59:29.033709 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:29.033675    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt" event={"ID":"26604ae6-2950-4a33-aa11-f14c952f5fbe","Type":"ContainerStarted","Data":"2b9cdd6be1b1457de8960fd3e8307ad8a5e829fe837c8618bc51482564cc9ec9"}
Sep 11 00:59:29.033911 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:29.033748    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt" event={"ID":"26604ae6-2950-4a33-aa11-f14c952f5fbe","Type":"ContainerStarted","Data":"85da05f91206bf192dbaea8748819b6ff741acf674f22606a3ca4b66a1ec7da4"}
Sep 11 00:59:29.033911 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:29.033793    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt" event={"ID":"26604ae6-2950-4a33-aa11-f14c952f5fbe","Type":"ContainerStarted","Data":"32662f6d68223eb27a2917621cc220fd320e56fdfa9deec7867ecefe9ecfefa5"}
Sep 11 00:59:29.033911 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:29.033869    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:29.035450 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:29.035425    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mlggs" event={"ID":"e0212033-2228-43eb-87dd-6f7d2faed57c","Type":"ContainerStarted","Data":"d8365d8c5d0659ebf1f94980ef45be660e8167073359c2cdd69644f7a540627c"}
Sep 11 00:59:29.035683 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:29.035664    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mlggs"
Sep 11 00:59:29.040696 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:29.040673    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mlggs"
Sep 11 00:59:29.056607 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:29.056555    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql" podStartSLOduration=2.122709311 podStartE2EDuration="4.056536807s" totalImagesPullingTime="1.933827496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:59:29.049579111 +0000 UTC m=+86.097667361" watchObservedRunningTime="2026-09-11 00:59:29.056536807 +0000 UTC m=+86.104625032"
Sep 11 00:59:29.110641 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:29.110589    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt" podStartSLOduration=1.5571618680000001 podStartE2EDuration="5.110569198s" totalImagesPullingTime="3.55340733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:59:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:59:29.083383327 +0000 UTC m=+86.131471569" watchObservedRunningTime="2026-09-11 00:59:29.110569198 +0000 UTC m=+86.158657424"
Sep 11 00:59:29.111693 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:29.111660    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mlggs" podStartSLOduration=1.446435205 podStartE2EDuration="3.111651367s" totalImagesPullingTime="1.665216162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 00:59:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 00:59:29.110687968 +0000 UTC m=+86.158776231" watchObservedRunningTime="2026-09-11 00:59:29.111651367 +0000 UTC m=+86.159739590"
Sep 11 00:59:30.827713 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:30.827677    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:31.554785 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:31.554731    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d9b4676db-6xx2k"]
Sep 11 00:59:31.813776 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:31.813663    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5" podUID="820508ab-5c1d-4ecd-bce6-d9885e8bab95" containerName="registry" containerID="cri-o://956df73380b34d9136bf2e4ed0d255ada377201ec46e70a20a814a27aae8097e" gracePeriod=30
Sep 11 00:59:32.057877 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.057795    2565 generic.go:356] "Generic (PLEG): container finished" podID="820508ab-5c1d-4ecd-bce6-d9885e8bab95" containerID="956df73380b34d9136bf2e4ed0d255ada377201ec46e70a20a814a27aae8097e" exitCode=0
Sep 11 00:59:32.058256 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.057927    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5" event={"ID":"820508ab-5c1d-4ecd-bce6-d9885e8bab95","Type":"ContainerDied","Data":"956df73380b34d9136bf2e4ed0d255ada377201ec46e70a20a814a27aae8097e"}
Sep 11 00:59:32.076957 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.076936    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:59:32.207606 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.207568    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/820508ab-5c1d-4ecd-bce6-d9885e8bab95-installation-pull-secrets\") pod \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") "
Sep 11 00:59:32.207795 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.207640    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-certificates\") pod \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") "
Sep 11 00:59:32.207795 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.207662    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrrb4\" (UniqueName: \"kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-kube-api-access-hrrb4\") pod \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") "
Sep 11 00:59:32.207943 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.207794    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/820508ab-5c1d-4ecd-bce6-d9885e8bab95-image-registry-private-configuration\") pod \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") "
Sep 11 00:59:32.207943 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.207897    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-tls\") pod \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") "
Sep 11 00:59:32.208040 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.207943    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/820508ab-5c1d-4ecd-bce6-d9885e8bab95-trusted-ca\") pod \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") "
Sep 11 00:59:32.208040 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.207974    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/820508ab-5c1d-4ecd-bce6-d9885e8bab95-ca-trust-extracted\") pod \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") "
Sep 11 00:59:32.208040 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.208026    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-bound-sa-token\") pod \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\" (UID: \"820508ab-5c1d-4ecd-bce6-d9885e8bab95\") "
Sep 11 00:59:32.208189 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.208115    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "820508ab-5c1d-4ecd-bce6-d9885e8bab95" (UID: "820508ab-5c1d-4ecd-bce6-d9885e8bab95"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:59:32.208321 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.208301    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-certificates\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:32.208481 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.208380    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/820508ab-5c1d-4ecd-bce6-d9885e8bab95-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "820508ab-5c1d-4ecd-bce6-d9885e8bab95" (UID: "820508ab-5c1d-4ecd-bce6-d9885e8bab95"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:59:32.210272 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.210244    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "820508ab-5c1d-4ecd-bce6-d9885e8bab95" (UID: "820508ab-5c1d-4ecd-bce6-d9885e8bab95"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:59:32.210417 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.210377    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "820508ab-5c1d-4ecd-bce6-d9885e8bab95" (UID: "820508ab-5c1d-4ecd-bce6-d9885e8bab95"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:59:32.210417 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.210399    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/820508ab-5c1d-4ecd-bce6-d9885e8bab95-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "820508ab-5c1d-4ecd-bce6-d9885e8bab95" (UID: "820508ab-5c1d-4ecd-bce6-d9885e8bab95"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:59:32.210515 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.210448    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-kube-api-access-hrrb4" (OuterVolumeSpecName: "kube-api-access-hrrb4") pod "820508ab-5c1d-4ecd-bce6-d9885e8bab95" (UID: "820508ab-5c1d-4ecd-bce6-d9885e8bab95"). InnerVolumeSpecName "kube-api-access-hrrb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:59:32.210515 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.210503    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/820508ab-5c1d-4ecd-bce6-d9885e8bab95-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "820508ab-5c1d-4ecd-bce6-d9885e8bab95" (UID: "820508ab-5c1d-4ecd-bce6-d9885e8bab95"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:59:32.216607 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.216584    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/820508ab-5c1d-4ecd-bce6-d9885e8bab95-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "820508ab-5c1d-4ecd-bce6-d9885e8bab95" (UID: "820508ab-5c1d-4ecd-bce6-d9885e8bab95"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 00:59:32.308915 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.308876    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrrb4\" (UniqueName: \"kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-kube-api-access-hrrb4\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:32.308915 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.308908    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/820508ab-5c1d-4ecd-bce6-d9885e8bab95-image-registry-private-configuration\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:32.308915 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.308918    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-registry-tls\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:32.308915 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.308927    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/820508ab-5c1d-4ecd-bce6-d9885e8bab95-trusted-ca\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:32.309172 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.308936    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/820508ab-5c1d-4ecd-bce6-d9885e8bab95-ca-trust-extracted\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:32.309172 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.308944    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/820508ab-5c1d-4ecd-bce6-d9885e8bab95-bound-sa-token\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:32.309172 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:32.308952    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/820508ab-5c1d-4ecd-bce6-d9885e8bab95-installation-pull-secrets\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:33.062639 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:33.062610    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5"
Sep 11 00:59:33.063040 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:33.062609    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dbc88f5d-5gkb5" event={"ID":"820508ab-5c1d-4ecd-bce6-d9885e8bab95","Type":"ContainerDied","Data":"60ae2e928c2cd1b0cb3f8f7d195ad556afda540ab8b10ff1f8c4f97303331578"}
Sep 11 00:59:33.063040 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:33.062747    2565 scope.go:117] "RemoveContainer" containerID="956df73380b34d9136bf2e4ed0d255ada377201ec46e70a20a814a27aae8097e"
Sep 11 00:59:33.083646 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:33.083609    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6dbc88f5d-5gkb5"]
Sep 11 00:59:33.087154 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:33.087134    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6dbc88f5d-5gkb5"]
Sep 11 00:59:33.470581 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:33.470506    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="820508ab-5c1d-4ecd-bce6-d9885e8bab95" path="/var/lib/kubelet/pods/820508ab-5c1d-4ecd-bce6-d9885e8bab95/volumes"
Sep 11 00:59:35.046392 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:35.046368    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-756d6fd8fc-zpklt"
Sep 11 00:59:36.881281 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:36.881239    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:42.237390 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:42.237352    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d99dcf4bd-r8m8s"]
Sep 11 00:59:45.945000 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:45.944962    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fvsdv"
Sep 11 00:59:45.973669 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:45.973628    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:45.973849 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:45.973704    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 00:59:51.554172 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.554136    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7548b65dff-w488w" podUID="9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb" containerName="console" containerID="cri-o://49ebfeae8c90ca4d16a343578b9704fae636111229e3011fec1496bcf0414b11" gracePeriod=15
Sep 11 00:59:51.793637 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.793611    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:51.869138 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.869039    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-trusted-ca-bundle\") pod \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") "
Sep 11 00:59:51.869138 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.869087    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-console-serving-cert\") pod \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") "
Sep 11 00:59:51.869373 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.869158    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-oauth-serving-cert\") pod \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") "
Sep 11 00:59:51.869373 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.869188    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-service-ca\") pod \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") "
Sep 11 00:59:51.869373 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.869223    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzwlx\" (UniqueName: \"kubernetes.io/projected/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-kube-api-access-bzwlx\") pod \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") "
Sep 11 00:59:51.869373 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.869257    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-console-config\") pod \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") "
Sep 11 00:59:51.869373 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.869293    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-console-oauth-config\") pod \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\" (UID: \"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb\") "
Sep 11 00:59:51.869620 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.869512    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb" (UID: "9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:59:51.869687 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.869634    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-service-ca" (OuterVolumeSpecName: "service-ca") pod "9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb" (UID: "9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:59:51.869872 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.869840    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-console-config" (OuterVolumeSpecName: "console-config") pod "9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb" (UID: "9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:59:51.870000 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.869872    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb" (UID: "9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:59:51.871531 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.871509    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb" (UID: "9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:59:51.871613 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.871549    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb" (UID: "9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:59:51.871613 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.871559    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-kube-api-access-bzwlx" (OuterVolumeSpecName: "kube-api-access-bzwlx") pod "9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb" (UID: "9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb"). InnerVolumeSpecName "kube-api-access-bzwlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:59:51.970183 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.970129    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-oauth-serving-cert\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:51.970183 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.970173    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-service-ca\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:51.970183 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.970183    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzwlx\" (UniqueName: \"kubernetes.io/projected/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-kube-api-access-bzwlx\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:51.970183 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.970191    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-console-config\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:51.970183 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.970200    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-console-oauth-config\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:51.970473 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.970209    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-trusted-ca-bundle\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:51.970473 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:51.970217    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb-console-serving-cert\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:52.139853 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:52.139756    2565 generic.go:356] "Generic (PLEG): container finished" podID="9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb" containerID="49ebfeae8c90ca4d16a343578b9704fae636111229e3011fec1496bcf0414b11" exitCode=0
Sep 11 00:59:52.139853 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:52.139800    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7548b65dff-w488w"
Sep 11 00:59:52.139853 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:52.139805    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7548b65dff-w488w" event={"ID":"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb","Type":"ContainerDied","Data":"49ebfeae8c90ca4d16a343578b9704fae636111229e3011fec1496bcf0414b11"}
Sep 11 00:59:52.140065 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:52.139879    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7548b65dff-w488w" event={"ID":"9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb","Type":"ContainerDied","Data":"ecabb844e3b15479189cdd98aad79a9cc03243bb3c4d03fcb561c4c25b5430c7"}
Sep 11 00:59:52.140065 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:52.139899    2565 scope.go:117] "RemoveContainer" containerID="49ebfeae8c90ca4d16a343578b9704fae636111229e3011fec1496bcf0414b11"
Sep 11 00:59:52.148827 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:52.148797    2565 scope.go:117] "RemoveContainer" containerID="49ebfeae8c90ca4d16a343578b9704fae636111229e3011fec1496bcf0414b11"
Sep 11 00:59:52.149098 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:59:52.149075    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49ebfeae8c90ca4d16a343578b9704fae636111229e3011fec1496bcf0414b11\": container with ID starting with 49ebfeae8c90ca4d16a343578b9704fae636111229e3011fec1496bcf0414b11 not found: ID does not exist" containerID="49ebfeae8c90ca4d16a343578b9704fae636111229e3011fec1496bcf0414b11"
Sep 11 00:59:52.149181 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:52.149103    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49ebfeae8c90ca4d16a343578b9704fae636111229e3011fec1496bcf0414b11"} err="failed to get container status \"49ebfeae8c90ca4d16a343578b9704fae636111229e3011fec1496bcf0414b11\": rpc error: code = NotFound desc = could not find container \"49ebfeae8c90ca4d16a343578b9704fae636111229e3011fec1496bcf0414b11\": container with ID starting with 49ebfeae8c90ca4d16a343578b9704fae636111229e3011fec1496bcf0414b11 not found: ID does not exist"
Sep 11 00:59:52.165438 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:52.165404    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7548b65dff-w488w"]
Sep 11 00:59:52.166541 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:52.166522    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7548b65dff-w488w"]
Sep 11 00:59:53.470185 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:53.470144    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb" path="/var/lib/kubelet/pods/9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb/volumes"
Sep 11 00:59:56.578024 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:56.577984    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d9b4676db-6xx2k" podUID="6b0d9276-7128-47cb-97cd-980a0ffcf6eb" containerName="console" containerID="cri-o://d31f98e8a025fb54f9e2797e87abea604848bb5f335358b35be34f47f3dfd225" gracePeriod=15
Sep 11 00:59:56.806622 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:56.806598    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:56.908336 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:56.908244    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-trusted-ca-bundle\") pod \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") "
Sep 11 00:59:56.908336 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:56.908284    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-oauth-serving-cert\") pod \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") "
Sep 11 00:59:56.908336 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:56.908304    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-console-oauth-config\") pod \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") "
Sep 11 00:59:56.908592 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:56.908343    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-service-ca\") pod \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") "
Sep 11 00:59:56.908592 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:56.908369    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-console-serving-cert\") pod \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") "
Sep 11 00:59:56.908592 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:56.908400    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-console-config\") pod \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") "
Sep 11 00:59:56.908592 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:56.908421    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8cw4\" (UniqueName: \"kubernetes.io/projected/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-kube-api-access-x8cw4\") pod \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\" (UID: \"6b0d9276-7128-47cb-97cd-980a0ffcf6eb\") "
Sep 11 00:59:56.908801 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:56.908703    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6b0d9276-7128-47cb-97cd-980a0ffcf6eb" (UID: "6b0d9276-7128-47cb-97cd-980a0ffcf6eb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:59:56.908906 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:56.908861    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-service-ca" (OuterVolumeSpecName: "service-ca") pod "6b0d9276-7128-47cb-97cd-980a0ffcf6eb" (UID: "6b0d9276-7128-47cb-97cd-980a0ffcf6eb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:59:56.908962 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:56.908904    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6b0d9276-7128-47cb-97cd-980a0ffcf6eb" (UID: "6b0d9276-7128-47cb-97cd-980a0ffcf6eb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:59:56.909010 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:56.908959    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-console-config" (OuterVolumeSpecName: "console-config") pod "6b0d9276-7128-47cb-97cd-980a0ffcf6eb" (UID: "6b0d9276-7128-47cb-97cd-980a0ffcf6eb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 00:59:56.910530 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:56.910508    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-kube-api-access-x8cw4" (OuterVolumeSpecName: "kube-api-access-x8cw4") pod "6b0d9276-7128-47cb-97cd-980a0ffcf6eb" (UID: "6b0d9276-7128-47cb-97cd-980a0ffcf6eb"). InnerVolumeSpecName "kube-api-access-x8cw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 00:59:56.910631 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:56.910534    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6b0d9276-7128-47cb-97cd-980a0ffcf6eb" (UID: "6b0d9276-7128-47cb-97cd-980a0ffcf6eb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:59:56.910631 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:56.910563    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6b0d9276-7128-47cb-97cd-980a0ffcf6eb" (UID: "6b0d9276-7128-47cb-97cd-980a0ffcf6eb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 00:59:57.009130 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:57.009086    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-service-ca\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:57.009130 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:57.009125    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-console-serving-cert\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:57.009130 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:57.009136    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-console-config\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:57.009347 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:57.009147    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8cw4\" (UniqueName: \"kubernetes.io/projected/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-kube-api-access-x8cw4\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:57.009347 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:57.009157    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-trusted-ca-bundle\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:57.009347 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:57.009165    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-oauth-serving-cert\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:57.009347 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:57.009173    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b0d9276-7128-47cb-97cd-980a0ffcf6eb-console-oauth-config\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 00:59:57.159419 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:57.159337    2565 generic.go:356] "Generic (PLEG): container finished" podID="6b0d9276-7128-47cb-97cd-980a0ffcf6eb" containerID="d31f98e8a025fb54f9e2797e87abea604848bb5f335358b35be34f47f3dfd225" exitCode=0
Sep 11 00:59:57.159419 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:57.159380    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d9b4676db-6xx2k"
Sep 11 00:59:57.159419 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:57.159384    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9b4676db-6xx2k" event={"ID":"6b0d9276-7128-47cb-97cd-980a0ffcf6eb","Type":"ContainerDied","Data":"d31f98e8a025fb54f9e2797e87abea604848bb5f335358b35be34f47f3dfd225"}
Sep 11 00:59:57.159607 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:57.159431    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d9b4676db-6xx2k" event={"ID":"6b0d9276-7128-47cb-97cd-980a0ffcf6eb","Type":"ContainerDied","Data":"8440e5e81dde61f936f3b9a6a7841e49bba6c22db2b9c5b1acc4ee88241659ff"}
Sep 11 00:59:57.159607 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:57.159453    2565 scope.go:117] "RemoveContainer" containerID="d31f98e8a025fb54f9e2797e87abea604848bb5f335358b35be34f47f3dfd225"
Sep 11 00:59:57.167588 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:57.167571    2565 scope.go:117] "RemoveContainer" containerID="d31f98e8a025fb54f9e2797e87abea604848bb5f335358b35be34f47f3dfd225"
Sep 11 00:59:57.167881 ip-10-0-133-50 kubenswrapper[2565]: E0911 00:59:57.167859    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d31f98e8a025fb54f9e2797e87abea604848bb5f335358b35be34f47f3dfd225\": container with ID starting with d31f98e8a025fb54f9e2797e87abea604848bb5f335358b35be34f47f3dfd225 not found: ID does not exist" containerID="d31f98e8a025fb54f9e2797e87abea604848bb5f335358b35be34f47f3dfd225"
Sep 11 00:59:57.167968 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:57.167888    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d31f98e8a025fb54f9e2797e87abea604848bb5f335358b35be34f47f3dfd225"} err="failed to get container status \"d31f98e8a025fb54f9e2797e87abea604848bb5f335358b35be34f47f3dfd225\": rpc error: code = NotFound desc = could not find container \"d31f98e8a025fb54f9e2797e87abea604848bb5f335358b35be34f47f3dfd225\": container with ID starting with d31f98e8a025fb54f9e2797e87abea604848bb5f335358b35be34f47f3dfd225 not found: ID does not exist"
Sep 11 00:59:57.181042 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:57.181016    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d9b4676db-6xx2k"]
Sep 11 00:59:57.183436 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:57.183415    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d9b4676db-6xx2k"]
Sep 11 00:59:57.469996 ip-10-0-133-50 kubenswrapper[2565]: I0911 00:59:57.469920    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b0d9276-7128-47cb-97cd-980a0ffcf6eb" path="/var/lib/kubelet/pods/6b0d9276-7128-47cb-97cd-980a0ffcf6eb/volumes"
Sep 11 01:00:05.978014 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:05.977981    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 01:00:05.981828 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:05.981796    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-f9fcbd86b-45dql"
Sep 11 01:00:07.255996 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:07.255937    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d99dcf4bd-r8m8s" podUID="4d21d94b-5e96-49b8-8f81-6204601b78c6" containerName="console" containerID="cri-o://352119d60de7493b74f83cd836e36443b8f91f018b9bf411b88121d516f2313e" gracePeriod=15
Sep 11 01:00:07.495334 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:07.495306    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 01:00:07.592128 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:07.592088    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d21d94b-5e96-49b8-8f81-6204601b78c6-console-config\") pod \"4d21d94b-5e96-49b8-8f81-6204601b78c6\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") "
Sep 11 01:00:07.592312 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:07.592135    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htd4t\" (UniqueName: \"kubernetes.io/projected/4d21d94b-5e96-49b8-8f81-6204601b78c6-kube-api-access-htd4t\") pod \"4d21d94b-5e96-49b8-8f81-6204601b78c6\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") "
Sep 11 01:00:07.592312 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:07.592174    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d21d94b-5e96-49b8-8f81-6204601b78c6-service-ca\") pod \"4d21d94b-5e96-49b8-8f81-6204601b78c6\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") "
Sep 11 01:00:07.592312 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:07.592206    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d21d94b-5e96-49b8-8f81-6204601b78c6-oauth-serving-cert\") pod \"4d21d94b-5e96-49b8-8f81-6204601b78c6\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") "
Sep 11 01:00:07.592312 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:07.592230    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d21d94b-5e96-49b8-8f81-6204601b78c6-console-oauth-config\") pod \"4d21d94b-5e96-49b8-8f81-6204601b78c6\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") "
Sep 11 01:00:07.592517 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:07.592377    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d21d94b-5e96-49b8-8f81-6204601b78c6-console-serving-cert\") pod \"4d21d94b-5e96-49b8-8f81-6204601b78c6\" (UID: \"4d21d94b-5e96-49b8-8f81-6204601b78c6\") "
Sep 11 01:00:07.592904 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:07.592590    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d21d94b-5e96-49b8-8f81-6204601b78c6-console-config" (OuterVolumeSpecName: "console-config") pod "4d21d94b-5e96-49b8-8f81-6204601b78c6" (UID: "4d21d94b-5e96-49b8-8f81-6204601b78c6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:00:07.592904 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:07.592630    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d21d94b-5e96-49b8-8f81-6204601b78c6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4d21d94b-5e96-49b8-8f81-6204601b78c6" (UID: "4d21d94b-5e96-49b8-8f81-6204601b78c6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:00:07.592904 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:07.592595    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d21d94b-5e96-49b8-8f81-6204601b78c6-service-ca" (OuterVolumeSpecName: "service-ca") pod "4d21d94b-5e96-49b8-8f81-6204601b78c6" (UID: "4d21d94b-5e96-49b8-8f81-6204601b78c6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:00:07.592904 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:07.592725    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d21d94b-5e96-49b8-8f81-6204601b78c6-console-config\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:00:07.592904 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:07.592755    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d21d94b-5e96-49b8-8f81-6204601b78c6-service-ca\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:00:07.592904 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:07.592770    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d21d94b-5e96-49b8-8f81-6204601b78c6-oauth-serving-cert\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:00:07.594548 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:07.594517    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d21d94b-5e96-49b8-8f81-6204601b78c6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4d21d94b-5e96-49b8-8f81-6204601b78c6" (UID: "4d21d94b-5e96-49b8-8f81-6204601b78c6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:00:07.594923 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:07.594902    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d21d94b-5e96-49b8-8f81-6204601b78c6-kube-api-access-htd4t" (OuterVolumeSpecName: "kube-api-access-htd4t") pod "4d21d94b-5e96-49b8-8f81-6204601b78c6" (UID: "4d21d94b-5e96-49b8-8f81-6204601b78c6"). InnerVolumeSpecName "kube-api-access-htd4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:00:07.594996 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:07.594919    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d21d94b-5e96-49b8-8f81-6204601b78c6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4d21d94b-5e96-49b8-8f81-6204601b78c6" (UID: "4d21d94b-5e96-49b8-8f81-6204601b78c6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:00:07.693918 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:07.693881    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d21d94b-5e96-49b8-8f81-6204601b78c6-console-oauth-config\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:00:07.693918 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:07.693908    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d21d94b-5e96-49b8-8f81-6204601b78c6-console-serving-cert\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:00:07.693918 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:07.693918    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htd4t\" (UniqueName: \"kubernetes.io/projected/4d21d94b-5e96-49b8-8f81-6204601b78c6-kube-api-access-htd4t\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:00:08.201737 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:08.201706    2565 generic.go:356] "Generic (PLEG): container finished" podID="4d21d94b-5e96-49b8-8f81-6204601b78c6" containerID="352119d60de7493b74f83cd836e36443b8f91f018b9bf411b88121d516f2313e" exitCode=0
Sep 11 01:00:08.201947 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:08.201758    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d99dcf4bd-r8m8s"
Sep 11 01:00:08.201947 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:08.201765    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d99dcf4bd-r8m8s" event={"ID":"4d21d94b-5e96-49b8-8f81-6204601b78c6","Type":"ContainerDied","Data":"352119d60de7493b74f83cd836e36443b8f91f018b9bf411b88121d516f2313e"}
Sep 11 01:00:08.201947 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:08.201805    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d99dcf4bd-r8m8s" event={"ID":"4d21d94b-5e96-49b8-8f81-6204601b78c6","Type":"ContainerDied","Data":"3c448c3474b793c60d701af53a02262b502ece750fdffa1fd6b17e1f89292d7e"}
Sep 11 01:00:08.201947 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:08.201841    2565 scope.go:117] "RemoveContainer" containerID="352119d60de7493b74f83cd836e36443b8f91f018b9bf411b88121d516f2313e"
Sep 11 01:00:08.210794 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:08.210778    2565 scope.go:117] "RemoveContainer" containerID="352119d60de7493b74f83cd836e36443b8f91f018b9bf411b88121d516f2313e"
Sep 11 01:00:08.211043 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:00:08.211025    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"352119d60de7493b74f83cd836e36443b8f91f018b9bf411b88121d516f2313e\": container with ID starting with 352119d60de7493b74f83cd836e36443b8f91f018b9bf411b88121d516f2313e not found: ID does not exist" containerID="352119d60de7493b74f83cd836e36443b8f91f018b9bf411b88121d516f2313e"
Sep 11 01:00:08.211092 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:08.211050    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"352119d60de7493b74f83cd836e36443b8f91f018b9bf411b88121d516f2313e"} err="failed to get container status \"352119d60de7493b74f83cd836e36443b8f91f018b9bf411b88121d516f2313e\": rpc error: code = NotFound desc = could not find container \"352119d60de7493b74f83cd836e36443b8f91f018b9bf411b88121d516f2313e\": container with ID starting with 352119d60de7493b74f83cd836e36443b8f91f018b9bf411b88121d516f2313e not found: ID does not exist"
Sep 11 01:00:08.221559 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:08.221536    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d99dcf4bd-r8m8s"]
Sep 11 01:00:08.225218 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:08.225196    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d99dcf4bd-r8m8s"]
Sep 11 01:00:09.469642 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:09.469612    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d21d94b-5e96-49b8-8f81-6204601b78c6" path="/var/lib/kubelet/pods/4d21d94b-5e96-49b8-8f81-6204601b78c6/volumes"
Sep 11 01:00:13.221375 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:13.221337    2565 generic.go:356] "Generic (PLEG): container finished" podID="809b7e8f-d5a8-4dcf-a450-83222c1a5705" containerID="3c562667185154d07ffd0415a73f7dfdec62650527cb5a35e85728d7626256a5" exitCode=0
Sep 11 01:00:13.221747 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:13.221408    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-j6ntg" event={"ID":"809b7e8f-d5a8-4dcf-a450-83222c1a5705","Type":"ContainerDied","Data":"3c562667185154d07ffd0415a73f7dfdec62650527cb5a35e85728d7626256a5"}
Sep 11 01:00:13.221787 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:13.221771    2565 scope.go:117] "RemoveContainer" containerID="3c562667185154d07ffd0415a73f7dfdec62650527cb5a35e85728d7626256a5"
Sep 11 01:00:14.227315 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:14.227274    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-j6ntg" event={"ID":"809b7e8f-d5a8-4dcf-a450-83222c1a5705","Type":"ContainerStarted","Data":"0c71ac75cabd7a162800c24c3126d5fc32aa7e852fea544dcc0f4407b7b9f6df"}
Sep 11 01:00:47.728074 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.728042    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c9f97ffdd-wmctr"]
Sep 11 01:00:47.728596 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.728420    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b0d9276-7128-47cb-97cd-980a0ffcf6eb" containerName="console"
Sep 11 01:00:47.728596 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.728438    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b0d9276-7128-47cb-97cd-980a0ffcf6eb" containerName="console"
Sep 11 01:00:47.728596 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.728456    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb" containerName="console"
Sep 11 01:00:47.728596 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.728464    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb" containerName="console"
Sep 11 01:00:47.728596 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.728482    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="820508ab-5c1d-4ecd-bce6-d9885e8bab95" containerName="registry"
Sep 11 01:00:47.728596 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.728491    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="820508ab-5c1d-4ecd-bce6-d9885e8bab95" containerName="registry"
Sep 11 01:00:47.728596 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.728501    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d21d94b-5e96-49b8-8f81-6204601b78c6" containerName="console"
Sep 11 01:00:47.728596 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.728509    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d21d94b-5e96-49b8-8f81-6204601b78c6" containerName="console"
Sep 11 01:00:47.728596 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.728585    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a0e2a61-8d04-4fcf-b5b5-06c8e433a3cb" containerName="console"
Sep 11 01:00:47.728596 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.728596    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d21d94b-5e96-49b8-8f81-6204601b78c6" containerName="console"
Sep 11 01:00:47.729089 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.728608    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b0d9276-7128-47cb-97cd-980a0ffcf6eb" containerName="console"
Sep 11 01:00:47.729089 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.728615    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="820508ab-5c1d-4ecd-bce6-d9885e8bab95" containerName="registry"
Sep 11 01:00:47.733514 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.733492    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:47.735790 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.735768    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 01:00:47.736724 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.736668    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 01:00:47.736849 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.736767    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 01:00:47.736849 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.736786    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 01:00:47.736849 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.736792    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 01:00:47.736849 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.736767    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 01:00:47.737038 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.736892    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 01:00:47.737136 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.737118    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6f9nw\""
Sep 11 01:00:47.741270 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.741247    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 01:00:47.745717 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.745696    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c9f97ffdd-wmctr"]
Sep 11 01:00:47.806371 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.806335    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-console-config\") pod \"console-c9f97ffdd-wmctr\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") " pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:47.806371 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.806370    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-oauth-serving-cert\") pod \"console-c9f97ffdd-wmctr\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") " pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:47.806597 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.806386    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsnmf\" (UniqueName: \"kubernetes.io/projected/dca1e528-1329-4fab-bde3-4f22d9edb6af-kube-api-access-qsnmf\") pod \"console-c9f97ffdd-wmctr\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") " pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:47.806597 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.806401    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-trusted-ca-bundle\") pod \"console-c9f97ffdd-wmctr\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") " pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:47.806597 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.806451    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dca1e528-1329-4fab-bde3-4f22d9edb6af-console-serving-cert\") pod \"console-c9f97ffdd-wmctr\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") " pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:47.806597 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.806535    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dca1e528-1329-4fab-bde3-4f22d9edb6af-console-oauth-config\") pod \"console-c9f97ffdd-wmctr\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") " pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:47.806597 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.806586    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-service-ca\") pod \"console-c9f97ffdd-wmctr\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") " pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:47.907448 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.907415    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dca1e528-1329-4fab-bde3-4f22d9edb6af-console-oauth-config\") pod \"console-c9f97ffdd-wmctr\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") " pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:47.907608 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.907465    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-service-ca\") pod \"console-c9f97ffdd-wmctr\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") " pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:47.907657 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.907611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-console-config\") pod \"console-c9f97ffdd-wmctr\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") " pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:47.907697 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.907656    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-oauth-serving-cert\") pod \"console-c9f97ffdd-wmctr\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") " pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:47.907697 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.907682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsnmf\" (UniqueName: \"kubernetes.io/projected/dca1e528-1329-4fab-bde3-4f22d9edb6af-kube-api-access-qsnmf\") pod \"console-c9f97ffdd-wmctr\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") " pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:47.907786 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.907711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-trusted-ca-bundle\") pod \"console-c9f97ffdd-wmctr\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") " pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:47.907869 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.907845    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dca1e528-1329-4fab-bde3-4f22d9edb6af-console-serving-cert\") pod \"console-c9f97ffdd-wmctr\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") " pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:47.908274 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.908245    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-service-ca\") pod \"console-c9f97ffdd-wmctr\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") " pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:47.908376 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.908303    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-oauth-serving-cert\") pod \"console-c9f97ffdd-wmctr\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") " pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:47.908446 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.908415    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-console-config\") pod \"console-c9f97ffdd-wmctr\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") " pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:47.908567 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.908524    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-trusted-ca-bundle\") pod \"console-c9f97ffdd-wmctr\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") " pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:47.910051 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.910024    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dca1e528-1329-4fab-bde3-4f22d9edb6af-console-oauth-config\") pod \"console-c9f97ffdd-wmctr\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") " pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:47.910167 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.910150    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dca1e528-1329-4fab-bde3-4f22d9edb6af-console-serving-cert\") pod \"console-c9f97ffdd-wmctr\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") " pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:47.914857 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:47.914833    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsnmf\" (UniqueName: \"kubernetes.io/projected/dca1e528-1329-4fab-bde3-4f22d9edb6af-kube-api-access-qsnmf\") pod \"console-c9f97ffdd-wmctr\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") " pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:48.047325 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:48.047293    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:48.319939 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:48.319857    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c9f97ffdd-wmctr"]
Sep 11 01:00:48.323063 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:00:48.323036    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca1e528_1329_4fab_bde3_4f22d9edb6af.slice/crio-f6e3e32fa38b87d549383aefa81d4dee2b810bedeff9c6b34e5cf39b1b1101f3 WatchSource:0}: Error finding container f6e3e32fa38b87d549383aefa81d4dee2b810bedeff9c6b34e5cf39b1b1101f3: Status 404 returned error can't find the container with id f6e3e32fa38b87d549383aefa81d4dee2b810bedeff9c6b34e5cf39b1b1101f3
Sep 11 01:00:48.353344 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:48.353303    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9f97ffdd-wmctr" event={"ID":"dca1e528-1329-4fab-bde3-4f22d9edb6af","Type":"ContainerStarted","Data":"f6e3e32fa38b87d549383aefa81d4dee2b810bedeff9c6b34e5cf39b1b1101f3"}
Sep 11 01:00:49.358551 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:49.358510    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9f97ffdd-wmctr" event={"ID":"dca1e528-1329-4fab-bde3-4f22d9edb6af","Type":"ContainerStarted","Data":"f1b6a36d8cd5a562014cdc1a56c7df1defe4b4be2df278849d77d033166ee4a3"}
Sep 11 01:00:49.376910 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:49.376862    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c9f97ffdd-wmctr" podStartSLOduration=2.376848066 podStartE2EDuration="2.376848066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:00:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:00:49.375940966 +0000 UTC m=+166.424029206" watchObservedRunningTime="2026-09-11 01:00:49.376848066 +0000 UTC m=+166.424936289"
Sep 11 01:00:58.048013 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:58.047920    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:58.048013 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:58.047987    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:58.052565 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:58.052543    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:00:58.394118 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:00:58.394032    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:01:56.845034 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:01:56.845001    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv"]
Sep 11 01:01:56.847990 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:01:56.847973    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv"
Sep 11 01:01:56.851650 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:01:56.851629    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 01:01:56.851793 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:01:56.851689    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 01:01:56.852737 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:01:56.852719    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sb47n\""
Sep 11 01:01:56.860330 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:01:56.860302    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv"]
Sep 11 01:01:56.954189 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:01:56.954151    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ac01e93-9a2d-4a57-b67b-bd97f736c49b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv\" (UID: \"0ac01e93-9a2d-4a57-b67b-bd97f736c49b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv"
Sep 11 01:01:56.954373 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:01:56.954217    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqxfd\" (UniqueName: \"kubernetes.io/projected/0ac01e93-9a2d-4a57-b67b-bd97f736c49b-kube-api-access-xqxfd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv\" (UID: \"0ac01e93-9a2d-4a57-b67b-bd97f736c49b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv"
Sep 11 01:01:56.958721 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:01:56.954639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ac01e93-9a2d-4a57-b67b-bd97f736c49b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv\" (UID: \"0ac01e93-9a2d-4a57-b67b-bd97f736c49b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv"
Sep 11 01:01:57.055803 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:01:57.055764    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ac01e93-9a2d-4a57-b67b-bd97f736c49b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv\" (UID: \"0ac01e93-9a2d-4a57-b67b-bd97f736c49b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv"
Sep 11 01:01:57.055974 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:01:57.055850    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqxfd\" (UniqueName: \"kubernetes.io/projected/0ac01e93-9a2d-4a57-b67b-bd97f736c49b-kube-api-access-xqxfd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv\" (UID: \"0ac01e93-9a2d-4a57-b67b-bd97f736c49b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv"
Sep 11 01:01:57.055974 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:01:57.055883    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ac01e93-9a2d-4a57-b67b-bd97f736c49b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv\" (UID: \"0ac01e93-9a2d-4a57-b67b-bd97f736c49b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv"
Sep 11 01:01:57.056155 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:01:57.056133    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ac01e93-9a2d-4a57-b67b-bd97f736c49b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv\" (UID: \"0ac01e93-9a2d-4a57-b67b-bd97f736c49b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv"
Sep 11 01:01:57.056191 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:01:57.056156    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ac01e93-9a2d-4a57-b67b-bd97f736c49b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv\" (UID: \"0ac01e93-9a2d-4a57-b67b-bd97f736c49b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv"
Sep 11 01:01:57.064667 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:01:57.064646    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqxfd\" (UniqueName: \"kubernetes.io/projected/0ac01e93-9a2d-4a57-b67b-bd97f736c49b-kube-api-access-xqxfd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv\" (UID: \"0ac01e93-9a2d-4a57-b67b-bd97f736c49b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv"
Sep 11 01:01:57.157011 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:01:57.156929    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv"
Sep 11 01:01:57.426156 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:01:57.426073    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv"]
Sep 11 01:01:57.428966 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:01:57.428939    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac01e93_9a2d_4a57_b67b_bd97f736c49b.slice/crio-39b70a59790d8f1daba683390de17d168da0da126651fd3c7f99e2cf61583f9a WatchSource:0}: Error finding container 39b70a59790d8f1daba683390de17d168da0da126651fd3c7f99e2cf61583f9a: Status 404 returned error can't find the container with id 39b70a59790d8f1daba683390de17d168da0da126651fd3c7f99e2cf61583f9a
Sep 11 01:01:57.599585 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:01:57.599548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv" event={"ID":"0ac01e93-9a2d-4a57-b67b-bd97f736c49b","Type":"ContainerStarted","Data":"39b70a59790d8f1daba683390de17d168da0da126651fd3c7f99e2cf61583f9a"}
Sep 11 01:02:04.628920 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:04.628878    2565 generic.go:356] "Generic (PLEG): container finished" podID="0ac01e93-9a2d-4a57-b67b-bd97f736c49b" containerID="d10e7f78a3a696b20becb3481afd273cbeabf0c4fb1e5d99ae17ed787508cb7c" exitCode=0
Sep 11 01:02:04.629319 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:04.628925    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv" event={"ID":"0ac01e93-9a2d-4a57-b67b-bd97f736c49b","Type":"ContainerDied","Data":"d10e7f78a3a696b20becb3481afd273cbeabf0c4fb1e5d99ae17ed787508cb7c"}
Sep 11 01:02:07.644201 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:07.644162    2565 generic.go:356] "Generic (PLEG): container finished" podID="0ac01e93-9a2d-4a57-b67b-bd97f736c49b" containerID="db1ff88aa5af2aee48944c7f6108f8fcacb58d155c55bf29776de42288e4ea76" exitCode=0
Sep 11 01:02:07.644664 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:07.644207    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv" event={"ID":"0ac01e93-9a2d-4a57-b67b-bd97f736c49b","Type":"ContainerDied","Data":"db1ff88aa5af2aee48944c7f6108f8fcacb58d155c55bf29776de42288e4ea76"}
Sep 11 01:02:16.681802 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:16.681763    2565 generic.go:356] "Generic (PLEG): container finished" podID="0ac01e93-9a2d-4a57-b67b-bd97f736c49b" containerID="3f9a1b3c7db31fb66668dd44cd4bb0a747484a0ab719e7a6484bda45b2277c94" exitCode=0
Sep 11 01:02:16.682197 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:16.681835    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv" event={"ID":"0ac01e93-9a2d-4a57-b67b-bd97f736c49b","Type":"ContainerDied","Data":"3f9a1b3c7db31fb66668dd44cd4bb0a747484a0ab719e7a6484bda45b2277c94"}
Sep 11 01:02:17.811740 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:17.811717    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv"
Sep 11 01:02:17.930785 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:17.930755    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqxfd\" (UniqueName: \"kubernetes.io/projected/0ac01e93-9a2d-4a57-b67b-bd97f736c49b-kube-api-access-xqxfd\") pod \"0ac01e93-9a2d-4a57-b67b-bd97f736c49b\" (UID: \"0ac01e93-9a2d-4a57-b67b-bd97f736c49b\") "
Sep 11 01:02:17.930960 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:17.930793    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ac01e93-9a2d-4a57-b67b-bd97f736c49b-util\") pod \"0ac01e93-9a2d-4a57-b67b-bd97f736c49b\" (UID: \"0ac01e93-9a2d-4a57-b67b-bd97f736c49b\") "
Sep 11 01:02:17.930960 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:17.930852    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ac01e93-9a2d-4a57-b67b-bd97f736c49b-bundle\") pod \"0ac01e93-9a2d-4a57-b67b-bd97f736c49b\" (UID: \"0ac01e93-9a2d-4a57-b67b-bd97f736c49b\") "
Sep 11 01:02:17.931518 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:17.931488    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ac01e93-9a2d-4a57-b67b-bd97f736c49b-bundle" (OuterVolumeSpecName: "bundle") pod "0ac01e93-9a2d-4a57-b67b-bd97f736c49b" (UID: "0ac01e93-9a2d-4a57-b67b-bd97f736c49b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:02:17.933006 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:17.932975    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ac01e93-9a2d-4a57-b67b-bd97f736c49b-kube-api-access-xqxfd" (OuterVolumeSpecName: "kube-api-access-xqxfd") pod "0ac01e93-9a2d-4a57-b67b-bd97f736c49b" (UID: "0ac01e93-9a2d-4a57-b67b-bd97f736c49b"). InnerVolumeSpecName "kube-api-access-xqxfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:02:17.935588 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:17.935568    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ac01e93-9a2d-4a57-b67b-bd97f736c49b-util" (OuterVolumeSpecName: "util") pod "0ac01e93-9a2d-4a57-b67b-bd97f736c49b" (UID: "0ac01e93-9a2d-4a57-b67b-bd97f736c49b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:02:18.031530 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:18.031497    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqxfd\" (UniqueName: \"kubernetes.io/projected/0ac01e93-9a2d-4a57-b67b-bd97f736c49b-kube-api-access-xqxfd\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:02:18.031530 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:18.031525    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ac01e93-9a2d-4a57-b67b-bd97f736c49b-util\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:02:18.031530 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:18.031534    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ac01e93-9a2d-4a57-b67b-bd97f736c49b-bundle\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:02:18.690844 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:18.690800    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv"
Sep 11 01:02:18.690844 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:18.690806    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qwppv" event={"ID":"0ac01e93-9a2d-4a57-b67b-bd97f736c49b","Type":"ContainerDied","Data":"39b70a59790d8f1daba683390de17d168da0da126651fd3c7f99e2cf61583f9a"}
Sep 11 01:02:18.691049 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:18.690869    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39b70a59790d8f1daba683390de17d168da0da126651fd3c7f99e2cf61583f9a"
Sep 11 01:02:24.951573 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:24.951536    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc8zk"]
Sep 11 01:02:24.951984 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:24.951828    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ac01e93-9a2d-4a57-b67b-bd97f736c49b" containerName="extract"
Sep 11 01:02:24.951984 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:24.951840    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ac01e93-9a2d-4a57-b67b-bd97f736c49b" containerName="extract"
Sep 11 01:02:24.951984 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:24.951853    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ac01e93-9a2d-4a57-b67b-bd97f736c49b" containerName="util"
Sep 11 01:02:24.951984 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:24.951858    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ac01e93-9a2d-4a57-b67b-bd97f736c49b" containerName="util"
Sep 11 01:02:24.951984 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:24.951874    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ac01e93-9a2d-4a57-b67b-bd97f736c49b" containerName="pull"
Sep 11 01:02:24.951984 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:24.951879    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ac01e93-9a2d-4a57-b67b-bd97f736c49b" containerName="pull"
Sep 11 01:02:24.951984 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:24.951927    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ac01e93-9a2d-4a57-b67b-bd97f736c49b" containerName="extract"
Sep 11 01:02:24.955473 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:24.955458    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc8zk"
Sep 11 01:02:24.957947 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:24.957925    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-cb4qf\""
Sep 11 01:02:24.958071 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:24.957926    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 11 01:02:24.958071 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:24.957927    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 11 01:02:24.970051 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:24.970030    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc8zk"]
Sep 11 01:02:25.090894 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:25.090859    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-566p6\" (UniqueName: \"kubernetes.io/projected/5bee6ff4-2a16-4eff-9425-4c0aa3f9f419-kube-api-access-566p6\") pod \"cert-manager-operator-controller-manager-55c444bf86-rc8zk\" (UID: \"5bee6ff4-2a16-4eff-9425-4c0aa3f9f419\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc8zk"
Sep 11 01:02:25.091059 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:25.090921    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bee6ff4-2a16-4eff-9425-4c0aa3f9f419-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rc8zk\" (UID: \"5bee6ff4-2a16-4eff-9425-4c0aa3f9f419\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc8zk"
Sep 11 01:02:25.191638 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:25.191602    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-566p6\" (UniqueName: \"kubernetes.io/projected/5bee6ff4-2a16-4eff-9425-4c0aa3f9f419-kube-api-access-566p6\") pod \"cert-manager-operator-controller-manager-55c444bf86-rc8zk\" (UID: \"5bee6ff4-2a16-4eff-9425-4c0aa3f9f419\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc8zk"
Sep 11 01:02:25.191801 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:25.191657    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bee6ff4-2a16-4eff-9425-4c0aa3f9f419-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rc8zk\" (UID: \"5bee6ff4-2a16-4eff-9425-4c0aa3f9f419\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc8zk"
Sep 11 01:02:25.192034 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:25.192017    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5bee6ff4-2a16-4eff-9425-4c0aa3f9f419-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rc8zk\" (UID: \"5bee6ff4-2a16-4eff-9425-4c0aa3f9f419\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc8zk"
Sep 11 01:02:25.200444 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:25.200418    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-566p6\" (UniqueName: \"kubernetes.io/projected/5bee6ff4-2a16-4eff-9425-4c0aa3f9f419-kube-api-access-566p6\") pod \"cert-manager-operator-controller-manager-55c444bf86-rc8zk\" (UID: \"5bee6ff4-2a16-4eff-9425-4c0aa3f9f419\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc8zk"
Sep 11 01:02:25.264581 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:25.264506    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc8zk"
Sep 11 01:02:25.543014 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:25.542989    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc8zk"]
Sep 11 01:02:25.545781 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:02:25.545756    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bee6ff4_2a16_4eff_9425_4c0aa3f9f419.slice/crio-3c23ce4816c4bf89dffb59c3d649dde7c6690e1d048433ddb8483e7d44fbd200 WatchSource:0}: Error finding container 3c23ce4816c4bf89dffb59c3d649dde7c6690e1d048433ddb8483e7d44fbd200: Status 404 returned error can't find the container with id 3c23ce4816c4bf89dffb59c3d649dde7c6690e1d048433ddb8483e7d44fbd200
Sep 11 01:02:25.717185 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:25.717139    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc8zk" event={"ID":"5bee6ff4-2a16-4eff-9425-4c0aa3f9f419","Type":"ContainerStarted","Data":"3c23ce4816c4bf89dffb59c3d649dde7c6690e1d048433ddb8483e7d44fbd200"}
Sep 11 01:02:27.727218 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:27.727179    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc8zk" event={"ID":"5bee6ff4-2a16-4eff-9425-4c0aa3f9f419","Type":"ContainerStarted","Data":"fe7a05198e124abf0d59c5f80bb1c5dadead2a0afe67b7097cdf431f76a28fa3"}
Sep 11 01:02:27.748551 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:27.748495    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rc8zk" podStartSLOduration=2.298325705 podStartE2EDuration="3.748474823s" totalImagesPullingTime="1.450149118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:02:27.747661626 +0000 UTC m=+264.795749874" watchObservedRunningTime="2026-09-11 01:02:27.748474823 +0000 UTC m=+264.796563048"
Sep 11 01:02:29.526692 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:29.526660    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf"]
Sep 11 01:02:29.528951 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:29.528935    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf"
Sep 11 01:02:29.531367 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:29.531325    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 01:02:29.531485 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:29.531444    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 01:02:29.532277 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:29.532259    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sb47n\""
Sep 11 01:02:29.539781 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:29.539758    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf"]
Sep 11 01:02:29.627224 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:29.627192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf\" (UID: \"bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf"
Sep 11 01:02:29.627386 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:29.627244    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf\" (UID: \"bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf"
Sep 11 01:02:29.627386 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:29.627351    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgq5l\" (UniqueName: \"kubernetes.io/projected/bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad-kube-api-access-hgq5l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf\" (UID: \"bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf"
Sep 11 01:02:29.728120 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:29.728086    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf\" (UID: \"bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf"
Sep 11 01:02:29.728283 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:29.728144    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgq5l\" (UniqueName: \"kubernetes.io/projected/bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad-kube-api-access-hgq5l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf\" (UID: \"bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf"
Sep 11 01:02:29.728283 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:29.728186    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf\" (UID: \"bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf"
Sep 11 01:02:29.728546 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:29.728525    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf\" (UID: \"bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf"
Sep 11 01:02:29.728582 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:29.728534    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf\" (UID: \"bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf"
Sep 11 01:02:29.735711 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:29.735668    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgq5l\" (UniqueName: \"kubernetes.io/projected/bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad-kube-api-access-hgq5l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf\" (UID: \"bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf"
Sep 11 01:02:29.838054 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:29.838027    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf"
Sep 11 01:02:30.107150 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:30.107122    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf"]
Sep 11 01:02:30.109339 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:02:30.109316    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc0a31fd_3bed_438d_aa8c_7cfbc5e5e1ad.slice/crio-df2fc45fc04e0d7a79cbc17086ba76150c32cfcb08297ad419a1ec7cae575acd WatchSource:0}: Error finding container df2fc45fc04e0d7a79cbc17086ba76150c32cfcb08297ad419a1ec7cae575acd: Status 404 returned error can't find the container with id df2fc45fc04e0d7a79cbc17086ba76150c32cfcb08297ad419a1ec7cae575acd
Sep 11 01:02:30.589854 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:30.589822    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wlf2t"]
Sep 11 01:02:30.595919 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:30.595891    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wlf2t"
Sep 11 01:02:30.598609 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:30.598582    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-pn42b\""
Sep 11 01:02:30.598745 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:30.598624    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 01:02:30.599501 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:30.599480    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 01:02:30.603370 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:30.603352    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wlf2t"]
Sep 11 01:02:30.737470 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:30.737434    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7ffd\" (UniqueName: \"kubernetes.io/projected/a5bc7a8d-7488-47bd-86e5-eb38bad57745-kube-api-access-h7ffd\") pod \"cert-manager-cainjector-559cdd8c87-wlf2t\" (UID: \"a5bc7a8d-7488-47bd-86e5-eb38bad57745\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wlf2t"
Sep 11 01:02:30.737628 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:30.737494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5bc7a8d-7488-47bd-86e5-eb38bad57745-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wlf2t\" (UID: \"a5bc7a8d-7488-47bd-86e5-eb38bad57745\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wlf2t"
Sep 11 01:02:30.741677 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:30.741649    2565 generic.go:356] "Generic (PLEG): container finished" podID="bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad" containerID="c0d8288b879d5956e220c4a8d04667f792734d81b28141980fbe053c145f457c" exitCode=0
Sep 11 01:02:30.741788 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:30.741729    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf" event={"ID":"bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad","Type":"ContainerDied","Data":"c0d8288b879d5956e220c4a8d04667f792734d81b28141980fbe053c145f457c"}
Sep 11 01:02:30.741863 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:30.741788    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf" event={"ID":"bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad","Type":"ContainerStarted","Data":"df2fc45fc04e0d7a79cbc17086ba76150c32cfcb08297ad419a1ec7cae575acd"}
Sep 11 01:02:30.838228 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:30.838201    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5bc7a8d-7488-47bd-86e5-eb38bad57745-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wlf2t\" (UID: \"a5bc7a8d-7488-47bd-86e5-eb38bad57745\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wlf2t"
Sep 11 01:02:30.838381 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:30.838255    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7ffd\" (UniqueName: \"kubernetes.io/projected/a5bc7a8d-7488-47bd-86e5-eb38bad57745-kube-api-access-h7ffd\") pod \"cert-manager-cainjector-559cdd8c87-wlf2t\" (UID: \"a5bc7a8d-7488-47bd-86e5-eb38bad57745\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wlf2t"
Sep 11 01:02:30.845917 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:30.845862    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a5bc7a8d-7488-47bd-86e5-eb38bad57745-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wlf2t\" (UID: \"a5bc7a8d-7488-47bd-86e5-eb38bad57745\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wlf2t"
Sep 11 01:02:30.846054 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:30.846034    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7ffd\" (UniqueName: \"kubernetes.io/projected/a5bc7a8d-7488-47bd-86e5-eb38bad57745-kube-api-access-h7ffd\") pod \"cert-manager-cainjector-559cdd8c87-wlf2t\" (UID: \"a5bc7a8d-7488-47bd-86e5-eb38bad57745\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wlf2t"
Sep 11 01:02:30.904777 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:30.904747    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wlf2t"
Sep 11 01:02:31.178885 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:31.178860    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wlf2t"]
Sep 11 01:02:31.179902 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:02:31.179874    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5bc7a8d_7488_47bd_86e5_eb38bad57745.slice/crio-a4ef033c567e563bdb634e874659bcfbd3439311f98c37dd1d84f373c840d3af WatchSource:0}: Error finding container a4ef033c567e563bdb634e874659bcfbd3439311f98c37dd1d84f373c840d3af: Status 404 returned error can't find the container with id a4ef033c567e563bdb634e874659bcfbd3439311f98c37dd1d84f373c840d3af
Sep 11 01:02:31.747549 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:31.747516    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wlf2t" event={"ID":"a5bc7a8d-7488-47bd-86e5-eb38bad57745","Type":"ContainerStarted","Data":"a4ef033c567e563bdb634e874659bcfbd3439311f98c37dd1d84f373c840d3af"}
Sep 11 01:02:34.762649 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:34.762612    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wlf2t" event={"ID":"a5bc7a8d-7488-47bd-86e5-eb38bad57745","Type":"ContainerStarted","Data":"68c6aa3530b03372e7be13b7718ebfbaf3b60f9b21696fc7ee99abaad7d360a6"}
Sep 11 01:02:34.779184 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:34.779136    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wlf2t" podStartSLOduration=1.93071721 podStartE2EDuration="4.779119718s" totalImagesPullingTime="2.848402508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:02:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:02:34.777926077 +0000 UTC m=+271.826014320" watchObservedRunningTime="2026-09-11 01:02:34.779119718 +0000 UTC m=+271.827207942"
Sep 11 01:02:36.155141 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:36.155097    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tb2tb"]
Sep 11 01:02:36.159117 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:36.159094    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tb2tb"
Sep 11 01:02:36.161341 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:36.161324    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-h28p2\""
Sep 11 01:02:36.167656 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:36.167634    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tb2tb"]
Sep 11 01:02:36.281403 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:36.281364    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sbwr\" (UniqueName: \"kubernetes.io/projected/9766e137-fd28-4b1b-8d51-768f920462c3-kube-api-access-2sbwr\") pod \"cert-manager-webhook-6486ffd997-tb2tb\" (UID: \"9766e137-fd28-4b1b-8d51-768f920462c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tb2tb"
Sep 11 01:02:36.281585 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:36.281416    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9766e137-fd28-4b1b-8d51-768f920462c3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tb2tb\" (UID: \"9766e137-fd28-4b1b-8d51-768f920462c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tb2tb"
Sep 11 01:02:36.382887 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:36.382849    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sbwr\" (UniqueName: \"kubernetes.io/projected/9766e137-fd28-4b1b-8d51-768f920462c3-kube-api-access-2sbwr\") pod \"cert-manager-webhook-6486ffd997-tb2tb\" (UID: \"9766e137-fd28-4b1b-8d51-768f920462c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tb2tb"
Sep 11 01:02:36.383035 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:36.382899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9766e137-fd28-4b1b-8d51-768f920462c3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tb2tb\" (UID: \"9766e137-fd28-4b1b-8d51-768f920462c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tb2tb"
Sep 11 01:02:36.391294 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:36.391262    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9766e137-fd28-4b1b-8d51-768f920462c3-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tb2tb\" (UID: \"9766e137-fd28-4b1b-8d51-768f920462c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tb2tb"
Sep 11 01:02:36.391461 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:36.391437    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sbwr\" (UniqueName: \"kubernetes.io/projected/9766e137-fd28-4b1b-8d51-768f920462c3-kube-api-access-2sbwr\") pod \"cert-manager-webhook-6486ffd997-tb2tb\" (UID: \"9766e137-fd28-4b1b-8d51-768f920462c3\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tb2tb"
Sep 11 01:02:36.467801 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:36.467739    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tb2tb"
Sep 11 01:02:36.745433 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:36.745352    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tb2tb"]
Sep 11 01:02:36.748506 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:02:36.748475    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9766e137_fd28_4b1b_8d51_768f920462c3.slice/crio-60ca7e157f78d1e850db94963451a58123cc91cf2b06b2e51e1f0cdb8da26d08 WatchSource:0}: Error finding container 60ca7e157f78d1e850db94963451a58123cc91cf2b06b2e51e1f0cdb8da26d08: Status 404 returned error can't find the container with id 60ca7e157f78d1e850db94963451a58123cc91cf2b06b2e51e1f0cdb8da26d08
Sep 11 01:02:36.772797 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:36.772768    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tb2tb" event={"ID":"9766e137-fd28-4b1b-8d51-768f920462c3","Type":"ContainerStarted","Data":"60ca7e157f78d1e850db94963451a58123cc91cf2b06b2e51e1f0cdb8da26d08"}
Sep 11 01:02:37.779248 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:37.779210    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tb2tb" event={"ID":"9766e137-fd28-4b1b-8d51-768f920462c3","Type":"ContainerStarted","Data":"95ea931e03ee585c9148d7de91e10ea4cd98b3e78fd7c34c4c1230693cbb1239"}
Sep 11 01:02:37.779702 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:37.779334    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tb2tb"
Sep 11 01:02:37.795978 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:37.795933    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-tb2tb" podStartSLOduration=1.795918887 podStartE2EDuration="1.795918887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:02:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:02:37.794389427 +0000 UTC m=+274.842477652" watchObservedRunningTime="2026-09-11 01:02:37.795918887 +0000 UTC m=+274.844007111"
Sep 11 01:02:40.794022 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:40.793987    2565 generic.go:356] "Generic (PLEG): container finished" podID="bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad" containerID="b45484c51213c5715b69019d485d35bed6f1b22e4c41a87b7b8ede38d5184844" exitCode=0
Sep 11 01:02:40.794370 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:40.794071    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf" event={"ID":"bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad","Type":"ContainerDied","Data":"b45484c51213c5715b69019d485d35bed6f1b22e4c41a87b7b8ede38d5184844"}
Sep 11 01:02:41.799942 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:41.799903    2565 generic.go:356] "Generic (PLEG): container finished" podID="bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad" containerID="4a628a1894521fa5724a8ab5e00cc55d9035f585dce0764fb65478ae8dc78c35" exitCode=0
Sep 11 01:02:41.800271 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:41.799977    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf" event={"ID":"bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad","Type":"ContainerDied","Data":"4a628a1894521fa5724a8ab5e00cc55d9035f585dce0764fb65478ae8dc78c35"}
Sep 11 01:02:42.949570 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:42.949538    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf"
Sep 11 01:02:43.038546 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:43.038512    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad-bundle\") pod \"bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad\" (UID: \"bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad\") "
Sep 11 01:02:43.038546 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:43.038554    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgq5l\" (UniqueName: \"kubernetes.io/projected/bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad-kube-api-access-hgq5l\") pod \"bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad\" (UID: \"bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad\") "
Sep 11 01:02:43.038788 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:43.038579    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad-util\") pod \"bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad\" (UID: \"bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad\") "
Sep 11 01:02:43.038958 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:43.038924    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad-bundle" (OuterVolumeSpecName: "bundle") pod "bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad" (UID: "bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:02:43.040627 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:43.040603    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad-kube-api-access-hgq5l" (OuterVolumeSpecName: "kube-api-access-hgq5l") pod "bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad" (UID: "bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad"). InnerVolumeSpecName "kube-api-access-hgq5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:02:43.043190 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:43.043171    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad-util" (OuterVolumeSpecName: "util") pod "bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad" (UID: "bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:02:43.139642 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:43.139576    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgq5l\" (UniqueName: \"kubernetes.io/projected/bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad-kube-api-access-hgq5l\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:02:43.139642 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:43.139600    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad-util\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:02:43.139642 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:43.139610    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad-bundle\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:02:43.785727 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:43.785653    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tb2tb"
Sep 11 01:02:43.810622 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:43.810590    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf" event={"ID":"bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad","Type":"ContainerDied","Data":"df2fc45fc04e0d7a79cbc17086ba76150c32cfcb08297ad419a1ec7cae575acd"}
Sep 11 01:02:43.810801 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:43.810636    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjtbjf"
Sep 11 01:02:43.810801 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:43.810637    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df2fc45fc04e0d7a79cbc17086ba76150c32cfcb08297ad419a1ec7cae575acd"
Sep 11 01:02:55.135218 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.135183    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5"]
Sep 11 01:02:55.135668 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.135501    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad" containerName="util"
Sep 11 01:02:55.135668 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.135512    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad" containerName="util"
Sep 11 01:02:55.135668 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.135528    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad" containerName="pull"
Sep 11 01:02:55.135668 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.135534    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad" containerName="pull"
Sep 11 01:02:55.135668 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.135542    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad" containerName="extract"
Sep 11 01:02:55.135668 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.135548    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad" containerName="extract"
Sep 11 01:02:55.135668 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.135592    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc0a31fd-3bed-438d-aa8c-7cfbc5e5e1ad" containerName="extract"
Sep 11 01:02:55.138457 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.138436    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5"
Sep 11 01:02:55.140857 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.140806    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 01:02:55.141000 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.140982    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 01:02:55.141666 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.141652    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sb47n\""
Sep 11 01:02:55.147019 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.146997    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5"]
Sep 11 01:02:55.235721 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.235685    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cd6ba87-46d5-42cb-8a90-de0682ff74d0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5\" (UID: \"3cd6ba87-46d5-42cb-8a90-de0682ff74d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5"
Sep 11 01:02:55.235721 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.235724    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c92bh\" (UniqueName: \"kubernetes.io/projected/3cd6ba87-46d5-42cb-8a90-de0682ff74d0-kube-api-access-c92bh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5\" (UID: \"3cd6ba87-46d5-42cb-8a90-de0682ff74d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5"
Sep 11 01:02:55.235951 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.235772    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cd6ba87-46d5-42cb-8a90-de0682ff74d0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5\" (UID: \"3cd6ba87-46d5-42cb-8a90-de0682ff74d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5"
Sep 11 01:02:55.336455 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.336419    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cd6ba87-46d5-42cb-8a90-de0682ff74d0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5\" (UID: \"3cd6ba87-46d5-42cb-8a90-de0682ff74d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5"
Sep 11 01:02:55.336455 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.336455    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c92bh\" (UniqueName: \"kubernetes.io/projected/3cd6ba87-46d5-42cb-8a90-de0682ff74d0-kube-api-access-c92bh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5\" (UID: \"3cd6ba87-46d5-42cb-8a90-de0682ff74d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5"
Sep 11 01:02:55.336645 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.336486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cd6ba87-46d5-42cb-8a90-de0682ff74d0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5\" (UID: \"3cd6ba87-46d5-42cb-8a90-de0682ff74d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5"
Sep 11 01:02:55.336779 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.336761    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cd6ba87-46d5-42cb-8a90-de0682ff74d0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5\" (UID: \"3cd6ba87-46d5-42cb-8a90-de0682ff74d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5"
Sep 11 01:02:55.336840 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.336791    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cd6ba87-46d5-42cb-8a90-de0682ff74d0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5\" (UID: \"3cd6ba87-46d5-42cb-8a90-de0682ff74d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5"
Sep 11 01:02:55.345049 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.345029    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c92bh\" (UniqueName: \"kubernetes.io/projected/3cd6ba87-46d5-42cb-8a90-de0682ff74d0-kube-api-access-c92bh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5\" (UID: \"3cd6ba87-46d5-42cb-8a90-de0682ff74d0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5"
Sep 11 01:02:55.448531 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.448455    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5"
Sep 11 01:02:55.719132 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.719110    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5"]
Sep 11 01:02:55.721322 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:02:55.721291    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cd6ba87_46d5_42cb_8a90_de0682ff74d0.slice/crio-0375886f7157c6f514ab595bf7e9ced01739c61b3bd59007b5f70e5d2b616413 WatchSource:0}: Error finding container 0375886f7157c6f514ab595bf7e9ced01739c61b3bd59007b5f70e5d2b616413: Status 404 returned error can't find the container with id 0375886f7157c6f514ab595bf7e9ced01739c61b3bd59007b5f70e5d2b616413
Sep 11 01:02:55.860977 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.860943    2565 generic.go:356] "Generic (PLEG): container finished" podID="3cd6ba87-46d5-42cb-8a90-de0682ff74d0" containerID="d10c8fc04121dcffaac1c7b3c1169a6891cebf4fdcd287695c9a4cc640482ec9" exitCode=0
Sep 11 01:02:55.861151 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.861024    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5" event={"ID":"3cd6ba87-46d5-42cb-8a90-de0682ff74d0","Type":"ContainerDied","Data":"d10c8fc04121dcffaac1c7b3c1169a6891cebf4fdcd287695c9a4cc640482ec9"}
Sep 11 01:02:55.861151 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:55.861076    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5" event={"ID":"3cd6ba87-46d5-42cb-8a90-de0682ff74d0","Type":"ContainerStarted","Data":"0375886f7157c6f514ab595bf7e9ced01739c61b3bd59007b5f70e5d2b616413"}
Sep 11 01:02:56.868335 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:56.868299    2565 generic.go:356] "Generic (PLEG): container finished" podID="3cd6ba87-46d5-42cb-8a90-de0682ff74d0" containerID="58966a3b2561731b9255d9224507c1185df0190b727ee424c3e3d26be003c8c3" exitCode=0
Sep 11 01:02:56.868763 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:56.868373    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5" event={"ID":"3cd6ba87-46d5-42cb-8a90-de0682ff74d0","Type":"ContainerDied","Data":"58966a3b2561731b9255d9224507c1185df0190b727ee424c3e3d26be003c8c3"}
Sep 11 01:02:57.874898 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:57.874861    2565 generic.go:356] "Generic (PLEG): container finished" podID="3cd6ba87-46d5-42cb-8a90-de0682ff74d0" containerID="9a6b13e05e607719ce0edfa5b7c2bcb3f5aed295c0763e1ff30e3c79c169e988" exitCode=0
Sep 11 01:02:57.875277 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:57.874948    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5" event={"ID":"3cd6ba87-46d5-42cb-8a90-de0682ff74d0","Type":"ContainerDied","Data":"9a6b13e05e607719ce0edfa5b7c2bcb3f5aed295c0763e1ff30e3c79c169e988"}
Sep 11 01:02:59.000083 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:59.000059    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5"
Sep 11 01:02:59.072149 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:59.072118    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cd6ba87-46d5-42cb-8a90-de0682ff74d0-util\") pod \"3cd6ba87-46d5-42cb-8a90-de0682ff74d0\" (UID: \"3cd6ba87-46d5-42cb-8a90-de0682ff74d0\") "
Sep 11 01:02:59.072310 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:59.072172    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c92bh\" (UniqueName: \"kubernetes.io/projected/3cd6ba87-46d5-42cb-8a90-de0682ff74d0-kube-api-access-c92bh\") pod \"3cd6ba87-46d5-42cb-8a90-de0682ff74d0\" (UID: \"3cd6ba87-46d5-42cb-8a90-de0682ff74d0\") "
Sep 11 01:02:59.072310 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:59.072249    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cd6ba87-46d5-42cb-8a90-de0682ff74d0-bundle\") pod \"3cd6ba87-46d5-42cb-8a90-de0682ff74d0\" (UID: \"3cd6ba87-46d5-42cb-8a90-de0682ff74d0\") "
Sep 11 01:02:59.072962 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:59.072932    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cd6ba87-46d5-42cb-8a90-de0682ff74d0-bundle" (OuterVolumeSpecName: "bundle") pod "3cd6ba87-46d5-42cb-8a90-de0682ff74d0" (UID: "3cd6ba87-46d5-42cb-8a90-de0682ff74d0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:02:59.074239 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:59.074217    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cd6ba87-46d5-42cb-8a90-de0682ff74d0-kube-api-access-c92bh" (OuterVolumeSpecName: "kube-api-access-c92bh") pod "3cd6ba87-46d5-42cb-8a90-de0682ff74d0" (UID: "3cd6ba87-46d5-42cb-8a90-de0682ff74d0"). InnerVolumeSpecName "kube-api-access-c92bh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:02:59.080516 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:59.080406    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cd6ba87-46d5-42cb-8a90-de0682ff74d0-util" (OuterVolumeSpecName: "util") pod "3cd6ba87-46d5-42cb-8a90-de0682ff74d0" (UID: "3cd6ba87-46d5-42cb-8a90-de0682ff74d0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:02:59.173425 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:59.173350    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3cd6ba87-46d5-42cb-8a90-de0682ff74d0-bundle\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:02:59.173425 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:59.173376    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3cd6ba87-46d5-42cb-8a90-de0682ff74d0-util\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:02:59.173425 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:59.173387    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c92bh\" (UniqueName: \"kubernetes.io/projected/3cd6ba87-46d5-42cb-8a90-de0682ff74d0-kube-api-access-c92bh\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:02:59.885548 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:59.885519    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5"
Sep 11 01:02:59.885750 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:59.885522    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afd28c5" event={"ID":"3cd6ba87-46d5-42cb-8a90-de0682ff74d0","Type":"ContainerDied","Data":"0375886f7157c6f514ab595bf7e9ced01739c61b3bd59007b5f70e5d2b616413"}
Sep 11 01:02:59.885750 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:02:59.885637    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0375886f7157c6f514ab595bf7e9ced01739c61b3bd59007b5f70e5d2b616413"
Sep 11 01:03:03.384393 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:03.384363    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/1.log"
Sep 11 01:03:03.387171 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:03.387135    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/1.log"
Sep 11 01:03:03.394963 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:03.394943    2565 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 01:03:09.063132 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.063090    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"]
Sep 11 01:03:09.064590 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.063475    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cd6ba87-46d5-42cb-8a90-de0682ff74d0" containerName="extract"
Sep 11 01:03:09.064590 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.063491    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cd6ba87-46d5-42cb-8a90-de0682ff74d0" containerName="extract"
Sep 11 01:03:09.064590 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.063505    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cd6ba87-46d5-42cb-8a90-de0682ff74d0" containerName="pull"
Sep 11 01:03:09.064590 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.063513    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cd6ba87-46d5-42cb-8a90-de0682ff74d0" containerName="pull"
Sep 11 01:03:09.064590 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.063533    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cd6ba87-46d5-42cb-8a90-de0682ff74d0" containerName="util"
Sep 11 01:03:09.064590 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.063541    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cd6ba87-46d5-42cb-8a90-de0682ff74d0" containerName="util"
Sep 11 01:03:09.064590 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.063601    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cd6ba87-46d5-42cb-8a90-de0682ff74d0" containerName="extract"
Sep 11 01:03:09.065555 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.065536    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"
Sep 11 01:03:09.068119 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.068099    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 01:03:09.068432 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.068412    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 01:03:09.068432 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.068426    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 01:03:09.068571 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.068524    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sqsm4\""
Sep 11 01:03:09.068571 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.068524    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 01:03:09.079534 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.079513    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"]
Sep 11 01:03:09.155559 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.155532    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1f084ee6-7b1a-4822-8690-958b65197142-manifests\") pod \"opendatahub-operator-controller-manager-7c49b45946-brnlr\" (UID: \"1f084ee6-7b1a-4822-8690-958b65197142\") " pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"
Sep 11 01:03:09.155712 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.155567    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f084ee6-7b1a-4822-8690-958b65197142-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c49b45946-brnlr\" (UID: \"1f084ee6-7b1a-4822-8690-958b65197142\") " pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"
Sep 11 01:03:09.155712 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.155615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4lns\" (UniqueName: \"kubernetes.io/projected/1f084ee6-7b1a-4822-8690-958b65197142-kube-api-access-w4lns\") pod \"opendatahub-operator-controller-manager-7c49b45946-brnlr\" (UID: \"1f084ee6-7b1a-4822-8690-958b65197142\") " pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"
Sep 11 01:03:09.155712 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.155664    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1f084ee6-7b1a-4822-8690-958b65197142-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c49b45946-brnlr\" (UID: \"1f084ee6-7b1a-4822-8690-958b65197142\") " pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"
Sep 11 01:03:09.155712 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.155699    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f084ee6-7b1a-4822-8690-958b65197142-tmp\") pod \"opendatahub-operator-controller-manager-7c49b45946-brnlr\" (UID: \"1f084ee6-7b1a-4822-8690-958b65197142\") " pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"
Sep 11 01:03:09.256571 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.256535    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4lns\" (UniqueName: \"kubernetes.io/projected/1f084ee6-7b1a-4822-8690-958b65197142-kube-api-access-w4lns\") pod \"opendatahub-operator-controller-manager-7c49b45946-brnlr\" (UID: \"1f084ee6-7b1a-4822-8690-958b65197142\") " pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"
Sep 11 01:03:09.256571 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.256574    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1f084ee6-7b1a-4822-8690-958b65197142-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c49b45946-brnlr\" (UID: \"1f084ee6-7b1a-4822-8690-958b65197142\") " pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"
Sep 11 01:03:09.256842 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.256602    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f084ee6-7b1a-4822-8690-958b65197142-tmp\") pod \"opendatahub-operator-controller-manager-7c49b45946-brnlr\" (UID: \"1f084ee6-7b1a-4822-8690-958b65197142\") " pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"
Sep 11 01:03:09.256842 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.256646    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1f084ee6-7b1a-4822-8690-958b65197142-manifests\") pod \"opendatahub-operator-controller-manager-7c49b45946-brnlr\" (UID: \"1f084ee6-7b1a-4822-8690-958b65197142\") " pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"
Sep 11 01:03:09.256842 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.256665    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f084ee6-7b1a-4822-8690-958b65197142-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c49b45946-brnlr\" (UID: \"1f084ee6-7b1a-4822-8690-958b65197142\") " pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"
Sep 11 01:03:09.257111 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.257074    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1f084ee6-7b1a-4822-8690-958b65197142-manifests\") pod \"opendatahub-operator-controller-manager-7c49b45946-brnlr\" (UID: \"1f084ee6-7b1a-4822-8690-958b65197142\") " pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"
Sep 11 01:03:09.259035 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.259014    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f084ee6-7b1a-4822-8690-958b65197142-tmp\") pod \"opendatahub-operator-controller-manager-7c49b45946-brnlr\" (UID: \"1f084ee6-7b1a-4822-8690-958b65197142\") " pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"
Sep 11 01:03:09.259139 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.259116    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1f084ee6-7b1a-4822-8690-958b65197142-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c49b45946-brnlr\" (UID: \"1f084ee6-7b1a-4822-8690-958b65197142\") " pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"
Sep 11 01:03:09.259253 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.259143    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f084ee6-7b1a-4822-8690-958b65197142-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c49b45946-brnlr\" (UID: \"1f084ee6-7b1a-4822-8690-958b65197142\") " pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"
Sep 11 01:03:09.271105 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.271076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4lns\" (UniqueName: \"kubernetes.io/projected/1f084ee6-7b1a-4822-8690-958b65197142-kube-api-access-w4lns\") pod \"opendatahub-operator-controller-manager-7c49b45946-brnlr\" (UID: \"1f084ee6-7b1a-4822-8690-958b65197142\") " pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"
Sep 11 01:03:09.376081 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.375998    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"
Sep 11 01:03:09.543992 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.543961    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb"]
Sep 11 01:03:09.546607 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.546590    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb"
Sep 11 01:03:09.549437 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.549414    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 01:03:09.549577 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.549519    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 01:03:09.549577 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.549522    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sb47n\""
Sep 11 01:03:09.557339 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.557317    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb"]
Sep 11 01:03:09.653610 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.653529    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"]
Sep 11 01:03:09.659395 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:03:09.659373    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f084ee6_7b1a_4822_8690_958b65197142.slice/crio-95c64864c769f4e0930311e443bf7edfa34ec5f5f72f51aa00fab2b60d4ce468 WatchSource:0}: Error finding container 95c64864c769f4e0930311e443bf7edfa34ec5f5f72f51aa00fab2b60d4ce468: Status 404 returned error can't find the container with id 95c64864c769f4e0930311e443bf7edfa34ec5f5f72f51aa00fab2b60d4ce468
Sep 11 01:03:09.660675 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.660656    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/812f4481-cc9c-442e-8138-7ec4b94cf12d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb\" (UID: \"812f4481-cc9c-442e-8138-7ec4b94cf12d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb"
Sep 11 01:03:09.660746 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.660683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zrz6\" (UniqueName: \"kubernetes.io/projected/812f4481-cc9c-442e-8138-7ec4b94cf12d-kube-api-access-6zrz6\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb\" (UID: \"812f4481-cc9c-442e-8138-7ec4b94cf12d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb"
Sep 11 01:03:09.660746 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.660709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/812f4481-cc9c-442e-8138-7ec4b94cf12d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb\" (UID: \"812f4481-cc9c-442e-8138-7ec4b94cf12d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb"
Sep 11 01:03:09.661125 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.661108    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 01:03:09.761581 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.761547    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/812f4481-cc9c-442e-8138-7ec4b94cf12d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb\" (UID: \"812f4481-cc9c-442e-8138-7ec4b94cf12d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb"
Sep 11 01:03:09.761581 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.761582    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zrz6\" (UniqueName: \"kubernetes.io/projected/812f4481-cc9c-442e-8138-7ec4b94cf12d-kube-api-access-6zrz6\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb\" (UID: \"812f4481-cc9c-442e-8138-7ec4b94cf12d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb"
Sep 11 01:03:09.761783 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.761611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/812f4481-cc9c-442e-8138-7ec4b94cf12d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb\" (UID: \"812f4481-cc9c-442e-8138-7ec4b94cf12d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb"
Sep 11 01:03:09.762001 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.761976    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/812f4481-cc9c-442e-8138-7ec4b94cf12d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb\" (UID: \"812f4481-cc9c-442e-8138-7ec4b94cf12d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb"
Sep 11 01:03:09.762047 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.761987    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/812f4481-cc9c-442e-8138-7ec4b94cf12d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb\" (UID: \"812f4481-cc9c-442e-8138-7ec4b94cf12d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb"
Sep 11 01:03:09.769429 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.769401    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zrz6\" (UniqueName: \"kubernetes.io/projected/812f4481-cc9c-442e-8138-7ec4b94cf12d-kube-api-access-6zrz6\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb\" (UID: \"812f4481-cc9c-442e-8138-7ec4b94cf12d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb"
Sep 11 01:03:09.856338 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.856309    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb"
Sep 11 01:03:09.930576 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:09.930536    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr" event={"ID":"1f084ee6-7b1a-4822-8690-958b65197142","Type":"ContainerStarted","Data":"95c64864c769f4e0930311e443bf7edfa34ec5f5f72f51aa00fab2b60d4ce468"}
Sep 11 01:03:10.125777 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:10.125719    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb"]
Sep 11 01:03:10.128951 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:03:10.128908    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod812f4481_cc9c_442e_8138_7ec4b94cf12d.slice/crio-5850b2614e569b0fac8be98b4b1ddb92fdf454721b1a3c7f81c7e53c8928fc1f WatchSource:0}: Error finding container 5850b2614e569b0fac8be98b4b1ddb92fdf454721b1a3c7f81c7e53c8928fc1f: Status 404 returned error can't find the container with id 5850b2614e569b0fac8be98b4b1ddb92fdf454721b1a3c7f81c7e53c8928fc1f
Sep 11 01:03:10.939405 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:10.939367    2565 generic.go:356] "Generic (PLEG): container finished" podID="812f4481-cc9c-442e-8138-7ec4b94cf12d" containerID="370d2bb935626d397aba52923dd38b576de05adb1bee206b95ae2ac2373d5c05" exitCode=0
Sep 11 01:03:10.939583 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:10.939428    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb" event={"ID":"812f4481-cc9c-442e-8138-7ec4b94cf12d","Type":"ContainerDied","Data":"370d2bb935626d397aba52923dd38b576de05adb1bee206b95ae2ac2373d5c05"}
Sep 11 01:03:10.939583 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:10.939474    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb" event={"ID":"812f4481-cc9c-442e-8138-7ec4b94cf12d","Type":"ContainerStarted","Data":"5850b2614e569b0fac8be98b4b1ddb92fdf454721b1a3c7f81c7e53c8928fc1f"}
Sep 11 01:03:12.951082 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:12.951049    2565 generic.go:356] "Generic (PLEG): container finished" podID="812f4481-cc9c-442e-8138-7ec4b94cf12d" containerID="7b3e9ef99df0b08df99d2361cd50e781aabd28f856abe31bde4a52c41e6bb358" exitCode=0
Sep 11 01:03:12.951503 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:12.951125    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb" event={"ID":"812f4481-cc9c-442e-8138-7ec4b94cf12d","Type":"ContainerDied","Data":"7b3e9ef99df0b08df99d2361cd50e781aabd28f856abe31bde4a52c41e6bb358"}
Sep 11 01:03:12.953078 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:12.953053    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr" event={"ID":"1f084ee6-7b1a-4822-8690-958b65197142","Type":"ContainerStarted","Data":"d4d650d061c4c27d6fe04abd04f3fc617dadc1dab3653b835fe09d144ef0f0fa"}
Sep 11 01:03:13.959686 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:13.959646    2565 generic.go:356] "Generic (PLEG): container finished" podID="812f4481-cc9c-442e-8138-7ec4b94cf12d" containerID="5a8bfff4739965ce8b3e44fbfc32892a040334bba5f7b823e7ea924671af4762" exitCode=0
Sep 11 01:03:13.960088 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:13.959728    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb" event={"ID":"812f4481-cc9c-442e-8138-7ec4b94cf12d","Type":"ContainerDied","Data":"5a8bfff4739965ce8b3e44fbfc32892a040334bba5f7b823e7ea924671af4762"}
Sep 11 01:03:13.961362 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:13.961339    2565 generic.go:356] "Generic (PLEG): container finished" podID="1f084ee6-7b1a-4822-8690-958b65197142" containerID="d4d650d061c4c27d6fe04abd04f3fc617dadc1dab3653b835fe09d144ef0f0fa" exitCode=0
Sep 11 01:03:13.961419 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:13.961385    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr" event={"ID":"1f084ee6-7b1a-4822-8690-958b65197142","Type":"ContainerDied","Data":"d4d650d061c4c27d6fe04abd04f3fc617dadc1dab3653b835fe09d144ef0f0fa"}
Sep 11 01:03:14.969435 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:14.969394    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr" event={"ID":"1f084ee6-7b1a-4822-8690-958b65197142","Type":"ContainerStarted","Data":"5f13a9b8f676ddc8002810fceb1a70a1c470ac350003da25ee66fedc7315c1d5"}
Sep 11 01:03:14.969917 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:14.969463    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"
Sep 11 01:03:14.994031 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:14.993968    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr" podStartSLOduration=1.618680162 podStartE2EDuration="5.993946052s" totalImagesPullingTime="3.300598356s" totalInitContainerRuntime="1.074667534s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:03:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:03:14.991481019 +0000 UTC m=+312.039569274" watchObservedRunningTime="2026-09-11 01:03:14.993946052 +0000 UTC m=+312.042034276"
Sep 11 01:03:15.095167 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:15.095143    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb"
Sep 11 01:03:15.209652 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:15.209620    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/812f4481-cc9c-442e-8138-7ec4b94cf12d-util\") pod \"812f4481-cc9c-442e-8138-7ec4b94cf12d\" (UID: \"812f4481-cc9c-442e-8138-7ec4b94cf12d\") "
Sep 11 01:03:15.209855 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:15.209720    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/812f4481-cc9c-442e-8138-7ec4b94cf12d-bundle\") pod \"812f4481-cc9c-442e-8138-7ec4b94cf12d\" (UID: \"812f4481-cc9c-442e-8138-7ec4b94cf12d\") "
Sep 11 01:03:15.209855 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:15.209757    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zrz6\" (UniqueName: \"kubernetes.io/projected/812f4481-cc9c-442e-8138-7ec4b94cf12d-kube-api-access-6zrz6\") pod \"812f4481-cc9c-442e-8138-7ec4b94cf12d\" (UID: \"812f4481-cc9c-442e-8138-7ec4b94cf12d\") "
Sep 11 01:03:15.210469 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:15.210441    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/812f4481-cc9c-442e-8138-7ec4b94cf12d-bundle" (OuterVolumeSpecName: "bundle") pod "812f4481-cc9c-442e-8138-7ec4b94cf12d" (UID: "812f4481-cc9c-442e-8138-7ec4b94cf12d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:03:15.211867 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:15.211840    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/812f4481-cc9c-442e-8138-7ec4b94cf12d-kube-api-access-6zrz6" (OuterVolumeSpecName: "kube-api-access-6zrz6") pod "812f4481-cc9c-442e-8138-7ec4b94cf12d" (UID: "812f4481-cc9c-442e-8138-7ec4b94cf12d"). InnerVolumeSpecName "kube-api-access-6zrz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:03:15.215274 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:15.215255    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/812f4481-cc9c-442e-8138-7ec4b94cf12d-util" (OuterVolumeSpecName: "util") pod "812f4481-cc9c-442e-8138-7ec4b94cf12d" (UID: "812f4481-cc9c-442e-8138-7ec4b94cf12d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:03:15.311066 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:15.311031    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/812f4481-cc9c-442e-8138-7ec4b94cf12d-bundle\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:03:15.311066 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:15.311061    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zrz6\" (UniqueName: \"kubernetes.io/projected/812f4481-cc9c-442e-8138-7ec4b94cf12d-kube-api-access-6zrz6\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:03:15.311066 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:15.311072    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/812f4481-cc9c-442e-8138-7ec4b94cf12d-util\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:03:15.976058 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:15.976026    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb"
Sep 11 01:03:15.976439 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:15.976056    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0d6vmb" event={"ID":"812f4481-cc9c-442e-8138-7ec4b94cf12d","Type":"ContainerDied","Data":"5850b2614e569b0fac8be98b4b1ddb92fdf454721b1a3c7f81c7e53c8928fc1f"}
Sep 11 01:03:15.976439 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:15.976103    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5850b2614e569b0fac8be98b4b1ddb92fdf454721b1a3c7f81c7e53c8928fc1f"
Sep 11 01:03:25.978793 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:25.978764    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c49b45946-brnlr"
Sep 11 01:03:28.715950 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.715916    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx"]
Sep 11 01:03:28.716382 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.716190    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="812f4481-cc9c-442e-8138-7ec4b94cf12d" containerName="pull"
Sep 11 01:03:28.716382 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.716200    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="812f4481-cc9c-442e-8138-7ec4b94cf12d" containerName="pull"
Sep 11 01:03:28.716382 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.716215    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="812f4481-cc9c-442e-8138-7ec4b94cf12d" containerName="util"
Sep 11 01:03:28.716382 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.716220    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="812f4481-cc9c-442e-8138-7ec4b94cf12d" containerName="util"
Sep 11 01:03:28.716382 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.716226    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="812f4481-cc9c-442e-8138-7ec4b94cf12d" containerName="extract"
Sep 11 01:03:28.716382 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.716232    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="812f4481-cc9c-442e-8138-7ec4b94cf12d" containerName="extract"
Sep 11 01:03:28.716382 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.716289    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="812f4481-cc9c-442e-8138-7ec4b94cf12d" containerName="extract"
Sep 11 01:03:28.719061 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.719043    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx"
Sep 11 01:03:28.723959 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.723941    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 01:03:28.724077 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.724012    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zsbnv\""
Sep 11 01:03:28.724410 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.724389    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 01:03:28.724981 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.724963    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 01:03:28.725069 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.725014    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 01:03:28.733026 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.733008    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 01:03:28.828317 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.828282    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfr75\" (UniqueName: \"kubernetes.io/projected/a4f3902f-cddb-40d7-babe-dabcc06c3ad8-kube-api-access-zfr75\") pod \"lws-controller-manager-6cff9449b4-bmlcx\" (UID: \"a4f3902f-cddb-40d7-babe-dabcc06c3ad8\") " pod="openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx"
Sep 11 01:03:28.828317 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.828319    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a4f3902f-cddb-40d7-babe-dabcc06c3ad8-manager-config\") pod \"lws-controller-manager-6cff9449b4-bmlcx\" (UID: \"a4f3902f-cddb-40d7-babe-dabcc06c3ad8\") " pod="openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx"
Sep 11 01:03:28.828532 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.828445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4f3902f-cddb-40d7-babe-dabcc06c3ad8-metrics-cert\") pod \"lws-controller-manager-6cff9449b4-bmlcx\" (UID: \"a4f3902f-cddb-40d7-babe-dabcc06c3ad8\") " pod="openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx"
Sep 11 01:03:28.828532 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.828470    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4f3902f-cddb-40d7-babe-dabcc06c3ad8-cert\") pod \"lws-controller-manager-6cff9449b4-bmlcx\" (UID: \"a4f3902f-cddb-40d7-babe-dabcc06c3ad8\") " pod="openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx"
Sep 11 01:03:28.929758 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.929723    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4f3902f-cddb-40d7-babe-dabcc06c3ad8-metrics-cert\") pod \"lws-controller-manager-6cff9449b4-bmlcx\" (UID: \"a4f3902f-cddb-40d7-babe-dabcc06c3ad8\") " pod="openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx"
Sep 11 01:03:28.929758 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.929761    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4f3902f-cddb-40d7-babe-dabcc06c3ad8-cert\") pod \"lws-controller-manager-6cff9449b4-bmlcx\" (UID: \"a4f3902f-cddb-40d7-babe-dabcc06c3ad8\") " pod="openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx"
Sep 11 01:03:28.929990 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.929809    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfr75\" (UniqueName: \"kubernetes.io/projected/a4f3902f-cddb-40d7-babe-dabcc06c3ad8-kube-api-access-zfr75\") pod \"lws-controller-manager-6cff9449b4-bmlcx\" (UID: \"a4f3902f-cddb-40d7-babe-dabcc06c3ad8\") " pod="openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx"
Sep 11 01:03:28.929990 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.929850    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a4f3902f-cddb-40d7-babe-dabcc06c3ad8-manager-config\") pod \"lws-controller-manager-6cff9449b4-bmlcx\" (UID: \"a4f3902f-cddb-40d7-babe-dabcc06c3ad8\") " pod="openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx"
Sep 11 01:03:28.930528 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.930493    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a4f3902f-cddb-40d7-babe-dabcc06c3ad8-manager-config\") pod \"lws-controller-manager-6cff9449b4-bmlcx\" (UID: \"a4f3902f-cddb-40d7-babe-dabcc06c3ad8\") " pod="openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx"
Sep 11 01:03:28.932317 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.932297    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4f3902f-cddb-40d7-babe-dabcc06c3ad8-metrics-cert\") pod \"lws-controller-manager-6cff9449b4-bmlcx\" (UID: \"a4f3902f-cddb-40d7-babe-dabcc06c3ad8\") " pod="openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx"
Sep 11 01:03:28.932434 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.932325    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4f3902f-cddb-40d7-babe-dabcc06c3ad8-cert\") pod \"lws-controller-manager-6cff9449b4-bmlcx\" (UID: \"a4f3902f-cddb-40d7-babe-dabcc06c3ad8\") " pod="openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx"
Sep 11 01:03:28.942322 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.942299    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfr75\" (UniqueName: \"kubernetes.io/projected/a4f3902f-cddb-40d7-babe-dabcc06c3ad8-kube-api-access-zfr75\") pod \"lws-controller-manager-6cff9449b4-bmlcx\" (UID: \"a4f3902f-cddb-40d7-babe-dabcc06c3ad8\") " pod="openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx"
Sep 11 01:03:28.977176 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:28.977095    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx"]
Sep 11 01:03:29.028353 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:29.028324    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx"
Sep 11 01:03:29.336117 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:29.336088    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx"]
Sep 11 01:03:29.339223 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:03:29.339196    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f3902f_cddb_40d7_babe_dabcc06c3ad8.slice/crio-13057a44e9e50089535ddee803bf975f44a18043fc425d4bb292df17d9033925 WatchSource:0}: Error finding container 13057a44e9e50089535ddee803bf975f44a18043fc425d4bb292df17d9033925: Status 404 returned error can't find the container with id 13057a44e9e50089535ddee803bf975f44a18043fc425d4bb292df17d9033925
Sep 11 01:03:30.040385 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:30.040349    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx" event={"ID":"a4f3902f-cddb-40d7-babe-dabcc06c3ad8","Type":"ContainerStarted","Data":"13057a44e9e50089535ddee803bf975f44a18043fc425d4bb292df17d9033925"}
Sep 11 01:03:32.051283 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:32.051247    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx" event={"ID":"a4f3902f-cddb-40d7-babe-dabcc06c3ad8","Type":"ContainerStarted","Data":"d03e84d39e8d47c51e3a9a373654f22cf0591e0c077dff77de0ca60a0dd64a37"}
Sep 11 01:03:32.051732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:32.051390    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx"
Sep 11 01:03:32.073295 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:32.073242    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx" podStartSLOduration=2.171269099 podStartE2EDuration="4.073224041s" totalImagesPullingTime="1.901954942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:03:32.072522061 +0000 UTC m=+329.120610303" watchObservedRunningTime="2026-09-11 01:03:32.073224041 +0000 UTC m=+329.121312266"
Sep 11 01:03:36.807565 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.807527    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"]
Sep 11 01:03:36.812596 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.812570    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.817602 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.817577    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 01:03:36.817754 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.817657    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 01:03:36.817951 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.817931    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-k4dft\""
Sep 11 01:03:36.818400 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.818386    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 01:03:36.826224 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.826198    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"]
Sep 11 01:03:36.894754 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.894724    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68c1d6af-333a-45aa-9c5a-6c6362163748-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.894936 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.894764    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68c1d6af-333a-45aa-9c5a-6c6362163748-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.894936 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.894798    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68c1d6af-333a-45aa-9c5a-6c6362163748-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.894936 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.894842    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68c1d6af-333a-45aa-9c5a-6c6362163748-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.894936 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.894876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68c1d6af-333a-45aa-9c5a-6c6362163748-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.894936 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.894904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d94fx\" (UniqueName: \"kubernetes.io/projected/68c1d6af-333a-45aa-9c5a-6c6362163748-kube-api-access-d94fx\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.894936 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.894931    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68c1d6af-333a-45aa-9c5a-6c6362163748-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.895195 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.894981    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68c1d6af-333a-45aa-9c5a-6c6362163748-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.895195 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.895053    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68c1d6af-333a-45aa-9c5a-6c6362163748-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.995525 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.995491    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68c1d6af-333a-45aa-9c5a-6c6362163748-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.995525 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.995522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68c1d6af-333a-45aa-9c5a-6c6362163748-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.995743 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.995546    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68c1d6af-333a-45aa-9c5a-6c6362163748-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.995743 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.995581    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d94fx\" (UniqueName: \"kubernetes.io/projected/68c1d6af-333a-45aa-9c5a-6c6362163748-kube-api-access-d94fx\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.995743 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.995603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68c1d6af-333a-45aa-9c5a-6c6362163748-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.995743 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.995623    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68c1d6af-333a-45aa-9c5a-6c6362163748-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.995959 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.995857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68c1d6af-333a-45aa-9c5a-6c6362163748-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.995959 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.995905    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68c1d6af-333a-45aa-9c5a-6c6362163748-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.995959 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.995950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68c1d6af-333a-45aa-9c5a-6c6362163748-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.996104 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.995976    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68c1d6af-333a-45aa-9c5a-6c6362163748-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.996104 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.996008    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68c1d6af-333a-45aa-9c5a-6c6362163748-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.996104 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.996037    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68c1d6af-333a-45aa-9c5a-6c6362163748-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.996465 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.996439    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68c1d6af-333a-45aa-9c5a-6c6362163748-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.996570 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.996481    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68c1d6af-333a-45aa-9c5a-6c6362163748-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.998252 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.998230    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68c1d6af-333a-45aa-9c5a-6c6362163748-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:36.998335 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:36.998308    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68c1d6af-333a-45aa-9c5a-6c6362163748-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:37.004499 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:37.004475    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d94fx\" (UniqueName: \"kubernetes.io/projected/68c1d6af-333a-45aa-9c5a-6c6362163748-kube-api-access-d94fx\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:37.004599 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:37.004544    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68c1d6af-333a-45aa-9c5a-6c6362163748-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44\" (UID: \"68c1d6af-333a-45aa-9c5a-6c6362163748\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:37.123304 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:37.123232    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:37.411856 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:37.411827    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"]
Sep 11 01:03:37.414434 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:03:37.414406    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68c1d6af_333a_45aa_9c5a_6c6362163748.slice/crio-f7622e62e2cb67f88d8a3fa130336f07c89d56163a16b5dd6119b09a4d0b699c WatchSource:0}: Error finding container f7622e62e2cb67f88d8a3fa130336f07c89d56163a16b5dd6119b09a4d0b699c: Status 404 returned error can't find the container with id f7622e62e2cb67f88d8a3fa130336f07c89d56163a16b5dd6119b09a4d0b699c
Sep 11 01:03:38.081472 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:38.081435    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44" event={"ID":"68c1d6af-333a-45aa-9c5a-6c6362163748","Type":"ContainerStarted","Data":"f7622e62e2cb67f88d8a3fa130336f07c89d56163a16b5dd6119b09a4d0b699c"}
Sep 11 01:03:39.422589 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:39.422553    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rdc7l"]
Sep 11 01:03:39.429769 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:39.429735    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rdc7l"
Sep 11 01:03:39.433006 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:39.432602    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 11 01:03:39.433006 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:39.432662    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-thk2s\""
Sep 11 01:03:39.434973 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:39.434947    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rdc7l"]
Sep 11 01:03:39.514831 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:39.514783    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9349ed9-e448-4010-801b-b514b82d32e6-cert\") pod \"odh-model-controller-7998c67dc4-rdc7l\" (UID: \"f9349ed9-e448-4010-801b-b514b82d32e6\") " pod="opendatahub/odh-model-controller-7998c67dc4-rdc7l"
Sep 11 01:03:39.514999 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:39.514871    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phlgb\" (UniqueName: \"kubernetes.io/projected/f9349ed9-e448-4010-801b-b514b82d32e6-kube-api-access-phlgb\") pod \"odh-model-controller-7998c67dc4-rdc7l\" (UID: \"f9349ed9-e448-4010-801b-b514b82d32e6\") " pod="opendatahub/odh-model-controller-7998c67dc4-rdc7l"
Sep 11 01:03:39.615928 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:39.615885    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9349ed9-e448-4010-801b-b514b82d32e6-cert\") pod \"odh-model-controller-7998c67dc4-rdc7l\" (UID: \"f9349ed9-e448-4010-801b-b514b82d32e6\") " pod="opendatahub/odh-model-controller-7998c67dc4-rdc7l"
Sep 11 01:03:39.616107 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:39.615946    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phlgb\" (UniqueName: \"kubernetes.io/projected/f9349ed9-e448-4010-801b-b514b82d32e6-kube-api-access-phlgb\") pod \"odh-model-controller-7998c67dc4-rdc7l\" (UID: \"f9349ed9-e448-4010-801b-b514b82d32e6\") " pod="opendatahub/odh-model-controller-7998c67dc4-rdc7l"
Sep 11 01:03:39.618648 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:39.618622    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9349ed9-e448-4010-801b-b514b82d32e6-cert\") pod \"odh-model-controller-7998c67dc4-rdc7l\" (UID: \"f9349ed9-e448-4010-801b-b514b82d32e6\") " pod="opendatahub/odh-model-controller-7998c67dc4-rdc7l"
Sep 11 01:03:39.626384 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:39.626359    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phlgb\" (UniqueName: \"kubernetes.io/projected/f9349ed9-e448-4010-801b-b514b82d32e6-kube-api-access-phlgb\") pod \"odh-model-controller-7998c67dc4-rdc7l\" (UID: \"f9349ed9-e448-4010-801b-b514b82d32e6\") " pod="opendatahub/odh-model-controller-7998c67dc4-rdc7l"
Sep 11 01:03:39.743106 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:39.743024    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rdc7l"
Sep 11 01:03:40.326343 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:40.326305    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:03:40.326417 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:40.326404    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:03:40.326474 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:40.326460    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:03:40.528803 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:40.528778    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rdc7l"]
Sep 11 01:03:40.531710 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:03:40.531678    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9349ed9_e448_4010_801b_b514b82d32e6.slice/crio-af0e197928a05ebe3bb7b6623dd4db5e1981f6f0b9e415a751c19f4d070591d2 WatchSource:0}: Error finding container af0e197928a05ebe3bb7b6623dd4db5e1981f6f0b9e415a751c19f4d070591d2: Status 404 returned error can't find the container with id af0e197928a05ebe3bb7b6623dd4db5e1981f6f0b9e415a751c19f4d070591d2
Sep 11 01:03:41.100347 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:41.100309    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44" event={"ID":"68c1d6af-333a-45aa-9c5a-6c6362163748","Type":"ContainerStarted","Data":"ef1b570a9dc6fa78087ae5e2922b94e862f75d7d5e6f7bf3cd5f00ca6f98b47a"}
Sep 11 01:03:41.101557 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:41.101529    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rdc7l" event={"ID":"f9349ed9-e448-4010-801b-b514b82d32e6","Type":"ContainerStarted","Data":"af0e197928a05ebe3bb7b6623dd4db5e1981f6f0b9e415a751c19f4d070591d2"}
Sep 11 01:03:41.123610 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:41.123582    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:41.124395 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:41.124348    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44" podStartSLOduration=2.215252621 podStartE2EDuration="5.124331131s" totalImagesPullingTime="2.90907851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:03:41.123647196 +0000 UTC m=+338.171735454" watchObservedRunningTime="2026-09-11 01:03:41.124331131 +0000 UTC m=+338.172419356"
Sep 11 01:03:41.128901 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:41.128884    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:42.109082 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:42.108956    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:42.110284 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:42.110261    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44"
Sep 11 01:03:43.059207 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:43.059165    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6cff9449b4-bmlcx"
Sep 11 01:03:44.121638 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:44.121597    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rdc7l" event={"ID":"f9349ed9-e448-4010-801b-b514b82d32e6","Type":"ContainerStarted","Data":"b5baaddb0a6c99c12ca9f829471db18870796f5f235265ea72c7edd9734acc85"}
Sep 11 01:03:44.122061 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:44.121698    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-rdc7l"
Sep 11 01:03:44.135680 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:44.135642    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-rdc7l" podStartSLOduration=2.204696659 podStartE2EDuration="5.135629129s" totalImagesPullingTime="2.93093247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:03:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:03:44.135592869 +0000 UTC m=+341.183681095" watchObservedRunningTime="2026-09-11 01:03:44.135629129 +0000 UTC m=+341.183717330"
Sep 11 01:03:47.286054 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.286021    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"]
Sep 11 01:03:47.293090 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.293067    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.296547 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.296523    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-twbw8\""
Sep 11 01:03:47.296783 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.296763    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 01:03:47.296897 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.296861    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 01:03:47.297095 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.297082    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 01:03:47.309855 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.309804    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"]
Sep 11 01:03:47.382157 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.382125    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d8f41323-f1d9-4fd6-9bcc-161c98f6cb07-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-8dn7w\" (UID: \"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.382312 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.382180    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8f41323-f1d9-4fd6-9bcc-161c98f6cb07-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-8dn7w\" (UID: \"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.382312 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.382203    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d8f41323-f1d9-4fd6-9bcc-161c98f6cb07-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-8dn7w\" (UID: \"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.382312 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.382287    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8f41323-f1d9-4fd6-9bcc-161c98f6cb07-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-8dn7w\" (UID: \"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.382497 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.382327    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8qzz\" (UniqueName: \"kubernetes.io/projected/d8f41323-f1d9-4fd6-9bcc-161c98f6cb07-kube-api-access-m8qzz\") pod \"istiod-openshift-gateway-5677ccb49b-8dn7w\" (UID: \"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.382497 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.382380    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d8f41323-f1d9-4fd6-9bcc-161c98f6cb07-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-8dn7w\" (UID: \"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.382497 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.382448    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d8f41323-f1d9-4fd6-9bcc-161c98f6cb07-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-8dn7w\" (UID: \"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.483757 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.483723    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8f41323-f1d9-4fd6-9bcc-161c98f6cb07-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-8dn7w\" (UID: \"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.483757 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.483760    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8qzz\" (UniqueName: \"kubernetes.io/projected/d8f41323-f1d9-4fd6-9bcc-161c98f6cb07-kube-api-access-m8qzz\") pod \"istiod-openshift-gateway-5677ccb49b-8dn7w\" (UID: \"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.484002 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.483785    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d8f41323-f1d9-4fd6-9bcc-161c98f6cb07-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-8dn7w\" (UID: \"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.484002 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.483841    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d8f41323-f1d9-4fd6-9bcc-161c98f6cb07-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-8dn7w\" (UID: \"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.484002 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.483864    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d8f41323-f1d9-4fd6-9bcc-161c98f6cb07-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-8dn7w\" (UID: \"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.484002 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.483900    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8f41323-f1d9-4fd6-9bcc-161c98f6cb07-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-8dn7w\" (UID: \"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.484002 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.483917    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d8f41323-f1d9-4fd6-9bcc-161c98f6cb07-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-8dn7w\" (UID: \"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.484601 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.484573    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d8f41323-f1d9-4fd6-9bcc-161c98f6cb07-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-8dn7w\" (UID: \"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.486317 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.486284    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d8f41323-f1d9-4fd6-9bcc-161c98f6cb07-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-8dn7w\" (UID: \"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.486418 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.486318    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d8f41323-f1d9-4fd6-9bcc-161c98f6cb07-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-8dn7w\" (UID: \"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.486460 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.486442    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8f41323-f1d9-4fd6-9bcc-161c98f6cb07-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-8dn7w\" (UID: \"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.486495 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.486456    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d8f41323-f1d9-4fd6-9bcc-161c98f6cb07-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-8dn7w\" (UID: \"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.496772 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.496751    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8f41323-f1d9-4fd6-9bcc-161c98f6cb07-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-8dn7w\" (UID: \"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.500741 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.500718    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8qzz\" (UniqueName: \"kubernetes.io/projected/d8f41323-f1d9-4fd6-9bcc-161c98f6cb07-kube-api-access-m8qzz\") pod \"istiod-openshift-gateway-5677ccb49b-8dn7w\" (UID: \"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.603902 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.603847    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:47.908976 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:47.908949    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"]
Sep 11 01:03:47.910642 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:03:47.910618    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8f41323_f1d9_4fd6_9bcc_161c98f6cb07.slice/crio-224ef700c23bdccd51903f111caf25f202c01711dbc7a661447eedad06d867a7 WatchSource:0}: Error finding container 224ef700c23bdccd51903f111caf25f202c01711dbc7a661447eedad06d867a7: Status 404 returned error can't find the container with id 224ef700c23bdccd51903f111caf25f202c01711dbc7a661447eedad06d867a7
Sep 11 01:03:48.141021 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:48.140980    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w" event={"ID":"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07","Type":"ContainerStarted","Data":"224ef700c23bdccd51903f111caf25f202c01711dbc7a661447eedad06d867a7"}
Sep 11 01:03:50.146800 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:50.146762    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:03:50.147128 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:50.146846    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:03:51.162279 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:51.162236    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w" event={"ID":"d8f41323-f1d9-4fd6-9bcc-161c98f6cb07","Type":"ContainerStarted","Data":"1060175af97580a9175809cdede08a84b7e9a321551fa53a31baec232ca44a46"}
Sep 11 01:03:51.162720 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:51.162435    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:51.164238 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:51.164219    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w"
Sep 11 01:03:51.212956 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:51.212903    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8dn7w" podStartSLOduration=1.979176357 podStartE2EDuration="4.212887687s" totalImagesPullingTime="2.23371133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:03:51.210025923 +0000 UTC m=+348.258114162" watchObservedRunningTime="2026-09-11 01:03:51.212887687 +0000 UTC m=+348.260975910"
Sep 11 01:03:55.129494 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:03:55.129461    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-rdc7l"
Sep 11 01:04:42.378309 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:42.378269    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c9f97ffdd-wmctr"]
Sep 11 01:04:44.092436 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.092397    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v"]
Sep 11 01:04:44.095893 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.095876    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v"
Sep 11 01:04:44.098323 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.098301    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 01:04:44.098446 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.098360    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-sb47n\""
Sep 11 01:04:44.099120 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.099105    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 01:04:44.104623 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.104599    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v"]
Sep 11 01:04:44.165342 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.165317    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/685f21bb-ed4b-4fe2-a03f-5558e90d3b4a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v\" (UID: \"685f21bb-ed4b-4fe2-a03f-5558e90d3b4a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v"
Sep 11 01:04:44.165478 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.165381    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/685f21bb-ed4b-4fe2-a03f-5558e90d3b4a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v\" (UID: \"685f21bb-ed4b-4fe2-a03f-5558e90d3b4a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v"
Sep 11 01:04:44.165478 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.165401    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59nfz\" (UniqueName: \"kubernetes.io/projected/685f21bb-ed4b-4fe2-a03f-5558e90d3b4a-kube-api-access-59nfz\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v\" (UID: \"685f21bb-ed4b-4fe2-a03f-5558e90d3b4a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v"
Sep 11 01:04:44.200118 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.200088    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94"]
Sep 11 01:04:44.203523 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.203502    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94"
Sep 11 01:04:44.210882 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.210696    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94"]
Sep 11 01:04:44.266745 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.266711    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/685f21bb-ed4b-4fe2-a03f-5558e90d3b4a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v\" (UID: \"685f21bb-ed4b-4fe2-a03f-5558e90d3b4a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v"
Sep 11 01:04:44.266745 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.266751    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59nfz\" (UniqueName: \"kubernetes.io/projected/685f21bb-ed4b-4fe2-a03f-5558e90d3b4a-kube-api-access-59nfz\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v\" (UID: \"685f21bb-ed4b-4fe2-a03f-5558e90d3b4a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v"
Sep 11 01:04:44.267027 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.266807    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d28ffbbe-9ffe-478b-9587-b43aea5a628a-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94\" (UID: \"d28ffbbe-9ffe-478b-9587-b43aea5a628a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94"
Sep 11 01:04:44.267027 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.266847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkmsj\" (UniqueName: \"kubernetes.io/projected/d28ffbbe-9ffe-478b-9587-b43aea5a628a-kube-api-access-jkmsj\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94\" (UID: \"d28ffbbe-9ffe-478b-9587-b43aea5a628a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94"
Sep 11 01:04:44.267027 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.266891    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/685f21bb-ed4b-4fe2-a03f-5558e90d3b4a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v\" (UID: \"685f21bb-ed4b-4fe2-a03f-5558e90d3b4a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v"
Sep 11 01:04:44.267027 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.266974    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d28ffbbe-9ffe-478b-9587-b43aea5a628a-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94\" (UID: \"d28ffbbe-9ffe-478b-9587-b43aea5a628a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94"
Sep 11 01:04:44.267242 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.267118    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/685f21bb-ed4b-4fe2-a03f-5558e90d3b4a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v\" (UID: \"685f21bb-ed4b-4fe2-a03f-5558e90d3b4a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v"
Sep 11 01:04:44.267242 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.267178    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/685f21bb-ed4b-4fe2-a03f-5558e90d3b4a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v\" (UID: \"685f21bb-ed4b-4fe2-a03f-5558e90d3b4a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v"
Sep 11 01:04:44.274281 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.274257    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59nfz\" (UniqueName: \"kubernetes.io/projected/685f21bb-ed4b-4fe2-a03f-5558e90d3b4a-kube-api-access-59nfz\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v\" (UID: \"685f21bb-ed4b-4fe2-a03f-5558e90d3b4a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v"
Sep 11 01:04:44.296358 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.296326    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b"]
Sep 11 01:04:44.299933 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.299913    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b"
Sep 11 01:04:44.306733 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.306710    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b"]
Sep 11 01:04:44.367410 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.367317    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b\" (UID: \"a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b"
Sep 11 01:04:44.367410 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.367346    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b\" (UID: \"a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b"
Sep 11 01:04:44.367410 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.367374    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5jjv\" (UniqueName: \"kubernetes.io/projected/a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7-kube-api-access-l5jjv\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b\" (UID: \"a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b"
Sep 11 01:04:44.367410 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.367401    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d28ffbbe-9ffe-478b-9587-b43aea5a628a-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94\" (UID: \"d28ffbbe-9ffe-478b-9587-b43aea5a628a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94"
Sep 11 01:04:44.367741 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.367450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d28ffbbe-9ffe-478b-9587-b43aea5a628a-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94\" (UID: \"d28ffbbe-9ffe-478b-9587-b43aea5a628a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94"
Sep 11 01:04:44.367741 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.367471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkmsj\" (UniqueName: \"kubernetes.io/projected/d28ffbbe-9ffe-478b-9587-b43aea5a628a-kube-api-access-jkmsj\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94\" (UID: \"d28ffbbe-9ffe-478b-9587-b43aea5a628a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94"
Sep 11 01:04:44.367741 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.367721    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d28ffbbe-9ffe-478b-9587-b43aea5a628a-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94\" (UID: \"d28ffbbe-9ffe-478b-9587-b43aea5a628a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94"
Sep 11 01:04:44.367921 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.367747    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d28ffbbe-9ffe-478b-9587-b43aea5a628a-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94\" (UID: \"d28ffbbe-9ffe-478b-9587-b43aea5a628a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94"
Sep 11 01:04:44.374995 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.374968    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkmsj\" (UniqueName: \"kubernetes.io/projected/d28ffbbe-9ffe-478b-9587-b43aea5a628a-kube-api-access-jkmsj\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94\" (UID: \"d28ffbbe-9ffe-478b-9587-b43aea5a628a\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94"
Sep 11 01:04:44.399612 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.399584    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg"]
Sep 11 01:04:44.403095 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.403081    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg"
Sep 11 01:04:44.406517 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.406499    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v"
Sep 11 01:04:44.411470 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.411447    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg"]
Sep 11 01:04:44.469023 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.468995    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34daccc5-fd7b-47c8-b9f3-8552dc5ed002-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg\" (UID: \"34daccc5-fd7b-47c8-b9f3-8552dc5ed002\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg"
Sep 11 01:04:44.469498 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.469448    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34daccc5-fd7b-47c8-b9f3-8552dc5ed002-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg\" (UID: \"34daccc5-fd7b-47c8-b9f3-8552dc5ed002\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg"
Sep 11 01:04:44.469761 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.469741    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mw4p\" (UniqueName: \"kubernetes.io/projected/34daccc5-fd7b-47c8-b9f3-8552dc5ed002-kube-api-access-9mw4p\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg\" (UID: \"34daccc5-fd7b-47c8-b9f3-8552dc5ed002\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg"
Sep 11 01:04:44.470013 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.469994    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b\" (UID: \"a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b"
Sep 11 01:04:44.470543 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.470523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b\" (UID: \"a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b"
Sep 11 01:04:44.470699 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.470682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5jjv\" (UniqueName: \"kubernetes.io/projected/a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7-kube-api-access-l5jjv\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b\" (UID: \"a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b"
Sep 11 01:04:44.471387 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.470478    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b\" (UID: \"a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b"
Sep 11 01:04:44.471387 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.471349    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b\" (UID: \"a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b"
Sep 11 01:04:44.479476 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.479452    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5jjv\" (UniqueName: \"kubernetes.io/projected/a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7-kube-api-access-l5jjv\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b\" (UID: \"a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b"
Sep 11 01:04:44.513255 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.513227    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94"
Sep 11 01:04:44.571428 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.571397    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34daccc5-fd7b-47c8-b9f3-8552dc5ed002-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg\" (UID: \"34daccc5-fd7b-47c8-b9f3-8552dc5ed002\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg"
Sep 11 01:04:44.571533 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.571457    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34daccc5-fd7b-47c8-b9f3-8552dc5ed002-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg\" (UID: \"34daccc5-fd7b-47c8-b9f3-8552dc5ed002\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg"
Sep 11 01:04:44.571533 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.571492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mw4p\" (UniqueName: \"kubernetes.io/projected/34daccc5-fd7b-47c8-b9f3-8552dc5ed002-kube-api-access-9mw4p\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg\" (UID: \"34daccc5-fd7b-47c8-b9f3-8552dc5ed002\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg"
Sep 11 01:04:44.571951 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.571933    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34daccc5-fd7b-47c8-b9f3-8552dc5ed002-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg\" (UID: \"34daccc5-fd7b-47c8-b9f3-8552dc5ed002\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg"
Sep 11 01:04:44.572004 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.571984    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34daccc5-fd7b-47c8-b9f3-8552dc5ed002-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg\" (UID: \"34daccc5-fd7b-47c8-b9f3-8552dc5ed002\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg"
Sep 11 01:04:44.581097 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.581076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mw4p\" (UniqueName: \"kubernetes.io/projected/34daccc5-fd7b-47c8-b9f3-8552dc5ed002-kube-api-access-9mw4p\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg\" (UID: \"34daccc5-fd7b-47c8-b9f3-8552dc5ed002\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg"
Sep 11 01:04:44.610393 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.610361    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b"
Sep 11 01:04:44.686154 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.686123    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v"]
Sep 11 01:04:44.688407 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:04:44.688379    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod685f21bb_ed4b_4fe2_a03f_5558e90d3b4a.slice/crio-8720b1ab7cff57c624206d5c00295e2d24dc58050389f1c39b31ffed99487597 WatchSource:0}: Error finding container 8720b1ab7cff57c624206d5c00295e2d24dc58050389f1c39b31ffed99487597: Status 404 returned error can't find the container with id 8720b1ab7cff57c624206d5c00295e2d24dc58050389f1c39b31ffed99487597
Sep 11 01:04:44.713499 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.713480    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg"
Sep 11 01:04:44.794227 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.794174    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94"]
Sep 11 01:04:44.846782 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:04:44.846744    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd28ffbbe_9ffe_478b_9587_b43aea5a628a.slice/crio-57d9740310d7fe52b35a9c6972a57ab75a18d8f0799acc69a16651e6a5c66242 WatchSource:0}: Error finding container 57d9740310d7fe52b35a9c6972a57ab75a18d8f0799acc69a16651e6a5c66242: Status 404 returned error can't find the container with id 57d9740310d7fe52b35a9c6972a57ab75a18d8f0799acc69a16651e6a5c66242
Sep 11 01:04:44.894489 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.894459    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b"]
Sep 11 01:04:44.990390 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:44.990366    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg"]
Sep 11 01:04:45.040637 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:04:45.040598    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34daccc5_fd7b_47c8_b9f3_8552dc5ed002.slice/crio-ac6384e0cc09550b38369cf34c4b20c4348d8282f13196af2a35ea07a88eaaa4 WatchSource:0}: Error finding container ac6384e0cc09550b38369cf34c4b20c4348d8282f13196af2a35ea07a88eaaa4: Status 404 returned error can't find the container with id ac6384e0cc09550b38369cf34c4b20c4348d8282f13196af2a35ea07a88eaaa4
Sep 11 01:04:45.420403 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:45.420318    2565 generic.go:356] "Generic (PLEG): container finished" podID="a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7" containerID="d564d4a3bbd84e975305ba4d65fda1dd2bf1bd5a57acfa6fcabc3dd5d9dd805c" exitCode=0
Sep 11 01:04:45.420809 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:45.420401    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b" event={"ID":"a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7","Type":"ContainerDied","Data":"d564d4a3bbd84e975305ba4d65fda1dd2bf1bd5a57acfa6fcabc3dd5d9dd805c"}
Sep 11 01:04:45.420809 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:45.420456    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b" event={"ID":"a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7","Type":"ContainerStarted","Data":"8a50bd6bdcbe7afa17640367acfa405a7804bacbec27722fe52b9274c97bd9ed"}
Sep 11 01:04:45.422104 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:45.422061    2565 generic.go:356] "Generic (PLEG): container finished" podID="34daccc5-fd7b-47c8-b9f3-8552dc5ed002" containerID="5358891f29632ee46cdfa287dc7015f8b49dcae61694fed3c71878b0de4bd2d7" exitCode=0
Sep 11 01:04:45.422194 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:45.422152    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg" event={"ID":"34daccc5-fd7b-47c8-b9f3-8552dc5ed002","Type":"ContainerDied","Data":"5358891f29632ee46cdfa287dc7015f8b49dcae61694fed3c71878b0de4bd2d7"}
Sep 11 01:04:45.422257 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:45.422196    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg" event={"ID":"34daccc5-fd7b-47c8-b9f3-8552dc5ed002","Type":"ContainerStarted","Data":"ac6384e0cc09550b38369cf34c4b20c4348d8282f13196af2a35ea07a88eaaa4"}
Sep 11 01:04:45.423823 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:45.423787    2565 generic.go:356] "Generic (PLEG): container finished" podID="d28ffbbe-9ffe-478b-9587-b43aea5a628a" containerID="c49fc29226258ba7e163da8efb985be65768a7a12baa66d3447d1f60da6e2321" exitCode=0
Sep 11 01:04:45.423963 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:45.423857    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94" event={"ID":"d28ffbbe-9ffe-478b-9587-b43aea5a628a","Type":"ContainerDied","Data":"c49fc29226258ba7e163da8efb985be65768a7a12baa66d3447d1f60da6e2321"}
Sep 11 01:04:45.423963 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:45.423913    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94" event={"ID":"d28ffbbe-9ffe-478b-9587-b43aea5a628a","Type":"ContainerStarted","Data":"57d9740310d7fe52b35a9c6972a57ab75a18d8f0799acc69a16651e6a5c66242"}
Sep 11 01:04:45.425617 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:45.425598    2565 generic.go:356] "Generic (PLEG): container finished" podID="685f21bb-ed4b-4fe2-a03f-5558e90d3b4a" containerID="b6c3e5c380105865b98bd0c12ee8b16aa1fcc2b4037cbe4790b18c6f6c80b91e" exitCode=0
Sep 11 01:04:45.425697 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:45.425650    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v" event={"ID":"685f21bb-ed4b-4fe2-a03f-5558e90d3b4a","Type":"ContainerDied","Data":"b6c3e5c380105865b98bd0c12ee8b16aa1fcc2b4037cbe4790b18c6f6c80b91e"}
Sep 11 01:04:45.425769 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:45.425746    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v" event={"ID":"685f21bb-ed4b-4fe2-a03f-5558e90d3b4a","Type":"ContainerStarted","Data":"8720b1ab7cff57c624206d5c00295e2d24dc58050389f1c39b31ffed99487597"}
Sep 11 01:04:46.432640 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:46.432615    2565 generic.go:356] "Generic (PLEG): container finished" podID="685f21bb-ed4b-4fe2-a03f-5558e90d3b4a" containerID="aedffa7fa0b605ba69b74d2bcd6d4217041c5270811f0bb4ee8cc9cbffbdab38" exitCode=0
Sep 11 01:04:46.432957 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:46.432691    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v" event={"ID":"685f21bb-ed4b-4fe2-a03f-5558e90d3b4a","Type":"ContainerDied","Data":"aedffa7fa0b605ba69b74d2bcd6d4217041c5270811f0bb4ee8cc9cbffbdab38"}
Sep 11 01:04:46.434599 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:46.434578    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg" event={"ID":"34daccc5-fd7b-47c8-b9f3-8552dc5ed002","Type":"ContainerStarted","Data":"d4e8c5f628e62a89a83ab309f8304c2ad33ebf90294afb898b6421c62c867395"}
Sep 11 01:04:46.436335 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:46.436315    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94" event={"ID":"d28ffbbe-9ffe-478b-9587-b43aea5a628a","Type":"ContainerStarted","Data":"0e5627e000240ed0bceebf0463e5244746d77506835d27769c8fb56b57f8ee00"}
Sep 11 01:04:47.446675 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:47.446638    2565 generic.go:356] "Generic (PLEG): container finished" podID="a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7" containerID="bfcdc5d0ce11f22f2cf30e4ed70c0506a19186ff92c089847970220b32b568e9" exitCode=0
Sep 11 01:04:47.447149 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:47.446709    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b" event={"ID":"a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7","Type":"ContainerDied","Data":"bfcdc5d0ce11f22f2cf30e4ed70c0506a19186ff92c089847970220b32b568e9"}
Sep 11 01:04:47.448677 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:47.448653    2565 generic.go:356] "Generic (PLEG): container finished" podID="34daccc5-fd7b-47c8-b9f3-8552dc5ed002" containerID="d4e8c5f628e62a89a83ab309f8304c2ad33ebf90294afb898b6421c62c867395" exitCode=0
Sep 11 01:04:47.448751 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:47.448733    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg" event={"ID":"34daccc5-fd7b-47c8-b9f3-8552dc5ed002","Type":"ContainerDied","Data":"d4e8c5f628e62a89a83ab309f8304c2ad33ebf90294afb898b6421c62c867395"}
Sep 11 01:04:47.450723 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:47.450703    2565 generic.go:356] "Generic (PLEG): container finished" podID="d28ffbbe-9ffe-478b-9587-b43aea5a628a" containerID="0e5627e000240ed0bceebf0463e5244746d77506835d27769c8fb56b57f8ee00" exitCode=0
Sep 11 01:04:47.450839 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:47.450782    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94" event={"ID":"d28ffbbe-9ffe-478b-9587-b43aea5a628a","Type":"ContainerDied","Data":"0e5627e000240ed0bceebf0463e5244746d77506835d27769c8fb56b57f8ee00"}
Sep 11 01:04:47.461509 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:47.461483    2565 generic.go:356] "Generic (PLEG): container finished" podID="685f21bb-ed4b-4fe2-a03f-5558e90d3b4a" containerID="5f5cab253388c00f45d90f71bb90b132c4e786299e243f74739c47933385956f" exitCode=0
Sep 11 01:04:47.461615 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:47.461519    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v" event={"ID":"685f21bb-ed4b-4fe2-a03f-5558e90d3b4a","Type":"ContainerDied","Data":"5f5cab253388c00f45d90f71bb90b132c4e786299e243f74739c47933385956f"}
Sep 11 01:04:48.469163 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:48.469129    2565 generic.go:356] "Generic (PLEG): container finished" podID="34daccc5-fd7b-47c8-b9f3-8552dc5ed002" containerID="4487a0a3cfe2f221df2e6c1aca8734eeeddabbce68d607a6715892a31a3707bb" exitCode=0
Sep 11 01:04:48.469584 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:48.469206    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg" event={"ID":"34daccc5-fd7b-47c8-b9f3-8552dc5ed002","Type":"ContainerDied","Data":"4487a0a3cfe2f221df2e6c1aca8734eeeddabbce68d607a6715892a31a3707bb"}
Sep 11 01:04:48.471178 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:48.471154    2565 generic.go:356] "Generic (PLEG): container finished" podID="d28ffbbe-9ffe-478b-9587-b43aea5a628a" containerID="385d42d26057e7c445376d1c1f0e72a380c29cdafedef692c85e117a20d80d12" exitCode=0
Sep 11 01:04:48.471291 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:48.471233    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94" event={"ID":"d28ffbbe-9ffe-478b-9587-b43aea5a628a","Type":"ContainerDied","Data":"385d42d26057e7c445376d1c1f0e72a380c29cdafedef692c85e117a20d80d12"}
Sep 11 01:04:48.473161 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:48.473140    2565 generic.go:356] "Generic (PLEG): container finished" podID="a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7" containerID="5ee2a4e5d270c5226a08a820e7dde5efc4857420bae5c7eb0006d6ee4680052e" exitCode=0
Sep 11 01:04:48.473259 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:48.473204    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b" event={"ID":"a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7","Type":"ContainerDied","Data":"5ee2a4e5d270c5226a08a820e7dde5efc4857420bae5c7eb0006d6ee4680052e"}
Sep 11 01:04:48.602638 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:48.602612    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v"
Sep 11 01:04:48.706738 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:48.706706    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/685f21bb-ed4b-4fe2-a03f-5558e90d3b4a-util\") pod \"685f21bb-ed4b-4fe2-a03f-5558e90d3b4a\" (UID: \"685f21bb-ed4b-4fe2-a03f-5558e90d3b4a\") "
Sep 11 01:04:48.706914 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:48.706749    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59nfz\" (UniqueName: \"kubernetes.io/projected/685f21bb-ed4b-4fe2-a03f-5558e90d3b4a-kube-api-access-59nfz\") pod \"685f21bb-ed4b-4fe2-a03f-5558e90d3b4a\" (UID: \"685f21bb-ed4b-4fe2-a03f-5558e90d3b4a\") "
Sep 11 01:04:48.706914 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:48.706771    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/685f21bb-ed4b-4fe2-a03f-5558e90d3b4a-bundle\") pod \"685f21bb-ed4b-4fe2-a03f-5558e90d3b4a\" (UID: \"685f21bb-ed4b-4fe2-a03f-5558e90d3b4a\") "
Sep 11 01:04:48.707297 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:48.707268    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/685f21bb-ed4b-4fe2-a03f-5558e90d3b4a-bundle" (OuterVolumeSpecName: "bundle") pod "685f21bb-ed4b-4fe2-a03f-5558e90d3b4a" (UID: "685f21bb-ed4b-4fe2-a03f-5558e90d3b4a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:04:48.708754 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:48.708732    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/685f21bb-ed4b-4fe2-a03f-5558e90d3b4a-kube-api-access-59nfz" (OuterVolumeSpecName: "kube-api-access-59nfz") pod "685f21bb-ed4b-4fe2-a03f-5558e90d3b4a" (UID: "685f21bb-ed4b-4fe2-a03f-5558e90d3b4a"). InnerVolumeSpecName "kube-api-access-59nfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:04:48.711799 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:48.711761    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/685f21bb-ed4b-4fe2-a03f-5558e90d3b4a-util" (OuterVolumeSpecName: "util") pod "685f21bb-ed4b-4fe2-a03f-5558e90d3b4a" (UID: "685f21bb-ed4b-4fe2-a03f-5558e90d3b4a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:04:48.808198 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:48.808169    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/685f21bb-ed4b-4fe2-a03f-5558e90d3b4a-util\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:04:48.808198 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:48.808197    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59nfz\" (UniqueName: \"kubernetes.io/projected/685f21bb-ed4b-4fe2-a03f-5558e90d3b4a-kube-api-access-59nfz\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:04:48.808363 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:48.808206    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/685f21bb-ed4b-4fe2-a03f-5558e90d3b4a-bundle\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:04:49.479383 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.479358    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v"
Sep 11 01:04:49.479729 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.479394    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7chq4v" event={"ID":"685f21bb-ed4b-4fe2-a03f-5558e90d3b4a","Type":"ContainerDied","Data":"8720b1ab7cff57c624206d5c00295e2d24dc58050389f1c39b31ffed99487597"}
Sep 11 01:04:49.479729 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.479434    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8720b1ab7cff57c624206d5c00295e2d24dc58050389f1c39b31ffed99487597"
Sep 11 01:04:49.626977 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.626941    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg"
Sep 11 01:04:49.647344 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.647320    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94"
Sep 11 01:04:49.650963 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.650944    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b"
Sep 11 01:04:49.716752 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.716714    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkmsj\" (UniqueName: \"kubernetes.io/projected/d28ffbbe-9ffe-478b-9587-b43aea5a628a-kube-api-access-jkmsj\") pod \"d28ffbbe-9ffe-478b-9587-b43aea5a628a\" (UID: \"d28ffbbe-9ffe-478b-9587-b43aea5a628a\") "
Sep 11 01:04:49.716905 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.716759    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7-util\") pod \"a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7\" (UID: \"a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7\") "
Sep 11 01:04:49.716905 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.716793    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d28ffbbe-9ffe-478b-9587-b43aea5a628a-util\") pod \"d28ffbbe-9ffe-478b-9587-b43aea5a628a\" (UID: \"d28ffbbe-9ffe-478b-9587-b43aea5a628a\") "
Sep 11 01:04:49.716905 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.716839    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34daccc5-fd7b-47c8-b9f3-8552dc5ed002-util\") pod \"34daccc5-fd7b-47c8-b9f3-8552dc5ed002\" (UID: \"34daccc5-fd7b-47c8-b9f3-8552dc5ed002\") "
Sep 11 01:04:49.716905 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.716884    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mw4p\" (UniqueName: \"kubernetes.io/projected/34daccc5-fd7b-47c8-b9f3-8552dc5ed002-kube-api-access-9mw4p\") pod \"34daccc5-fd7b-47c8-b9f3-8552dc5ed002\" (UID: \"34daccc5-fd7b-47c8-b9f3-8552dc5ed002\") "
Sep 11 01:04:49.717070 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.716916    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7-bundle\") pod \"a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7\" (UID: \"a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7\") "
Sep 11 01:04:49.717070 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.716943    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34daccc5-fd7b-47c8-b9f3-8552dc5ed002-bundle\") pod \"34daccc5-fd7b-47c8-b9f3-8552dc5ed002\" (UID: \"34daccc5-fd7b-47c8-b9f3-8552dc5ed002\") "
Sep 11 01:04:49.717070 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.716973    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d28ffbbe-9ffe-478b-9587-b43aea5a628a-bundle\") pod \"d28ffbbe-9ffe-478b-9587-b43aea5a628a\" (UID: \"d28ffbbe-9ffe-478b-9587-b43aea5a628a\") "
Sep 11 01:04:49.717070 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.717003    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5jjv\" (UniqueName: \"kubernetes.io/projected/a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7-kube-api-access-l5jjv\") pod \"a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7\" (UID: \"a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7\") "
Sep 11 01:04:49.717809 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.717714    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7-bundle" (OuterVolumeSpecName: "bundle") pod "a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7" (UID: "a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:04:49.717809 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.717766    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d28ffbbe-9ffe-478b-9587-b43aea5a628a-bundle" (OuterVolumeSpecName: "bundle") pod "d28ffbbe-9ffe-478b-9587-b43aea5a628a" (UID: "d28ffbbe-9ffe-478b-9587-b43aea5a628a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:04:49.718052 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.717928    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34daccc5-fd7b-47c8-b9f3-8552dc5ed002-bundle" (OuterVolumeSpecName: "bundle") pod "34daccc5-fd7b-47c8-b9f3-8552dc5ed002" (UID: "34daccc5-fd7b-47c8-b9f3-8552dc5ed002"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:04:49.719873 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.719849    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d28ffbbe-9ffe-478b-9587-b43aea5a628a-kube-api-access-jkmsj" (OuterVolumeSpecName: "kube-api-access-jkmsj") pod "d28ffbbe-9ffe-478b-9587-b43aea5a628a" (UID: "d28ffbbe-9ffe-478b-9587-b43aea5a628a"). InnerVolumeSpecName "kube-api-access-jkmsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:04:49.720007 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.719884    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7-kube-api-access-l5jjv" (OuterVolumeSpecName: "kube-api-access-l5jjv") pod "a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7" (UID: "a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7"). InnerVolumeSpecName "kube-api-access-l5jjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:04:49.720174 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.720150    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34daccc5-fd7b-47c8-b9f3-8552dc5ed002-kube-api-access-9mw4p" (OuterVolumeSpecName: "kube-api-access-9mw4p") pod "34daccc5-fd7b-47c8-b9f3-8552dc5ed002" (UID: "34daccc5-fd7b-47c8-b9f3-8552dc5ed002"). InnerVolumeSpecName "kube-api-access-9mw4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:04:49.723563 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.723526    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7-util" (OuterVolumeSpecName: "util") pod "a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7" (UID: "a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:04:49.724737 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.724715    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d28ffbbe-9ffe-478b-9587-b43aea5a628a-util" (OuterVolumeSpecName: "util") pod "d28ffbbe-9ffe-478b-9587-b43aea5a628a" (UID: "d28ffbbe-9ffe-478b-9587-b43aea5a628a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:04:49.725801 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.725783    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34daccc5-fd7b-47c8-b9f3-8552dc5ed002-util" (OuterVolumeSpecName: "util") pod "34daccc5-fd7b-47c8-b9f3-8552dc5ed002" (UID: "34daccc5-fd7b-47c8-b9f3-8552dc5ed002"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:04:49.818346 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.818315    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkmsj\" (UniqueName: \"kubernetes.io/projected/d28ffbbe-9ffe-478b-9587-b43aea5a628a-kube-api-access-jkmsj\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:04:49.818346 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.818345    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7-util\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:04:49.818526 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.818354    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d28ffbbe-9ffe-478b-9587-b43aea5a628a-util\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:04:49.818526 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.818362    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34daccc5-fd7b-47c8-b9f3-8552dc5ed002-util\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:04:49.818526 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.818370    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mw4p\" (UniqueName: \"kubernetes.io/projected/34daccc5-fd7b-47c8-b9f3-8552dc5ed002-kube-api-access-9mw4p\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:04:49.818526 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.818380    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7-bundle\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:04:49.818526 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.818388    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34daccc5-fd7b-47c8-b9f3-8552dc5ed002-bundle\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:04:49.818526 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.818396    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d28ffbbe-9ffe-478b-9587-b43aea5a628a-bundle\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:04:49.818526 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:49.818404    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5jjv\" (UniqueName: \"kubernetes.io/projected/a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7-kube-api-access-l5jjv\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:04:50.485878 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:50.485843    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg"
Sep 11 01:04:50.485878 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:50.485861    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aq82gg" event={"ID":"34daccc5-fd7b-47c8-b9f3-8552dc5ed002","Type":"ContainerDied","Data":"ac6384e0cc09550b38369cf34c4b20c4348d8282f13196af2a35ea07a88eaaa4"}
Sep 11 01:04:50.486350 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:50.485908    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac6384e0cc09550b38369cf34c4b20c4348d8282f13196af2a35ea07a88eaaa4"
Sep 11 01:04:50.487870 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:50.487846    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94"
Sep 11 01:04:50.488005 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:50.487849    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c64ql94" event={"ID":"d28ffbbe-9ffe-478b-9587-b43aea5a628a","Type":"ContainerDied","Data":"57d9740310d7fe52b35a9c6972a57ab75a18d8f0799acc69a16651e6a5c66242"}
Sep 11 01:04:50.488005 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:50.487954    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57d9740310d7fe52b35a9c6972a57ab75a18d8f0799acc69a16651e6a5c66242"
Sep 11 01:04:50.489785 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:50.489760    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b" event={"ID":"a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7","Type":"ContainerDied","Data":"8a50bd6bdcbe7afa17640367acfa405a7804bacbec27722fe52b9274c97bd9ed"}
Sep 11 01:04:50.489903 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:50.489785    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cg676b"
Sep 11 01:04:50.489903 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:04:50.489797    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a50bd6bdcbe7afa17640367acfa405a7804bacbec27722fe52b9274c97bd9ed"
Sep 11 01:05:07.398657 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.398592    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c9f97ffdd-wmctr" podUID="dca1e528-1329-4fab-bde3-4f22d9edb6af" containerName="console" containerID="cri-o://f1b6a36d8cd5a562014cdc1a56c7df1defe4b4be2df278849d77d033166ee4a3" gracePeriod=15
Sep 11 01:05:07.584110 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.584080    2565 generic.go:356] "Generic (PLEG): container finished" podID="dca1e528-1329-4fab-bde3-4f22d9edb6af" containerID="f1b6a36d8cd5a562014cdc1a56c7df1defe4b4be2df278849d77d033166ee4a3" exitCode=0
Sep 11 01:05:07.584259 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.584160    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9f97ffdd-wmctr" event={"ID":"dca1e528-1329-4fab-bde3-4f22d9edb6af","Type":"ContainerDied","Data":"f1b6a36d8cd5a562014cdc1a56c7df1defe4b4be2df278849d77d033166ee4a3"}
Sep 11 01:05:07.646972 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.646945    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:05:07.776713 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.776633    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-service-ca\") pod \"dca1e528-1329-4fab-bde3-4f22d9edb6af\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") "
Sep 11 01:05:07.776713 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.776691    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dca1e528-1329-4fab-bde3-4f22d9edb6af-console-oauth-config\") pod \"dca1e528-1329-4fab-bde3-4f22d9edb6af\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") "
Sep 11 01:05:07.776713 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.776709    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-oauth-serving-cert\") pod \"dca1e528-1329-4fab-bde3-4f22d9edb6af\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") "
Sep 11 01:05:07.776957 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.776865    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsnmf\" (UniqueName: \"kubernetes.io/projected/dca1e528-1329-4fab-bde3-4f22d9edb6af-kube-api-access-qsnmf\") pod \"dca1e528-1329-4fab-bde3-4f22d9edb6af\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") "
Sep 11 01:05:07.776957 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.776916    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-trusted-ca-bundle\") pod \"dca1e528-1329-4fab-bde3-4f22d9edb6af\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") "
Sep 11 01:05:07.777050 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.776998    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dca1e528-1329-4fab-bde3-4f22d9edb6af-console-serving-cert\") pod \"dca1e528-1329-4fab-bde3-4f22d9edb6af\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") "
Sep 11 01:05:07.777050 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.777027    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-console-config\") pod \"dca1e528-1329-4fab-bde3-4f22d9edb6af\" (UID: \"dca1e528-1329-4fab-bde3-4f22d9edb6af\") "
Sep 11 01:05:07.777356 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.777143    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-service-ca" (OuterVolumeSpecName: "service-ca") pod "dca1e528-1329-4fab-bde3-4f22d9edb6af" (UID: "dca1e528-1329-4fab-bde3-4f22d9edb6af"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:05:07.777356 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.777135    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dca1e528-1329-4fab-bde3-4f22d9edb6af" (UID: "dca1e528-1329-4fab-bde3-4f22d9edb6af"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:05:07.777356 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.777301    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-oauth-serving-cert\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:05:07.777356 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.777318    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-service-ca\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:05:07.777356 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.777329    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dca1e528-1329-4fab-bde3-4f22d9edb6af" (UID: "dca1e528-1329-4fab-bde3-4f22d9edb6af"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:05:07.777639 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.777513    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-console-config" (OuterVolumeSpecName: "console-config") pod "dca1e528-1329-4fab-bde3-4f22d9edb6af" (UID: "dca1e528-1329-4fab-bde3-4f22d9edb6af"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:05:07.778991 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.778960    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dca1e528-1329-4fab-bde3-4f22d9edb6af-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dca1e528-1329-4fab-bde3-4f22d9edb6af" (UID: "dca1e528-1329-4fab-bde3-4f22d9edb6af"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:05:07.779082 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.779017    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dca1e528-1329-4fab-bde3-4f22d9edb6af-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dca1e528-1329-4fab-bde3-4f22d9edb6af" (UID: "dca1e528-1329-4fab-bde3-4f22d9edb6af"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:05:07.779082 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.779038    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dca1e528-1329-4fab-bde3-4f22d9edb6af-kube-api-access-qsnmf" (OuterVolumeSpecName: "kube-api-access-qsnmf") pod "dca1e528-1329-4fab-bde3-4f22d9edb6af" (UID: "dca1e528-1329-4fab-bde3-4f22d9edb6af"). InnerVolumeSpecName "kube-api-access-qsnmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:05:07.877954 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.877912    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dca1e528-1329-4fab-bde3-4f22d9edb6af-console-oauth-config\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:05:07.877954 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.877948    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsnmf\" (UniqueName: \"kubernetes.io/projected/dca1e528-1329-4fab-bde3-4f22d9edb6af-kube-api-access-qsnmf\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:05:07.877954 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.877959    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-trusted-ca-bundle\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:05:07.877954 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.877969    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dca1e528-1329-4fab-bde3-4f22d9edb6af-console-serving-cert\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:05:07.878196 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:07.877978    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dca1e528-1329-4fab-bde3-4f22d9edb6af-console-config\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:05:08.590382 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:08.590352    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9f97ffdd-wmctr"
Sep 11 01:05:08.590382 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:08.590363    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9f97ffdd-wmctr" event={"ID":"dca1e528-1329-4fab-bde3-4f22d9edb6af","Type":"ContainerDied","Data":"f6e3e32fa38b87d549383aefa81d4dee2b810bedeff9c6b34e5cf39b1b1101f3"}
Sep 11 01:05:08.590867 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:08.590413    2565 scope.go:117] "RemoveContainer" containerID="f1b6a36d8cd5a562014cdc1a56c7df1defe4b4be2df278849d77d033166ee4a3"
Sep 11 01:05:08.611436 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:08.611412    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c9f97ffdd-wmctr"]
Sep 11 01:05:08.616129 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:08.616106    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c9f97ffdd-wmctr"]
Sep 11 01:05:09.471498 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:09.471458    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dca1e528-1329-4fab-bde3-4f22d9edb6af" path="/var/lib/kubelet/pods/dca1e528-1329-4fab-bde3-4f22d9edb6af/volumes"
Sep 11 01:05:20.169282 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169247    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg"]
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169562    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d28ffbbe-9ffe-478b-9587-b43aea5a628a" containerName="pull"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169574    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d28ffbbe-9ffe-478b-9587-b43aea5a628a" containerName="pull"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169583    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d28ffbbe-9ffe-478b-9587-b43aea5a628a" containerName="extract"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169589    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d28ffbbe-9ffe-478b-9587-b43aea5a628a" containerName="extract"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169600    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="685f21bb-ed4b-4fe2-a03f-5558e90d3b4a" containerName="pull"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169606    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="685f21bb-ed4b-4fe2-a03f-5558e90d3b4a" containerName="pull"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169614    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34daccc5-fd7b-47c8-b9f3-8552dc5ed002" containerName="extract"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169619    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="34daccc5-fd7b-47c8-b9f3-8552dc5ed002" containerName="extract"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169625    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dca1e528-1329-4fab-bde3-4f22d9edb6af" containerName="console"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169630    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dca1e528-1329-4fab-bde3-4f22d9edb6af" containerName="console"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169638    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7" containerName="util"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169643    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7" containerName="util"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169650    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d28ffbbe-9ffe-478b-9587-b43aea5a628a" containerName="util"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169655    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d28ffbbe-9ffe-478b-9587-b43aea5a628a" containerName="util"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169662    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34daccc5-fd7b-47c8-b9f3-8552dc5ed002" containerName="util"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169667    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="34daccc5-fd7b-47c8-b9f3-8552dc5ed002" containerName="util"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169675    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7" containerName="extract"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169680    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7" containerName="extract"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169687    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="685f21bb-ed4b-4fe2-a03f-5558e90d3b4a" containerName="util"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169692    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="685f21bb-ed4b-4fe2-a03f-5558e90d3b4a" containerName="util"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169697    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34daccc5-fd7b-47c8-b9f3-8552dc5ed002" containerName="pull"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169701    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="34daccc5-fd7b-47c8-b9f3-8552dc5ed002" containerName="pull"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169707    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7" containerName="pull"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169712    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7" containerName="pull"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169720    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="685f21bb-ed4b-4fe2-a03f-5558e90d3b4a" containerName="extract"
Sep 11 01:05:20.169732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169725    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="685f21bb-ed4b-4fe2-a03f-5558e90d3b4a" containerName="extract"
Sep 11 01:05:20.170497 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169770    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="685f21bb-ed4b-4fe2-a03f-5558e90d3b4a" containerName="extract"
Sep 11 01:05:20.170497 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169779    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d28ffbbe-9ffe-478b-9587-b43aea5a628a" containerName="extract"
Sep 11 01:05:20.170497 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169786    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6a0a2d1-79c7-4b80-ab42-f4aa4edc6bf7" containerName="extract"
Sep 11 01:05:20.170497 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169791    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="34daccc5-fd7b-47c8-b9f3-8552dc5ed002" containerName="extract"
Sep 11 01:05:20.170497 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.169798    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dca1e528-1329-4fab-bde3-4f22d9edb6af" containerName="console"
Sep 11 01:05:20.174239 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.174224    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg"
Sep 11 01:05:20.177000 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.176976    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-sstc2\""
Sep 11 01:05:20.177258 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.177245    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 01:05:20.177463 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.177279    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 01:05:20.186759 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.186733    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg"]
Sep 11 01:05:20.288274 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.288241    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgg7c\" (UniqueName: \"kubernetes.io/projected/f2cb5f73-6740-4c56-b41b-e8a146a6eee6-kube-api-access-bgg7c\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-xkckg\" (UID: \"f2cb5f73-6740-4c56-b41b-e8a146a6eee6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg"
Sep 11 01:05:20.288274 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.288277    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2cb5f73-6740-4c56-b41b-e8a146a6eee6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-xkckg\" (UID: \"f2cb5f73-6740-4c56-b41b-e8a146a6eee6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg"
Sep 11 01:05:20.389582 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.389545    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgg7c\" (UniqueName: \"kubernetes.io/projected/f2cb5f73-6740-4c56-b41b-e8a146a6eee6-kube-api-access-bgg7c\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-xkckg\" (UID: \"f2cb5f73-6740-4c56-b41b-e8a146a6eee6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg"
Sep 11 01:05:20.389582 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.389583    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2cb5f73-6740-4c56-b41b-e8a146a6eee6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-xkckg\" (UID: \"f2cb5f73-6740-4c56-b41b-e8a146a6eee6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg"
Sep 11 01:05:20.389996 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.389978    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2cb5f73-6740-4c56-b41b-e8a146a6eee6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-xkckg\" (UID: \"f2cb5f73-6740-4c56-b41b-e8a146a6eee6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg"
Sep 11 01:05:20.401448 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.401414    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgg7c\" (UniqueName: \"kubernetes.io/projected/f2cb5f73-6740-4c56-b41b-e8a146a6eee6-kube-api-access-bgg7c\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-xkckg\" (UID: \"f2cb5f73-6740-4c56-b41b-e8a146a6eee6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg"
Sep 11 01:05:20.483711 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.483626    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg"
Sep 11 01:05:20.679289 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.679258    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg"]
Sep 11 01:05:20.697874 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:20.697839    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg"]
Sep 11 01:05:20.881527 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:05:20.881494    2565 log.go:32] "RunPodSandbox from runtime service failed" err=<
Sep 11 01:05:20.881527 ip-10-0-133-50 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-xkckg_kuadrant-system_f2cb5f73-6740-4c56-b41b-e8a146a6eee6_0(83f27df0152210dfd5668a80b8fda6bd6cb37326ce7fe055e423ec5a00eb25ff): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-xkckg to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"83f27df0152210dfd5668a80b8fda6bd6cb37326ce7fe055e423ec5a00eb25ff" Netns:"/var/run/netns/5b6801cf-c0da-4953-afc5-2d106c6b0b09" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-xkckg;K8S_POD_INFRA_CONTAINER_ID=83f27df0152210dfd5668a80b8fda6bd6cb37326ce7fe055e423ec5a00eb25ff;K8S_POD_UID=f2cb5f73-6740-4c56-b41b-e8a146a6eee6" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg/f2cb5f73-6740-4c56-b41b-e8a146a6eee6:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg 83f27df0152210dfd5668a80b8fda6bd6cb37326ce7fe055e423ec5a00eb25ff network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:86:00:26 [10.134.0.38/23]
Sep 11 01:05:20.881527 ip-10-0-133-50 kubenswrapper[2565]:         '
Sep 11 01:05:20.881527 ip-10-0-133-50 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 11 01:05:20.881527 ip-10-0-133-50 kubenswrapper[2565]:  >
Sep 11 01:05:20.881755 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:05:20.881562    2565 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Sep 11 01:05:20.881755 ip-10-0-133-50 kubenswrapper[2565]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-xkckg_kuadrant-system_f2cb5f73-6740-4c56-b41b-e8a146a6eee6_0(83f27df0152210dfd5668a80b8fda6bd6cb37326ce7fe055e423ec5a00eb25ff): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-xkckg to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"83f27df0152210dfd5668a80b8fda6bd6cb37326ce7fe055e423ec5a00eb25ff" Netns:"/var/run/netns/5b6801cf-c0da-4953-afc5-2d106c6b0b09" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-xkckg;K8S_POD_INFRA_CONTAINER_ID=83f27df0152210dfd5668a80b8fda6bd6cb37326ce7fe055e423ec5a00eb25ff;K8S_POD_UID=f2cb5f73-6740-4c56-b41b-e8a146a6eee6" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg/f2cb5f73-6740-4c56-b41b-e8a146a6eee6:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg 83f27df0152210dfd5668a80b8fda6bd6cb37326ce7fe055e423ec5a00eb25ff network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:86:00:26 [10.134.0.38/23]
Sep 11 01:05:20.881755 ip-10-0-133-50 kubenswrapper[2565]:         '
Sep 11 01:05:20.881755 ip-10-0-133-50 kubenswrapper[2565]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 11 01:05:20.881755 ip-10-0-133-50 kubenswrapper[2565]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg"
Sep 11 01:05:21.654236 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:21.654202    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg"
Sep 11 01:05:21.661925 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:21.661898    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg"
Sep 11 01:05:21.663918 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:05:21.663891    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-xkckg\" is forbidden: User \"system:node:ip-10-0-133-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-50.ec2.internal' and this object" podUID="f2cb5f73-6740-4c56-b41b-e8a146a6eee6" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg"
Sep 11 01:05:21.699743 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:21.699712    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2cb5f73-6740-4c56-b41b-e8a146a6eee6-extensions-socket-volume\") pod \"f2cb5f73-6740-4c56-b41b-e8a146a6eee6\" (UID: \"f2cb5f73-6740-4c56-b41b-e8a146a6eee6\") "
Sep 11 01:05:21.699898 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:21.699750    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgg7c\" (UniqueName: \"kubernetes.io/projected/f2cb5f73-6740-4c56-b41b-e8a146a6eee6-kube-api-access-bgg7c\") pod \"f2cb5f73-6740-4c56-b41b-e8a146a6eee6\" (UID: \"f2cb5f73-6740-4c56-b41b-e8a146a6eee6\") "
Sep 11 01:05:21.700018 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:21.699994    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2cb5f73-6740-4c56-b41b-e8a146a6eee6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f2cb5f73-6740-4c56-b41b-e8a146a6eee6" (UID: "f2cb5f73-6740-4c56-b41b-e8a146a6eee6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:05:21.701883 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:21.701854    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2cb5f73-6740-4c56-b41b-e8a146a6eee6-kube-api-access-bgg7c" (OuterVolumeSpecName: "kube-api-access-bgg7c") pod "f2cb5f73-6740-4c56-b41b-e8a146a6eee6" (UID: "f2cb5f73-6740-4c56-b41b-e8a146a6eee6"). InnerVolumeSpecName "kube-api-access-bgg7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:05:21.800853 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:21.800798    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2cb5f73-6740-4c56-b41b-e8a146a6eee6-extensions-socket-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:05:21.800853 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:21.800844    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgg7c\" (UniqueName: \"kubernetes.io/projected/f2cb5f73-6740-4c56-b41b-e8a146a6eee6-kube-api-access-bgg7c\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:05:22.658722 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:22.658690    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg"
Sep 11 01:05:22.663842 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:05:22.660895    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-xkckg\" is forbidden: User \"system:node:ip-10-0-133-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-50.ec2.internal' and this object" podUID="f2cb5f73-6740-4c56-b41b-e8a146a6eee6" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg"
Sep 11 01:05:22.670794 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:05:22.670764    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-xkckg\" is forbidden: User \"system:node:ip-10-0-133-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-50.ec2.internal' and this object" podUID="f2cb5f73-6740-4c56-b41b-e8a146a6eee6" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg"
Sep 11 01:05:23.470473 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:05:23.470436    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-xkckg\" is forbidden: User \"system:node:ip-10-0-133-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-50.ec2.internal' and this object" podUID="f2cb5f73-6740-4c56-b41b-e8a146a6eee6" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-xkckg"
Sep 11 01:05:23.471367 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:05:23.471345    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2cb5f73-6740-4c56-b41b-e8a146a6eee6" path="/var/lib/kubelet/pods/f2cb5f73-6740-4c56-b41b-e8a146a6eee6/volumes"
Sep 11 01:06:34.399574 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:34.399541    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55d86fb7c8-p4nnc"]
Sep 11 01:06:34.405365 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:34.405342    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d86fb7c8-p4nnc"
Sep 11 01:06:34.407946 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:34.407919    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 01:06:34.408072 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:34.407971    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 01:06:34.408072 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:34.408037    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 01:06:34.408072 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:34.408060    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wp4dg\""
Sep 11 01:06:34.413999 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:34.413975    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55d86fb7c8-p4nnc"]
Sep 11 01:06:34.503968 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:34.503923    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxkw6\" (UniqueName: \"kubernetes.io/projected/575e150a-0680-4ccc-9ca9-96def36fcb3d-kube-api-access-rxkw6\") pod \"maas-controller-55d86fb7c8-p4nnc\" (UID: \"575e150a-0680-4ccc-9ca9-96def36fcb3d\") " pod="opendatahub/maas-controller-55d86fb7c8-p4nnc"
Sep 11 01:06:34.504140 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:34.504041    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/575e150a-0680-4ccc-9ca9-96def36fcb3d-metrics-certs\") pod \"maas-controller-55d86fb7c8-p4nnc\" (UID: \"575e150a-0680-4ccc-9ca9-96def36fcb3d\") " pod="opendatahub/maas-controller-55d86fb7c8-p4nnc"
Sep 11 01:06:34.504140 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:34.504103    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/575e150a-0680-4ccc-9ca9-96def36fcb3d-webhook-cert\") pod \"maas-controller-55d86fb7c8-p4nnc\" (UID: \"575e150a-0680-4ccc-9ca9-96def36fcb3d\") " pod="opendatahub/maas-controller-55d86fb7c8-p4nnc"
Sep 11 01:06:34.605403 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:34.605361    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxkw6\" (UniqueName: \"kubernetes.io/projected/575e150a-0680-4ccc-9ca9-96def36fcb3d-kube-api-access-rxkw6\") pod \"maas-controller-55d86fb7c8-p4nnc\" (UID: \"575e150a-0680-4ccc-9ca9-96def36fcb3d\") " pod="opendatahub/maas-controller-55d86fb7c8-p4nnc"
Sep 11 01:06:34.605573 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:34.605460    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/575e150a-0680-4ccc-9ca9-96def36fcb3d-metrics-certs\") pod \"maas-controller-55d86fb7c8-p4nnc\" (UID: \"575e150a-0680-4ccc-9ca9-96def36fcb3d\") " pod="opendatahub/maas-controller-55d86fb7c8-p4nnc"
Sep 11 01:06:34.605573 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:34.605489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/575e150a-0680-4ccc-9ca9-96def36fcb3d-webhook-cert\") pod \"maas-controller-55d86fb7c8-p4nnc\" (UID: \"575e150a-0680-4ccc-9ca9-96def36fcb3d\") " pod="opendatahub/maas-controller-55d86fb7c8-p4nnc"
Sep 11 01:06:34.605644 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:06:34.605602    2565 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 11 01:06:34.605677 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:06:34.605658    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/575e150a-0680-4ccc-9ca9-96def36fcb3d-metrics-certs podName:575e150a-0680-4ccc-9ca9-96def36fcb3d nodeName:}" failed. No retries permitted until 2026-09-11 01:06:35.105641863 +0000 UTC m=+512.153730069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/575e150a-0680-4ccc-9ca9-96def36fcb3d-metrics-certs") pod "maas-controller-55d86fb7c8-p4nnc" (UID: "575e150a-0680-4ccc-9ca9-96def36fcb3d") : secret "maas-controller-metrics-tls" not found
Sep 11 01:06:34.605717 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:06:34.605602    2565 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 11 01:06:34.605770 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:06:34.605758    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/575e150a-0680-4ccc-9ca9-96def36fcb3d-webhook-cert podName:575e150a-0680-4ccc-9ca9-96def36fcb3d nodeName:}" failed. No retries permitted until 2026-09-11 01:06:35.105739943 +0000 UTC m=+512.153828156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/575e150a-0680-4ccc-9ca9-96def36fcb3d-webhook-cert") pod "maas-controller-55d86fb7c8-p4nnc" (UID: "575e150a-0680-4ccc-9ca9-96def36fcb3d") : secret "maas-controller-webhook-cert" not found
Sep 11 01:06:34.614393 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:34.614372    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxkw6\" (UniqueName: \"kubernetes.io/projected/575e150a-0680-4ccc-9ca9-96def36fcb3d-kube-api-access-rxkw6\") pod \"maas-controller-55d86fb7c8-p4nnc\" (UID: \"575e150a-0680-4ccc-9ca9-96def36fcb3d\") " pod="opendatahub/maas-controller-55d86fb7c8-p4nnc"
Sep 11 01:06:35.110270 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:35.110232    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/575e150a-0680-4ccc-9ca9-96def36fcb3d-metrics-certs\") pod \"maas-controller-55d86fb7c8-p4nnc\" (UID: \"575e150a-0680-4ccc-9ca9-96def36fcb3d\") " pod="opendatahub/maas-controller-55d86fb7c8-p4nnc"
Sep 11 01:06:35.110463 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:35.110284    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/575e150a-0680-4ccc-9ca9-96def36fcb3d-webhook-cert\") pod \"maas-controller-55d86fb7c8-p4nnc\" (UID: \"575e150a-0680-4ccc-9ca9-96def36fcb3d\") " pod="opendatahub/maas-controller-55d86fb7c8-p4nnc"
Sep 11 01:06:35.112806 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:35.112775    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/575e150a-0680-4ccc-9ca9-96def36fcb3d-webhook-cert\") pod \"maas-controller-55d86fb7c8-p4nnc\" (UID: \"575e150a-0680-4ccc-9ca9-96def36fcb3d\") " pod="opendatahub/maas-controller-55d86fb7c8-p4nnc"
Sep 11 01:06:35.112931 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:35.112775    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/575e150a-0680-4ccc-9ca9-96def36fcb3d-metrics-certs\") pod \"maas-controller-55d86fb7c8-p4nnc\" (UID: \"575e150a-0680-4ccc-9ca9-96def36fcb3d\") " pod="opendatahub/maas-controller-55d86fb7c8-p4nnc"
Sep 11 01:06:35.317294 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:35.317257    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d86fb7c8-p4nnc"
Sep 11 01:06:35.612838 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:35.612795    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55d86fb7c8-p4nnc"]
Sep 11 01:06:35.614464 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:06:35.614406    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod575e150a_0680_4ccc_9ca9_96def36fcb3d.slice/crio-c756e02a6e45b6f86119b10a4d0e1c1ccf4ff58ee8abf7054dc9430ebec3c13f WatchSource:0}: Error finding container c756e02a6e45b6f86119b10a4d0e1c1ccf4ff58ee8abf7054dc9430ebec3c13f: Status 404 returned error can't find the container with id c756e02a6e45b6f86119b10a4d0e1c1ccf4ff58ee8abf7054dc9430ebec3c13f
Sep 11 01:06:36.027484 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:36.027396    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d86fb7c8-p4nnc" event={"ID":"575e150a-0680-4ccc-9ca9-96def36fcb3d","Type":"ContainerStarted","Data":"c756e02a6e45b6f86119b10a4d0e1c1ccf4ff58ee8abf7054dc9430ebec3c13f"}
Sep 11 01:06:39.046141 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:39.046107    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d86fb7c8-p4nnc" event={"ID":"575e150a-0680-4ccc-9ca9-96def36fcb3d","Type":"ContainerStarted","Data":"af62acec63fc0b5214c481945c2b8760fb3853f25473cc22988939b62fe682b3"}
Sep 11 01:06:39.046509 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:39.046207    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55d86fb7c8-p4nnc"
Sep 11 01:06:39.063230 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:39.063183    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55d86fb7c8-p4nnc" podStartSLOduration=2.6530536270000002 podStartE2EDuration="5.063170187s" totalImagesPullingTime="2.41011656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:06:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:06:39.062198896 +0000 UTC m=+516.110287147" watchObservedRunningTime="2026-09-11 01:06:39.063170187 +0000 UTC m=+516.111258411"
Sep 11 01:06:49.952014 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:49.951979    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55d86fb7c8-p4nnc"]
Sep 11 01:06:49.952518 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:49.952203    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55d86fb7c8-p4nnc" podUID="575e150a-0680-4ccc-9ca9-96def36fcb3d" containerName="manager" containerID="cri-o://af62acec63fc0b5214c481945c2b8760fb3853f25473cc22988939b62fe682b3" gracePeriod=30
Sep 11 01:06:49.953862 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:49.953840    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55d86fb7c8-p4nnc"
Sep 11 01:06:50.103292 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:50.103248    2565 generic.go:356] "Generic (PLEG): container finished" podID="575e150a-0680-4ccc-9ca9-96def36fcb3d" containerID="af62acec63fc0b5214c481945c2b8760fb3853f25473cc22988939b62fe682b3" exitCode=0
Sep 11 01:06:50.103445 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:50.103313    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d86fb7c8-p4nnc" event={"ID":"575e150a-0680-4ccc-9ca9-96def36fcb3d","Type":"ContainerDied","Data":"af62acec63fc0b5214c481945c2b8760fb3853f25473cc22988939b62fe682b3"}
Sep 11 01:06:50.197240 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:50.197213    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d86fb7c8-p4nnc"
Sep 11 01:06:50.338500 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:50.338461    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/575e150a-0680-4ccc-9ca9-96def36fcb3d-webhook-cert\") pod \"575e150a-0680-4ccc-9ca9-96def36fcb3d\" (UID: \"575e150a-0680-4ccc-9ca9-96def36fcb3d\") "
Sep 11 01:06:50.338676 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:50.338521    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxkw6\" (UniqueName: \"kubernetes.io/projected/575e150a-0680-4ccc-9ca9-96def36fcb3d-kube-api-access-rxkw6\") pod \"575e150a-0680-4ccc-9ca9-96def36fcb3d\" (UID: \"575e150a-0680-4ccc-9ca9-96def36fcb3d\") "
Sep 11 01:06:50.338676 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:50.338551    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/575e150a-0680-4ccc-9ca9-96def36fcb3d-metrics-certs\") pod \"575e150a-0680-4ccc-9ca9-96def36fcb3d\" (UID: \"575e150a-0680-4ccc-9ca9-96def36fcb3d\") "
Sep 11 01:06:50.340856 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:50.340825    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/575e150a-0680-4ccc-9ca9-96def36fcb3d-kube-api-access-rxkw6" (OuterVolumeSpecName: "kube-api-access-rxkw6") pod "575e150a-0680-4ccc-9ca9-96def36fcb3d" (UID: "575e150a-0680-4ccc-9ca9-96def36fcb3d"). InnerVolumeSpecName "kube-api-access-rxkw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:06:50.340856 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:50.340842    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/575e150a-0680-4ccc-9ca9-96def36fcb3d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "575e150a-0680-4ccc-9ca9-96def36fcb3d" (UID: "575e150a-0680-4ccc-9ca9-96def36fcb3d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:06:50.340856 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:50.340852    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/575e150a-0680-4ccc-9ca9-96def36fcb3d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "575e150a-0680-4ccc-9ca9-96def36fcb3d" (UID: "575e150a-0680-4ccc-9ca9-96def36fcb3d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:06:50.440001 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:50.439971    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/575e150a-0680-4ccc-9ca9-96def36fcb3d-metrics-certs\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:06:50.440001 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:50.439997    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/575e150a-0680-4ccc-9ca9-96def36fcb3d-webhook-cert\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:06:50.440001 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:50.440008    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxkw6\" (UniqueName: \"kubernetes.io/projected/575e150a-0680-4ccc-9ca9-96def36fcb3d-kube-api-access-rxkw6\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:06:51.109027 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:51.108993    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d86fb7c8-p4nnc"
Sep 11 01:06:51.109489 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:51.109040    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d86fb7c8-p4nnc" event={"ID":"575e150a-0680-4ccc-9ca9-96def36fcb3d","Type":"ContainerDied","Data":"c756e02a6e45b6f86119b10a4d0e1c1ccf4ff58ee8abf7054dc9430ebec3c13f"}
Sep 11 01:06:51.109489 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:51.109093    2565 scope.go:117] "RemoveContainer" containerID="af62acec63fc0b5214c481945c2b8760fb3853f25473cc22988939b62fe682b3"
Sep 11 01:06:51.129333 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:51.129300    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55d86fb7c8-p4nnc"]
Sep 11 01:06:51.132889 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:51.132864    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55d86fb7c8-p4nnc"]
Sep 11 01:06:51.471155 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:06:51.471076    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="575e150a-0680-4ccc-9ca9-96def36fcb3d" path="/var/lib/kubelet/pods/575e150a-0680-4ccc-9ca9-96def36fcb3d/volumes"
Sep 11 01:07:10.039027 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.038994    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-wcfks"]
Sep 11 01:07:10.039518 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.039305    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="575e150a-0680-4ccc-9ca9-96def36fcb3d" containerName="manager"
Sep 11 01:07:10.039518 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.039317    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="575e150a-0680-4ccc-9ca9-96def36fcb3d" containerName="manager"
Sep 11 01:07:10.039518 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.039370    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="575e150a-0680-4ccc-9ca9-96def36fcb3d" containerName="manager"
Sep 11 01:07:10.043478 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.043460    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-wcfks"
Sep 11 01:07:10.045896 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.045872    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6czfm\""
Sep 11 01:07:10.045896 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.045887    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 11 01:07:10.051885 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.051863    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-wcfks"]
Sep 11 01:07:10.090115 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.090081    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-jmnn9"]
Sep 11 01:07:10.093400 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.093380    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jmnn9"
Sep 11 01:07:10.104856 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.104805    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-jmnn9"]
Sep 11 01:07:10.209168 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.209138    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0804bf91-e319-401b-8eff-7964f1dc0d8c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-wcfks\" (UID: \"0804bf91-e319-401b-8eff-7964f1dc0d8c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wcfks"
Sep 11 01:07:10.209168 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.209171    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b280d862-8dd9-4ca3-a01f-44c4199fab20-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-jmnn9\" (UID: \"b280d862-8dd9-4ca3-a01f-44c4199fab20\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jmnn9"
Sep 11 01:07:10.209387 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.209190    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfrj9\" (UniqueName: \"kubernetes.io/projected/b280d862-8dd9-4ca3-a01f-44c4199fab20-kube-api-access-zfrj9\") pod \"payload-pre-processing-59fbc47bf8-jmnn9\" (UID: \"b280d862-8dd9-4ca3-a01f-44c4199fab20\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jmnn9"
Sep 11 01:07:10.209387 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.209289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqq5d\" (UniqueName: \"kubernetes.io/projected/0804bf91-e319-401b-8eff-7964f1dc0d8c-kube-api-access-fqq5d\") pod \"payload-processing-5b54b7fbb7-wcfks\" (UID: \"0804bf91-e319-401b-8eff-7964f1dc0d8c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wcfks"
Sep 11 01:07:10.310497 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.310412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0804bf91-e319-401b-8eff-7964f1dc0d8c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-wcfks\" (UID: \"0804bf91-e319-401b-8eff-7964f1dc0d8c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wcfks"
Sep 11 01:07:10.310497 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.310450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b280d862-8dd9-4ca3-a01f-44c4199fab20-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-jmnn9\" (UID: \"b280d862-8dd9-4ca3-a01f-44c4199fab20\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jmnn9"
Sep 11 01:07:10.310497 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.310469    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfrj9\" (UniqueName: \"kubernetes.io/projected/b280d862-8dd9-4ca3-a01f-44c4199fab20-kube-api-access-zfrj9\") pod \"payload-pre-processing-59fbc47bf8-jmnn9\" (UID: \"b280d862-8dd9-4ca3-a01f-44c4199fab20\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jmnn9"
Sep 11 01:07:10.310767 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.310529    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqq5d\" (UniqueName: \"kubernetes.io/projected/0804bf91-e319-401b-8eff-7964f1dc0d8c-kube-api-access-fqq5d\") pod \"payload-processing-5b54b7fbb7-wcfks\" (UID: \"0804bf91-e319-401b-8eff-7964f1dc0d8c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wcfks"
Sep 11 01:07:10.311239 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.311219    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b280d862-8dd9-4ca3-a01f-44c4199fab20-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-jmnn9\" (UID: \"b280d862-8dd9-4ca3-a01f-44c4199fab20\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jmnn9"
Sep 11 01:07:10.311312 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.311219    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0804bf91-e319-401b-8eff-7964f1dc0d8c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-wcfks\" (UID: \"0804bf91-e319-401b-8eff-7964f1dc0d8c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wcfks"
Sep 11 01:07:10.322388 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.322358    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqq5d\" (UniqueName: \"kubernetes.io/projected/0804bf91-e319-401b-8eff-7964f1dc0d8c-kube-api-access-fqq5d\") pod \"payload-processing-5b54b7fbb7-wcfks\" (UID: \"0804bf91-e319-401b-8eff-7964f1dc0d8c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-wcfks"
Sep 11 01:07:10.322569 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.322546    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfrj9\" (UniqueName: \"kubernetes.io/projected/b280d862-8dd9-4ca3-a01f-44c4199fab20-kube-api-access-zfrj9\") pod \"payload-pre-processing-59fbc47bf8-jmnn9\" (UID: \"b280d862-8dd9-4ca3-a01f-44c4199fab20\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jmnn9"
Sep 11 01:07:10.355090 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.355061    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-wcfks"
Sep 11 01:07:10.404374 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.404345    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jmnn9"
Sep 11 01:07:10.625587 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.625558    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-wcfks"]
Sep 11 01:07:10.627201 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:07:10.627174    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0804bf91_e319_401b_8eff_7964f1dc0d8c.slice/crio-d18fe85fc4805168c9fc5b078cf9491eaffe000ed348afb967439f4721ff593a WatchSource:0}: Error finding container d18fe85fc4805168c9fc5b078cf9491eaffe000ed348afb967439f4721ff593a: Status 404 returned error can't find the container with id d18fe85fc4805168c9fc5b078cf9491eaffe000ed348afb967439f4721ff593a
Sep 11 01:07:10.679651 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:10.679627    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-jmnn9"]
Sep 11 01:07:10.681086 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:07:10.681065    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb280d862_8dd9_4ca3_a01f_44c4199fab20.slice/crio-c43039b43419ae033682e514f7cefd8c70d2a092a67d987244071c995ce7881c WatchSource:0}: Error finding container c43039b43419ae033682e514f7cefd8c70d2a092a67d987244071c995ce7881c: Status 404 returned error can't find the container with id c43039b43419ae033682e514f7cefd8c70d2a092a67d987244071c995ce7881c
Sep 11 01:07:11.208203 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:11.208155    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jmnn9" event={"ID":"b280d862-8dd9-4ca3-a01f-44c4199fab20","Type":"ContainerStarted","Data":"c43039b43419ae033682e514f7cefd8c70d2a092a67d987244071c995ce7881c"}
Sep 11 01:07:11.209405 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:11.209379    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-wcfks" event={"ID":"0804bf91-e319-401b-8eff-7964f1dc0d8c","Type":"ContainerStarted","Data":"d18fe85fc4805168c9fc5b078cf9491eaffe000ed348afb967439f4721ff593a"}
Sep 11 01:07:13.222361 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:13.222319    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-wcfks" event={"ID":"0804bf91-e319-401b-8eff-7964f1dc0d8c","Type":"ContainerStarted","Data":"f978cd71163056dd864efdd248ba07410692e05fc9bbbf0aeecc05ace5ae0014"}
Sep 11 01:07:13.222766 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:13.222391    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-wcfks"
Sep 11 01:07:13.224079 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:13.224052    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jmnn9" event={"ID":"b280d862-8dd9-4ca3-a01f-44c4199fab20","Type":"ContainerStarted","Data":"4767d18e17b94e0fcaaa4ba66a43ded337efa7721544504a81a373be5790bba7"}
Sep 11 01:07:13.224213 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:13.224164    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jmnn9"
Sep 11 01:07:13.239071 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:13.239022    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-wcfks" podStartSLOduration=1.361367566 podStartE2EDuration="3.238996793s" totalImagesPullingTime="1.877629227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:07:13.236637256 +0000 UTC m=+550.284725479" watchObservedRunningTime="2026-09-11 01:07:13.238996793 +0000 UTC m=+550.287085018"
Sep 11 01:07:13.255855 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:13.255797    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jmnn9" podStartSLOduration=1.426082204 podStartE2EDuration="3.255783343s" totalImagesPullingTime="1.829701139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:07:13.254030475 +0000 UTC m=+550.302118724" watchObservedRunningTime="2026-09-11 01:07:13.255783343 +0000 UTC m=+550.303871567"
Sep 11 01:07:24.231241 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:24.231208    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-wcfks"
Sep 11 01:07:24.231709 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:24.231361    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-jmnn9"
Sep 11 01:07:37.992114 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:37.992076    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"]
Sep 11 01:07:37.999478 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:37.999457    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:38.003154 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.003129    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 01:07:38.003364 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.003131    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lg79n\""
Sep 11 01:07:38.003518 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.003191    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 01:07:38.003635 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.003265    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 11 01:07:38.006218 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.006196    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"]
Sep 11 01:07:38.140188 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.140152    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbjns\" (UniqueName: \"kubernetes.io/projected/6dbfcc0c-9180-4538-8b1a-f478b23a936d-kube-api-access-kbjns\") pod \"e2e-distinct-simulated-kserve-59975d69f9-j4rmw\" (UID: \"6dbfcc0c-9180-4538-8b1a-f478b23a936d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:38.140356 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.140195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dbfcc0c-9180-4538-8b1a-f478b23a936d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-j4rmw\" (UID: \"6dbfcc0c-9180-4538-8b1a-f478b23a936d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:38.140356 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.140273    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dbfcc0c-9180-4538-8b1a-f478b23a936d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-j4rmw\" (UID: \"6dbfcc0c-9180-4538-8b1a-f478b23a936d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:38.140356 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.140328    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dbfcc0c-9180-4538-8b1a-f478b23a936d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-j4rmw\" (UID: \"6dbfcc0c-9180-4538-8b1a-f478b23a936d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:38.140485 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.140385    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dbfcc0c-9180-4538-8b1a-f478b23a936d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-j4rmw\" (UID: \"6dbfcc0c-9180-4538-8b1a-f478b23a936d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:38.140485 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.140411    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dbfcc0c-9180-4538-8b1a-f478b23a936d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-j4rmw\" (UID: \"6dbfcc0c-9180-4538-8b1a-f478b23a936d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:38.240871 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.240841    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dbfcc0c-9180-4538-8b1a-f478b23a936d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-j4rmw\" (UID: \"6dbfcc0c-9180-4538-8b1a-f478b23a936d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:38.240871 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.240873    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dbfcc0c-9180-4538-8b1a-f478b23a936d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-j4rmw\" (UID: \"6dbfcc0c-9180-4538-8b1a-f478b23a936d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:38.241093 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.240916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dbfcc0c-9180-4538-8b1a-f478b23a936d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-j4rmw\" (UID: \"6dbfcc0c-9180-4538-8b1a-f478b23a936d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:38.241093 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.240940    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dbfcc0c-9180-4538-8b1a-f478b23a936d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-j4rmw\" (UID: \"6dbfcc0c-9180-4538-8b1a-f478b23a936d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:38.241093 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.240986    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbjns\" (UniqueName: \"kubernetes.io/projected/6dbfcc0c-9180-4538-8b1a-f478b23a936d-kube-api-access-kbjns\") pod \"e2e-distinct-simulated-kserve-59975d69f9-j4rmw\" (UID: \"6dbfcc0c-9180-4538-8b1a-f478b23a936d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:38.241093 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.241015    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dbfcc0c-9180-4538-8b1a-f478b23a936d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-j4rmw\" (UID: \"6dbfcc0c-9180-4538-8b1a-f478b23a936d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:38.241290 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.241234    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dbfcc0c-9180-4538-8b1a-f478b23a936d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-j4rmw\" (UID: \"6dbfcc0c-9180-4538-8b1a-f478b23a936d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:38.241344 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.241296    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dbfcc0c-9180-4538-8b1a-f478b23a936d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-j4rmw\" (UID: \"6dbfcc0c-9180-4538-8b1a-f478b23a936d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:38.241344 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.241319    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dbfcc0c-9180-4538-8b1a-f478b23a936d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-j4rmw\" (UID: \"6dbfcc0c-9180-4538-8b1a-f478b23a936d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:38.243310 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.243258    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dbfcc0c-9180-4538-8b1a-f478b23a936d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-j4rmw\" (UID: \"6dbfcc0c-9180-4538-8b1a-f478b23a936d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:38.243521 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.243503    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dbfcc0c-9180-4538-8b1a-f478b23a936d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-j4rmw\" (UID: \"6dbfcc0c-9180-4538-8b1a-f478b23a936d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:38.249057 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.249038    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbjns\" (UniqueName: \"kubernetes.io/projected/6dbfcc0c-9180-4538-8b1a-f478b23a936d-kube-api-access-kbjns\") pod \"e2e-distinct-simulated-kserve-59975d69f9-j4rmw\" (UID: \"6dbfcc0c-9180-4538-8b1a-f478b23a936d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:38.310341 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.310304    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:38.581276 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:38.581239    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"]
Sep 11 01:07:38.584233 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:07:38.584204    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dbfcc0c_9180_4538_8b1a_f478b23a936d.slice/crio-e2f07905799df7a9faea24d9f04276f90e03175fc8e4ad4eb99c0ba6c099308b WatchSource:0}: Error finding container e2f07905799df7a9faea24d9f04276f90e03175fc8e4ad4eb99c0ba6c099308b: Status 404 returned error can't find the container with id e2f07905799df7a9faea24d9f04276f90e03175fc8e4ad4eb99c0ba6c099308b
Sep 11 01:07:39.354251 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:39.354187    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw" event={"ID":"6dbfcc0c-9180-4538-8b1a-f478b23a936d","Type":"ContainerStarted","Data":"e2f07905799df7a9faea24d9f04276f90e03175fc8e4ad4eb99c0ba6c099308b"}
Sep 11 01:07:40.361693 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:40.361658    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw" event={"ID":"6dbfcc0c-9180-4538-8b1a-f478b23a936d","Type":"ContainerStarted","Data":"a1a38ded8da00e5c484f945e28457dad29263ea62ad92fc5658ef8c8f9da0b0a"}
Sep 11 01:07:40.384902 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:40.384851    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw" podStartSLOduration=2.419358599 podStartE2EDuration="3.384834215s" totalImagesPullingTime="965.475616ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:07:40.38314371 +0000 UTC m=+577.431231934" watchObservedRunningTime="2026-09-11 01:07:40.384834215 +0000 UTC m=+577.432922431"
Sep 11 01:07:48.310694 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:48.310652    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:48.311197 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:48.310742    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:48.323313 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:48.323291    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:07:48.412978 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:07:48.412950    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-j4rmw"
Sep 11 01:08:03.424438 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:08:03.424404    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/1.log"
Sep 11 01:08:03.424438 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:08:03.424435    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/1.log"
Sep 11 01:09:56.993718 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:56.993638    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"]
Sep 11 01:09:56.997015 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:56.996975    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:56.999444 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:56.999423    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-cef92e-openshift-default-dockercfg-58hxj\""
Sep 11 01:09:57.011155 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.011131    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"]
Sep 11 01:09:57.035715 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.035683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-workload-certs\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.035715 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.035718    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-data\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.035922 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.035734    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-token\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.035922 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.035779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istiod-ca-cert\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.035922 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.035799    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c59l\" (UniqueName: \"kubernetes.io/projected/0db135f1-2ba1-404c-ab6b-fba56c6ec419-kube-api-access-8c59l\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.035922 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.035881    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-workload-socket\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.035922 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.035914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-podinfo\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.036115 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.035957    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-credential-socket\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.036115 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.035983    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-envoy\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.062287 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.062261    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"]
Sep 11 01:09:57.068411 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.068380    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.071978 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.071318    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-651569-openshift-default-dockercfg-c9cl6\""
Sep 11 01:09:57.077607 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.077575    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"]
Sep 11 01:09:57.137141 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.137109    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-workload-socket\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.137141 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.137140    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-workload-certs\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.137352 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.137157    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-token\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.137352 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.137176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-credential-socket\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.137352 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.137230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istiod-ca-cert\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.137352 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.137266    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh8wx\" (UniqueName: \"kubernetes.io/projected/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-kube-api-access-kh8wx\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.137352 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.137302    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-workload-certs\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.137352 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.137319    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-data\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.137352 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.137334    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-token\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.137352 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.137352    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istiod-ca-cert\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.137754 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.137369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c59l\" (UniqueName: \"kubernetes.io/projected/0db135f1-2ba1-404c-ab6b-fba56c6ec419-kube-api-access-8c59l\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.137754 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.137528    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-envoy\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.137754 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.137558    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-data\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.137754 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.137599    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-podinfo\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.137754 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.137631    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-workload-socket\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.137754 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.137681    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-podinfo\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.137754 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.137745    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-credential-socket\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.137754 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.137742    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-workload-certs\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.138290 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.137799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-envoy\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.138290 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.137984    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-data\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.138290 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.138035    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-credential-socket\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.138290 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.138088    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-workload-socket\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.138290 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.138126    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istiod-ca-cert\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.140049 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.140026    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-envoy\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.140470 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.140451    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-podinfo\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.145650 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.145626    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c59l\" (UniqueName: \"kubernetes.io/projected/0db135f1-2ba1-404c-ab6b-fba56c6ec419-kube-api-access-8c59l\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.148981 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.148960    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-token\") pod \"e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") " pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.238722 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.238686    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-workload-socket\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.238722 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.238721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-workload-certs\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.239024 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.238736    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-token\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.239024 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.238754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-credential-socket\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.239024 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.238799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istiod-ca-cert\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.239024 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.238857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh8wx\" (UniqueName: \"kubernetes.io/projected/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-kube-api-access-kh8wx\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.239024 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.238906    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-envoy\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.239024 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.238929    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-data\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.239024 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.238972    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-podinfo\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.239418 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.239227    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-workload-certs\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.239418 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.239228    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-workload-socket\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.239418 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.239294    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-data\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.239579 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.239426    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-credential-socket\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.239922 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.239900    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istiod-ca-cert\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.241506 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.241460    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-envoy\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.241925 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.241906    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-podinfo\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.255659 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.255602    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-token\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.255787 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.255765    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh8wx\" (UniqueName: \"kubernetes.io/projected/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-kube-api-access-kh8wx\") pod \"e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") " pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.308392 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.308360    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:57.382648 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.382425    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:57.584469 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.584128    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"]
Sep 11 01:09:57.586235 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:09:57.586205    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db135f1_2ba1_404c_ab6b_fba56c6ec419.slice/crio-b7818feab04a92e24fcdff592dd43659bec95e79a28f9e55bee013a366c70304 WatchSource:0}: Error finding container b7818feab04a92e24fcdff592dd43659bec95e79a28f9e55bee013a366c70304: Status 404 returned error can't find the container with id b7818feab04a92e24fcdff592dd43659bec95e79a28f9e55bee013a366c70304
Sep 11 01:09:57.588929 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.588890    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:09:57.589010 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.588961    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:09:57.589010 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.588987    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:09:57.662292 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.662264    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"]
Sep 11 01:09:57.663653 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:09:57.663626    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod438eba62_ffb0_4bf7_ac00_60f8f10a11f6.slice/crio-48765210a3eef96eddbd24b35b992f934bea57302f71ab4ec1a946500d7302eb WatchSource:0}: Error finding container 48765210a3eef96eddbd24b35b992f934bea57302f71ab4ec1a946500d7302eb: Status 404 returned error can't find the container with id 48765210a3eef96eddbd24b35b992f934bea57302f71ab4ec1a946500d7302eb
Sep 11 01:09:57.665998 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.665958    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:09:57.666121 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.666046    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:09:57.666121 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:57.666090    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:09:58.046253 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:58.046218    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc" event={"ID":"0db135f1-2ba1-404c-ab6b-fba56c6ec419","Type":"ContainerStarted","Data":"a2e5c0ba6a85d855a6a4c5388cbfea21dc989b394cc38cc8c5da56e9e79355b8"}
Sep 11 01:09:58.046701 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:58.046276    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc" event={"ID":"0db135f1-2ba1-404c-ab6b-fba56c6ec419","Type":"ContainerStarted","Data":"b7818feab04a92e24fcdff592dd43659bec95e79a28f9e55bee013a366c70304"}
Sep 11 01:09:58.047782 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:58.047760    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf" event={"ID":"438eba62-ffb0-4bf7-ac00-60f8f10a11f6","Type":"ContainerStarted","Data":"0007b95f0c8c0186099c9f7d48cd2fe5eec4df43c55c4a1737ad0c1ee058e3dd"}
Sep 11 01:09:58.047890 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:58.047807    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf" event={"ID":"438eba62-ffb0-4bf7-ac00-60f8f10a11f6","Type":"ContainerStarted","Data":"48765210a3eef96eddbd24b35b992f934bea57302f71ab4ec1a946500d7302eb"}
Sep 11 01:09:58.073640 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:58.073593    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc" podStartSLOduration=2.073574964 podStartE2EDuration="2.073574964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:09:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:09:58.071037228 +0000 UTC m=+715.119125471" watchObservedRunningTime="2026-09-11 01:09:58.073574964 +0000 UTC m=+715.121663188"
Sep 11 01:09:58.108241 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:58.108179    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf" podStartSLOduration=1.108160722 podStartE2EDuration="1.108160722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:09:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:09:58.105193817 +0000 UTC m=+715.153282096" watchObservedRunningTime="2026-09-11 01:09:58.108160722 +0000 UTC m=+715.156249006"
Sep 11 01:09:58.309631 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:58.309548    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:58.314737 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:58.314711    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:58.383616 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:58.383585    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:58.388385 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:58.388362    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:59.052826 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:59.052792    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:59.053260 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:59.052871    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:09:59.053484 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:59.053467    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:09:59.053540 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:09:59.053516    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:10:02.188158 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.188119    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp"]
Sep 11 01:10:02.191410 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.191391    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp"
Sep 11 01:10:02.193921 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.193896    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-651569\""
Sep 11 01:10:02.207045 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.207015    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp"]
Sep 11 01:10:02.213540 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.213513    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk"]
Sep 11 01:10:02.217461 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.217439    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk"
Sep 11 01:10:02.219881 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.219858    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-651569-dockercfg-zmvlb\""
Sep 11 01:10:02.227419 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.227221    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk"]
Sep 11 01:10:02.281922 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.281883    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khm9j\" (UniqueName: \"kubernetes.io/projected/3f82db2c-1a10-465b-a339-cf42289489f8-kube-api-access-khm9j\") pod \"payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk\" (UID: \"3f82db2c-1a10-465b-a339-cf42289489f8\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk"
Sep 11 01:10:02.282084 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.281928    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f82db2c-1a10-465b-a339-cf42289489f8-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk\" (UID: \"3f82db2c-1a10-465b-a339-cf42289489f8\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk"
Sep 11 01:10:02.282084 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.281954    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f524\" (UniqueName: \"kubernetes.io/projected/69d5c781-c8be-4f1c-868e-18e6aacfdd91-kube-api-access-7f524\") pod \"payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp\" (UID: \"69d5c781-c8be-4f1c-868e-18e6aacfdd91\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp"
Sep 11 01:10:02.282084 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.282013    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69d5c781-c8be-4f1c-868e-18e6aacfdd91-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp\" (UID: \"69d5c781-c8be-4f1c-868e-18e6aacfdd91\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp"
Sep 11 01:10:02.382731 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.382696    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f82db2c-1a10-465b-a339-cf42289489f8-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk\" (UID: \"3f82db2c-1a10-465b-a339-cf42289489f8\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk"
Sep 11 01:10:02.382731 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.382739    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f524\" (UniqueName: \"kubernetes.io/projected/69d5c781-c8be-4f1c-868e-18e6aacfdd91-kube-api-access-7f524\") pod \"payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp\" (UID: \"69d5c781-c8be-4f1c-868e-18e6aacfdd91\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp"
Sep 11 01:10:02.382973 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.382862    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69d5c781-c8be-4f1c-868e-18e6aacfdd91-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp\" (UID: \"69d5c781-c8be-4f1c-868e-18e6aacfdd91\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp"
Sep 11 01:10:02.383013 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.382994    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khm9j\" (UniqueName: \"kubernetes.io/projected/3f82db2c-1a10-465b-a339-cf42289489f8-kube-api-access-khm9j\") pod \"payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk\" (UID: \"3f82db2c-1a10-465b-a339-cf42289489f8\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk"
Sep 11 01:10:02.383426 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.383408    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f82db2c-1a10-465b-a339-cf42289489f8-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk\" (UID: \"3f82db2c-1a10-465b-a339-cf42289489f8\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk"
Sep 11 01:10:02.383627 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.383611    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69d5c781-c8be-4f1c-868e-18e6aacfdd91-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp\" (UID: \"69d5c781-c8be-4f1c-868e-18e6aacfdd91\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp"
Sep 11 01:10:02.391338 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.391305    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khm9j\" (UniqueName: \"kubernetes.io/projected/3f82db2c-1a10-465b-a339-cf42289489f8-kube-api-access-khm9j\") pod \"payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk\" (UID: \"3f82db2c-1a10-465b-a339-cf42289489f8\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk"
Sep 11 01:10:02.391461 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.391314    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f524\" (UniqueName: \"kubernetes.io/projected/69d5c781-c8be-4f1c-868e-18e6aacfdd91-kube-api-access-7f524\") pod \"payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp\" (UID: \"69d5c781-c8be-4f1c-868e-18e6aacfdd91\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp"
Sep 11 01:10:02.505410 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.505298    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp"
Sep 11 01:10:02.531661 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.531634    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk"
Sep 11 01:10:02.782037 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.782005    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp"]
Sep 11 01:10:02.783754 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:10:02.783726    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69d5c781_c8be_4f1c_868e_18e6aacfdd91.slice/crio-f4ea7e9267abd6bd25f36433954d666480ca26a116fc5d10b58cd6f043a384fc WatchSource:0}: Error finding container f4ea7e9267abd6bd25f36433954d666480ca26a116fc5d10b58cd6f043a384fc: Status 404 returned error can't find the container with id f4ea7e9267abd6bd25f36433954d666480ca26a116fc5d10b58cd6f043a384fc
Sep 11 01:10:02.820331 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:02.820258    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk"]
Sep 11 01:10:02.825961 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:10:02.825924    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f82db2c_1a10_465b_a339_cf42289489f8.slice/crio-bcc4bc32f50cb27488bb95a7bcc9326d10006e2a9ccc3fdd4284ad3cfe557c04 WatchSource:0}: Error finding container bcc4bc32f50cb27488bb95a7bcc9326d10006e2a9ccc3fdd4284ad3cfe557c04: Status 404 returned error can't find the container with id bcc4bc32f50cb27488bb95a7bcc9326d10006e2a9ccc3fdd4284ad3cfe557c04
Sep 11 01:10:03.078770 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.078731    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp" event={"ID":"69d5c781-c8be-4f1c-868e-18e6aacfdd91","Type":"ContainerStarted","Data":"d2958c92b3d4791a53cb99fed32e2fd7d1cb670b1ca5fdb005c29d223a1bd15b"}
Sep 11 01:10:03.078962 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.078888    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp"
Sep 11 01:10:03.078962 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.078945    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp" event={"ID":"69d5c781-c8be-4f1c-868e-18e6aacfdd91","Type":"ContainerStarted","Data":"f4ea7e9267abd6bd25f36433954d666480ca26a116fc5d10b58cd6f043a384fc"}
Sep 11 01:10:03.080514 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.080488    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk" event={"ID":"3f82db2c-1a10-465b-a339-cf42289489f8","Type":"ContainerStarted","Data":"b3e89024699b004a7d482a483b5d388e21ca1ce1dde6d7b039222158e32eb05f"}
Sep 11 01:10:03.080640 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.080526    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk" event={"ID":"3f82db2c-1a10-465b-a339-cf42289489f8","Type":"ContainerStarted","Data":"bcc4bc32f50cb27488bb95a7bcc9326d10006e2a9ccc3fdd4284ad3cfe557c04"}
Sep 11 01:10:03.080640 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.080566    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk"
Sep 11 01:10:03.099560 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.099510    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp" podStartSLOduration=1.099495436 podStartE2EDuration="1.099495436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:10:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:10:03.097634098 +0000 UTC m=+720.145722337" watchObservedRunningTime="2026-09-11 01:10:03.099495436 +0000 UTC m=+720.147583705"
Sep 11 01:10:03.114628 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.114601    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d"]
Sep 11 01:10:03.116844 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.116780    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk" podStartSLOduration=1.116761996 podStartE2EDuration="1.116761996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:10:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:10:03.11369455 +0000 UTC m=+720.161782772" watchObservedRunningTime="2026-09-11 01:10:03.116761996 +0000 UTC m=+720.164850222"
Sep 11 01:10:03.118174 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.118156    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d"
Sep 11 01:10:03.120581 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.120558    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-cef92e\""
Sep 11 01:10:03.120668 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.120612    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-cef92e-dockercfg-db62q\""
Sep 11 01:10:03.128010 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.127990    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d"]
Sep 11 01:10:03.145078 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.145049    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7"]
Sep 11 01:10:03.149171 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.149150    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7"
Sep 11 01:10:03.159863 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.159832    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7"]
Sep 11 01:10:03.190641 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.190609    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9850b82e-399f-431b-a6a2-8e7f8804d469-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d\" (UID: \"9850b82e-399f-431b-a6a2-8e7f8804d469\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d"
Sep 11 01:10:03.191096 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.190647    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3529ea03-099d-4392-b1a7-8e8afee3cfe8-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7\" (UID: \"3529ea03-099d-4392-b1a7-8e8afee3cfe8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7"
Sep 11 01:10:03.191096 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.190852    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7q7h\" (UniqueName: \"kubernetes.io/projected/3529ea03-099d-4392-b1a7-8e8afee3cfe8-kube-api-access-f7q7h\") pod \"payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7\" (UID: \"3529ea03-099d-4392-b1a7-8e8afee3cfe8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7"
Sep 11 01:10:03.191096 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.190903    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjvxb\" (UniqueName: \"kubernetes.io/projected/9850b82e-399f-431b-a6a2-8e7f8804d469-kube-api-access-gjvxb\") pod \"payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d\" (UID: \"9850b82e-399f-431b-a6a2-8e7f8804d469\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d"
Sep 11 01:10:03.291650 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.291614    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9850b82e-399f-431b-a6a2-8e7f8804d469-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d\" (UID: \"9850b82e-399f-431b-a6a2-8e7f8804d469\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d"
Sep 11 01:10:03.291650 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.291656    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3529ea03-099d-4392-b1a7-8e8afee3cfe8-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7\" (UID: \"3529ea03-099d-4392-b1a7-8e8afee3cfe8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7"
Sep 11 01:10:03.291938 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.291719    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7q7h\" (UniqueName: \"kubernetes.io/projected/3529ea03-099d-4392-b1a7-8e8afee3cfe8-kube-api-access-f7q7h\") pod \"payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7\" (UID: \"3529ea03-099d-4392-b1a7-8e8afee3cfe8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7"
Sep 11 01:10:03.291938 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.291737    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjvxb\" (UniqueName: \"kubernetes.io/projected/9850b82e-399f-431b-a6a2-8e7f8804d469-kube-api-access-gjvxb\") pod \"payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d\" (UID: \"9850b82e-399f-431b-a6a2-8e7f8804d469\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d"
Sep 11 01:10:03.292438 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.292408    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3529ea03-099d-4392-b1a7-8e8afee3cfe8-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7\" (UID: \"3529ea03-099d-4392-b1a7-8e8afee3cfe8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7"
Sep 11 01:10:03.292535 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.292453    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9850b82e-399f-431b-a6a2-8e7f8804d469-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d\" (UID: \"9850b82e-399f-431b-a6a2-8e7f8804d469\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d"
Sep 11 01:10:03.302286 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.302262    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjvxb\" (UniqueName: \"kubernetes.io/projected/9850b82e-399f-431b-a6a2-8e7f8804d469-kube-api-access-gjvxb\") pod \"payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d\" (UID: \"9850b82e-399f-431b-a6a2-8e7f8804d469\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d"
Sep 11 01:10:03.302383 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.302332    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7q7h\" (UniqueName: \"kubernetes.io/projected/3529ea03-099d-4392-b1a7-8e8afee3cfe8-kube-api-access-f7q7h\") pod \"payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7\" (UID: \"3529ea03-099d-4392-b1a7-8e8afee3cfe8\") " pod="openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7"
Sep 11 01:10:03.431603 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.431528    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-cef92e-dockercfg-db62q\""
Sep 11 01:10:03.439479 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.439460    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d"
Sep 11 01:10:03.460645 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.460619    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7"
Sep 11 01:10:03.722458 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.722431    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d"]
Sep 11 01:10:03.724233 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:10:03.724209    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9850b82e_399f_431b_a6a2_8e7f8804d469.slice/crio-25913897b94d0a42748dc0a363a22245ac38280ca116d4ae9af3045c1b6c0444 WatchSource:0}: Error finding container 25913897b94d0a42748dc0a363a22245ac38280ca116d4ae9af3045c1b6c0444: Status 404 returned error can't find the container with id 25913897b94d0a42748dc0a363a22245ac38280ca116d4ae9af3045c1b6c0444
Sep 11 01:10:03.757974 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:03.757944    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7"]
Sep 11 01:10:03.758440 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:10:03.758418    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3529ea03_099d_4392_b1a7_8e8afee3cfe8.slice/crio-0a9c34f832e0f7be3044efe51faccc640663b2789a44ac25447dda42ebb6048d WatchSource:0}: Error finding container 0a9c34f832e0f7be3044efe51faccc640663b2789a44ac25447dda42ebb6048d: Status 404 returned error can't find the container with id 0a9c34f832e0f7be3044efe51faccc640663b2789a44ac25447dda42ebb6048d
Sep 11 01:10:04.090126 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:04.090085    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7" event={"ID":"3529ea03-099d-4392-b1a7-8e8afee3cfe8","Type":"ContainerStarted","Data":"cf6b69cd80d0a62942a313acfbd8ae0c9f9ab3dae175ba60289e0e21d6250d6a"}
Sep 11 01:10:04.090321 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:04.090146    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7" event={"ID":"3529ea03-099d-4392-b1a7-8e8afee3cfe8","Type":"ContainerStarted","Data":"0a9c34f832e0f7be3044efe51faccc640663b2789a44ac25447dda42ebb6048d"}
Sep 11 01:10:04.090321 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:04.090232    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7"
Sep 11 01:10:04.091986 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:04.091949    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d" event={"ID":"9850b82e-399f-431b-a6a2-8e7f8804d469","Type":"ContainerStarted","Data":"32e37ed4f6c74462c6e11fb58a9080bf4c5d0fb8325c6e4375a6ee669f8323c8"}
Sep 11 01:10:04.092221 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:04.092201    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d"
Sep 11 01:10:04.092322 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:04.092250    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d" event={"ID":"9850b82e-399f-431b-a6a2-8e7f8804d469","Type":"ContainerStarted","Data":"25913897b94d0a42748dc0a363a22245ac38280ca116d4ae9af3045c1b6c0444"}
Sep 11 01:10:04.110105 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:04.110053    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7" podStartSLOduration=1.11003748 podStartE2EDuration="1.11003748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:10:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:10:04.109155924 +0000 UTC m=+721.157244176" watchObservedRunningTime="2026-09-11 01:10:04.11003748 +0000 UTC m=+721.158125707"
Sep 11 01:10:04.135658 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:04.134626    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d" podStartSLOduration=1.13460374 podStartE2EDuration="1.13460374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:10:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:10:04.133979344 +0000 UTC m=+721.182067593" watchObservedRunningTime="2026-09-11 01:10:04.13460374 +0000 UTC m=+721.182691970"
Sep 11 01:10:04.313199 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:04.313160    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf"]
Sep 11 01:10:04.316649 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:04.316629    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf"
Sep 11 01:10:04.319665 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:04.319640    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-6ba087-dockercfg-kxjhm\""
Sep 11 01:10:04.319768 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:04.319689    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-6ba087\""
Sep 11 01:10:04.328213 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:04.328190    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf"]
Sep 11 01:10:04.403468 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:04.403374    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71155bc3-28cd-4229-8f79-4fd11c3cf88c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf\" (UID: \"71155bc3-28cd-4229-8f79-4fd11c3cf88c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf"
Sep 11 01:10:04.403468 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:04.403442    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n47nx\" (UniqueName: \"kubernetes.io/projected/71155bc3-28cd-4229-8f79-4fd11c3cf88c-kube-api-access-n47nx\") pod \"payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf\" (UID: \"71155bc3-28cd-4229-8f79-4fd11c3cf88c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf"
Sep 11 01:10:04.505015 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:04.504978    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71155bc3-28cd-4229-8f79-4fd11c3cf88c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf\" (UID: \"71155bc3-28cd-4229-8f79-4fd11c3cf88c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf"
Sep 11 01:10:04.505183 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:04.505026    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n47nx\" (UniqueName: \"kubernetes.io/projected/71155bc3-28cd-4229-8f79-4fd11c3cf88c-kube-api-access-n47nx\") pod \"payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf\" (UID: \"71155bc3-28cd-4229-8f79-4fd11c3cf88c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf"
Sep 11 01:10:04.505913 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:04.505890    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71155bc3-28cd-4229-8f79-4fd11c3cf88c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf\" (UID: \"71155bc3-28cd-4229-8f79-4fd11c3cf88c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf"
Sep 11 01:10:04.514394 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:04.514368    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n47nx\" (UniqueName: \"kubernetes.io/projected/71155bc3-28cd-4229-8f79-4fd11c3cf88c-kube-api-access-n47nx\") pod \"payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf\" (UID: \"71155bc3-28cd-4229-8f79-4fd11c3cf88c\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf"
Sep 11 01:10:04.628462 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:04.628423    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf"
Sep 11 01:10:04.919685 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:04.919645    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf"]
Sep 11 01:10:04.921396 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:10:04.921370    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71155bc3_28cd_4229_8f79_4fd11c3cf88c.slice/crio-09f16b8f02de65afcd07c7a1f6f2c3f27ead63c3bc08d1b3344e9a41766ca585 WatchSource:0}: Error finding container 09f16b8f02de65afcd07c7a1f6f2c3f27ead63c3bc08d1b3344e9a41766ca585: Status 404 returned error can't find the container with id 09f16b8f02de65afcd07c7a1f6f2c3f27ead63c3bc08d1b3344e9a41766ca585
Sep 11 01:10:05.106573 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:05.106019    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf" event={"ID":"71155bc3-28cd-4229-8f79-4fd11c3cf88c","Type":"ContainerStarted","Data":"283d2ccb833d2ff3ab401a6f482f2bb1434a7ba27c73d2fc4f971e4ffa6f525c"}
Sep 11 01:10:05.106573 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:05.106076    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf" event={"ID":"71155bc3-28cd-4229-8f79-4fd11c3cf88c","Type":"ContainerStarted","Data":"09f16b8f02de65afcd07c7a1f6f2c3f27ead63c3bc08d1b3344e9a41766ca585"}
Sep 11 01:10:05.106573 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:05.106526    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf"
Sep 11 01:10:05.125344 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:05.124313    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf" podStartSLOduration=1.124287395 podStartE2EDuration="1.124287395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:10:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:10:05.123330652 +0000 UTC m=+722.171418877" watchObservedRunningTime="2026-09-11 01:10:05.124287395 +0000 UTC m=+722.172375621"
Sep 11 01:10:10.523181 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:10.523144    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd"]
Sep 11 01:10:10.526806 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:10.526789    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd"
Sep 11 01:10:10.530047 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:10.530025    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-dc7dcd-dockercfg-8jnck\""
Sep 11 01:10:10.530137 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:10.530060    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-dc7dcd\""
Sep 11 01:10:10.537282 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:10.537257    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd"]
Sep 11 01:10:10.573075 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:10.573033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/492449bf-2102-4169-b0b4-f32b86c9f0b9-plugins-config-volume\") pod \"payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd\" (UID: \"492449bf-2102-4169-b0b4-f32b86c9f0b9\") " pod="openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd"
Sep 11 01:10:10.573212 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:10.573163    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg6z2\" (UniqueName: \"kubernetes.io/projected/492449bf-2102-4169-b0b4-f32b86c9f0b9-kube-api-access-fg6z2\") pod \"payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd\" (UID: \"492449bf-2102-4169-b0b4-f32b86c9f0b9\") " pod="openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd"
Sep 11 01:10:10.674398 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:10.674366    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/492449bf-2102-4169-b0b4-f32b86c9f0b9-plugins-config-volume\") pod \"payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd\" (UID: \"492449bf-2102-4169-b0b4-f32b86c9f0b9\") " pod="openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd"
Sep 11 01:10:10.674552 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:10.674455    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg6z2\" (UniqueName: \"kubernetes.io/projected/492449bf-2102-4169-b0b4-f32b86c9f0b9-kube-api-access-fg6z2\") pod \"payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd\" (UID: \"492449bf-2102-4169-b0b4-f32b86c9f0b9\") " pod="openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd"
Sep 11 01:10:10.675122 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:10.675102    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/492449bf-2102-4169-b0b4-f32b86c9f0b9-plugins-config-volume\") pod \"payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd\" (UID: \"492449bf-2102-4169-b0b4-f32b86c9f0b9\") " pod="openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd"
Sep 11 01:10:10.682725 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:10.682692    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg6z2\" (UniqueName: \"kubernetes.io/projected/492449bf-2102-4169-b0b4-f32b86c9f0b9-kube-api-access-fg6z2\") pod \"payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd\" (UID: \"492449bf-2102-4169-b0b4-f32b86c9f0b9\") " pod="openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd"
Sep 11 01:10:10.838378 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:10.838347    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd"
Sep 11 01:10:11.170711 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:11.170675    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd"]
Sep 11 01:10:11.171169 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:10:11.171145    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod492449bf_2102_4169_b0b4_f32b86c9f0b9.slice/crio-d6efc09bfb9fbaa60c55c2d82c714c1c54942d0f7e0602d27e9a2b575f24bdf3 WatchSource:0}: Error finding container d6efc09bfb9fbaa60c55c2d82c714c1c54942d0f7e0602d27e9a2b575f24bdf3: Status 404 returned error can't find the container with id d6efc09bfb9fbaa60c55c2d82c714c1c54942d0f7e0602d27e9a2b575f24bdf3
Sep 11 01:10:12.077032 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.076988    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2"]
Sep 11 01:10:12.080653 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.080629    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2"
Sep 11 01:10:12.083123 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.083097    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-0bc9acd8\""
Sep 11 01:10:12.083259 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.083098    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-0bc9acd8-dockercfg-xq8hc\""
Sep 11 01:10:12.089598 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.089575    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2"]
Sep 11 01:10:12.128607 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.128572    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn"]
Sep 11 01:10:12.132196 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.132176    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn"
Sep 11 01:10:12.142033 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.142010    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn"]
Sep 11 01:10:12.143755 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.143706    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd" event={"ID":"492449bf-2102-4169-b0b4-f32b86c9f0b9","Type":"ContainerStarted","Data":"01f5b1b8d001008490d23fcb396179672c086353cc5743a721ff7f449a3f7c6e"}
Sep 11 01:10:12.143755 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.143748    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd" event={"ID":"492449bf-2102-4169-b0b4-f32b86c9f0b9","Type":"ContainerStarted","Data":"d6efc09bfb9fbaa60c55c2d82c714c1c54942d0f7e0602d27e9a2b575f24bdf3"}
Sep 11 01:10:12.171070 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.143794    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd"
Sep 11 01:10:12.188600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.188465    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg49n\" (UniqueName: \"kubernetes.io/projected/114a39a7-b7a7-4acc-a25c-81bb71a0cac3-kube-api-access-tg49n\") pod \"payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn\" (UID: \"114a39a7-b7a7-4acc-a25c-81bb71a0cac3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn"
Sep 11 01:10:12.188600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.188522    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/114a39a7-b7a7-4acc-a25c-81bb71a0cac3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn\" (UID: \"114a39a7-b7a7-4acc-a25c-81bb71a0cac3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn"
Sep 11 01:10:12.188600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.188577    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fda9ced7-8fc9-4367-8b20-c2eea18c1423-plugins-config-volume\") pod \"payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2\" (UID: \"fda9ced7-8fc9-4367-8b20-c2eea18c1423\") " pod="openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2"
Sep 11 01:10:12.188600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.188608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbh5l\" (UniqueName: \"kubernetes.io/projected/fda9ced7-8fc9-4367-8b20-c2eea18c1423-kube-api-access-hbh5l\") pod \"payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2\" (UID: \"fda9ced7-8fc9-4367-8b20-c2eea18c1423\") " pod="openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2"
Sep 11 01:10:12.290061 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.290026    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbh5l\" (UniqueName: \"kubernetes.io/projected/fda9ced7-8fc9-4367-8b20-c2eea18c1423-kube-api-access-hbh5l\") pod \"payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2\" (UID: \"fda9ced7-8fc9-4367-8b20-c2eea18c1423\") " pod="openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2"
Sep 11 01:10:12.290246 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.290141    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg49n\" (UniqueName: \"kubernetes.io/projected/114a39a7-b7a7-4acc-a25c-81bb71a0cac3-kube-api-access-tg49n\") pod \"payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn\" (UID: \"114a39a7-b7a7-4acc-a25c-81bb71a0cac3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn"
Sep 11 01:10:12.290246 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.290174    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/114a39a7-b7a7-4acc-a25c-81bb71a0cac3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn\" (UID: \"114a39a7-b7a7-4acc-a25c-81bb71a0cac3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn"
Sep 11 01:10:12.290246 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.290222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fda9ced7-8fc9-4367-8b20-c2eea18c1423-plugins-config-volume\") pod \"payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2\" (UID: \"fda9ced7-8fc9-4367-8b20-c2eea18c1423\") " pod="openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2"
Sep 11 01:10:12.290975 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.290948    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fda9ced7-8fc9-4367-8b20-c2eea18c1423-plugins-config-volume\") pod \"payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2\" (UID: \"fda9ced7-8fc9-4367-8b20-c2eea18c1423\") " pod="openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2"
Sep 11 01:10:12.290975 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.290970    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/114a39a7-b7a7-4acc-a25c-81bb71a0cac3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn\" (UID: \"114a39a7-b7a7-4acc-a25c-81bb71a0cac3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn"
Sep 11 01:10:12.299525 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.299170    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbh5l\" (UniqueName: \"kubernetes.io/projected/fda9ced7-8fc9-4367-8b20-c2eea18c1423-kube-api-access-hbh5l\") pod \"payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2\" (UID: \"fda9ced7-8fc9-4367-8b20-c2eea18c1423\") " pod="openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2"
Sep 11 01:10:12.299525 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.299279    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg49n\" (UniqueName: \"kubernetes.io/projected/114a39a7-b7a7-4acc-a25c-81bb71a0cac3-kube-api-access-tg49n\") pod \"payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn\" (UID: \"114a39a7-b7a7-4acc-a25c-81bb71a0cac3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn"
Sep 11 01:10:12.391987 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.391900    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2"
Sep 11 01:10:12.443650 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.443340    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn"
Sep 11 01:10:12.677562 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.677467    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd" podStartSLOduration=2.677447791 podStartE2EDuration="2.677447791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:10:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:10:12.188008586 +0000 UTC m=+729.236096839" watchObservedRunningTime="2026-09-11 01:10:12.677447791 +0000 UTC m=+729.725536014"
Sep 11 01:10:12.679702 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.679680    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2"]
Sep 11 01:10:12.680600 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:10:12.680574    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda9ced7_8fc9_4367_8b20_c2eea18c1423.slice/crio-5bb7d0f5b56dc84764af41329388d560742a12dfc80d364027a6adfd96632e25 WatchSource:0}: Error finding container 5bb7d0f5b56dc84764af41329388d560742a12dfc80d364027a6adfd96632e25: Status 404 returned error can't find the container with id 5bb7d0f5b56dc84764af41329388d560742a12dfc80d364027a6adfd96632e25
Sep 11 01:10:12.773451 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:12.756509    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn"]
Sep 11 01:10:13.154545 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:13.154500    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn" event={"ID":"114a39a7-b7a7-4acc-a25c-81bb71a0cac3","Type":"ContainerStarted","Data":"175a2f566f1c4d6dc09752370d5347410a049f786b9e21d661991fd74bab0f8c"}
Sep 11 01:10:13.155032 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:13.154604    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn" event={"ID":"114a39a7-b7a7-4acc-a25c-81bb71a0cac3","Type":"ContainerStarted","Data":"6e12d2e1515e320c267ad0ec6ee747aac5b1fff43e83ccc1c0802a452281d276"}
Sep 11 01:10:13.155458 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:13.155431    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn"
Sep 11 01:10:13.158377 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:13.158299    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2" event={"ID":"fda9ced7-8fc9-4367-8b20-c2eea18c1423","Type":"ContainerStarted","Data":"be3cd1a7689d4dcd7e45eb0a69fc45a3495f19158a66ea238ca4f5f24acaba89"}
Sep 11 01:10:13.158377 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:13.158345    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2" event={"ID":"fda9ced7-8fc9-4367-8b20-c2eea18c1423","Type":"ContainerStarted","Data":"5bb7d0f5b56dc84764af41329388d560742a12dfc80d364027a6adfd96632e25"}
Sep 11 01:10:13.158689 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:13.158652    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2"
Sep 11 01:10:13.193527 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:13.193472    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2" podStartSLOduration=1.193449268 podStartE2EDuration="1.193449268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:10:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:10:13.193283961 +0000 UTC m=+730.241372211" watchObservedRunningTime="2026-09-11 01:10:13.193449268 +0000 UTC m=+730.241537491"
Sep 11 01:10:13.196512 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:13.196473    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn" podStartSLOduration=1.196460519 podStartE2EDuration="1.196460519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:10:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:10:13.174588122 +0000 UTC m=+730.222676362" watchObservedRunningTime="2026-09-11 01:10:13.196460519 +0000 UTC m=+730.244548779"
Sep 11 01:10:14.093780 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:14.093749    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp"
Sep 11 01:10:14.093969 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:14.093845    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk"
Sep 11 01:10:15.107435 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:15.107401    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7"
Sep 11 01:10:15.108313 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:15.108292    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d"
Sep 11 01:10:17.117711 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:17.117678    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf"
Sep 11 01:10:18.209877 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:18.209789    2565 generic.go:356] "Generic (PLEG): container finished" podID="0db135f1-2ba1-404c-ab6b-fba56c6ec419" containerID="a2e5c0ba6a85d855a6a4c5388cbfea21dc989b394cc38cc8c5da56e9e79355b8" exitCode=0
Sep 11 01:10:18.209877 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:18.209862    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc" event={"ID":"0db135f1-2ba1-404c-ab6b-fba56c6ec419","Type":"ContainerDied","Data":"a2e5c0ba6a85d855a6a4c5388cbfea21dc989b394cc38cc8c5da56e9e79355b8"}
Sep 11 01:10:18.210373 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:18.210256    2565 scope.go:117] "RemoveContainer" containerID="a2e5c0ba6a85d855a6a4c5388cbfea21dc989b394cc38cc8c5da56e9e79355b8"
Sep 11 01:10:18.211411 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:18.211379    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:10:18.211493 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:18.211456    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:10:18.211493 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:18.211489    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:10:19.217426 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:19.217394    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc" event={"ID":"0db135f1-2ba1-404c-ab6b-fba56c6ec419","Type":"ContainerStarted","Data":"a2fc192a638b513095dec5e19c69fdd70192dc4362a7bc9814bc23e6454916c9"}
Sep 11 01:10:19.308922 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:19.308886    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:10:19.309126 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:19.309102    2565 patch_prober.go:28] interesting pod/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 01:10:19.309181 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:19.309152    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc" podUID="0db135f1-2ba1-404c-ab6b-fba56c6ec419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 01:10:20.309351 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:20.309316    2565 patch_prober.go:28] interesting pod/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 01:10:20.309732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:20.309373    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc" podUID="0db135f1-2ba1-404c-ab6b-fba56c6ec419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 01:10:21.309582 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:21.309547    2565 patch_prober.go:28] interesting pod/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 01:10:21.309986 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:21.309604    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc" podUID="0db135f1-2ba1-404c-ab6b-fba56c6ec419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 01:10:22.309246 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:22.309207    2565 patch_prober.go:28] interesting pod/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 01:10:22.309438 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:22.309262    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc" podUID="0db135f1-2ba1-404c-ab6b-fba56c6ec419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 01:10:23.160504 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:23.160466    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd"
Sep 11 01:10:23.309698 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:23.309649    2565 patch_prober.go:28] interesting pod/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 01:10:23.309932 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:23.309729    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc" podUID="0db135f1-2ba1-404c-ab6b-fba56c6ec419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 01:10:24.185032 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:24.184988    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2"
Sep 11 01:10:24.309600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:24.309550    2565 patch_prober.go:28] interesting pod/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 01:10:24.309774 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:24.309644    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc" podUID="0db135f1-2ba1-404c-ab6b-fba56c6ec419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 01:10:25.192017 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:25.191985    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn"
Sep 11 01:10:25.309492 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:25.309457    2565 patch_prober.go:28] interesting pod/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 11 01:10:25.309672 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:25.309511    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc" podUID="0db135f1-2ba1-404c-ab6b-fba56c6ec419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 11 01:10:26.313203 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:26.313169    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:10:26.313571 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:26.313448    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:10:26.314094 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:26.314075    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:10:30.094017 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:30.093970    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 01:10:30.094415 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:30.094059    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf" podUID="438eba62-ffb0-4bf7-ac00-60f8f10a11f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 01:10:32.310678 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:32.310649    2565 generic.go:356] "Generic (PLEG): container finished" podID="438eba62-ffb0-4bf7-ac00-60f8f10a11f6" containerID="0007b95f0c8c0186099c9f7d48cd2fe5eec4df43c55c4a1737ad0c1ee058e3dd" exitCode=0
Sep 11 01:10:32.311101 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:32.310719    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf" event={"ID":"438eba62-ffb0-4bf7-ac00-60f8f10a11f6","Type":"ContainerDied","Data":"0007b95f0c8c0186099c9f7d48cd2fe5eec4df43c55c4a1737ad0c1ee058e3dd"}
Sep 11 01:10:32.311167 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:32.311152    2565 scope.go:117] "RemoveContainer" containerID="0007b95f0c8c0186099c9f7d48cd2fe5eec4df43c55c4a1737ad0c1ee058e3dd"
Sep 11 01:10:32.312253 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:32.312225    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:10:32.312324 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:32.312292    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:10:32.312359 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:32.312323    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:10:33.318162 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:33.318125    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf" event={"ID":"438eba62-ffb0-4bf7-ac00-60f8f10a11f6","Type":"ContainerStarted","Data":"ce5dd52b8c542d638b29891ed455b0078ce1a4da75bfb034b6f7c1b12b842534"}
Sep 11 01:10:33.383597 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:33.383560    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:10:33.383842 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:33.383806    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 01:10:33.383904 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:33.383869    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf" podUID="438eba62-ffb0-4bf7-ac00-60f8f10a11f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 01:10:34.383771 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:34.383734    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 01:10:34.384182 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:34.383805    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf" podUID="438eba62-ffb0-4bf7-ac00-60f8f10a11f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 01:10:35.383356 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:35.383316    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 01:10:35.383535 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:35.383378    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf" podUID="438eba62-ffb0-4bf7-ac00-60f8f10a11f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 01:10:36.383554 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:36.383514    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 01:10:36.383974 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:36.383583    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf" podUID="438eba62-ffb0-4bf7-ac00-60f8f10a11f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 01:10:37.383169 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:37.383128    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 01:10:37.383345 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:37.383187    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf" podUID="438eba62-ffb0-4bf7-ac00-60f8f10a11f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 01:10:38.383467 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:38.383426    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 11 01:10:38.383891 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:38.383484    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf" podUID="438eba62-ffb0-4bf7-ac00-60f8f10a11f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 11 01:10:39.386970 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:39.386939    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:10:39.387392 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:39.387338    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:10:39.388102 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:39.388084    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:10:52.696839 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:52.696790    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2"]
Sep 11 01:10:52.697525 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:52.697492    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2" podUID="fda9ced7-8fc9-4367-8b20-c2eea18c1423" containerName="payload-processing" containerID="cri-o://be3cd1a7689d4dcd7e45eb0a69fc45a3495f19158a66ea238ca4f5f24acaba89" gracePeriod=30
Sep 11 01:10:52.701407 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:52.701363    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn"]
Sep 11 01:10:52.702016 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:52.701625    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn" podUID="114a39a7-b7a7-4acc-a25c-81bb71a0cac3" containerName="payload-pre-processing" containerID="cri-o://175a2f566f1c4d6dc09752370d5347410a049f786b9e21d661991fd74bab0f8c" gracePeriod=30
Sep 11 01:10:52.954221 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:52.954161    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2"
Sep 11 01:10:52.988540 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:52.988518    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn"
Sep 11 01:10:52.989991 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:52.989964    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fda9ced7-8fc9-4367-8b20-c2eea18c1423-plugins-config-volume\") pod \"fda9ced7-8fc9-4367-8b20-c2eea18c1423\" (UID: \"fda9ced7-8fc9-4367-8b20-c2eea18c1423\") "
Sep 11 01:10:52.990152 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:52.990110    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbh5l\" (UniqueName: \"kubernetes.io/projected/fda9ced7-8fc9-4367-8b20-c2eea18c1423-kube-api-access-hbh5l\") pod \"fda9ced7-8fc9-4367-8b20-c2eea18c1423\" (UID: \"fda9ced7-8fc9-4367-8b20-c2eea18c1423\") "
Sep 11 01:10:52.990418 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:52.990387    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fda9ced7-8fc9-4367-8b20-c2eea18c1423-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fda9ced7-8fc9-4367-8b20-c2eea18c1423" (UID: "fda9ced7-8fc9-4367-8b20-c2eea18c1423"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:10:52.990670 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:52.990652    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fda9ced7-8fc9-4367-8b20-c2eea18c1423-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:10:52.993701 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:52.993677    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fda9ced7-8fc9-4367-8b20-c2eea18c1423-kube-api-access-hbh5l" (OuterVolumeSpecName: "kube-api-access-hbh5l") pod "fda9ced7-8fc9-4367-8b20-c2eea18c1423" (UID: "fda9ced7-8fc9-4367-8b20-c2eea18c1423"). InnerVolumeSpecName "kube-api-access-hbh5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:10:53.091754 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.091723    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg49n\" (UniqueName: \"kubernetes.io/projected/114a39a7-b7a7-4acc-a25c-81bb71a0cac3-kube-api-access-tg49n\") pod \"114a39a7-b7a7-4acc-a25c-81bb71a0cac3\" (UID: \"114a39a7-b7a7-4acc-a25c-81bb71a0cac3\") "
Sep 11 01:10:53.091971 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.091780    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/114a39a7-b7a7-4acc-a25c-81bb71a0cac3-plugins-config-volume\") pod \"114a39a7-b7a7-4acc-a25c-81bb71a0cac3\" (UID: \"114a39a7-b7a7-4acc-a25c-81bb71a0cac3\") "
Sep 11 01:10:53.092106 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.092087    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbh5l\" (UniqueName: \"kubernetes.io/projected/fda9ced7-8fc9-4367-8b20-c2eea18c1423-kube-api-access-hbh5l\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:10:53.092190 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.092167    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/114a39a7-b7a7-4acc-a25c-81bb71a0cac3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "114a39a7-b7a7-4acc-a25c-81bb71a0cac3" (UID: "114a39a7-b7a7-4acc-a25c-81bb71a0cac3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:10:53.094217 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.094189    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/114a39a7-b7a7-4acc-a25c-81bb71a0cac3-kube-api-access-tg49n" (OuterVolumeSpecName: "kube-api-access-tg49n") pod "114a39a7-b7a7-4acc-a25c-81bb71a0cac3" (UID: "114a39a7-b7a7-4acc-a25c-81bb71a0cac3"). InnerVolumeSpecName "kube-api-access-tg49n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:10:53.193357 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.193315    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg49n\" (UniqueName: \"kubernetes.io/projected/114a39a7-b7a7-4acc-a25c-81bb71a0cac3-kube-api-access-tg49n\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:10:53.193357 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.193348    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/114a39a7-b7a7-4acc-a25c-81bb71a0cac3-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:10:53.424325 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.424287    2565 generic.go:356] "Generic (PLEG): container finished" podID="114a39a7-b7a7-4acc-a25c-81bb71a0cac3" containerID="175a2f566f1c4d6dc09752370d5347410a049f786b9e21d661991fd74bab0f8c" exitCode=0
Sep 11 01:10:53.424523 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.424342    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn"
Sep 11 01:10:53.424523 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.424376    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn" event={"ID":"114a39a7-b7a7-4acc-a25c-81bb71a0cac3","Type":"ContainerDied","Data":"175a2f566f1c4d6dc09752370d5347410a049f786b9e21d661991fd74bab0f8c"}
Sep 11 01:10:53.424523 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.424437    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn" event={"ID":"114a39a7-b7a7-4acc-a25c-81bb71a0cac3","Type":"ContainerDied","Data":"6e12d2e1515e320c267ad0ec6ee747aac5b1fff43e83ccc1c0802a452281d276"}
Sep 11 01:10:53.424523 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.424464    2565 scope.go:117] "RemoveContainer" containerID="175a2f566f1c4d6dc09752370d5347410a049f786b9e21d661991fd74bab0f8c"
Sep 11 01:10:53.425743 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.425722    2565 generic.go:356] "Generic (PLEG): container finished" podID="fda9ced7-8fc9-4367-8b20-c2eea18c1423" containerID="be3cd1a7689d4dcd7e45eb0a69fc45a3495f19158a66ea238ca4f5f24acaba89" exitCode=0
Sep 11 01:10:53.425875 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.425765    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2"
Sep 11 01:10:53.425875 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.425788    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2" event={"ID":"fda9ced7-8fc9-4367-8b20-c2eea18c1423","Type":"ContainerDied","Data":"be3cd1a7689d4dcd7e45eb0a69fc45a3495f19158a66ea238ca4f5f24acaba89"}
Sep 11 01:10:53.425875 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.425850    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2" event={"ID":"fda9ced7-8fc9-4367-8b20-c2eea18c1423","Type":"ContainerDied","Data":"5bb7d0f5b56dc84764af41329388d560742a12dfc80d364027a6adfd96632e25"}
Sep 11 01:10:53.433595 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.433573    2565 scope.go:117] "RemoveContainer" containerID="175a2f566f1c4d6dc09752370d5347410a049f786b9e21d661991fd74bab0f8c"
Sep 11 01:10:53.433903 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:10:53.433882    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"175a2f566f1c4d6dc09752370d5347410a049f786b9e21d661991fd74bab0f8c\": container with ID starting with 175a2f566f1c4d6dc09752370d5347410a049f786b9e21d661991fd74bab0f8c not found: ID does not exist" containerID="175a2f566f1c4d6dc09752370d5347410a049f786b9e21d661991fd74bab0f8c"
Sep 11 01:10:53.433985 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.433910    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"175a2f566f1c4d6dc09752370d5347410a049f786b9e21d661991fd74bab0f8c"} err="failed to get container status \"175a2f566f1c4d6dc09752370d5347410a049f786b9e21d661991fd74bab0f8c\": rpc error: code = NotFound desc = could not find container \"175a2f566f1c4d6dc09752370d5347410a049f786b9e21d661991fd74bab0f8c\": container with ID starting with 175a2f566f1c4d6dc09752370d5347410a049f786b9e21d661991fd74bab0f8c not found: ID does not exist"
Sep 11 01:10:53.433985 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.433927    2565 scope.go:117] "RemoveContainer" containerID="be3cd1a7689d4dcd7e45eb0a69fc45a3495f19158a66ea238ca4f5f24acaba89"
Sep 11 01:10:53.442604 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.442587    2565 scope.go:117] "RemoveContainer" containerID="be3cd1a7689d4dcd7e45eb0a69fc45a3495f19158a66ea238ca4f5f24acaba89"
Sep 11 01:10:53.442859 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:10:53.442839    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be3cd1a7689d4dcd7e45eb0a69fc45a3495f19158a66ea238ca4f5f24acaba89\": container with ID starting with be3cd1a7689d4dcd7e45eb0a69fc45a3495f19158a66ea238ca4f5f24acaba89 not found: ID does not exist" containerID="be3cd1a7689d4dcd7e45eb0a69fc45a3495f19158a66ea238ca4f5f24acaba89"
Sep 11 01:10:53.442926 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.442863    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be3cd1a7689d4dcd7e45eb0a69fc45a3495f19158a66ea238ca4f5f24acaba89"} err="failed to get container status \"be3cd1a7689d4dcd7e45eb0a69fc45a3495f19158a66ea238ca4f5f24acaba89\": rpc error: code = NotFound desc = could not find container \"be3cd1a7689d4dcd7e45eb0a69fc45a3495f19158a66ea238ca4f5f24acaba89\": container with ID starting with be3cd1a7689d4dcd7e45eb0a69fc45a3495f19158a66ea238ca4f5f24acaba89 not found: ID does not exist"
Sep 11 01:10:53.450957 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.450937    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn"]
Sep 11 01:10:53.455538 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.455506    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0bc9acd8-56d475fd66-6gsbn"]
Sep 11 01:10:53.472627 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.472603    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="114a39a7-b7a7-4acc-a25c-81bb71a0cac3" path="/var/lib/kubelet/pods/114a39a7-b7a7-4acc-a25c-81bb71a0cac3/volumes"
Sep 11 01:10:53.472959 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.472940    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2"]
Sep 11 01:10:53.487419 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:53.487390    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0bc9acd8-7777f5d8d7-4mzc2"]
Sep 11 01:10:54.020451 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.020329    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"]
Sep 11 01:10:54.020938 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.020918    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="114a39a7-b7a7-4acc-a25c-81bb71a0cac3" containerName="payload-pre-processing"
Sep 11 01:10:54.021001 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.020942    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="114a39a7-b7a7-4acc-a25c-81bb71a0cac3" containerName="payload-pre-processing"
Sep 11 01:10:54.021001 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.020984    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fda9ced7-8fc9-4367-8b20-c2eea18c1423" containerName="payload-processing"
Sep 11 01:10:54.021001 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.020993    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fda9ced7-8fc9-4367-8b20-c2eea18c1423" containerName="payload-processing"
Sep 11 01:10:54.021114 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.021081    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="114a39a7-b7a7-4acc-a25c-81bb71a0cac3" containerName="payload-pre-processing"
Sep 11 01:10:54.021114 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.021097    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fda9ced7-8fc9-4367-8b20-c2eea18c1423" containerName="payload-processing"
Sep 11 01:10:54.024078 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.024059    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.026733 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.026713    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-1d3c7cc9-gw-openshift-default-dockercfg-l5xn6\""
Sep 11 01:10:54.041632 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.040292    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"]
Sep 11 01:10:54.105389 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.105354    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-credential-socket\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.105802 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.105771    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-data\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.105959 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.105853    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-workload-certs\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.105959 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.105879    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cdb0403-6dfb-4126-a1f3-217984d31424-istiod-ca-cert\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.105959 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.105914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-envoy\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.105959 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.105936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-token\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.106188 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.105990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-workload-socket\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.106188 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.106031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-podinfo\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.106188 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.106076    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x5wg\" (UniqueName: \"kubernetes.io/projected/4cdb0403-6dfb-4126-a1f3-217984d31424-kube-api-access-9x5wg\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.206526 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.206493    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-credential-socket\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.206526 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.206529    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-data\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.206731 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.206565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-workload-certs\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.206731 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.206687    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cdb0403-6dfb-4126-a1f3-217984d31424-istiod-ca-cert\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.206865 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.206741    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-envoy\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.206865 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.206764    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-token\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.206987 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.206974    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-workload-certs\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.207045 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.206979    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-workload-socket\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.207045 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.207029    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-data\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.207045 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.207037    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-podinfo\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.207214 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.207095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x5wg\" (UniqueName: \"kubernetes.io/projected/4cdb0403-6dfb-4126-a1f3-217984d31424-kube-api-access-9x5wg\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.207585 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.207558    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-workload-socket\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.207714 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.207623    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cdb0403-6dfb-4126-a1f3-217984d31424-istiod-ca-cert\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.207714 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.207626    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-credential-socket\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.209388 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.209364    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-envoy\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.209628 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.209608    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-podinfo\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.214907 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.214883    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-token\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.215040 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.215023    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x5wg\" (UniqueName: \"kubernetes.io/projected/4cdb0403-6dfb-4126-a1f3-217984d31424-kube-api-access-9x5wg\") pod \"e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") " pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.333839 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.333787    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:54.632093 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.632064    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"]
Sep 11 01:10:54.633061 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:10:54.633035    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cdb0403_6dfb_4126_a1f3_217984d31424.slice/crio-d09cc0f78e73872bb092daed6ca7a727985b91102767b4e9323cc900af06a81e WatchSource:0}: Error finding container d09cc0f78e73872bb092daed6ca7a727985b91102767b4e9323cc900af06a81e: Status 404 returned error can't find the container with id d09cc0f78e73872bb092daed6ca7a727985b91102767b4e9323cc900af06a81e
Sep 11 01:10:54.635218 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.635183    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:10:54.635310 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.635249    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:10:54.635310 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:54.635276    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:10:55.441574 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:55.441538    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9" event={"ID":"4cdb0403-6dfb-4126-a1f3-217984d31424","Type":"ContainerStarted","Data":"18ffd30eb20c4600fa083ba7dab6a0dcc65d3027dc0b46ae9770b2c6e942c5e7"}
Sep 11 01:10:55.441983 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:55.441592    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9" event={"ID":"4cdb0403-6dfb-4126-a1f3-217984d31424","Type":"ContainerStarted","Data":"d09cc0f78e73872bb092daed6ca7a727985b91102767b4e9323cc900af06a81e"}
Sep 11 01:10:55.471259 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:55.471230    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fda9ced7-8fc9-4367-8b20-c2eea18c1423" path="/var/lib/kubelet/pods/fda9ced7-8fc9-4367-8b20-c2eea18c1423/volumes"
Sep 11 01:10:55.512736 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:55.512689    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9" podStartSLOduration=2.51266802 podStartE2EDuration="2.51266802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:10:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:10:55.511184596 +0000 UTC m=+772.559272841" watchObservedRunningTime="2026-09-11 01:10:55.51266802 +0000 UTC m=+772.560756245"
Sep 11 01:10:56.334333 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:56.334300    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:56.338953 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:56.338926    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:56.447135 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:56.447102    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:56.447910 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:56.447894    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:10:57.873694 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:57.873658    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr"]
Sep 11 01:10:57.883931 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:57.883888    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr"
Sep 11 01:10:57.886305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:57.886279    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-1d3c7cc9\""
Sep 11 01:10:57.886514 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:57.886307    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-1d3c7cc9-dockercfg-xtnj8\""
Sep 11 01:10:57.887556 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:57.887452    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr"]
Sep 11 01:10:57.943854 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:57.943795    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vjb6\" (UniqueName: \"kubernetes.io/projected/afa15799-33b5-4147-a33b-abd92c33d9ff-kube-api-access-6vjb6\") pod \"payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr\" (UID: \"afa15799-33b5-4147-a33b-abd92c33d9ff\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr"
Sep 11 01:10:57.944003 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:57.943872    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/afa15799-33b5-4147-a33b-abd92c33d9ff-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr\" (UID: \"afa15799-33b5-4147-a33b-abd92c33d9ff\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr"
Sep 11 01:10:58.045297 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:58.045253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vjb6\" (UniqueName: \"kubernetes.io/projected/afa15799-33b5-4147-a33b-abd92c33d9ff-kube-api-access-6vjb6\") pod \"payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr\" (UID: \"afa15799-33b5-4147-a33b-abd92c33d9ff\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr"
Sep 11 01:10:58.045441 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:58.045312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/afa15799-33b5-4147-a33b-abd92c33d9ff-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr\" (UID: \"afa15799-33b5-4147-a33b-abd92c33d9ff\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr"
Sep 11 01:10:58.046016 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:58.045997    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/afa15799-33b5-4147-a33b-abd92c33d9ff-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr\" (UID: \"afa15799-33b5-4147-a33b-abd92c33d9ff\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr"
Sep 11 01:10:58.057034 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:58.057010    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vjb6\" (UniqueName: \"kubernetes.io/projected/afa15799-33b5-4147-a33b-abd92c33d9ff-kube-api-access-6vjb6\") pod \"payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr\" (UID: \"afa15799-33b5-4147-a33b-abd92c33d9ff\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr"
Sep 11 01:10:58.197585 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:58.197498    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr"
Sep 11 01:10:58.468681 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:58.468611    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr"]
Sep 11 01:10:58.471634 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:10:58.471608    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafa15799_33b5_4147_a33b_abd92c33d9ff.slice/crio-d88329d1529c771ebb8d4bf4c23dee4e25505121a7bb550f8a37e1dcf14ca308 WatchSource:0}: Error finding container d88329d1529c771ebb8d4bf4c23dee4e25505121a7bb550f8a37e1dcf14ca308: Status 404 returned error can't find the container with id d88329d1529c771ebb8d4bf4c23dee4e25505121a7bb550f8a37e1dcf14ca308
Sep 11 01:10:59.464357 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:59.464320    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr" event={"ID":"afa15799-33b5-4147-a33b-abd92c33d9ff","Type":"ContainerStarted","Data":"1e46bac85a4e31dc51e6f2a7371e30e7f59ce481d9d0743ad0dd7e30e220cd9e"}
Sep 11 01:10:59.464740 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:59.464382    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr" event={"ID":"afa15799-33b5-4147-a33b-abd92c33d9ff","Type":"ContainerStarted","Data":"d88329d1529c771ebb8d4bf4c23dee4e25505121a7bb550f8a37e1dcf14ca308"}
Sep 11 01:10:59.464740 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:59.464411    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr"
Sep 11 01:10:59.482122 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:10:59.482074    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr" podStartSLOduration=2.482056596 podStartE2EDuration="2.482056596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:10:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:10:59.48134373 +0000 UTC m=+776.529431977" watchObservedRunningTime="2026-09-11 01:10:59.482056596 +0000 UTC m=+776.530144820"
Sep 11 01:11:10.472872 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:10.472809    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr"
Sep 11 01:11:19.581162 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:19.581130    2565 generic.go:356] "Generic (PLEG): container finished" podID="4cdb0403-6dfb-4126-a1f3-217984d31424" containerID="18ffd30eb20c4600fa083ba7dab6a0dcc65d3027dc0b46ae9770b2c6e942c5e7" exitCode=0
Sep 11 01:11:19.581681 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:19.581187    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9" event={"ID":"4cdb0403-6dfb-4126-a1f3-217984d31424","Type":"ContainerDied","Data":"18ffd30eb20c4600fa083ba7dab6a0dcc65d3027dc0b46ae9770b2c6e942c5e7"}
Sep 11 01:11:19.581681 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:19.581656    2565 scope.go:117] "RemoveContainer" containerID="18ffd30eb20c4600fa083ba7dab6a0dcc65d3027dc0b46ae9770b2c6e942c5e7"
Sep 11 01:11:19.582861 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:19.582808    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:11:19.582981 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:19.582912    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:11:19.583045 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:19.582977    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:11:20.589032 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:20.588997    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9" event={"ID":"4cdb0403-6dfb-4126-a1f3-217984d31424","Type":"ContainerStarted","Data":"bfb8f026afb1d34be031178bb7d597bfe3a44e3f78ec2ee39ebe949063c04108"}
Sep 11 01:11:21.334747 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:21.334703    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:11:21.334965 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:21.334942    2565 patch_prober.go:28] interesting pod/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 11 01:11:21.335025 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:21.335006    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9" podUID="4cdb0403-6dfb-4126-a1f3-217984d31424" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 11 01:11:22.334325 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:22.334289    2565 patch_prober.go:28] interesting pod/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 11 01:11:22.334714 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:22.334350    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9" podUID="4cdb0403-6dfb-4126-a1f3-217984d31424" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 11 01:11:23.334222 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:23.334187    2565 patch_prober.go:28] interesting pod/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 11 01:11:23.334431 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:23.334252    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9" podUID="4cdb0403-6dfb-4126-a1f3-217984d31424" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 11 01:11:24.334641 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:24.334602    2565 patch_prober.go:28] interesting pod/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 11 01:11:24.335124 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:24.334660    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9" podUID="4cdb0403-6dfb-4126-a1f3-217984d31424" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 11 01:11:25.335056 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:25.335018    2565 patch_prober.go:28] interesting pod/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 11 01:11:25.335427 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:25.335078    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9" podUID="4cdb0403-6dfb-4126-a1f3-217984d31424" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 11 01:11:26.334137 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:26.334102    2565 patch_prober.go:28] interesting pod/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 11 01:11:26.334320 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:26.334163    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9" podUID="4cdb0403-6dfb-4126-a1f3-217984d31424" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 11 01:11:26.447249 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:26.447215    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:11:27.338896 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:27.338868    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:11:27.339808 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:27.339790    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:11:27.792422 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:27.792389    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr"]
Sep 11 01:11:27.792918 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:27.792626    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr" podUID="afa15799-33b5-4147-a33b-abd92c33d9ff" containerName="payload-pre-processing" containerID="cri-o://1e46bac85a4e31dc51e6f2a7371e30e7f59ce481d9d0743ad0dd7e30e220cd9e" gracePeriod=30
Sep 11 01:11:28.060176 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:28.060095    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr"
Sep 11 01:11:28.116938 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:28.116898    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"]
Sep 11 01:11:28.135384 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:28.135347    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/afa15799-33b5-4147-a33b-abd92c33d9ff-plugins-config-volume\") pod \"afa15799-33b5-4147-a33b-abd92c33d9ff\" (UID: \"afa15799-33b5-4147-a33b-abd92c33d9ff\") "
Sep 11 01:11:28.135523 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:28.135423    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vjb6\" (UniqueName: \"kubernetes.io/projected/afa15799-33b5-4147-a33b-abd92c33d9ff-kube-api-access-6vjb6\") pod \"afa15799-33b5-4147-a33b-abd92c33d9ff\" (UID: \"afa15799-33b5-4147-a33b-abd92c33d9ff\") "
Sep 11 01:11:28.135714 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:28.135689    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afa15799-33b5-4147-a33b-abd92c33d9ff-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "afa15799-33b5-4147-a33b-abd92c33d9ff" (UID: "afa15799-33b5-4147-a33b-abd92c33d9ff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:11:28.137499 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:28.137469    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afa15799-33b5-4147-a33b-abd92c33d9ff-kube-api-access-6vjb6" (OuterVolumeSpecName: "kube-api-access-6vjb6") pod "afa15799-33b5-4147-a33b-abd92c33d9ff" (UID: "afa15799-33b5-4147-a33b-abd92c33d9ff"). InnerVolumeSpecName "kube-api-access-6vjb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:11:28.236364 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:28.236300    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/afa15799-33b5-4147-a33b-abd92c33d9ff-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:11:28.236364 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:28.236339    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vjb6\" (UniqueName: \"kubernetes.io/projected/afa15799-33b5-4147-a33b-abd92c33d9ff-kube-api-access-6vjb6\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:11:28.639057 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:28.639023    2565 generic.go:356] "Generic (PLEG): container finished" podID="afa15799-33b5-4147-a33b-abd92c33d9ff" containerID="1e46bac85a4e31dc51e6f2a7371e30e7f59ce481d9d0743ad0dd7e30e220cd9e" exitCode=0
Sep 11 01:11:28.639232 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:28.639083    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr"
Sep 11 01:11:28.639232 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:28.639103    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr" event={"ID":"afa15799-33b5-4147-a33b-abd92c33d9ff","Type":"ContainerDied","Data":"1e46bac85a4e31dc51e6f2a7371e30e7f59ce481d9d0743ad0dd7e30e220cd9e"}
Sep 11 01:11:28.639232 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:28.639162    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr" event={"ID":"afa15799-33b5-4147-a33b-abd92c33d9ff","Type":"ContainerDied","Data":"d88329d1529c771ebb8d4bf4c23dee4e25505121a7bb550f8a37e1dcf14ca308"}
Sep 11 01:11:28.639232 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:28.639190    2565 scope.go:117] "RemoveContainer" containerID="1e46bac85a4e31dc51e6f2a7371e30e7f59ce481d9d0743ad0dd7e30e220cd9e"
Sep 11 01:11:28.639430 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:28.639306    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9" podUID="4cdb0403-6dfb-4126-a1f3-217984d31424" containerName="istio-proxy" containerID="cri-o://bfb8f026afb1d34be031178bb7d597bfe3a44e3f78ec2ee39ebe949063c04108" gracePeriod=30
Sep 11 01:11:28.649197 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:28.649143    2565 scope.go:117] "RemoveContainer" containerID="1e46bac85a4e31dc51e6f2a7371e30e7f59ce481d9d0743ad0dd7e30e220cd9e"
Sep 11 01:11:28.649533 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:11:28.649506    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e46bac85a4e31dc51e6f2a7371e30e7f59ce481d9d0743ad0dd7e30e220cd9e\": container with ID starting with 1e46bac85a4e31dc51e6f2a7371e30e7f59ce481d9d0743ad0dd7e30e220cd9e not found: ID does not exist" containerID="1e46bac85a4e31dc51e6f2a7371e30e7f59ce481d9d0743ad0dd7e30e220cd9e"
Sep 11 01:11:28.649624 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:28.649543    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e46bac85a4e31dc51e6f2a7371e30e7f59ce481d9d0743ad0dd7e30e220cd9e"} err="failed to get container status \"1e46bac85a4e31dc51e6f2a7371e30e7f59ce481d9d0743ad0dd7e30e220cd9e\": rpc error: code = NotFound desc = could not find container \"1e46bac85a4e31dc51e6f2a7371e30e7f59ce481d9d0743ad0dd7e30e220cd9e\": container with ID starting with 1e46bac85a4e31dc51e6f2a7371e30e7f59ce481d9d0743ad0dd7e30e220cd9e not found: ID does not exist"
Sep 11 01:11:28.678539 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:28.678509    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr"]
Sep 11 01:11:28.686469 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:28.686444    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1d3c7cc9-669cdd9b6b-mnxqr"]
Sep 11 01:11:29.471304 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:29.471272    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afa15799-33b5-4147-a33b-abd92c33d9ff" path="/var/lib/kubelet/pods/afa15799-33b5-4147-a33b-abd92c33d9ff/volumes"
Sep 11 01:11:33.046236 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.046200    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv"]
Sep 11 01:11:33.046786 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.046766    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa15799-33b5-4147-a33b-abd92c33d9ff" containerName="payload-pre-processing"
Sep 11 01:11:33.046895 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.046789    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa15799-33b5-4147-a33b-abd92c33d9ff" containerName="payload-pre-processing"
Sep 11 01:11:33.046961 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.046945    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="afa15799-33b5-4147-a33b-abd92c33d9ff" containerName="payload-pre-processing"
Sep 11 01:11:33.049083 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.049065    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv"
Sep 11 01:11:33.051336 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.051317    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-aba078c2\""
Sep 11 01:11:33.060808 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.060776    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv"]
Sep 11 01:11:33.082238 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.082211    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b00e99c8-0b83-4971-bc7c-86c2514dd659-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv\" (UID: \"b00e99c8-0b83-4971-bc7c-86c2514dd659\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv"
Sep 11 01:11:33.082400 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.082247    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hs5d\" (UniqueName: \"kubernetes.io/projected/b00e99c8-0b83-4971-bc7c-86c2514dd659-kube-api-access-5hs5d\") pod \"payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv\" (UID: \"b00e99c8-0b83-4971-bc7c-86c2514dd659\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv"
Sep 11 01:11:33.183502 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.183410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b00e99c8-0b83-4971-bc7c-86c2514dd659-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv\" (UID: \"b00e99c8-0b83-4971-bc7c-86c2514dd659\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv"
Sep 11 01:11:33.183502 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.183484    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hs5d\" (UniqueName: \"kubernetes.io/projected/b00e99c8-0b83-4971-bc7c-86c2514dd659-kube-api-access-5hs5d\") pod \"payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv\" (UID: \"b00e99c8-0b83-4971-bc7c-86c2514dd659\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv"
Sep 11 01:11:33.184679 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.184630    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b00e99c8-0b83-4971-bc7c-86c2514dd659-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv\" (UID: \"b00e99c8-0b83-4971-bc7c-86c2514dd659\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv"
Sep 11 01:11:33.193199 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.193142    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hs5d\" (UniqueName: \"kubernetes.io/projected/b00e99c8-0b83-4971-bc7c-86c2514dd659-kube-api-access-5hs5d\") pod \"payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv\" (UID: \"b00e99c8-0b83-4971-bc7c-86c2514dd659\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv"
Sep 11 01:11:33.361259 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.361166    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv"
Sep 11 01:11:33.637076 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.637044    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv"]
Sep 11 01:11:33.638386 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:11:33.638359    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb00e99c8_0b83_4971_bc7c_86c2514dd659.slice/crio-56ee81038bcbd5db53d0076c0e64102336aa6a8f6b5d1b08e3ab20e60c2cae1e WatchSource:0}: Error finding container 56ee81038bcbd5db53d0076c0e64102336aa6a8f6b5d1b08e3ab20e60c2cae1e: Status 404 returned error can't find the container with id 56ee81038bcbd5db53d0076c0e64102336aa6a8f6b5d1b08e3ab20e60c2cae1e
Sep 11 01:11:33.667714 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.667686    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv" event={"ID":"b00e99c8-0b83-4971-bc7c-86c2514dd659","Type":"ContainerStarted","Data":"56ee81038bcbd5db53d0076c0e64102336aa6a8f6b5d1b08e3ab20e60c2cae1e"}
Sep 11 01:11:33.885046 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.884982    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:11:33.992557 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.992522    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-workload-certs\") pod \"4cdb0403-6dfb-4126-a1f3-217984d31424\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") "
Sep 11 01:11:33.992744 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.992566    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-workload-socket\") pod \"4cdb0403-6dfb-4126-a1f3-217984d31424\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") "
Sep 11 01:11:33.992744 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.992587    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-data\") pod \"4cdb0403-6dfb-4126-a1f3-217984d31424\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") "
Sep 11 01:11:33.992744 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.992646    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9x5wg\" (UniqueName: \"kubernetes.io/projected/4cdb0403-6dfb-4126-a1f3-217984d31424-kube-api-access-9x5wg\") pod \"4cdb0403-6dfb-4126-a1f3-217984d31424\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") "
Sep 11 01:11:33.992744 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.992674    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-credential-socket\") pod \"4cdb0403-6dfb-4126-a1f3-217984d31424\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") "
Sep 11 01:11:33.992744 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.992698    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-envoy\") pod \"4cdb0403-6dfb-4126-a1f3-217984d31424\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") "
Sep 11 01:11:33.992744 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.992728    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cdb0403-6dfb-4126-a1f3-217984d31424-istiod-ca-cert\") pod \"4cdb0403-6dfb-4126-a1f3-217984d31424\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") "
Sep 11 01:11:33.993098 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.992761    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-token\") pod \"4cdb0403-6dfb-4126-a1f3-217984d31424\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") "
Sep 11 01:11:33.993098 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.992798    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-podinfo\") pod \"4cdb0403-6dfb-4126-a1f3-217984d31424\" (UID: \"4cdb0403-6dfb-4126-a1f3-217984d31424\") "
Sep 11 01:11:33.993098 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.992874    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4cdb0403-6dfb-4126-a1f3-217984d31424" (UID: "4cdb0403-6dfb-4126-a1f3-217984d31424"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:11:33.993098 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.992895    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4cdb0403-6dfb-4126-a1f3-217984d31424" (UID: "4cdb0403-6dfb-4126-a1f3-217984d31424"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:11:33.993098 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.992968    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-data" (OuterVolumeSpecName: "istio-data") pod "4cdb0403-6dfb-4126-a1f3-217984d31424" (UID: "4cdb0403-6dfb-4126-a1f3-217984d31424"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:11:33.993098 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.993045    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4cdb0403-6dfb-4126-a1f3-217984d31424" (UID: "4cdb0403-6dfb-4126-a1f3-217984d31424"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:11:33.993361 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.993165    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-workload-certs\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:11:33.993361 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.993187    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-workload-socket\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:11:33.993361 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.993201    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-data\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:11:33.993361 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.993214    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-credential-socket\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:11:33.993555 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.993525    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cdb0403-6dfb-4126-a1f3-217984d31424-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4cdb0403-6dfb-4126-a1f3-217984d31424" (UID: "4cdb0403-6dfb-4126-a1f3-217984d31424"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:11:33.995071 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.995048    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4cdb0403-6dfb-4126-a1f3-217984d31424" (UID: "4cdb0403-6dfb-4126-a1f3-217984d31424"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 01:11:33.995160 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.995112    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4cdb0403-6dfb-4126-a1f3-217984d31424" (UID: "4cdb0403-6dfb-4126-a1f3-217984d31424"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:11:33.995397 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.995378    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-token" (OuterVolumeSpecName: "istio-token") pod "4cdb0403-6dfb-4126-a1f3-217984d31424" (UID: "4cdb0403-6dfb-4126-a1f3-217984d31424"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:11:33.995453 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:33.995387    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cdb0403-6dfb-4126-a1f3-217984d31424-kube-api-access-9x5wg" (OuterVolumeSpecName: "kube-api-access-9x5wg") pod "4cdb0403-6dfb-4126-a1f3-217984d31424" (UID: "4cdb0403-6dfb-4126-a1f3-217984d31424"). InnerVolumeSpecName "kube-api-access-9x5wg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:11:34.093673 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.093646    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9x5wg\" (UniqueName: \"kubernetes.io/projected/4cdb0403-6dfb-4126-a1f3-217984d31424-kube-api-access-9x5wg\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:11:34.093673 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.093670    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-envoy\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:11:34.094067 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.093681    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cdb0403-6dfb-4126-a1f3-217984d31424-istiod-ca-cert\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:11:34.094067 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.093689    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-token\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:11:34.094067 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.093697    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cdb0403-6dfb-4126-a1f3-217984d31424-istio-podinfo\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:11:34.486455 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.486374    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"]
Sep 11 01:11:34.486980 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.486963    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cdb0403-6dfb-4126-a1f3-217984d31424" containerName="istio-proxy"
Sep 11 01:11:34.487034 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.486983    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cdb0403-6dfb-4126-a1f3-217984d31424" containerName="istio-proxy"
Sep 11 01:11:34.487106 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.487095    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cdb0403-6dfb-4126-a1f3-217984d31424" containerName="istio-proxy"
Sep 11 01:11:34.490509 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.490491    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:34.493729 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.493593    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-dc7dcd\"/\"default-dockercfg-rzv44\""
Sep 11 01:11:34.493729 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.493615    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-dc7dcd\"/\"openshift-service-ca.crt\""
Sep 11 01:11:34.493729 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.493672    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-dc7dcd\"/\"kube-root-ca.crt\""
Sep 11 01:11:34.494015 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.493769    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-dc7dcd\"/\"autores-model-dc7dcd-kserve-self-signed-certs\""
Sep 11 01:11:34.497536 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.497510    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"]
Sep 11 01:11:34.598907 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.598871    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c96e31d8-580c-460b-abb0-20c777684e3a-tls-certs\") pod \"autores-model-dc7dcd-kserve-7f67cfc467-5c65p\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") " pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:34.599088 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.599007    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fzgv\" (UniqueName: \"kubernetes.io/projected/c96e31d8-580c-460b-abb0-20c777684e3a-kube-api-access-4fzgv\") pod \"autores-model-dc7dcd-kserve-7f67cfc467-5c65p\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") " pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:34.599164 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.599081    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-model-cache\") pod \"autores-model-dc7dcd-kserve-7f67cfc467-5c65p\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") " pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:34.599164 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.599109    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-dshm\") pod \"autores-model-dc7dcd-kserve-7f67cfc467-5c65p\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") " pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:34.599164 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.599150    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-home\") pod \"autores-model-dc7dcd-kserve-7f67cfc467-5c65p\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") " pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:34.599268 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.599169    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-tmp-dir\") pod \"autores-model-dc7dcd-kserve-7f67cfc467-5c65p\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") " pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:34.678775 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.678734    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv" event={"ID":"b00e99c8-0b83-4971-bc7c-86c2514dd659","Type":"ContainerStarted","Data":"0015ddf49bd76fb67b836b9a89e55846ccefa9f20b08c633dffd84944679c7c1"}
Sep 11 01:11:34.679016 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.678805    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv"
Sep 11 01:11:34.680447 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.680420    2565 generic.go:356] "Generic (PLEG): container finished" podID="4cdb0403-6dfb-4126-a1f3-217984d31424" containerID="bfb8f026afb1d34be031178bb7d597bfe3a44e3f78ec2ee39ebe949063c04108" exitCode=0
Sep 11 01:11:34.680526 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.680459    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"
Sep 11 01:11:34.680526 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.680487    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9" event={"ID":"4cdb0403-6dfb-4126-a1f3-217984d31424","Type":"ContainerDied","Data":"bfb8f026afb1d34be031178bb7d597bfe3a44e3f78ec2ee39ebe949063c04108"}
Sep 11 01:11:34.680603 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.680536    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9" event={"ID":"4cdb0403-6dfb-4126-a1f3-217984d31424","Type":"ContainerDied","Data":"d09cc0f78e73872bb092daed6ca7a727985b91102767b4e9323cc900af06a81e"}
Sep 11 01:11:34.680603 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.680565    2565 scope.go:117] "RemoveContainer" containerID="bfb8f026afb1d34be031178bb7d597bfe3a44e3f78ec2ee39ebe949063c04108"
Sep 11 01:11:34.689872 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.689855    2565 scope.go:117] "RemoveContainer" containerID="18ffd30eb20c4600fa083ba7dab6a0dcc65d3027dc0b46ae9770b2c6e942c5e7"
Sep 11 01:11:34.696164 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.696124    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv" podStartSLOduration=1.696110668 podStartE2EDuration="1.696110668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:11:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:11:34.692526363 +0000 UTC m=+811.740614602" watchObservedRunningTime="2026-09-11 01:11:34.696110668 +0000 UTC m=+811.744198938"
Sep 11 01:11:34.699293 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.699276    2565 scope.go:117] "RemoveContainer" containerID="bfb8f026afb1d34be031178bb7d597bfe3a44e3f78ec2ee39ebe949063c04108"
Sep 11 01:11:34.699590 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:11:34.699569    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfb8f026afb1d34be031178bb7d597bfe3a44e3f78ec2ee39ebe949063c04108\": container with ID starting with bfb8f026afb1d34be031178bb7d597bfe3a44e3f78ec2ee39ebe949063c04108 not found: ID does not exist" containerID="bfb8f026afb1d34be031178bb7d597bfe3a44e3f78ec2ee39ebe949063c04108"
Sep 11 01:11:34.699641 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.699599    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfb8f026afb1d34be031178bb7d597bfe3a44e3f78ec2ee39ebe949063c04108"} err="failed to get container status \"bfb8f026afb1d34be031178bb7d597bfe3a44e3f78ec2ee39ebe949063c04108\": rpc error: code = NotFound desc = could not find container \"bfb8f026afb1d34be031178bb7d597bfe3a44e3f78ec2ee39ebe949063c04108\": container with ID starting with bfb8f026afb1d34be031178bb7d597bfe3a44e3f78ec2ee39ebe949063c04108 not found: ID does not exist"
Sep 11 01:11:34.699641 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.699616    2565 scope.go:117] "RemoveContainer" containerID="18ffd30eb20c4600fa083ba7dab6a0dcc65d3027dc0b46ae9770b2c6e942c5e7"
Sep 11 01:11:34.699722 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.699650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fzgv\" (UniqueName: \"kubernetes.io/projected/c96e31d8-580c-460b-abb0-20c777684e3a-kube-api-access-4fzgv\") pod \"autores-model-dc7dcd-kserve-7f67cfc467-5c65p\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") " pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:34.699881 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.699857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-model-cache\") pod \"autores-model-dc7dcd-kserve-7f67cfc467-5c65p\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") " pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:34.699989 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.699891    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-dshm\") pod \"autores-model-dc7dcd-kserve-7f67cfc467-5c65p\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") " pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:34.699989 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:11:34.699904    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18ffd30eb20c4600fa083ba7dab6a0dcc65d3027dc0b46ae9770b2c6e942c5e7\": container with ID starting with 18ffd30eb20c4600fa083ba7dab6a0dcc65d3027dc0b46ae9770b2c6e942c5e7 not found: ID does not exist" containerID="18ffd30eb20c4600fa083ba7dab6a0dcc65d3027dc0b46ae9770b2c6e942c5e7"
Sep 11 01:11:34.699989 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.699927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-home\") pod \"autores-model-dc7dcd-kserve-7f67cfc467-5c65p\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") " pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:34.699989 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.699937    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18ffd30eb20c4600fa083ba7dab6a0dcc65d3027dc0b46ae9770b2c6e942c5e7"} err="failed to get container status \"18ffd30eb20c4600fa083ba7dab6a0dcc65d3027dc0b46ae9770b2c6e942c5e7\": rpc error: code = NotFound desc = could not find container \"18ffd30eb20c4600fa083ba7dab6a0dcc65d3027dc0b46ae9770b2c6e942c5e7\": container with ID starting with 18ffd30eb20c4600fa083ba7dab6a0dcc65d3027dc0b46ae9770b2c6e942c5e7 not found: ID does not exist"
Sep 11 01:11:34.699989 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.699953    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-tmp-dir\") pod \"autores-model-dc7dcd-kserve-7f67cfc467-5c65p\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") " pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:34.700190 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.700001    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c96e31d8-580c-460b-abb0-20c777684e3a-tls-certs\") pod \"autores-model-dc7dcd-kserve-7f67cfc467-5c65p\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") " pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:34.700275 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.700256    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-model-cache\") pod \"autores-model-dc7dcd-kserve-7f67cfc467-5c65p\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") " pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:34.700343 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.700290    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-tmp-dir\") pod \"autores-model-dc7dcd-kserve-7f67cfc467-5c65p\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") " pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:34.700450 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.700432    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-home\") pod \"autores-model-dc7dcd-kserve-7f67cfc467-5c65p\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") " pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:34.702150 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.702127    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-dshm\") pod \"autores-model-dc7dcd-kserve-7f67cfc467-5c65p\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") " pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:34.702351 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.702334    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c96e31d8-580c-460b-abb0-20c777684e3a-tls-certs\") pod \"autores-model-dc7dcd-kserve-7f67cfc467-5c65p\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") " pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:34.707217 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.707196    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"]
Sep 11 01:11:34.709269 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.709247    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fzgv\" (UniqueName: \"kubernetes.io/projected/c96e31d8-580c-460b-abb0-20c777684e3a-kube-api-access-4fzgv\") pod \"autores-model-dc7dcd-kserve-7f67cfc467-5c65p\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") " pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:34.711334 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.711314    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-1d3c7cc9-gw-openshift-default-79869c5548-mqlm9"]
Sep 11 01:11:34.801926 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:34.801878    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:35.081362 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:35.081334    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"]
Sep 11 01:11:35.083670 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:11:35.083645    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc96e31d8_580c_460b_abb0_20c777684e3a.slice/crio-962c28ed006d5fc30e8973256cd808ab6d951635fecea0bde7cec45c3a45bcba WatchSource:0}: Error finding container 962c28ed006d5fc30e8973256cd808ab6d951635fecea0bde7cec45c3a45bcba: Status 404 returned error can't find the container with id 962c28ed006d5fc30e8973256cd808ab6d951635fecea0bde7cec45c3a45bcba
Sep 11 01:11:35.475666 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:35.475577    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cdb0403-6dfb-4126-a1f3-217984d31424" path="/var/lib/kubelet/pods/4cdb0403-6dfb-4126-a1f3-217984d31424/volumes"
Sep 11 01:11:35.687472 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:35.687437    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p" event={"ID":"c96e31d8-580c-460b-abb0-20c777684e3a","Type":"ContainerStarted","Data":"8365fd4306bc99d83b041724363af9c90bee866a7efa9a0b8374388fc44fe783"}
Sep 11 01:11:35.687654 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:35.687479    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p" event={"ID":"c96e31d8-580c-460b-abb0-20c777684e3a","Type":"ContainerStarted","Data":"962c28ed006d5fc30e8973256cd808ab6d951635fecea0bde7cec45c3a45bcba"}
Sep 11 01:11:35.705206 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:35.705158    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p" podStartSLOduration=1.705143157 podStartE2EDuration="1.705143157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:11:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:11:35.702514792 +0000 UTC m=+812.750603041" watchObservedRunningTime="2026-09-11 01:11:35.705143157 +0000 UTC m=+812.753231380"
Sep 11 01:11:44.802964 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:44.802932    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:44.803359 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:44.802981    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:44.815882 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:44.815857    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:45.691740 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:45.691713    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv"
Sep 11 01:11:45.761983 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:45.761952    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:11:57.142697 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:57.142666    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aba078c2-ww68b"]
Sep 11 01:11:57.143109 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:57.143097    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cdb0403-6dfb-4126-a1f3-217984d31424" containerName="istio-proxy"
Sep 11 01:11:57.143109 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:57.143110    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cdb0403-6dfb-4126-a1f3-217984d31424" containerName="istio-proxy"
Sep 11 01:11:57.143229 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:57.143201    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cdb0403-6dfb-4126-a1f3-217984d31424" containerName="istio-proxy"
Sep 11 01:11:57.145873 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:57.145852    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aba078c2-ww68b"
Sep 11 01:11:57.148315 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:57.148287    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 01:11:57.148315 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:57.148311    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pppkt\""
Sep 11 01:11:57.152681 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:57.152654    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aba078c2-ww68b"]
Sep 11 01:11:57.314852 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:57.314796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-aba078c2-ww68b\" (UID: \"bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aba078c2-ww68b"
Sep 11 01:11:57.416441 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:57.416346    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-aba078c2-ww68b\" (UID: \"bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aba078c2-ww68b"
Sep 11 01:11:57.417013 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:57.416993    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-aba078c2-ww68b\" (UID: \"bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aba078c2-ww68b"
Sep 11 01:11:57.460014 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:57.459986    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aba078c2-ww68b"
Sep 11 01:11:57.732264 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:57.732238    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aba078c2-ww68b"]
Sep 11 01:11:57.733184 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:11:57.733161    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbebcb9af_d9dc_4c71_83d0_e8b2802d9ac1.slice/crio-e9e74536708e65a1bfcee854dcf130b72598f8eed6ace172982bf23dc11d429a WatchSource:0}: Error finding container e9e74536708e65a1bfcee854dcf130b72598f8eed6ace172982bf23dc11d429a: Status 404 returned error can't find the container with id e9e74536708e65a1bfcee854dcf130b72598f8eed6ace172982bf23dc11d429a
Sep 11 01:11:57.735157 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:57.735138    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 01:11:57.816317 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:11:57.816278    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aba078c2-ww68b" event={"ID":"bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1","Type":"ContainerStarted","Data":"e9e74536708e65a1bfcee854dcf130b72598f8eed6ace172982bf23dc11d429a"}
Sep 11 01:12:00.836772 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:00.836733    2565 generic.go:356] "Generic (PLEG): container finished" podID="bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1" containerID="64a58bad8ac0ac2651cd7fc2eaf2a6c3a705faddf87c9729d36505743ec8fe20" exitCode=0
Sep 11 01:12:00.837178 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:00.836845    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aba078c2-ww68b" event={"ID":"bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1","Type":"ContainerDied","Data":"64a58bad8ac0ac2651cd7fc2eaf2a6c3a705faddf87c9729d36505743ec8fe20"}
Sep 11 01:12:01.977060 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:01.977038    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aba078c2-ww68b"
Sep 11 01:12:02.165288 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:02.165190    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1-maas-api-service-ca\") pod \"bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1\" (UID: \"bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1\") "
Sep 11 01:12:02.165683 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:02.165656    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1" (UID: "bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:12:02.165875 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:02.165853    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1-maas-api-service-ca\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:12:02.849927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:02.849887    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aba078c2-ww68b" event={"ID":"bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1","Type":"ContainerDied","Data":"e9e74536708e65a1bfcee854dcf130b72598f8eed6ace172982bf23dc11d429a"}
Sep 11 01:12:02.850106 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:02.849950    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9e74536708e65a1bfcee854dcf130b72598f8eed6ace172982bf23dc11d429a"
Sep 11 01:12:02.850106 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:02.849962    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aba078c2-ww68b"
Sep 11 01:12:05.290926 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.290895    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"]
Sep 11 01:12:05.291287 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.291275    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1" containerName="revoke-keys"
Sep 11 01:12:05.291339 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.291288    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1" containerName="revoke-keys"
Sep 11 01:12:05.291376 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.291366    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1" containerName="revoke-keys"
Sep 11 01:12:05.294384 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.294363    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:05.298085 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.298059    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-cef92e\"/\"openshift-service-ca.crt\""
Sep 11 01:12:05.298208 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.298059    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-cef92e\"/\"test-model-cef92e-kserve-self-signed-certs\""
Sep 11 01:12:05.298208 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.298059    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-cef92e\"/\"kube-root-ca.crt\""
Sep 11 01:12:05.298208 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.298069    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-cef92e\"/\"default-dockercfg-twk6j\""
Sep 11 01:12:05.304475 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.304453    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"]
Sep 11 01:12:05.397964 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.397915    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-home\") pod \"test-model-cef92e-kserve-86554fb565-p6twz\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") " pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:05.397964 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.397964    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44cd6ac5-7db5-4298-a099-f79687a9943e-tls-certs\") pod \"test-model-cef92e-kserve-86554fb565-p6twz\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") " pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:05.398190 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.398033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-model-cache\") pod \"test-model-cef92e-kserve-86554fb565-p6twz\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") " pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:05.398190 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.398083    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swjbx\" (UniqueName: \"kubernetes.io/projected/44cd6ac5-7db5-4298-a099-f79687a9943e-kube-api-access-swjbx\") pod \"test-model-cef92e-kserve-86554fb565-p6twz\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") " pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:05.398190 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.398113    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-tmp-dir\") pod \"test-model-cef92e-kserve-86554fb565-p6twz\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") " pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:05.398338 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.398240    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-dshm\") pod \"test-model-cef92e-kserve-86554fb565-p6twz\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") " pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:05.499519 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.499486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-dshm\") pod \"test-model-cef92e-kserve-86554fb565-p6twz\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") " pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:05.499735 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.499553    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-home\") pod \"test-model-cef92e-kserve-86554fb565-p6twz\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") " pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:05.499735 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.499578    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44cd6ac5-7db5-4298-a099-f79687a9943e-tls-certs\") pod \"test-model-cef92e-kserve-86554fb565-p6twz\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") " pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:05.499735 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.499613    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-model-cache\") pod \"test-model-cef92e-kserve-86554fb565-p6twz\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") " pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:05.500025 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.499996    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-home\") pod \"test-model-cef92e-kserve-86554fb565-p6twz\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") " pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:05.500202 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.500044    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-model-cache\") pod \"test-model-cef92e-kserve-86554fb565-p6twz\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") " pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:05.500202 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.500065    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swjbx\" (UniqueName: \"kubernetes.io/projected/44cd6ac5-7db5-4298-a099-f79687a9943e-kube-api-access-swjbx\") pod \"test-model-cef92e-kserve-86554fb565-p6twz\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") " pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:05.500370 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.500265    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-tmp-dir\") pod \"test-model-cef92e-kserve-86554fb565-p6twz\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") " pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:05.500861 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.500838    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-tmp-dir\") pod \"test-model-cef92e-kserve-86554fb565-p6twz\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") " pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:05.502156 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.502136    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-dshm\") pod \"test-model-cef92e-kserve-86554fb565-p6twz\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") " pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:05.502471 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.502452    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44cd6ac5-7db5-4298-a099-f79687a9943e-tls-certs\") pod \"test-model-cef92e-kserve-86554fb565-p6twz\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") " pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:05.513426 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.513393    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swjbx\" (UniqueName: \"kubernetes.io/projected/44cd6ac5-7db5-4298-a099-f79687a9943e-kube-api-access-swjbx\") pod \"test-model-cef92e-kserve-86554fb565-p6twz\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") " pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:05.605132 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.605038    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:05.879047 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:05.879021    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"]
Sep 11 01:12:05.880053 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:12:05.880027    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44cd6ac5_7db5_4298_a099_f79687a9943e.slice/crio-33dec43795649d6abfecd094a26cf873cfe6d8092a632cc946d2483b1bf2cc70 WatchSource:0}: Error finding container 33dec43795649d6abfecd094a26cf873cfe6d8092a632cc946d2483b1bf2cc70: Status 404 returned error can't find the container with id 33dec43795649d6abfecd094a26cf873cfe6d8092a632cc946d2483b1bf2cc70
Sep 11 01:12:06.229123 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:06.229023    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc7dcd-g659h"]
Sep 11 01:12:06.231710 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:06.231680    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc7dcd-g659h"
Sep 11 01:12:06.234225 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:06.234206    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pppkt\""
Sep 11 01:12:06.234314 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:06.234208    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 01:12:06.241659 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:06.241634    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc7dcd-g659h"]
Sep 11 01:12:06.308029 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:06.307996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/790b230b-1c2e-470c-b314-32b3061c01c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-dc7dcd-g659h\" (UID: \"790b230b-1c2e-470c-b314-32b3061c01c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc7dcd-g659h"
Sep 11 01:12:06.408917 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:06.408884    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/790b230b-1c2e-470c-b314-32b3061c01c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-dc7dcd-g659h\" (UID: \"790b230b-1c2e-470c-b314-32b3061c01c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc7dcd-g659h"
Sep 11 01:12:06.409490 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:06.409468    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/790b230b-1c2e-470c-b314-32b3061c01c7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-dc7dcd-g659h\" (UID: \"790b230b-1c2e-470c-b314-32b3061c01c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc7dcd-g659h"
Sep 11 01:12:06.544441 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:06.544403    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc7dcd-g659h"
Sep 11 01:12:06.816309 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:06.816279    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc7dcd-g659h"]
Sep 11 01:12:06.817075 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:12:06.817040    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod790b230b_1c2e_470c_b314_32b3061c01c7.slice/crio-d2a53fc6e8f23bfcec2c8fde359eb32ef7eda3149a754b0a27f95a814b40951f WatchSource:0}: Error finding container d2a53fc6e8f23bfcec2c8fde359eb32ef7eda3149a754b0a27f95a814b40951f: Status 404 returned error can't find the container with id d2a53fc6e8f23bfcec2c8fde359eb32ef7eda3149a754b0a27f95a814b40951f
Sep 11 01:12:06.873461 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:06.873437    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc7dcd-g659h" event={"ID":"790b230b-1c2e-470c-b314-32b3061c01c7","Type":"ContainerStarted","Data":"d2a53fc6e8f23bfcec2c8fde359eb32ef7eda3149a754b0a27f95a814b40951f"}
Sep 11 01:12:06.875030 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:06.875007    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz" event={"ID":"44cd6ac5-7db5-4298-a099-f79687a9943e","Type":"ContainerStarted","Data":"daa9941e78b886d035869cd3f8fb0cedd605c673ed396dc86edf43a8b0f4f350"}
Sep 11 01:12:06.875134 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:06.875037    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz" event={"ID":"44cd6ac5-7db5-4298-a099-f79687a9943e","Type":"ContainerStarted","Data":"33dec43795649d6abfecd094a26cf873cfe6d8092a632cc946d2483b1bf2cc70"}
Sep 11 01:12:06.895068 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:06.895027    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz" podStartSLOduration=1.895011282 podStartE2EDuration="1.895011282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:12:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:12:06.894524609 +0000 UTC m=+843.942612835" watchObservedRunningTime="2026-09-11 01:12:06.895011282 +0000 UTC m=+843.943099505"
Sep 11 01:12:07.881881 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:07.881783    2565 generic.go:356] "Generic (PLEG): container finished" podID="790b230b-1c2e-470c-b314-32b3061c01c7" containerID="e4e660d3e9535450f08f775b3bc664bd8bb9102c1b9f8ad081dcf99b5710ea2c" exitCode=0
Sep 11 01:12:07.881881 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:07.881854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc7dcd-g659h" event={"ID":"790b230b-1c2e-470c-b314-32b3061c01c7","Type":"ContainerDied","Data":"e4e660d3e9535450f08f775b3bc664bd8bb9102c1b9f8ad081dcf99b5710ea2c"}
Sep 11 01:12:09.023039 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:09.023016    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc7dcd-g659h"
Sep 11 01:12:09.136800 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:09.136770    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/790b230b-1c2e-470c-b314-32b3061c01c7-maas-api-service-ca\") pod \"790b230b-1c2e-470c-b314-32b3061c01c7\" (UID: \"790b230b-1c2e-470c-b314-32b3061c01c7\") "
Sep 11 01:12:09.137158 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:09.137123    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/790b230b-1c2e-470c-b314-32b3061c01c7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "790b230b-1c2e-470c-b314-32b3061c01c7" (UID: "790b230b-1c2e-470c-b314-32b3061c01c7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:12:09.237753 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:09.237665    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/790b230b-1c2e-470c-b314-32b3061c01c7-maas-api-service-ca\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:12:09.895334 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:09.895298    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc7dcd-g659h" event={"ID":"790b230b-1c2e-470c-b314-32b3061c01c7","Type":"ContainerDied","Data":"d2a53fc6e8f23bfcec2c8fde359eb32ef7eda3149a754b0a27f95a814b40951f"}
Sep 11 01:12:09.895334 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:09.895336    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc7dcd-g659h"
Sep 11 01:12:09.895545 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:09.895347    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2a53fc6e8f23bfcec2c8fde359eb32ef7eda3149a754b0a27f95a814b40951f"
Sep 11 01:12:12.300694 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:12.300660    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"]
Sep 11 01:12:13.252892 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:13.252856    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv"]
Sep 11 01:12:13.253097 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:13.253068    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv" podUID="b00e99c8-0b83-4971-bc7c-86c2514dd659" containerName="payload-pre-processing" containerID="cri-o://0015ddf49bd76fb67b836b9a89e55846ccefa9f20b08c633dffd84944679c7c1" gracePeriod=30
Sep 11 01:12:13.410292 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:13.410259    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aba078c2-ww68b"]
Sep 11 01:12:13.412825 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:13.412786    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-aba078c2-ww68b"]
Sep 11 01:12:13.473432 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:13.473403    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1" path="/var/lib/kubelet/pods/bebcb9af-d9dc-4c71-83d0-e8b2802d9ac1/volumes"
Sep 11 01:12:13.509194 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:13.509132    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv"
Sep 11 01:12:13.586077 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:13.585959    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b00e99c8-0b83-4971-bc7c-86c2514dd659-plugins-config-volume\") pod \"b00e99c8-0b83-4971-bc7c-86c2514dd659\" (UID: \"b00e99c8-0b83-4971-bc7c-86c2514dd659\") "
Sep 11 01:12:13.586260 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:13.586194    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hs5d\" (UniqueName: \"kubernetes.io/projected/b00e99c8-0b83-4971-bc7c-86c2514dd659-kube-api-access-5hs5d\") pod \"b00e99c8-0b83-4971-bc7c-86c2514dd659\" (UID: \"b00e99c8-0b83-4971-bc7c-86c2514dd659\") "
Sep 11 01:12:13.586319 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:13.586289    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b00e99c8-0b83-4971-bc7c-86c2514dd659-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b00e99c8-0b83-4971-bc7c-86c2514dd659" (UID: "b00e99c8-0b83-4971-bc7c-86c2514dd659"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:12:13.586565 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:13.586548    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b00e99c8-0b83-4971-bc7c-86c2514dd659-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:12:13.588802 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:13.588757    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b00e99c8-0b83-4971-bc7c-86c2514dd659-kube-api-access-5hs5d" (OuterVolumeSpecName: "kube-api-access-5hs5d") pod "b00e99c8-0b83-4971-bc7c-86c2514dd659" (UID: "b00e99c8-0b83-4971-bc7c-86c2514dd659"). InnerVolumeSpecName "kube-api-access-5hs5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:12:13.687764 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:13.687737    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hs5d\" (UniqueName: \"kubernetes.io/projected/b00e99c8-0b83-4971-bc7c-86c2514dd659-kube-api-access-5hs5d\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:12:13.920577 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:13.920536    2565 generic.go:356] "Generic (PLEG): container finished" podID="b00e99c8-0b83-4971-bc7c-86c2514dd659" containerID="0015ddf49bd76fb67b836b9a89e55846ccefa9f20b08c633dffd84944679c7c1" exitCode=0
Sep 11 01:12:13.920772 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:13.920595    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv" event={"ID":"b00e99c8-0b83-4971-bc7c-86c2514dd659","Type":"ContainerDied","Data":"0015ddf49bd76fb67b836b9a89e55846ccefa9f20b08c633dffd84944679c7c1"}
Sep 11 01:12:13.920772 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:13.920659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv" event={"ID":"b00e99c8-0b83-4971-bc7c-86c2514dd659","Type":"ContainerDied","Data":"56ee81038bcbd5db53d0076c0e64102336aa6a8f6b5d1b08e3ab20e60c2cae1e"}
Sep 11 01:12:13.920772 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:13.920687    2565 scope.go:117] "RemoveContainer" containerID="0015ddf49bd76fb67b836b9a89e55846ccefa9f20b08c633dffd84944679c7c1"
Sep 11 01:12:13.920994 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:13.920606    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv"
Sep 11 01:12:13.931064 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:13.931038    2565 scope.go:117] "RemoveContainer" containerID="0015ddf49bd76fb67b836b9a89e55846ccefa9f20b08c633dffd84944679c7c1"
Sep 11 01:12:13.931408 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:12:13.931389    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0015ddf49bd76fb67b836b9a89e55846ccefa9f20b08c633dffd84944679c7c1\": container with ID starting with 0015ddf49bd76fb67b836b9a89e55846ccefa9f20b08c633dffd84944679c7c1 not found: ID does not exist" containerID="0015ddf49bd76fb67b836b9a89e55846ccefa9f20b08c633dffd84944679c7c1"
Sep 11 01:12:13.931470 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:13.931417    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0015ddf49bd76fb67b836b9a89e55846ccefa9f20b08c633dffd84944679c7c1"} err="failed to get container status \"0015ddf49bd76fb67b836b9a89e55846ccefa9f20b08c633dffd84944679c7c1\": rpc error: code = NotFound desc = could not find container \"0015ddf49bd76fb67b836b9a89e55846ccefa9f20b08c633dffd84944679c7c1\": container with ID starting with 0015ddf49bd76fb67b836b9a89e55846ccefa9f20b08c633dffd84944679c7c1 not found: ID does not exist"
Sep 11 01:12:13.944032 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:13.943679    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv"]
Sep 11 01:12:13.947189 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:13.947169    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-aba078c2-5f89d47446-dv6fv"]
Sep 11 01:12:15.480163 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:15.480128    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b00e99c8-0b83-4971-bc7c-86c2514dd659" path="/var/lib/kubelet/pods/b00e99c8-0b83-4971-bc7c-86c2514dd659/volumes"
Sep 11 01:12:15.605525 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:15.605492    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:15.605671 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:15.605545    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:15.618238 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:15.618209    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:15.944928 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:15.944900    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:12:17.060199 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:17.060166    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd"]
Sep 11 01:12:17.060601 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:17.060420    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd" podUID="492449bf-2102-4169-b0b4-f32b86c9f0b9" containerName="payload-processing" containerID="cri-o://01f5b1b8d001008490d23fcb396179672c086353cc5743a721ff7f449a3f7c6e" gracePeriod=30
Sep 11 01:12:17.251545 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:17.251468    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc7dcd-g659h"]
Sep 11 01:12:17.254589 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:17.254558    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-dc7dcd-g659h"]
Sep 11 01:12:17.322368 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:17.322313    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd"
Sep 11 01:12:17.420926 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:17.420890    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/492449bf-2102-4169-b0b4-f32b86c9f0b9-plugins-config-volume\") pod \"492449bf-2102-4169-b0b4-f32b86c9f0b9\" (UID: \"492449bf-2102-4169-b0b4-f32b86c9f0b9\") "
Sep 11 01:12:17.421071 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:17.421023    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg6z2\" (UniqueName: \"kubernetes.io/projected/492449bf-2102-4169-b0b4-f32b86c9f0b9-kube-api-access-fg6z2\") pod \"492449bf-2102-4169-b0b4-f32b86c9f0b9\" (UID: \"492449bf-2102-4169-b0b4-f32b86c9f0b9\") "
Sep 11 01:12:17.421294 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:17.421272    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/492449bf-2102-4169-b0b4-f32b86c9f0b9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "492449bf-2102-4169-b0b4-f32b86c9f0b9" (UID: "492449bf-2102-4169-b0b4-f32b86c9f0b9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:12:17.423124 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:17.423097    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/492449bf-2102-4169-b0b4-f32b86c9f0b9-kube-api-access-fg6z2" (OuterVolumeSpecName: "kube-api-access-fg6z2") pod "492449bf-2102-4169-b0b4-f32b86c9f0b9" (UID: "492449bf-2102-4169-b0b4-f32b86c9f0b9"). InnerVolumeSpecName "kube-api-access-fg6z2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:12:17.473242 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:17.473208    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="790b230b-1c2e-470c-b314-32b3061c01c7" path="/var/lib/kubelet/pods/790b230b-1c2e-470c-b314-32b3061c01c7/volumes"
Sep 11 01:12:17.521803 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:17.521777    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fg6z2\" (UniqueName: \"kubernetes.io/projected/492449bf-2102-4169-b0b4-f32b86c9f0b9-kube-api-access-fg6z2\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:12:17.521803 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:17.521800    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/492449bf-2102-4169-b0b4-f32b86c9f0b9-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:12:17.946751 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:17.946717    2565 generic.go:356] "Generic (PLEG): container finished" podID="492449bf-2102-4169-b0b4-f32b86c9f0b9" containerID="01f5b1b8d001008490d23fcb396179672c086353cc5743a721ff7f449a3f7c6e" exitCode=0
Sep 11 01:12:17.946953 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:17.946763    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd"
Sep 11 01:12:17.946953 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:17.946788    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd" event={"ID":"492449bf-2102-4169-b0b4-f32b86c9f0b9","Type":"ContainerDied","Data":"01f5b1b8d001008490d23fcb396179672c086353cc5743a721ff7f449a3f7c6e"}
Sep 11 01:12:17.946953 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:17.946860    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd" event={"ID":"492449bf-2102-4169-b0b4-f32b86c9f0b9","Type":"ContainerDied","Data":"d6efc09bfb9fbaa60c55c2d82c714c1c54942d0f7e0602d27e9a2b575f24bdf3"}
Sep 11 01:12:17.946953 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:17.946881    2565 scope.go:117] "RemoveContainer" containerID="01f5b1b8d001008490d23fcb396179672c086353cc5743a721ff7f449a3f7c6e"
Sep 11 01:12:17.956119 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:17.956101    2565 scope.go:117] "RemoveContainer" containerID="01f5b1b8d001008490d23fcb396179672c086353cc5743a721ff7f449a3f7c6e"
Sep 11 01:12:17.956383 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:12:17.956362    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01f5b1b8d001008490d23fcb396179672c086353cc5743a721ff7f449a3f7c6e\": container with ID starting with 01f5b1b8d001008490d23fcb396179672c086353cc5743a721ff7f449a3f7c6e not found: ID does not exist" containerID="01f5b1b8d001008490d23fcb396179672c086353cc5743a721ff7f449a3f7c6e"
Sep 11 01:12:17.956453 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:17.956391    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01f5b1b8d001008490d23fcb396179672c086353cc5743a721ff7f449a3f7c6e"} err="failed to get container status \"01f5b1b8d001008490d23fcb396179672c086353cc5743a721ff7f449a3f7c6e\": rpc error: code = NotFound desc = could not find container \"01f5b1b8d001008490d23fcb396179672c086353cc5743a721ff7f449a3f7c6e\": container with ID starting with 01f5b1b8d001008490d23fcb396179672c086353cc5743a721ff7f449a3f7c6e not found: ID does not exist"
Sep 11 01:12:17.968984 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:17.968930    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd"]
Sep 11 01:12:17.971418 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:17.971396    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-dc7dcd-57499fcd99-bhxnd"]
Sep 11 01:12:19.471601 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.471571    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="492449bf-2102-4169-b0b4-f32b86c9f0b9" path="/var/lib/kubelet/pods/492449bf-2102-4169-b0b4-f32b86c9f0b9/volumes"
Sep 11 01:12:19.544184 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.544145    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks"]
Sep 11 01:12:19.545700 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.545670    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b00e99c8-0b83-4971-bc7c-86c2514dd659" containerName="payload-pre-processing"
Sep 11 01:12:19.545700 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.545701    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b00e99c8-0b83-4971-bc7c-86c2514dd659" containerName="payload-pre-processing"
Sep 11 01:12:19.545894 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.545721    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="790b230b-1c2e-470c-b314-32b3061c01c7" containerName="revoke-keys"
Sep 11 01:12:19.545894 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.545731    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="790b230b-1c2e-470c-b314-32b3061c01c7" containerName="revoke-keys"
Sep 11 01:12:19.546281 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.546242    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="492449bf-2102-4169-b0b4-f32b86c9f0b9" containerName="payload-processing"
Sep 11 01:12:19.546281 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.546260    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="492449bf-2102-4169-b0b4-f32b86c9f0b9" containerName="payload-processing"
Sep 11 01:12:19.546489 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.546475    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="492449bf-2102-4169-b0b4-f32b86c9f0b9" containerName="payload-processing"
Sep 11 01:12:19.546572 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.546502    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b00e99c8-0b83-4971-bc7c-86c2514dd659" containerName="payload-pre-processing"
Sep 11 01:12:19.546572 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.546517    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="790b230b-1c2e-470c-b314-32b3061c01c7" containerName="revoke-keys"
Sep 11 01:12:19.550895 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.550871    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks"
Sep 11 01:12:19.556280 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.556258    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-39ea7c6f-dockercfg-57cr9\""
Sep 11 01:12:19.556543 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.556527    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-39ea7c6f\""
Sep 11 01:12:19.563512 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.563490    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks"]
Sep 11 01:12:19.566910 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.566875    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k"]
Sep 11 01:12:19.569421 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.569403    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k"
Sep 11 01:12:19.583435 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.583406    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k"]
Sep 11 01:12:19.643060 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.643026    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dc69222-c73e-4b33-9176-e600a30a8896-plugins-config-volume\") pod \"payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k\" (UID: \"0dc69222-c73e-4b33-9176-e600a30a8896\") " pod="openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k"
Sep 11 01:12:19.643223 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.643133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca96efcc-0aa6-4d0d-98eb-f02c594eba3b-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks\" (UID: \"ca96efcc-0aa6-4d0d-98eb-f02c594eba3b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks"
Sep 11 01:12:19.643223 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.643191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2v5j\" (UniqueName: \"kubernetes.io/projected/ca96efcc-0aa6-4d0d-98eb-f02c594eba3b-kube-api-access-b2v5j\") pod \"payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks\" (UID: \"ca96efcc-0aa6-4d0d-98eb-f02c594eba3b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks"
Sep 11 01:12:19.643223 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.643215    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r78lj\" (UniqueName: \"kubernetes.io/projected/0dc69222-c73e-4b33-9176-e600a30a8896-kube-api-access-r78lj\") pod \"payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k\" (UID: \"0dc69222-c73e-4b33-9176-e600a30a8896\") " pod="openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k"
Sep 11 01:12:19.743905 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.743775    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2v5j\" (UniqueName: \"kubernetes.io/projected/ca96efcc-0aa6-4d0d-98eb-f02c594eba3b-kube-api-access-b2v5j\") pod \"payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks\" (UID: \"ca96efcc-0aa6-4d0d-98eb-f02c594eba3b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks"
Sep 11 01:12:19.743905 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.743861    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r78lj\" (UniqueName: \"kubernetes.io/projected/0dc69222-c73e-4b33-9176-e600a30a8896-kube-api-access-r78lj\") pod \"payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k\" (UID: \"0dc69222-c73e-4b33-9176-e600a30a8896\") " pod="openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k"
Sep 11 01:12:19.744121 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.743911    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dc69222-c73e-4b33-9176-e600a30a8896-plugins-config-volume\") pod \"payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k\" (UID: \"0dc69222-c73e-4b33-9176-e600a30a8896\") " pod="openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k"
Sep 11 01:12:19.744121 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.744007    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca96efcc-0aa6-4d0d-98eb-f02c594eba3b-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks\" (UID: \"ca96efcc-0aa6-4d0d-98eb-f02c594eba3b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks"
Sep 11 01:12:19.744662 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.744642    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dc69222-c73e-4b33-9176-e600a30a8896-plugins-config-volume\") pod \"payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k\" (UID: \"0dc69222-c73e-4b33-9176-e600a30a8896\") " pod="openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k"
Sep 11 01:12:19.744757 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.744715    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca96efcc-0aa6-4d0d-98eb-f02c594eba3b-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks\" (UID: \"ca96efcc-0aa6-4d0d-98eb-f02c594eba3b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks"
Sep 11 01:12:19.753744 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.753718    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r78lj\" (UniqueName: \"kubernetes.io/projected/0dc69222-c73e-4b33-9176-e600a30a8896-kube-api-access-r78lj\") pod \"payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k\" (UID: \"0dc69222-c73e-4b33-9176-e600a30a8896\") " pod="openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k"
Sep 11 01:12:19.755086 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.755066    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2v5j\" (UniqueName: \"kubernetes.io/projected/ca96efcc-0aa6-4d0d-98eb-f02c594eba3b-kube-api-access-b2v5j\") pod \"payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks\" (UID: \"ca96efcc-0aa6-4d0d-98eb-f02c594eba3b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks"
Sep 11 01:12:19.863338 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.863307    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks"
Sep 11 01:12:19.881809 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:19.881748    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k"
Sep 11 01:12:20.137781 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:20.137754    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks"]
Sep 11 01:12:20.139634 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:12:20.139610    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca96efcc_0aa6_4d0d_98eb_f02c594eba3b.slice/crio-e03944a0d0a31ca3f37de36c6de8e235039e7e53cfad97381353f65d000cd6f2 WatchSource:0}: Error finding container e03944a0d0a31ca3f37de36c6de8e235039e7e53cfad97381353f65d000cd6f2: Status 404 returned error can't find the container with id e03944a0d0a31ca3f37de36c6de8e235039e7e53cfad97381353f65d000cd6f2
Sep 11 01:12:20.173050 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:20.173022    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k"]
Sep 11 01:12:20.176911 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:12:20.176881    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dc69222_c73e_4b33_9176_e600a30a8896.slice/crio-5c57921e8cf8d05e2b661e06094c68de3c22d6440930b0ad6d552571279d5925 WatchSource:0}: Error finding container 5c57921e8cf8d05e2b661e06094c68de3c22d6440930b0ad6d552571279d5925: Status 404 returned error can't find the container with id 5c57921e8cf8d05e2b661e06094c68de3c22d6440930b0ad6d552571279d5925
Sep 11 01:12:20.970696 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:20.970661    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k" event={"ID":"0dc69222-c73e-4b33-9176-e600a30a8896","Type":"ContainerStarted","Data":"d97359820854f7060e041039f63349996bb111385850058982dd529c4c00c122"}
Sep 11 01:12:20.971157 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:20.970712    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k" event={"ID":"0dc69222-c73e-4b33-9176-e600a30a8896","Type":"ContainerStarted","Data":"5c57921e8cf8d05e2b661e06094c68de3c22d6440930b0ad6d552571279d5925"}
Sep 11 01:12:20.971157 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:20.970752    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k"
Sep 11 01:12:20.972356 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:20.972336    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks" event={"ID":"ca96efcc-0aa6-4d0d-98eb-f02c594eba3b","Type":"ContainerStarted","Data":"b259d623b4d7906b6e8d84b6f360e7d15b99c98506bb751d38ca105be9242008"}
Sep 11 01:12:20.972462 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:20.972370    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks" event={"ID":"ca96efcc-0aa6-4d0d-98eb-f02c594eba3b","Type":"ContainerStarted","Data":"e03944a0d0a31ca3f37de36c6de8e235039e7e53cfad97381353f65d000cd6f2"}
Sep 11 01:12:20.972462 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:20.972450    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks"
Sep 11 01:12:20.989621 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:20.989572    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k" podStartSLOduration=1.9895533890000001 podStartE2EDuration="1.989553389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:12:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:12:20.987112701 +0000 UTC m=+858.035200944" watchObservedRunningTime="2026-09-11 01:12:20.989553389 +0000 UTC m=+858.037641617"
Sep 11 01:12:21.003848 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:21.003786    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks" podStartSLOduration=2.003774919 podStartE2EDuration="2.003774919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:12:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:12:21.00293183 +0000 UTC m=+858.051020074" watchObservedRunningTime="2026-09-11 01:12:21.003774919 +0000 UTC m=+858.051863143"
Sep 11 01:12:27.319700 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:27.319651    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p" podUID="c96e31d8-580c-460b-abb0-20c777684e3a" containerName="main" containerID="cri-o://8365fd4306bc99d83b041724363af9c90bee866a7efa9a0b8374388fc44fe783" gracePeriod=45
Sep 11 01:12:27.580332 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:27.580274    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:12:27.718899 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:27.718866    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-dshm\") pod \"c96e31d8-580c-460b-abb0-20c777684e3a\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") "
Sep 11 01:12:27.719066 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:27.718915    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-tmp-dir\") pod \"c96e31d8-580c-460b-abb0-20c777684e3a\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") "
Sep 11 01:12:27.719066 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:27.719021    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-home\") pod \"c96e31d8-580c-460b-abb0-20c777684e3a\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") "
Sep 11 01:12:27.719066 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:27.719042    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c96e31d8-580c-460b-abb0-20c777684e3a-tls-certs\") pod \"c96e31d8-580c-460b-abb0-20c777684e3a\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") "
Sep 11 01:12:27.719228 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:27.719066    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fzgv\" (UniqueName: \"kubernetes.io/projected/c96e31d8-580c-460b-abb0-20c777684e3a-kube-api-access-4fzgv\") pod \"c96e31d8-580c-460b-abb0-20c777684e3a\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") "
Sep 11 01:12:27.719228 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:27.719097    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-model-cache\") pod \"c96e31d8-580c-460b-abb0-20c777684e3a\" (UID: \"c96e31d8-580c-460b-abb0-20c777684e3a\") "
Sep 11 01:12:27.719335 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:27.719212    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c96e31d8-580c-460b-abb0-20c777684e3a" (UID: "c96e31d8-580c-460b-abb0-20c777684e3a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:12:27.719335 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:27.719309    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-home" (OuterVolumeSpecName: "home") pod "c96e31d8-580c-460b-abb0-20c777684e3a" (UID: "c96e31d8-580c-460b-abb0-20c777684e3a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:12:27.719452 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:27.719390    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-model-cache" (OuterVolumeSpecName: "model-cache") pod "c96e31d8-580c-460b-abb0-20c777684e3a" (UID: "c96e31d8-580c-460b-abb0-20c777684e3a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:12:27.719508 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:27.719447    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-tmp-dir\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:12:27.719508 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:27.719466    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-home\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:12:27.721108 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:27.721082    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-dshm" (OuterVolumeSpecName: "dshm") pod "c96e31d8-580c-460b-abb0-20c777684e3a" (UID: "c96e31d8-580c-460b-abb0-20c777684e3a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:12:27.721221 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:27.721207    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c96e31d8-580c-460b-abb0-20c777684e3a-kube-api-access-4fzgv" (OuterVolumeSpecName: "kube-api-access-4fzgv") pod "c96e31d8-580c-460b-abb0-20c777684e3a" (UID: "c96e31d8-580c-460b-abb0-20c777684e3a"). InnerVolumeSpecName "kube-api-access-4fzgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:12:27.721284 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:27.721249    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c96e31d8-580c-460b-abb0-20c777684e3a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c96e31d8-580c-460b-abb0-20c777684e3a" (UID: "c96e31d8-580c-460b-abb0-20c777684e3a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:12:27.819973 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:27.819939    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-dshm\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:12:27.819973 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:27.819966    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c96e31d8-580c-460b-abb0-20c777684e3a-tls-certs\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:12:27.819973 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:27.819977    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fzgv\" (UniqueName: \"kubernetes.io/projected/c96e31d8-580c-460b-abb0-20c777684e3a-kube-api-access-4fzgv\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:12:27.820185 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:27.819986    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c96e31d8-580c-460b-abb0-20c777684e3a-model-cache\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:12:28.014168 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:28.014064    2565 generic.go:356] "Generic (PLEG): container finished" podID="c96e31d8-580c-460b-abb0-20c777684e3a" containerID="8365fd4306bc99d83b041724363af9c90bee866a7efa9a0b8374388fc44fe783" exitCode=0
Sep 11 01:12:28.014168 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:28.014124    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"
Sep 11 01:12:28.014168 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:28.014153    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p" event={"ID":"c96e31d8-580c-460b-abb0-20c777684e3a","Type":"ContainerDied","Data":"8365fd4306bc99d83b041724363af9c90bee866a7efa9a0b8374388fc44fe783"}
Sep 11 01:12:28.014384 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:28.014200    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p" event={"ID":"c96e31d8-580c-460b-abb0-20c777684e3a","Type":"ContainerDied","Data":"962c28ed006d5fc30e8973256cd808ab6d951635fecea0bde7cec45c3a45bcba"}
Sep 11 01:12:28.014384 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:28.014217    2565 scope.go:117] "RemoveContainer" containerID="8365fd4306bc99d83b041724363af9c90bee866a7efa9a0b8374388fc44fe783"
Sep 11 01:12:28.023975 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:28.023956    2565 scope.go:117] "RemoveContainer" containerID="8365fd4306bc99d83b041724363af9c90bee866a7efa9a0b8374388fc44fe783"
Sep 11 01:12:28.024274 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:12:28.024256    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8365fd4306bc99d83b041724363af9c90bee866a7efa9a0b8374388fc44fe783\": container with ID starting with 8365fd4306bc99d83b041724363af9c90bee866a7efa9a0b8374388fc44fe783 not found: ID does not exist" containerID="8365fd4306bc99d83b041724363af9c90bee866a7efa9a0b8374388fc44fe783"
Sep 11 01:12:28.024326 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:28.024283    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8365fd4306bc99d83b041724363af9c90bee866a7efa9a0b8374388fc44fe783"} err="failed to get container status \"8365fd4306bc99d83b041724363af9c90bee866a7efa9a0b8374388fc44fe783\": rpc error: code = NotFound desc = could not find container \"8365fd4306bc99d83b041724363af9c90bee866a7efa9a0b8374388fc44fe783\": container with ID starting with 8365fd4306bc99d83b041724363af9c90bee866a7efa9a0b8374388fc44fe783 not found: ID does not exist"
Sep 11 01:12:28.036437 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:28.036339    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"]
Sep 11 01:12:28.039010 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:28.038990    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-dc7dcd/autores-model-dc7dcd-kserve-7f67cfc467-5c65p"]
Sep 11 01:12:29.472210 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:29.472179    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c96e31d8-580c-460b-abb0-20c777684e3a" path="/var/lib/kubelet/pods/c96e31d8-580c-460b-abb0-20c777684e3a/volumes"
Sep 11 01:12:31.980902 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:31.980871    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k"
Sep 11 01:12:31.981350 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:31.980946    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks"
Sep 11 01:12:35.115551 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:35.115520    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr"]
Sep 11 01:12:35.115997 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:35.115982    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c96e31d8-580c-460b-abb0-20c777684e3a" containerName="main"
Sep 11 01:12:35.115997 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:35.115999    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c96e31d8-580c-460b-abb0-20c777684e3a" containerName="main"
Sep 11 01:12:35.116084 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:35.116074    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c96e31d8-580c-460b-abb0-20c777684e3a" containerName="main"
Sep 11 01:12:35.123147 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:35.123126    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr"
Sep 11 01:12:35.125798 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:35.125774    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-8d451c-dockercfg-nlhpd\""
Sep 11 01:12:35.126420 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:35.126401    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-8d451c\""
Sep 11 01:12:35.137653 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:35.137628    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr"]
Sep 11 01:12:35.294176 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:35.294139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b2vn\" (UniqueName: \"kubernetes.io/projected/b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d-kube-api-access-5b2vn\") pod \"payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr\" (UID: \"b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d\") " pod="openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr"
Sep 11 01:12:35.294362 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:35.294200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d-plugins-config-volume\") pod \"payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr\" (UID: \"b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d\") " pod="openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr"
Sep 11 01:12:35.395154 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:35.395058    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b2vn\" (UniqueName: \"kubernetes.io/projected/b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d-kube-api-access-5b2vn\") pod \"payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr\" (UID: \"b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d\") " pod="openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr"
Sep 11 01:12:35.395154 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:35.395153    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d-plugins-config-volume\") pod \"payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr\" (UID: \"b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d\") " pod="openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr"
Sep 11 01:12:35.395864 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:35.395844    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d-plugins-config-volume\") pod \"payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr\" (UID: \"b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d\") " pod="openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr"
Sep 11 01:12:35.407302 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:35.407270    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b2vn\" (UniqueName: \"kubernetes.io/projected/b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d-kube-api-access-5b2vn\") pod \"payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr\" (UID: \"b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d\") " pod="openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr"
Sep 11 01:12:35.433910 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:35.433887    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr"
Sep 11 01:12:35.717003 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:35.716974    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr"]
Sep 11 01:12:35.718751 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:12:35.718724    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4dfe433_b9c5_4aa2_8b75_ffb7d1ed9e3d.slice/crio-e298e5955553278902a567d1d541f5a89ad9753ccb4f05c7af0e62ccb9b74114 WatchSource:0}: Error finding container e298e5955553278902a567d1d541f5a89ad9753ccb4f05c7af0e62ccb9b74114: Status 404 returned error can't find the container with id e298e5955553278902a567d1d541f5a89ad9753ccb4f05c7af0e62ccb9b74114
Sep 11 01:12:36.061509 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:36.061470    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr" event={"ID":"b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d","Type":"ContainerStarted","Data":"379e7e1d09b64dc2ff6362fe3cb4773b7e60f1f9efb042b23c73d0a4a49789ab"}
Sep 11 01:12:36.061699 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:36.061544    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr" event={"ID":"b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d","Type":"ContainerStarted","Data":"e298e5955553278902a567d1d541f5a89ad9753ccb4f05c7af0e62ccb9b74114"}
Sep 11 01:12:36.061699 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:36.061583    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr"
Sep 11 01:12:36.076584 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:36.076534    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr" podStartSLOduration=1.076514756 podStartE2EDuration="1.076514756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:12:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:12:36.075940999 +0000 UTC m=+873.124029243" watchObservedRunningTime="2026-09-11 01:12:36.076514756 +0000 UTC m=+873.124602983"
Sep 11 01:12:47.069364 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:47.069334    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr"
Sep 11 01:12:49.590926 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:49.590885    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k"]
Sep 11 01:12:49.591359 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:49.591179    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k" podUID="0dc69222-c73e-4b33-9176-e600a30a8896" containerName="payload-processing" containerID="cri-o://d97359820854f7060e041039f63349996bb111385850058982dd529c4c00c122" gracePeriod=30
Sep 11 01:12:49.598692 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:49.598665    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks"]
Sep 11 01:12:49.598897 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:49.598875    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks" podUID="ca96efcc-0aa6-4d0d-98eb-f02c594eba3b" containerName="payload-pre-processing" containerID="cri-o://b259d623b4d7906b6e8d84b6f360e7d15b99c98506bb751d38ca105be9242008" gracePeriod=30
Sep 11 01:12:49.870909 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:49.870849    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k"
Sep 11 01:12:49.903503 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:49.903475    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks"
Sep 11 01:12:49.929530 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:49.929504    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dc69222-c73e-4b33-9176-e600a30a8896-plugins-config-volume\") pod \"0dc69222-c73e-4b33-9176-e600a30a8896\" (UID: \"0dc69222-c73e-4b33-9176-e600a30a8896\") "
Sep 11 01:12:49.929664 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:49.929572    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r78lj\" (UniqueName: \"kubernetes.io/projected/0dc69222-c73e-4b33-9176-e600a30a8896-kube-api-access-r78lj\") pod \"0dc69222-c73e-4b33-9176-e600a30a8896\" (UID: \"0dc69222-c73e-4b33-9176-e600a30a8896\") "
Sep 11 01:12:49.929664 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:49.929621    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2v5j\" (UniqueName: \"kubernetes.io/projected/ca96efcc-0aa6-4d0d-98eb-f02c594eba3b-kube-api-access-b2v5j\") pod \"ca96efcc-0aa6-4d0d-98eb-f02c594eba3b\" (UID: \"ca96efcc-0aa6-4d0d-98eb-f02c594eba3b\") "
Sep 11 01:12:49.929664 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:49.929651    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca96efcc-0aa6-4d0d-98eb-f02c594eba3b-plugins-config-volume\") pod \"ca96efcc-0aa6-4d0d-98eb-f02c594eba3b\" (UID: \"ca96efcc-0aa6-4d0d-98eb-f02c594eba3b\") "
Sep 11 01:12:49.930042 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:49.930013    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dc69222-c73e-4b33-9176-e600a30a8896-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0dc69222-c73e-4b33-9176-e600a30a8896" (UID: "0dc69222-c73e-4b33-9176-e600a30a8896"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:12:49.930159 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:49.930084    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca96efcc-0aa6-4d0d-98eb-f02c594eba3b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ca96efcc-0aa6-4d0d-98eb-f02c594eba3b" (UID: "ca96efcc-0aa6-4d0d-98eb-f02c594eba3b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:12:49.931604 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:49.931583    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca96efcc-0aa6-4d0d-98eb-f02c594eba3b-kube-api-access-b2v5j" (OuterVolumeSpecName: "kube-api-access-b2v5j") pod "ca96efcc-0aa6-4d0d-98eb-f02c594eba3b" (UID: "ca96efcc-0aa6-4d0d-98eb-f02c594eba3b"). InnerVolumeSpecName "kube-api-access-b2v5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:12:49.931663 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:49.931622    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dc69222-c73e-4b33-9176-e600a30a8896-kube-api-access-r78lj" (OuterVolumeSpecName: "kube-api-access-r78lj") pod "0dc69222-c73e-4b33-9176-e600a30a8896" (UID: "0dc69222-c73e-4b33-9176-e600a30a8896"). InnerVolumeSpecName "kube-api-access-r78lj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:12:50.031029 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.030989    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dc69222-c73e-4b33-9176-e600a30a8896-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:12:50.031029 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.031022    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r78lj\" (UniqueName: \"kubernetes.io/projected/0dc69222-c73e-4b33-9176-e600a30a8896-kube-api-access-r78lj\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:12:50.031029 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.031031    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2v5j\" (UniqueName: \"kubernetes.io/projected/ca96efcc-0aa6-4d0d-98eb-f02c594eba3b-kube-api-access-b2v5j\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:12:50.031029 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.031040    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca96efcc-0aa6-4d0d-98eb-f02c594eba3b-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:12:50.138501 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.138415    2565 generic.go:356] "Generic (PLEG): container finished" podID="0dc69222-c73e-4b33-9176-e600a30a8896" containerID="d97359820854f7060e041039f63349996bb111385850058982dd529c4c00c122" exitCode=0
Sep 11 01:12:50.138501 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.138455    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k"
Sep 11 01:12:50.138692 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.138498    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k" event={"ID":"0dc69222-c73e-4b33-9176-e600a30a8896","Type":"ContainerDied","Data":"d97359820854f7060e041039f63349996bb111385850058982dd529c4c00c122"}
Sep 11 01:12:50.138692 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.138549    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k" event={"ID":"0dc69222-c73e-4b33-9176-e600a30a8896","Type":"ContainerDied","Data":"5c57921e8cf8d05e2b661e06094c68de3c22d6440930b0ad6d552571279d5925"}
Sep 11 01:12:50.138692 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.138576    2565 scope.go:117] "RemoveContainer" containerID="d97359820854f7060e041039f63349996bb111385850058982dd529c4c00c122"
Sep 11 01:12:50.139941 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.139918    2565 generic.go:356] "Generic (PLEG): container finished" podID="ca96efcc-0aa6-4d0d-98eb-f02c594eba3b" containerID="b259d623b4d7906b6e8d84b6f360e7d15b99c98506bb751d38ca105be9242008" exitCode=0
Sep 11 01:12:50.140053 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.139950    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks" event={"ID":"ca96efcc-0aa6-4d0d-98eb-f02c594eba3b","Type":"ContainerDied","Data":"b259d623b4d7906b6e8d84b6f360e7d15b99c98506bb751d38ca105be9242008"}
Sep 11 01:12:50.140053 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.139972    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks"
Sep 11 01:12:50.140053 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.140011    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks" event={"ID":"ca96efcc-0aa6-4d0d-98eb-f02c594eba3b","Type":"ContainerDied","Data":"e03944a0d0a31ca3f37de36c6de8e235039e7e53cfad97381353f65d000cd6f2"}
Sep 11 01:12:50.148317 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.148297    2565 scope.go:117] "RemoveContainer" containerID="d97359820854f7060e041039f63349996bb111385850058982dd529c4c00c122"
Sep 11 01:12:50.148622 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:12:50.148603    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d97359820854f7060e041039f63349996bb111385850058982dd529c4c00c122\": container with ID starting with d97359820854f7060e041039f63349996bb111385850058982dd529c4c00c122 not found: ID does not exist" containerID="d97359820854f7060e041039f63349996bb111385850058982dd529c4c00c122"
Sep 11 01:12:50.148675 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.148630    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d97359820854f7060e041039f63349996bb111385850058982dd529c4c00c122"} err="failed to get container status \"d97359820854f7060e041039f63349996bb111385850058982dd529c4c00c122\": rpc error: code = NotFound desc = could not find container \"d97359820854f7060e041039f63349996bb111385850058982dd529c4c00c122\": container with ID starting with d97359820854f7060e041039f63349996bb111385850058982dd529c4c00c122 not found: ID does not exist"
Sep 11 01:12:50.148675 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.148647    2565 scope.go:117] "RemoveContainer" containerID="b259d623b4d7906b6e8d84b6f360e7d15b99c98506bb751d38ca105be9242008"
Sep 11 01:12:50.157070 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.157054    2565 scope.go:117] "RemoveContainer" containerID="b259d623b4d7906b6e8d84b6f360e7d15b99c98506bb751d38ca105be9242008"
Sep 11 01:12:50.157326 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:12:50.157310    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b259d623b4d7906b6e8d84b6f360e7d15b99c98506bb751d38ca105be9242008\": container with ID starting with b259d623b4d7906b6e8d84b6f360e7d15b99c98506bb751d38ca105be9242008 not found: ID does not exist" containerID="b259d623b4d7906b6e8d84b6f360e7d15b99c98506bb751d38ca105be9242008"
Sep 11 01:12:50.157391 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.157331    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b259d623b4d7906b6e8d84b6f360e7d15b99c98506bb751d38ca105be9242008"} err="failed to get container status \"b259d623b4d7906b6e8d84b6f360e7d15b99c98506bb751d38ca105be9242008\": rpc error: code = NotFound desc = could not find container \"b259d623b4d7906b6e8d84b6f360e7d15b99c98506bb751d38ca105be9242008\": container with ID starting with b259d623b4d7906b6e8d84b6f360e7d15b99c98506bb751d38ca105be9242008 not found: ID does not exist"
Sep 11 01:12:50.164299 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.164279    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k"]
Sep 11 01:12:50.168271 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.168249    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-39ea7c6f-fd968b857-7mq2k"]
Sep 11 01:12:50.179560 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.179541    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks"]
Sep 11 01:12:50.186081 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:50.186061    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-39ea7c6f-69f5574754-lmcks"]
Sep 11 01:12:51.472530 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:51.472496    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dc69222-c73e-4b33-9176-e600a30a8896" path="/var/lib/kubelet/pods/0dc69222-c73e-4b33-9176-e600a30a8896/volumes"
Sep 11 01:12:51.472916 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:51.472894    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca96efcc-0aa6-4d0d-98eb-f02c594eba3b" path="/var/lib/kubelet/pods/ca96efcc-0aa6-4d0d-98eb-f02c594eba3b/volumes"
Sep 11 01:12:53.380938 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.380899    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"]
Sep 11 01:12:53.381305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.381293    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca96efcc-0aa6-4d0d-98eb-f02c594eba3b" containerName="payload-pre-processing"
Sep 11 01:12:53.381344 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.381307    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca96efcc-0aa6-4d0d-98eb-f02c594eba3b" containerName="payload-pre-processing"
Sep 11 01:12:53.381344 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.381314    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dc69222-c73e-4b33-9176-e600a30a8896" containerName="payload-processing"
Sep 11 01:12:53.381344 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.381320    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dc69222-c73e-4b33-9176-e600a30a8896" containerName="payload-processing"
Sep 11 01:12:53.381429 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.381379    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dc69222-c73e-4b33-9176-e600a30a8896" containerName="payload-processing"
Sep 11 01:12:53.381429 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.381388    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca96efcc-0aa6-4d0d-98eb-f02c594eba3b" containerName="payload-pre-processing"
Sep 11 01:12:53.385860 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.385842    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:12:53.388349 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.388328    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-651569\"/\"openshift-service-ca.crt\""
Sep 11 01:12:53.389581 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.389556    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-651569\"/\"premium-w4-651569-kserve-self-signed-certs\""
Sep 11 01:12:53.389705 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.389659    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-651569\"/\"kube-root-ca.crt\""
Sep 11 01:12:53.389803 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.389782    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-651569\"/\"default-dockercfg-cdvkt\""
Sep 11 01:12:53.393229 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.393207    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"]
Sep 11 01:12:53.460268 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.460237    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-model-cache\") pod \"premium-w4-651569-kserve-74f6b774-vw8zs\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") " pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:12:53.460268 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.460267    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-tmp-dir\") pod \"premium-w4-651569-kserve-74f6b774-vw8zs\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") " pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:12:53.460477 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.460300    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-home\") pod \"premium-w4-651569-kserve-74f6b774-vw8zs\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") " pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:12:53.460477 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.460361    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqg7p\" (UniqueName: \"kubernetes.io/projected/5e3bb054-65ad-4f4e-9694-a6073210c7da-kube-api-access-fqg7p\") pod \"premium-w4-651569-kserve-74f6b774-vw8zs\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") " pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:12:53.460477 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.460401    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e3bb054-65ad-4f4e-9694-a6073210c7da-tls-certs\") pod \"premium-w4-651569-kserve-74f6b774-vw8zs\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") " pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:12:53.460477 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.460426    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-dshm\") pod \"premium-w4-651569-kserve-74f6b774-vw8zs\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") " pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:12:53.561239 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.561201    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e3bb054-65ad-4f4e-9694-a6073210c7da-tls-certs\") pod \"premium-w4-651569-kserve-74f6b774-vw8zs\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") " pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:12:53.561239 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.561239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-dshm\") pod \"premium-w4-651569-kserve-74f6b774-vw8zs\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") " pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:12:53.561594 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.561548    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-model-cache\") pod \"premium-w4-651569-kserve-74f6b774-vw8zs\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") " pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:12:53.561696 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.561594    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-tmp-dir\") pod \"premium-w4-651569-kserve-74f6b774-vw8zs\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") " pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:12:53.561696 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.561677    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-home\") pod \"premium-w4-651569-kserve-74f6b774-vw8zs\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") " pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:12:53.561807 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.561729    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqg7p\" (UniqueName: \"kubernetes.io/projected/5e3bb054-65ad-4f4e-9694-a6073210c7da-kube-api-access-fqg7p\") pod \"premium-w4-651569-kserve-74f6b774-vw8zs\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") " pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:12:53.562051 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.562026    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-home\") pod \"premium-w4-651569-kserve-74f6b774-vw8zs\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") " pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:12:53.562151 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.562063    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-model-cache\") pod \"premium-w4-651569-kserve-74f6b774-vw8zs\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") " pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:12:53.562151 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.562135    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-tmp-dir\") pod \"premium-w4-651569-kserve-74f6b774-vw8zs\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") " pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:12:53.563622 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.563593    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-dshm\") pod \"premium-w4-651569-kserve-74f6b774-vw8zs\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") " pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:12:53.563789 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.563772    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e3bb054-65ad-4f4e-9694-a6073210c7da-tls-certs\") pod \"premium-w4-651569-kserve-74f6b774-vw8zs\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") " pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:12:53.572341 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.572321    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqg7p\" (UniqueName: \"kubernetes.io/projected/5e3bb054-65ad-4f4e-9694-a6073210c7da-kube-api-access-fqg7p\") pod \"premium-w4-651569-kserve-74f6b774-vw8zs\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") " pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:12:53.696918 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.696807    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:12:53.976446 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:53.976414    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"]
Sep 11 01:12:53.977874 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:12:53.977844    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e3bb054_65ad_4f4e_9694_a6073210c7da.slice/crio-ebec224509cdacd7dc3c9260661dc3fe35323e554584032edd8193931060f3ff WatchSource:0}: Error finding container ebec224509cdacd7dc3c9260661dc3fe35323e554584032edd8193931060f3ff: Status 404 returned error can't find the container with id ebec224509cdacd7dc3c9260661dc3fe35323e554584032edd8193931060f3ff
Sep 11 01:12:54.166395 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:54.166357    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs" event={"ID":"5e3bb054-65ad-4f4e-9694-a6073210c7da","Type":"ContainerStarted","Data":"d77ae19654763eabc0b387586e43a46e8a2aa2d3cbab1ec89a7c38824fd7d099"}
Sep 11 01:12:54.166554 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:54.166411    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs" event={"ID":"5e3bb054-65ad-4f4e-9694-a6073210c7da","Type":"ContainerStarted","Data":"ebec224509cdacd7dc3c9260661dc3fe35323e554584032edd8193931060f3ff"}
Sep 11 01:12:54.185462 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:12:54.185414    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs" podStartSLOduration=1.185399213 podStartE2EDuration="1.185399213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:12:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:12:54.183584812 +0000 UTC m=+891.231673060" watchObservedRunningTime="2026-09-11 01:12:54.185399213 +0000 UTC m=+891.233487437"
Sep 11 01:13:03.462472 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.462393    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/1.log"
Sep 11 01:13:03.463021 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.462996    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/1.log"
Sep 11 01:13:03.697128 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.697098    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:13:03.697302 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.697152    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:13:03.709472 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.709449    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:13:03.795050 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.795018    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"]
Sep 11 01:13:03.799536 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.799517    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:03.802278 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.802254    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-6ba087\"/\"kube-root-ca.crt\""
Sep 11 01:13:03.802393 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.802361    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-6ba087\"/\"premium-w0-6ba087-kserve-self-signed-certs\""
Sep 11 01:13:03.802500 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.802483    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-6ba087\"/\"openshift-service-ca.crt\""
Sep 11 01:13:03.802589 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.802572    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-6ba087\"/\"default-dockercfg-ld827\""
Sep 11 01:13:03.808278 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.808255    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"]
Sep 11 01:13:03.863137 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.863100    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hp6v\" (UniqueName: \"kubernetes.io/projected/8f1de61d-8c87-4a73-aa56-4000653dc1e8-kube-api-access-5hp6v\") pod \"premium-w0-6ba087-kserve-67df86f79b-5rsgz\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") " pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:03.863301 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.863156    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f1de61d-8c87-4a73-aa56-4000653dc1e8-tls-certs\") pod \"premium-w0-6ba087-kserve-67df86f79b-5rsgz\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") " pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:03.863301 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.863261    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-model-cache\") pod \"premium-w0-6ba087-kserve-67df86f79b-5rsgz\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") " pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:03.863301 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.863287    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-tmp-dir\") pod \"premium-w0-6ba087-kserve-67df86f79b-5rsgz\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") " pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:03.863411 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.863314    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-dshm\") pod \"premium-w0-6ba087-kserve-67df86f79b-5rsgz\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") " pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:03.863411 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.863377    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-home\") pod \"premium-w0-6ba087-kserve-67df86f79b-5rsgz\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") " pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:03.964096 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.964062    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f1de61d-8c87-4a73-aa56-4000653dc1e8-tls-certs\") pod \"premium-w0-6ba087-kserve-67df86f79b-5rsgz\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") " pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:03.964286 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.964104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-model-cache\") pod \"premium-w0-6ba087-kserve-67df86f79b-5rsgz\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") " pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:03.964286 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.964119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-tmp-dir\") pod \"premium-w0-6ba087-kserve-67df86f79b-5rsgz\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") " pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:03.964286 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.964141    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-dshm\") pod \"premium-w0-6ba087-kserve-67df86f79b-5rsgz\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") " pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:03.964286 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.964179    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-home\") pod \"premium-w0-6ba087-kserve-67df86f79b-5rsgz\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") " pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:03.964286 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.964224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hp6v\" (UniqueName: \"kubernetes.io/projected/8f1de61d-8c87-4a73-aa56-4000653dc1e8-kube-api-access-5hp6v\") pod \"premium-w0-6ba087-kserve-67df86f79b-5rsgz\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") " pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:03.964559 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.964483    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-model-cache\") pod \"premium-w0-6ba087-kserve-67df86f79b-5rsgz\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") " pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:03.964559 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.964533    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-tmp-dir\") pod \"premium-w0-6ba087-kserve-67df86f79b-5rsgz\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") " pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:03.964674 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.964626    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-home\") pod \"premium-w0-6ba087-kserve-67df86f79b-5rsgz\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") " pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:03.966438 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.966421    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-dshm\") pod \"premium-w0-6ba087-kserve-67df86f79b-5rsgz\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") " pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:03.966707 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.966688    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f1de61d-8c87-4a73-aa56-4000653dc1e8-tls-certs\") pod \"premium-w0-6ba087-kserve-67df86f79b-5rsgz\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") " pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:03.971829 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:03.971789    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hp6v\" (UniqueName: \"kubernetes.io/projected/8f1de61d-8c87-4a73-aa56-4000653dc1e8-kube-api-access-5hp6v\") pod \"premium-w0-6ba087-kserve-67df86f79b-5rsgz\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") " pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:04.109653 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:04.109571    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:04.238424 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:04.238391    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:13:04.382568 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:04.382457    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"]
Sep 11 01:13:04.385341 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:13:04.385316    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f1de61d_8c87_4a73_aa56_4000653dc1e8.slice/crio-5390668fc7eb4ac9a5d429f56952e9bf1bf3be0bc3cc7bfded00e5edab7e2e6e WatchSource:0}: Error finding container 5390668fc7eb4ac9a5d429f56952e9bf1bf3be0bc3cc7bfded00e5edab7e2e6e: Status 404 returned error can't find the container with id 5390668fc7eb4ac9a5d429f56952e9bf1bf3be0bc3cc7bfded00e5edab7e2e6e
Sep 11 01:13:05.234983 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:05.234943    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz" event={"ID":"8f1de61d-8c87-4a73-aa56-4000653dc1e8","Type":"ContainerStarted","Data":"a4e582516067beb58191f62d9c6be3f469cc5b0a310aa642f4632e3bab546170"}
Sep 11 01:13:05.235371 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:05.234994    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz" event={"ID":"8f1de61d-8c87-4a73-aa56-4000653dc1e8","Type":"ContainerStarted","Data":"5390668fc7eb4ac9a5d429f56952e9bf1bf3be0bc3cc7bfded00e5edab7e2e6e"}
Sep 11 01:13:05.252479 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:05.252432    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz" podStartSLOduration=2.252413078 podStartE2EDuration="2.252413078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:13:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:13:05.251535011 +0000 UTC m=+902.299623254" watchObservedRunningTime="2026-09-11 01:13:05.252413078 +0000 UTC m=+902.300501303"
Sep 11 01:13:14.110777 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:14.110746    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:14.111171 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:14.110794    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:14.122920 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:14.122898    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:13:14.297559 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:13:14.297531    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:14:36.932996 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:14:36.932920    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr"]
Sep 11 01:14:36.933551 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:14:36.933170    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr" podUID="b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d" containerName="payload-processing" containerID="cri-o://379e7e1d09b64dc2ff6362fe3cb4773b7e60f1f9efb042b23c73d0a4a49789ab" gracePeriod=30
Sep 11 01:14:37.067075 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:14:37.067023    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr" podUID="b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.62:9004: connect: connection refused"
Sep 11 01:14:37.208440 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:14:37.208415    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr"
Sep 11 01:14:37.268948 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:14:37.268918    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5b2vn\" (UniqueName: \"kubernetes.io/projected/b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d-kube-api-access-5b2vn\") pod \"b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d\" (UID: \"b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d\") "
Sep 11 01:14:37.269105 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:14:37.268957    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d-plugins-config-volume\") pod \"b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d\" (UID: \"b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d\") "
Sep 11 01:14:37.269351 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:14:37.269329    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d" (UID: "b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:14:37.270927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:14:37.270904    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d-kube-api-access-5b2vn" (OuterVolumeSpecName: "kube-api-access-5b2vn") pod "b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d" (UID: "b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d"). InnerVolumeSpecName "kube-api-access-5b2vn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:14:37.369644 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:14:37.369615    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5b2vn\" (UniqueName: \"kubernetes.io/projected/b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d-kube-api-access-5b2vn\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:14:37.369644 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:14:37.369640    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:14:37.756838 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:14:37.756725    2565 generic.go:356] "Generic (PLEG): container finished" podID="b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d" containerID="379e7e1d09b64dc2ff6362fe3cb4773b7e60f1f9efb042b23c73d0a4a49789ab" exitCode=0
Sep 11 01:14:37.756838 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:14:37.756776    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr"
Sep 11 01:14:37.757079 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:14:37.756833    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr" event={"ID":"b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d","Type":"ContainerDied","Data":"379e7e1d09b64dc2ff6362fe3cb4773b7e60f1f9efb042b23c73d0a4a49789ab"}
Sep 11 01:14:37.757079 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:14:37.756895    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr" event={"ID":"b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d","Type":"ContainerDied","Data":"e298e5955553278902a567d1d541f5a89ad9753ccb4f05c7af0e62ccb9b74114"}
Sep 11 01:14:37.757079 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:14:37.756923    2565 scope.go:117] "RemoveContainer" containerID="379e7e1d09b64dc2ff6362fe3cb4773b7e60f1f9efb042b23c73d0a4a49789ab"
Sep 11 01:14:37.772907 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:14:37.772882    2565 scope.go:117] "RemoveContainer" containerID="379e7e1d09b64dc2ff6362fe3cb4773b7e60f1f9efb042b23c73d0a4a49789ab"
Sep 11 01:14:37.773236 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:14:37.773216    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"379e7e1d09b64dc2ff6362fe3cb4773b7e60f1f9efb042b23c73d0a4a49789ab\": container with ID starting with 379e7e1d09b64dc2ff6362fe3cb4773b7e60f1f9efb042b23c73d0a4a49789ab not found: ID does not exist" containerID="379e7e1d09b64dc2ff6362fe3cb4773b7e60f1f9efb042b23c73d0a4a49789ab"
Sep 11 01:14:37.773286 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:14:37.773244    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"379e7e1d09b64dc2ff6362fe3cb4773b7e60f1f9efb042b23c73d0a4a49789ab"} err="failed to get container status \"379e7e1d09b64dc2ff6362fe3cb4773b7e60f1f9efb042b23c73d0a4a49789ab\": rpc error: code = NotFound desc = could not find container \"379e7e1d09b64dc2ff6362fe3cb4773b7e60f1f9efb042b23c73d0a4a49789ab\": container with ID starting with 379e7e1d09b64dc2ff6362fe3cb4773b7e60f1f9efb042b23c73d0a4a49789ab not found: ID does not exist"
Sep 11 01:14:37.780977 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:14:37.780955    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr"]
Sep 11 01:14:37.784168 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:14:37.784147    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-8d451c-7d758d8fdf-hdnqr"]
Sep 11 01:14:39.472338 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:14:39.472303    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d" path="/var/lib/kubelet/pods/b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d/volumes"
Sep 11 01:15:00.217669 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.217626    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-651569-29818155-cbhph"]
Sep 11 01:15:00.218695 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.218670    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d" containerName="payload-processing"
Sep 11 01:15:00.218695 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.218698    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d" containerName="payload-processing"
Sep 11 01:15:00.218909 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.218893    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4dfe433-b9c5-4aa2-8b75-ffb7d1ed9e3d" containerName="payload-processing"
Sep 11 01:15:00.227518 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.227486    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7b8e72c7-29818155-4h486"]
Sep 11 01:15:00.227669 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.227627    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-651569-29818155-cbhph"
Sep 11 01:15:00.230733 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.230714    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818155-j7v6v"]
Sep 11 01:15:00.230847 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.230780    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7b8e72c7-29818155-4h486"
Sep 11 01:15:00.231039 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.231021    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pppkt\""
Sep 11 01:15:00.233959 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.233938    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818155-j7v6v"
Sep 11 01:15:00.238336 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.238317    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-651569-29818155-cbhph"
Sep 11 01:15:00.243753 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.243409    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-651569-29818155-cbhph"]
Sep 11 01:15:00.250214 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.250195    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7b8e72c7-29818155-4h486"
Sep 11 01:15:00.251006 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.250984    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7b8e72c7-29818155-4h486"]
Sep 11 01:15:00.255620 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.255587    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818155-j7v6v"]
Sep 11 01:15:00.288520 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.288495    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818155-j7v6v"
Sep 11 01:15:00.551258 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.551233    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-651569-29818155-cbhph"]
Sep 11 01:15:00.553249 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:15:00.553220    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2edb9deb_8812_4a01_87d6_4ad0a9a05bde.slice/crio-16f7b79a2cb7db2693e824fddd54b02e022ac1189dc77e9a25217d47f37c08ac WatchSource:0}: Error finding container 16f7b79a2cb7db2693e824fddd54b02e022ac1189dc77e9a25217d47f37c08ac: Status 404 returned error can't find the container with id 16f7b79a2cb7db2693e824fddd54b02e022ac1189dc77e9a25217d47f37c08ac
Sep 11 01:15:00.569871 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.569846    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7b8e72c7-29818155-4h486"]
Sep 11 01:15:00.573059 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:15:00.573036    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7f9dc99_f045_4077_b331_a2b9db9d3783.slice/crio-ba85b13cfa80eb5688f3d2901524f2e19d9ce6c16785786dd582f943669e9493 WatchSource:0}: Error finding container ba85b13cfa80eb5688f3d2901524f2e19d9ce6c16785786dd582f943669e9493: Status 404 returned error can't find the container with id ba85b13cfa80eb5688f3d2901524f2e19d9ce6c16785786dd582f943669e9493
Sep 11 01:15:00.592013 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:15:00.591986    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbafed37_c98d_4f45_afff_27298d541f6a.slice/crio-7e841d42418e5b907de3c5bc87c00702d9f4207082d0a76eaf97bd62ad87a2a4 WatchSource:0}: Error finding container 7e841d42418e5b907de3c5bc87c00702d9f4207082d0a76eaf97bd62ad87a2a4: Status 404 returned error can't find the container with id 7e841d42418e5b907de3c5bc87c00702d9f4207082d0a76eaf97bd62ad87a2a4
Sep 11 01:15:00.592195 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.592179    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818155-j7v6v"]
Sep 11 01:15:00.887078 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.887039    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7b8e72c7-29818155-4h486" event={"ID":"e7f9dc99-f045-4077-b331-a2b9db9d3783","Type":"ContainerStarted","Data":"fdb10a64b2c5c60d766ca84b67e0c159cbb14972ef03cc972f033994b0058ab9"}
Sep 11 01:15:00.887234 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.887097    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7b8e72c7-29818155-4h486" event={"ID":"e7f9dc99-f045-4077-b331-a2b9db9d3783","Type":"ContainerStarted","Data":"ba85b13cfa80eb5688f3d2901524f2e19d9ce6c16785786dd582f943669e9493"}
Sep 11 01:15:00.888301 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.888275    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-651569-29818155-cbhph" event={"ID":"2edb9deb-8812-4a01-87d6-4ad0a9a05bde","Type":"ContainerStarted","Data":"16f7b79a2cb7db2693e824fddd54b02e022ac1189dc77e9a25217d47f37c08ac"}
Sep 11 01:15:00.889426 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.889407    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818155-j7v6v" event={"ID":"dbafed37-c98d-4f45-afff-27298d541f6a","Type":"ContainerStarted","Data":"7e841d42418e5b907de3c5bc87c00702d9f4207082d0a76eaf97bd62ad87a2a4"}
Sep 11 01:15:00.904601 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:00.904560    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7b8e72c7-29818155-4h486" podStartSLOduration=0.904547476 podStartE2EDuration="904.547476ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:15:00.901636747 +0000 UTC m=+1017.949724971" watchObservedRunningTime="2026-09-11 01:15:00.904547476 +0000 UTC m=+1017.952635699"
Sep 11 01:15:01.896079 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:01.896045    2565 generic.go:356] "Generic (PLEG): container finished" podID="e7f9dc99-f045-4077-b331-a2b9db9d3783" containerID="fdb10a64b2c5c60d766ca84b67e0c159cbb14972ef03cc972f033994b0058ab9" exitCode=0
Sep 11 01:15:01.896703 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:01.896134    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7b8e72c7-29818155-4h486" event={"ID":"e7f9dc99-f045-4077-b331-a2b9db9d3783","Type":"ContainerDied","Data":"fdb10a64b2c5c60d766ca84b67e0c159cbb14972ef03cc972f033994b0058ab9"}
Sep 11 01:15:01.897771 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:01.897750    2565 generic.go:356] "Generic (PLEG): container finished" podID="2edb9deb-8812-4a01-87d6-4ad0a9a05bde" containerID="17bb7a92d6b98765e5cf4ff9d3eed043b3f26e91f89c7160acd76a610369c339" exitCode=0
Sep 11 01:15:01.897906 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:01.897829    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-651569-29818155-cbhph" event={"ID":"2edb9deb-8812-4a01-87d6-4ad0a9a05bde","Type":"ContainerDied","Data":"17bb7a92d6b98765e5cf4ff9d3eed043b3f26e91f89c7160acd76a610369c339"}
Sep 11 01:15:01.899401 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:01.899379    2565 generic.go:356] "Generic (PLEG): container finished" podID="dbafed37-c98d-4f45-afff-27298d541f6a" containerID="bce1bada7e66cf5b4ea989b40b7bd666bd0130129fced3f27901564b422d19c2" exitCode=0
Sep 11 01:15:01.899499 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:01.899458    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818155-j7v6v" event={"ID":"dbafed37-c98d-4f45-afff-27298d541f6a","Type":"ContainerDied","Data":"bce1bada7e66cf5b4ea989b40b7bd666bd0130129fced3f27901564b422d19c2"}
Sep 11 01:15:03.062162 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.062138    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818155-j7v6v"
Sep 11 01:15:03.115731 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.115703    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7b8e72c7-29818155-4h486"
Sep 11 01:15:03.118848 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.118806    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-651569-29818155-cbhph"
Sep 11 01:15:03.826184 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.826151    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7b8e72c7-bbkcr"]
Sep 11 01:15:03.826544 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.826531    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7f9dc99-f045-4077-b331-a2b9db9d3783" containerName="cleanup"
Sep 11 01:15:03.826591 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.826545    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7f9dc99-f045-4077-b331-a2b9db9d3783" containerName="cleanup"
Sep 11 01:15:03.826591 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.826557    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbafed37-c98d-4f45-afff-27298d541f6a" containerName="cleanup"
Sep 11 01:15:03.826591 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.826563    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbafed37-c98d-4f45-afff-27298d541f6a" containerName="cleanup"
Sep 11 01:15:03.826591 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.826582    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2edb9deb-8812-4a01-87d6-4ad0a9a05bde" containerName="cleanup"
Sep 11 01:15:03.826591 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.826588    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2edb9deb-8812-4a01-87d6-4ad0a9a05bde" containerName="cleanup"
Sep 11 01:15:03.826745 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.826653    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2edb9deb-8812-4a01-87d6-4ad0a9a05bde" containerName="cleanup"
Sep 11 01:15:03.826745 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.826663    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7f9dc99-f045-4077-b331-a2b9db9d3783" containerName="cleanup"
Sep 11 01:15:03.826745 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.826669    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbafed37-c98d-4f45-afff-27298d541f6a" containerName="cleanup"
Sep 11 01:15:03.830837 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.830805    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7b8e72c7-bbkcr"
Sep 11 01:15:03.833991 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.833953    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 01:15:03.837254 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.837230    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7b8e72c7-bbkcr"]
Sep 11 01:15:03.913945 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.913914    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7b8e72c7-29818155-4h486"
Sep 11 01:15:03.914261 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.913914    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7b8e72c7-29818155-4h486" event={"ID":"e7f9dc99-f045-4077-b331-a2b9db9d3783","Type":"ContainerDied","Data":"ba85b13cfa80eb5688f3d2901524f2e19d9ce6c16785786dd582f943669e9493"}
Sep 11 01:15:03.914261 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.914060    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba85b13cfa80eb5688f3d2901524f2e19d9ce6c16785786dd582f943669e9493"
Sep 11 01:15:03.915884 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.915858    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-651569-29818155-cbhph"
Sep 11 01:15:03.916014 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.915886    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-651569-29818155-cbhph" event={"ID":"2edb9deb-8812-4a01-87d6-4ad0a9a05bde","Type":"ContainerDied","Data":"16f7b79a2cb7db2693e824fddd54b02e022ac1189dc77e9a25217d47f37c08ac"}
Sep 11 01:15:03.916014 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.915929    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16f7b79a2cb7db2693e824fddd54b02e022ac1189dc77e9a25217d47f37c08ac"
Sep 11 01:15:03.916752 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.916724    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f10e5f9-3a1e-4561-81c0-28ca038836ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7b8e72c7-bbkcr\" (UID: \"5f10e5f9-3a1e-4561-81c0-28ca038836ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7b8e72c7-bbkcr"
Sep 11 01:15:03.917460 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.917430    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818155-j7v6v"
Sep 11 01:15:03.917552 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.917477    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818155-j7v6v" event={"ID":"dbafed37-c98d-4f45-afff-27298d541f6a","Type":"ContainerDied","Data":"7e841d42418e5b907de3c5bc87c00702d9f4207082d0a76eaf97bd62ad87a2a4"}
Sep 11 01:15:03.917552 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:03.917525    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e841d42418e5b907de3c5bc87c00702d9f4207082d0a76eaf97bd62ad87a2a4"
Sep 11 01:15:04.018325 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:04.018285    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f10e5f9-3a1e-4561-81c0-28ca038836ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7b8e72c7-bbkcr\" (UID: \"5f10e5f9-3a1e-4561-81c0-28ca038836ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7b8e72c7-bbkcr"
Sep 11 01:15:04.018947 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:04.018927    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f10e5f9-3a1e-4561-81c0-28ca038836ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7b8e72c7-bbkcr\" (UID: \"5f10e5f9-3a1e-4561-81c0-28ca038836ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7b8e72c7-bbkcr"
Sep 11 01:15:04.142831 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:04.142730    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7b8e72c7-bbkcr"
Sep 11 01:15:04.415547 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:04.415522    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7b8e72c7-bbkcr"]
Sep 11 01:15:04.416875 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:15:04.416845    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f10e5f9_3a1e_4561_81c0_28ca038836ec.slice/crio-e85aa507d707b2fd8c071182fec8e385f89a3b2923b3d1d69248d0eafe38ea61 WatchSource:0}: Error finding container e85aa507d707b2fd8c071182fec8e385f89a3b2923b3d1d69248d0eafe38ea61: Status 404 returned error can't find the container with id e85aa507d707b2fd8c071182fec8e385f89a3b2923b3d1d69248d0eafe38ea61
Sep 11 01:15:04.925274 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:04.925229    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7b8e72c7-bbkcr" event={"ID":"5f10e5f9-3a1e-4561-81c0-28ca038836ec","Type":"ContainerStarted","Data":"50c6fa31bb76ce1edd7897d1e5ed168c16a016e0acdb84d20f4020b8a51dfdde"}
Sep 11 01:15:04.925476 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:04.925291    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7b8e72c7-bbkcr" event={"ID":"5f10e5f9-3a1e-4561-81c0-28ca038836ec","Type":"ContainerStarted","Data":"e85aa507d707b2fd8c071182fec8e385f89a3b2923b3d1d69248d0eafe38ea61"}
Sep 11 01:15:04.944284 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:04.944230    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7b8e72c7-bbkcr" podStartSLOduration=1.944212635 podStartE2EDuration="1.944212635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:15:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:15:04.942231674 +0000 UTC m=+1021.990319923" watchObservedRunningTime="2026-09-11 01:15:04.944212635 +0000 UTC m=+1021.992300858"
Sep 11 01:15:05.932135 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:05.932105    2565 generic.go:356] "Generic (PLEG): container finished" podID="5f10e5f9-3a1e-4561-81c0-28ca038836ec" containerID="50c6fa31bb76ce1edd7897d1e5ed168c16a016e0acdb84d20f4020b8a51dfdde" exitCode=0
Sep 11 01:15:05.932507 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:05.932191    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7b8e72c7-bbkcr" event={"ID":"5f10e5f9-3a1e-4561-81c0-28ca038836ec","Type":"ContainerDied","Data":"50c6fa31bb76ce1edd7897d1e5ed168c16a016e0acdb84d20f4020b8a51dfdde"}
Sep 11 01:15:07.079713 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:07.079674    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7b8e72c7-bbkcr"
Sep 11 01:15:07.259880 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:07.259783    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f10e5f9-3a1e-4561-81c0-28ca038836ec-maas-api-service-ca\") pod \"5f10e5f9-3a1e-4561-81c0-28ca038836ec\" (UID: \"5f10e5f9-3a1e-4561-81c0-28ca038836ec\") "
Sep 11 01:15:07.260144 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:07.260114    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f10e5f9-3a1e-4561-81c0-28ca038836ec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5f10e5f9-3a1e-4561-81c0-28ca038836ec" (UID: "5f10e5f9-3a1e-4561-81c0-28ca038836ec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:15:07.360981 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:07.360944    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f10e5f9-3a1e-4561-81c0-28ca038836ec-maas-api-service-ca\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:15:07.946058 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:07.946026    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7b8e72c7-bbkcr" event={"ID":"5f10e5f9-3a1e-4561-81c0-28ca038836ec","Type":"ContainerDied","Data":"e85aa507d707b2fd8c071182fec8e385f89a3b2923b3d1d69248d0eafe38ea61"}
Sep 11 01:15:07.946302 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:07.946074    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e85aa507d707b2fd8c071182fec8e385f89a3b2923b3d1d69248d0eafe38ea61"
Sep 11 01:15:07.946302 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:07.946034    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7b8e72c7-bbkcr"
Sep 11 01:15:14.264050 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:14.264000    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7b8e72c7-29818155-4h486"]
Sep 11 01:15:14.266376 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:14.266350    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-7b8e72c7-29818155-4h486"]
Sep 11 01:15:14.432666 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:14.432426    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7b8e72c7-bbkcr"]
Sep 11 01:15:14.435215 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:14.435191    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7b8e72c7-bbkcr"]
Sep 11 01:15:15.472302 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:15.472270    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f10e5f9-3a1e-4561-81c0-28ca038836ec" path="/var/lib/kubelet/pods/5f10e5f9-3a1e-4561-81c0-28ca038836ec/volumes"
Sep 11 01:15:15.472669 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:15.472564    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7f9dc99-f045-4077-b331-a2b9db9d3783" path="/var/lib/kubelet/pods/e7f9dc99-f045-4077-b331-a2b9db9d3783/volumes"
Sep 11 01:15:33.614039 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.614004    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"]
Sep 11 01:15:33.614416 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.614385    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f10e5f9-3a1e-4561-81c0-28ca038836ec" containerName="revoke-keys"
Sep 11 01:15:33.614416 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.614395    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f10e5f9-3a1e-4561-81c0-28ca038836ec" containerName="revoke-keys"
Sep 11 01:15:33.614489 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.614471    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f10e5f9-3a1e-4561-81c0-28ca038836ec" containerName="revoke-keys"
Sep 11 01:15:33.617753 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.617736    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:33.620059 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.620039    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-651569\"/\"distinct-2-w4-651569-kserve-self-signed-certs\""
Sep 11 01:15:33.630214 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.630189    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"]
Sep 11 01:15:33.707514 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.707480    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-dshm\") pod \"distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") " pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:33.707690 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.707554    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6cs2\" (UniqueName: \"kubernetes.io/projected/a1d069cd-c786-4b21-bbc3-bfe2e024f110-kube-api-access-r6cs2\") pod \"distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") " pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:33.707690 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.707616    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-model-cache\") pod \"distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") " pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:33.707775 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.707732    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1d069cd-c786-4b21-bbc3-bfe2e024f110-tls-certs\") pod \"distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") " pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:33.707836 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.707772    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-home\") pod \"distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") " pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:33.707894 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.707840    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-tmp-dir\") pod \"distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") " pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:33.809623 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.809584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-model-cache\") pod \"distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") " pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:33.809829 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.809668    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1d069cd-c786-4b21-bbc3-bfe2e024f110-tls-certs\") pod \"distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") " pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:33.809829 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.809696    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-home\") pod \"distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") " pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:33.809829 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.809734    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-tmp-dir\") pod \"distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") " pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:33.809829 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.809804    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-dshm\") pod \"distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") " pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:33.810068 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.809899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6cs2\" (UniqueName: \"kubernetes.io/projected/a1d069cd-c786-4b21-bbc3-bfe2e024f110-kube-api-access-r6cs2\") pod \"distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") " pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:33.810239 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.810214    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-home\") pod \"distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") " pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:33.810446 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.810421    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-model-cache\") pod \"distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") " pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:33.811052 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.810904    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-tmp-dir\") pod \"distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") " pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:33.813294 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.813248    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-dshm\") pod \"distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") " pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:33.813469 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.813420    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1d069cd-c786-4b21-bbc3-bfe2e024f110-tls-certs\") pod \"distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") " pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:33.822554 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.822519    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6cs2\" (UniqueName: \"kubernetes.io/projected/a1d069cd-c786-4b21-bbc3-bfe2e024f110-kube-api-access-r6cs2\") pod \"distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") " pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:33.926675 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:33.926589    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:34.202781 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:34.202754    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"]
Sep 11 01:15:34.204228 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:15:34.204200    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1d069cd_c786_4b21_bbc3_bfe2e024f110.slice/crio-14d9bc711164402716faa4babe037f84665e0cb10fa7524563695f875795e852 WatchSource:0}: Error finding container 14d9bc711164402716faa4babe037f84665e0cb10fa7524563695f875795e852: Status 404 returned error can't find the container with id 14d9bc711164402716faa4babe037f84665e0cb10fa7524563695f875795e852
Sep 11 01:15:35.109639 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:35.109603    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw" event={"ID":"a1d069cd-c786-4b21-bbc3-bfe2e024f110","Type":"ContainerStarted","Data":"50afab841e7e5a296ae0008d32f70c5d82df243854ca5e4cb24b345467663815"}
Sep 11 01:15:35.109639 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:35.109647    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw" event={"ID":"a1d069cd-c786-4b21-bbc3-bfe2e024f110","Type":"ContainerStarted","Data":"14d9bc711164402716faa4babe037f84665e0cb10fa7524563695f875795e852"}
Sep 11 01:15:35.127447 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:35.127401    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw" podStartSLOduration=2.127385153 podStartE2EDuration="2.127385153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:15:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:15:35.126579124 +0000 UTC m=+1052.174667363" watchObservedRunningTime="2026-09-11 01:15:35.127385153 +0000 UTC m=+1052.175473381"
Sep 11 01:15:43.927655 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:43.927611    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:43.928110 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:43.927712    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:43.940496 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:43.940474    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:15:44.181953 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:15:44.181867    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:16:07.460085 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.459997    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl"]
Sep 11 01:16:07.463754 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.463737    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl"
Sep 11 01:16:07.467124 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.467100    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-71ba6d-dockercfg-t8l5s\""
Sep 11 01:16:07.467358 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.467338    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-71ba6d\""
Sep 11 01:16:07.475947 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.475921    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl"]
Sep 11 01:16:07.478497 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.478473    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp"]
Sep 11 01:16:07.487032 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.487014    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp"
Sep 11 01:16:07.493686 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.493664    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp"]
Sep 11 01:16:07.538535 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.538501    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z5bt\" (UniqueName: \"kubernetes.io/projected/a18a14c8-5761-4e52-b366-62b40c77ad99-kube-api-access-2z5bt\") pod \"payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl\" (UID: \"a18a14c8-5761-4e52-b366-62b40c77ad99\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl"
Sep 11 01:16:07.538694 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.538548    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a18a14c8-5761-4e52-b366-62b40c77ad99-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl\" (UID: \"a18a14c8-5761-4e52-b366-62b40c77ad99\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl"
Sep 11 01:16:07.538694 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.538588    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rq2r\" (UniqueName: \"kubernetes.io/projected/87966ea8-25e6-47c6-be6f-9ae24ef74844-kube-api-access-6rq2r\") pod \"payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp\" (UID: \"87966ea8-25e6-47c6-be6f-9ae24ef74844\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp"
Sep 11 01:16:07.538694 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.538651    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87966ea8-25e6-47c6-be6f-9ae24ef74844-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp\" (UID: \"87966ea8-25e6-47c6-be6f-9ae24ef74844\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp"
Sep 11 01:16:07.639912 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.639872    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z5bt\" (UniqueName: \"kubernetes.io/projected/a18a14c8-5761-4e52-b366-62b40c77ad99-kube-api-access-2z5bt\") pod \"payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl\" (UID: \"a18a14c8-5761-4e52-b366-62b40c77ad99\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl"
Sep 11 01:16:07.640130 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.639983    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a18a14c8-5761-4e52-b366-62b40c77ad99-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl\" (UID: \"a18a14c8-5761-4e52-b366-62b40c77ad99\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl"
Sep 11 01:16:07.640130 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.640019    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rq2r\" (UniqueName: \"kubernetes.io/projected/87966ea8-25e6-47c6-be6f-9ae24ef74844-kube-api-access-6rq2r\") pod \"payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp\" (UID: \"87966ea8-25e6-47c6-be6f-9ae24ef74844\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp"
Sep 11 01:16:07.640130 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.640125    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87966ea8-25e6-47c6-be6f-9ae24ef74844-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp\" (UID: \"87966ea8-25e6-47c6-be6f-9ae24ef74844\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp"
Sep 11 01:16:07.640926 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.640905    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87966ea8-25e6-47c6-be6f-9ae24ef74844-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp\" (UID: \"87966ea8-25e6-47c6-be6f-9ae24ef74844\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp"
Sep 11 01:16:07.641027 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.640911    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a18a14c8-5761-4e52-b366-62b40c77ad99-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl\" (UID: \"a18a14c8-5761-4e52-b366-62b40c77ad99\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl"
Sep 11 01:16:07.648073 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.648052    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rq2r\" (UniqueName: \"kubernetes.io/projected/87966ea8-25e6-47c6-be6f-9ae24ef74844-kube-api-access-6rq2r\") pod \"payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp\" (UID: \"87966ea8-25e6-47c6-be6f-9ae24ef74844\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp"
Sep 11 01:16:07.648500 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.648478    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z5bt\" (UniqueName: \"kubernetes.io/projected/a18a14c8-5761-4e52-b366-62b40c77ad99-kube-api-access-2z5bt\") pod \"payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl\" (UID: \"a18a14c8-5761-4e52-b366-62b40c77ad99\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl"
Sep 11 01:16:07.776571 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.776487    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl"
Sep 11 01:16:07.799071 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:07.799037    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp"
Sep 11 01:16:08.084030 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.084003    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl"]
Sep 11 01:16:08.085412 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:16:08.085383    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18a14c8_5761_4e52_b366_62b40c77ad99.slice/crio-3c3bd0b6e9a2b15bacbc9cf1058deb0ac28b48e9274c905451a3996b95a2ae01 WatchSource:0}: Error finding container 3c3bd0b6e9a2b15bacbc9cf1058deb0ac28b48e9274c905451a3996b95a2ae01: Status 404 returned error can't find the container with id 3c3bd0b6e9a2b15bacbc9cf1058deb0ac28b48e9274c905451a3996b95a2ae01
Sep 11 01:16:08.131175 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.131150    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp"]
Sep 11 01:16:08.132079 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:16:08.132058    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87966ea8_25e6_47c6_be6f_9ae24ef74844.slice/crio-43d1147fe333c43553c465ebb8ccc49aa618ac205d468cbbf3775155f2fb8034 WatchSource:0}: Error finding container 43d1147fe333c43553c465ebb8ccc49aa618ac205d468cbbf3775155f2fb8034: Status 404 returned error can't find the container with id 43d1147fe333c43553c465ebb8ccc49aa618ac205d468cbbf3775155f2fb8034
Sep 11 01:16:08.317678 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.317639    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp" event={"ID":"87966ea8-25e6-47c6-be6f-9ae24ef74844","Type":"ContainerStarted","Data":"5d7071a78a7d95fc308fd289aa28536011fee3f1b51c62ed33118d91ed33fcfc"}
Sep 11 01:16:08.317922 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.317711    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp" event={"ID":"87966ea8-25e6-47c6-be6f-9ae24ef74844","Type":"ContainerStarted","Data":"43d1147fe333c43553c465ebb8ccc49aa618ac205d468cbbf3775155f2fb8034"}
Sep 11 01:16:08.317922 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.317874    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp"
Sep 11 01:16:08.319520 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.319492    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl" event={"ID":"a18a14c8-5761-4e52-b366-62b40c77ad99","Type":"ContainerStarted","Data":"92e43d098f1506c638b9305149d5789fbd6b9ef156bda312430094f3efebfa07"}
Sep 11 01:16:08.319631 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.319541    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl" event={"ID":"a18a14c8-5761-4e52-b366-62b40c77ad99","Type":"ContainerStarted","Data":"3c3bd0b6e9a2b15bacbc9cf1058deb0ac28b48e9274c905451a3996b95a2ae01"}
Sep 11 01:16:08.319631 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.319571    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl"
Sep 11 01:16:08.374443 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.374326    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl" podStartSLOduration=1.374304362 podStartE2EDuration="1.374304362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:16:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:16:08.373765278 +0000 UTC m=+1085.421853515" watchObservedRunningTime="2026-09-11 01:16:08.374304362 +0000 UTC m=+1085.422392583"
Sep 11 01:16:08.375491 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.375444    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp" podStartSLOduration=1.375429194 podStartE2EDuration="1.375429194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:16:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:16:08.350426224 +0000 UTC m=+1085.398514465" watchObservedRunningTime="2026-09-11 01:16:08.375429194 +0000 UTC m=+1085.423517427"
Sep 11 01:16:08.489313 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.489279    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"]
Sep 11 01:16:08.492971 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.492952    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.496654 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.496632    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-836d37-openshift-default-dockercfg-bf26k\""
Sep 11 01:16:08.506640 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.506620    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"]
Sep 11 01:16:08.550560 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.550529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-workload-certs\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.550702 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.550581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65c4z\" (UniqueName: \"kubernetes.io/projected/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-kube-api-access-65c4z\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.550702 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.550662    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-token\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.550702 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.550691    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istiod-ca-cert\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.550867 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.550718    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-envoy\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.550867 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.550751    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-workload-socket\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.550867 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.550777    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-data\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.550867 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.550834    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-podinfo\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.550998 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.550883    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-credential-socket\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.651711 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.651611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65c4z\" (UniqueName: \"kubernetes.io/projected/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-kube-api-access-65c4z\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.651711 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.651698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-token\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.651953 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.651727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istiod-ca-cert\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.651953 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.651761    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-envoy\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.651953 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.651794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-workload-socket\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.651953 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.651837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-data\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.651953 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.651870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-podinfo\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.651953 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.651927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-credential-socket\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.652285 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.651970    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-workload-certs\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.652430 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.652403    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-workload-socket\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.652786 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.652726    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-credential-socket\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.652929 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.652845    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-workload-certs\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.653048 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.653021    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istiod-ca-cert\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.653310 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.653286    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-data\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.654667 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.654645    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-envoy\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.654667 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.654660    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-podinfo\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.660383 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.660353    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65c4z\" (UniqueName: \"kubernetes.io/projected/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-kube-api-access-65c4z\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.660593 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.660574    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-token\") pod \"e2e-noten-836d37-openshift-default-58bc769474-4gtk6\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") " pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:08.806485 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:08.806446    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:09.091308 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:09.091279    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"]
Sep 11 01:16:09.092240 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:16:09.092213    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aac4e8d_e35c_43bf_b5d6_a70c089ef6b5.slice/crio-d6536cdc0a2e0b7199a4e1b8bdf6aec99985fff5e363d437fa2e3c8093293012 WatchSource:0}: Error finding container d6536cdc0a2e0b7199a4e1b8bdf6aec99985fff5e363d437fa2e3c8093293012: Status 404 returned error can't find the container with id d6536cdc0a2e0b7199a4e1b8bdf6aec99985fff5e363d437fa2e3c8093293012
Sep 11 01:16:09.094951 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:09.094917    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:16:09.095034 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:09.094979    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:16:09.095034 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:09.095011    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:16:09.329140 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:09.329102    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6" event={"ID":"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5","Type":"ContainerStarted","Data":"5116a5220ae5fb73baaa911d586ece48e31ac24e54af23bd20544f6c68e3ac22"}
Sep 11 01:16:09.329354 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:09.329167    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6" event={"ID":"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5","Type":"ContainerStarted","Data":"d6536cdc0a2e0b7199a4e1b8bdf6aec99985fff5e363d437fa2e3c8093293012"}
Sep 11 01:16:09.349616 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:09.349241    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6" podStartSLOduration=1.349218918 podStartE2EDuration="1.349218918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:16:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:16:09.348358647 +0000 UTC m=+1086.396446898" watchObservedRunningTime="2026-09-11 01:16:09.349218918 +0000 UTC m=+1086.397307144"
Sep 11 01:16:09.807558 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:09.807519    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:10.812220 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:10.812185    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:11.344387 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:11.344357    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:11.345221 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:11.345203    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:16:19.331803 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:19.331768    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp"
Sep 11 01:16:19.334258 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:19.332083    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl"
Sep 11 01:16:39.031969 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.031898    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7"]
Sep 11 01:16:39.032446 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.032189    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7" podUID="3529ea03-099d-4392-b1a7-8e8afee3cfe8" containerName="payload-processing" containerID="cri-o://cf6b69cd80d0a62942a313acfbd8ae0c9f9ab3dae175ba60289e0e21d6250d6a" gracePeriod=30
Sep 11 01:16:39.038674 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.038353    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d"]
Sep 11 01:16:39.038978 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.038928    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d" podUID="9850b82e-399f-431b-a6a2-8e7f8804d469" containerName="payload-pre-processing" containerID="cri-o://32e37ed4f6c74462c6e11fb58a9080bf4c5d0fb8325c6e4375a6ee669f8323c8" gracePeriod=30
Sep 11 01:16:39.326673 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.326643    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7"
Sep 11 01:16:39.331329 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.331305    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d"
Sep 11 01:16:39.361894 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.360474    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9850b82e-399f-431b-a6a2-8e7f8804d469-plugins-config-volume\") pod \"9850b82e-399f-431b-a6a2-8e7f8804d469\" (UID: \"9850b82e-399f-431b-a6a2-8e7f8804d469\") "
Sep 11 01:16:39.361894 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.360546    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7q7h\" (UniqueName: \"kubernetes.io/projected/3529ea03-099d-4392-b1a7-8e8afee3cfe8-kube-api-access-f7q7h\") pod \"3529ea03-099d-4392-b1a7-8e8afee3cfe8\" (UID: \"3529ea03-099d-4392-b1a7-8e8afee3cfe8\") "
Sep 11 01:16:39.361894 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.360647    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3529ea03-099d-4392-b1a7-8e8afee3cfe8-plugins-config-volume\") pod \"3529ea03-099d-4392-b1a7-8e8afee3cfe8\" (UID: \"3529ea03-099d-4392-b1a7-8e8afee3cfe8\") "
Sep 11 01:16:39.361894 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.360717    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjvxb\" (UniqueName: \"kubernetes.io/projected/9850b82e-399f-431b-a6a2-8e7f8804d469-kube-api-access-gjvxb\") pod \"9850b82e-399f-431b-a6a2-8e7f8804d469\" (UID: \"9850b82e-399f-431b-a6a2-8e7f8804d469\") "
Sep 11 01:16:39.361894 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.360897    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9850b82e-399f-431b-a6a2-8e7f8804d469-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9850b82e-399f-431b-a6a2-8e7f8804d469" (UID: "9850b82e-399f-431b-a6a2-8e7f8804d469"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:16:39.361894 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.361273    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3529ea03-099d-4392-b1a7-8e8afee3cfe8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3529ea03-099d-4392-b1a7-8e8afee3cfe8" (UID: "3529ea03-099d-4392-b1a7-8e8afee3cfe8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:16:39.361894 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.361419    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9850b82e-399f-431b-a6a2-8e7f8804d469-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:16:39.363509 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.363483    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3529ea03-099d-4392-b1a7-8e8afee3cfe8-kube-api-access-f7q7h" (OuterVolumeSpecName: "kube-api-access-f7q7h") pod "3529ea03-099d-4392-b1a7-8e8afee3cfe8" (UID: "3529ea03-099d-4392-b1a7-8e8afee3cfe8"). InnerVolumeSpecName "kube-api-access-f7q7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:16:39.363908 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.363885    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9850b82e-399f-431b-a6a2-8e7f8804d469-kube-api-access-gjvxb" (OuterVolumeSpecName: "kube-api-access-gjvxb") pod "9850b82e-399f-431b-a6a2-8e7f8804d469" (UID: "9850b82e-399f-431b-a6a2-8e7f8804d469"). InnerVolumeSpecName "kube-api-access-gjvxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:16:39.462787 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.462743    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3529ea03-099d-4392-b1a7-8e8afee3cfe8-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:16:39.462787 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.462778    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjvxb\" (UniqueName: \"kubernetes.io/projected/9850b82e-399f-431b-a6a2-8e7f8804d469-kube-api-access-gjvxb\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:16:39.462787 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.462791    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7q7h\" (UniqueName: \"kubernetes.io/projected/3529ea03-099d-4392-b1a7-8e8afee3cfe8-kube-api-access-f7q7h\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:16:39.529296 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.529264    2565 generic.go:356] "Generic (PLEG): container finished" podID="3529ea03-099d-4392-b1a7-8e8afee3cfe8" containerID="cf6b69cd80d0a62942a313acfbd8ae0c9f9ab3dae175ba60289e0e21d6250d6a" exitCode=0
Sep 11 01:16:39.529459 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.529308    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7"
Sep 11 01:16:39.529459 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.529340    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7" event={"ID":"3529ea03-099d-4392-b1a7-8e8afee3cfe8","Type":"ContainerDied","Data":"cf6b69cd80d0a62942a313acfbd8ae0c9f9ab3dae175ba60289e0e21d6250d6a"}
Sep 11 01:16:39.529459 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.529385    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7" event={"ID":"3529ea03-099d-4392-b1a7-8e8afee3cfe8","Type":"ContainerDied","Data":"0a9c34f832e0f7be3044efe51faccc640663b2789a44ac25447dda42ebb6048d"}
Sep 11 01:16:39.529459 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.529402    2565 scope.go:117] "RemoveContainer" containerID="cf6b69cd80d0a62942a313acfbd8ae0c9f9ab3dae175ba60289e0e21d6250d6a"
Sep 11 01:16:39.531040 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.530751    2565 generic.go:356] "Generic (PLEG): container finished" podID="9850b82e-399f-431b-a6a2-8e7f8804d469" containerID="32e37ed4f6c74462c6e11fb58a9080bf4c5d0fb8325c6e4375a6ee669f8323c8" exitCode=0
Sep 11 01:16:39.531040 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.530784    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d" event={"ID":"9850b82e-399f-431b-a6a2-8e7f8804d469","Type":"ContainerDied","Data":"32e37ed4f6c74462c6e11fb58a9080bf4c5d0fb8325c6e4375a6ee669f8323c8"}
Sep 11 01:16:39.531040 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.530803    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d"
Sep 11 01:16:39.531040 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.530849    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d" event={"ID":"9850b82e-399f-431b-a6a2-8e7f8804d469","Type":"ContainerDied","Data":"25913897b94d0a42748dc0a363a22245ac38280ca116d4ae9af3045c1b6c0444"}
Sep 11 01:16:39.539012 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.538996    2565 scope.go:117] "RemoveContainer" containerID="cf6b69cd80d0a62942a313acfbd8ae0c9f9ab3dae175ba60289e0e21d6250d6a"
Sep 11 01:16:39.539267 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:16:39.539252    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf6b69cd80d0a62942a313acfbd8ae0c9f9ab3dae175ba60289e0e21d6250d6a\": container with ID starting with cf6b69cd80d0a62942a313acfbd8ae0c9f9ab3dae175ba60289e0e21d6250d6a not found: ID does not exist" containerID="cf6b69cd80d0a62942a313acfbd8ae0c9f9ab3dae175ba60289e0e21d6250d6a"
Sep 11 01:16:39.539321 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.539277    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf6b69cd80d0a62942a313acfbd8ae0c9f9ab3dae175ba60289e0e21d6250d6a"} err="failed to get container status \"cf6b69cd80d0a62942a313acfbd8ae0c9f9ab3dae175ba60289e0e21d6250d6a\": rpc error: code = NotFound desc = could not find container \"cf6b69cd80d0a62942a313acfbd8ae0c9f9ab3dae175ba60289e0e21d6250d6a\": container with ID starting with cf6b69cd80d0a62942a313acfbd8ae0c9f9ab3dae175ba60289e0e21d6250d6a not found: ID does not exist"
Sep 11 01:16:39.539321 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.539292    2565 scope.go:117] "RemoveContainer" containerID="32e37ed4f6c74462c6e11fb58a9080bf4c5d0fb8325c6e4375a6ee669f8323c8"
Sep 11 01:16:39.548116 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.548099    2565 scope.go:117] "RemoveContainer" containerID="32e37ed4f6c74462c6e11fb58a9080bf4c5d0fb8325c6e4375a6ee669f8323c8"
Sep 11 01:16:39.548393 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:16:39.548375    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32e37ed4f6c74462c6e11fb58a9080bf4c5d0fb8325c6e4375a6ee669f8323c8\": container with ID starting with 32e37ed4f6c74462c6e11fb58a9080bf4c5d0fb8325c6e4375a6ee669f8323c8 not found: ID does not exist" containerID="32e37ed4f6c74462c6e11fb58a9080bf4c5d0fb8325c6e4375a6ee669f8323c8"
Sep 11 01:16:39.548441 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.548400    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32e37ed4f6c74462c6e11fb58a9080bf4c5d0fb8325c6e4375a6ee669f8323c8"} err="failed to get container status \"32e37ed4f6c74462c6e11fb58a9080bf4c5d0fb8325c6e4375a6ee669f8323c8\": rpc error: code = NotFound desc = could not find container \"32e37ed4f6c74462c6e11fb58a9080bf4c5d0fb8325c6e4375a6ee669f8323c8\": container with ID starting with 32e37ed4f6c74462c6e11fb58a9080bf4c5d0fb8325c6e4375a6ee669f8323c8 not found: ID does not exist"
Sep 11 01:16:39.550044 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.550005    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d"]
Sep 11 01:16:39.555737 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.555714    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-cef92e-5678c5544b-4jp9d"]
Sep 11 01:16:39.566733 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.566712    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7"]
Sep 11 01:16:39.571856 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:39.571834    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-cef92e-65546b8d85-v27x7"]
Sep 11 01:16:41.471743 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:41.471666    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3529ea03-099d-4392-b1a7-8e8afee3cfe8" path="/var/lib/kubelet/pods/3529ea03-099d-4392-b1a7-8e8afee3cfe8/volumes"
Sep 11 01:16:41.472176 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:41.472155    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9850b82e-399f-431b-a6a2-8e7f8804d469" path="/var/lib/kubelet/pods/9850b82e-399f-431b-a6a2-8e7f8804d469/volumes"
Sep 11 01:16:44.524097 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:44.524054    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"]
Sep 11 01:16:45.814262 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:45.814225    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf"]
Sep 11 01:16:45.814626 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:45.814616    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9850b82e-399f-431b-a6a2-8e7f8804d469" containerName="payload-pre-processing"
Sep 11 01:16:45.814667 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:45.814628    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9850b82e-399f-431b-a6a2-8e7f8804d469" containerName="payload-pre-processing"
Sep 11 01:16:45.814667 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:45.814647    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3529ea03-099d-4392-b1a7-8e8afee3cfe8" containerName="payload-processing"
Sep 11 01:16:45.814667 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:45.814653    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3529ea03-099d-4392-b1a7-8e8afee3cfe8" containerName="payload-processing"
Sep 11 01:16:45.814762 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:45.814737    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9850b82e-399f-431b-a6a2-8e7f8804d469" containerName="payload-pre-processing"
Sep 11 01:16:45.814762 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:45.814745    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3529ea03-099d-4392-b1a7-8e8afee3cfe8" containerName="payload-processing"
Sep 11 01:16:45.819396 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:45.819379    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf"
Sep 11 01:16:45.822032 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:45.822007    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-194eb64c-dockercfg-dcfg9\""
Sep 11 01:16:45.822159 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:45.822051    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-194eb64c\""
Sep 11 01:16:45.828861 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:45.828835    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf"]
Sep 11 01:16:45.922743 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:45.922705    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0cee4817-5899-43ab-8cdd-3d4ab729ecad-plugins-config-volume\") pod \"payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf\" (UID: \"0cee4817-5899-43ab-8cdd-3d4ab729ecad\") " pod="openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf"
Sep 11 01:16:45.922946 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:45.922784    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7g5x\" (UniqueName: \"kubernetes.io/projected/0cee4817-5899-43ab-8cdd-3d4ab729ecad-kube-api-access-w7g5x\") pod \"payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf\" (UID: \"0cee4817-5899-43ab-8cdd-3d4ab729ecad\") " pod="openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf"
Sep 11 01:16:46.023896 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:46.023861    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0cee4817-5899-43ab-8cdd-3d4ab729ecad-plugins-config-volume\") pod \"payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf\" (UID: \"0cee4817-5899-43ab-8cdd-3d4ab729ecad\") " pod="openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf"
Sep 11 01:16:46.024066 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:46.023908    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7g5x\" (UniqueName: \"kubernetes.io/projected/0cee4817-5899-43ab-8cdd-3d4ab729ecad-kube-api-access-w7g5x\") pod \"payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf\" (UID: \"0cee4817-5899-43ab-8cdd-3d4ab729ecad\") " pod="openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf"
Sep 11 01:16:46.024596 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:46.024574    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0cee4817-5899-43ab-8cdd-3d4ab729ecad-plugins-config-volume\") pod \"payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf\" (UID: \"0cee4817-5899-43ab-8cdd-3d4ab729ecad\") " pod="openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf"
Sep 11 01:16:46.031582 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:46.031557    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7g5x\" (UniqueName: \"kubernetes.io/projected/0cee4817-5899-43ab-8cdd-3d4ab729ecad-kube-api-access-w7g5x\") pod \"payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf\" (UID: \"0cee4817-5899-43ab-8cdd-3d4ab729ecad\") " pod="openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf"
Sep 11 01:16:46.132973 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:46.132874    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf"
Sep 11 01:16:46.408208 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:46.408177    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf"]
Sep 11 01:16:46.408965 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:16:46.408938    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cee4817_5899_43ab_8cdd_3d4ab729ecad.slice/crio-2a5ac340e42576771c4b8cbc9d1ad933c1b20c24b918aa6e3ac32a0917e3c6f4 WatchSource:0}: Error finding container 2a5ac340e42576771c4b8cbc9d1ad933c1b20c24b918aa6e3ac32a0917e3c6f4: Status 404 returned error can't find the container with id 2a5ac340e42576771c4b8cbc9d1ad933c1b20c24b918aa6e3ac32a0917e3c6f4
Sep 11 01:16:46.578883 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:46.578848    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf" event={"ID":"0cee4817-5899-43ab-8cdd-3d4ab729ecad","Type":"ContainerStarted","Data":"4f789dbb67356cd6d8c19a161a7961ef2154a4de26175307ba608234670965c9"}
Sep 11 01:16:46.579077 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:46.578908    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf"
Sep 11 01:16:46.579077 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:46.578928    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf" event={"ID":"0cee4817-5899-43ab-8cdd-3d4ab729ecad","Type":"ContainerStarted","Data":"2a5ac340e42576771c4b8cbc9d1ad933c1b20c24b918aa6e3ac32a0917e3c6f4"}
Sep 11 01:16:46.595394 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:46.595349    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf" podStartSLOduration=1.595333109 podStartE2EDuration="1.595333109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:16:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:16:46.594560126 +0000 UTC m=+1123.642648378" watchObservedRunningTime="2026-09-11 01:16:46.595333109 +0000 UTC m=+1123.643421350"
Sep 11 01:16:57.586654 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:57.586618    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf"
Sep 11 01:16:59.543447 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.543389    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz" podUID="44cd6ac5-7db5-4298-a099-f79687a9943e" containerName="main" containerID="cri-o://daa9941e78b886d035869cd3f8fb0cedd605c673ed396dc86edf43a8b0f4f350" gracePeriod=45
Sep 11 01:16:59.666789 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.666761    2565 generic.go:356] "Generic (PLEG): container finished" podID="44cd6ac5-7db5-4298-a099-f79687a9943e" containerID="daa9941e78b886d035869cd3f8fb0cedd605c673ed396dc86edf43a8b0f4f350" exitCode=0
Sep 11 01:16:59.666940 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.666856    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz" event={"ID":"44cd6ac5-7db5-4298-a099-f79687a9943e","Type":"ContainerDied","Data":"daa9941e78b886d035869cd3f8fb0cedd605c673ed396dc86edf43a8b0f4f350"}
Sep 11 01:16:59.794928 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.794873    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:16:59.867594 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.867563    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44cd6ac5-7db5-4298-a099-f79687a9943e-tls-certs\") pod \"44cd6ac5-7db5-4298-a099-f79687a9943e\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") "
Sep 11 01:16:59.867779 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.867601    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swjbx\" (UniqueName: \"kubernetes.io/projected/44cd6ac5-7db5-4298-a099-f79687a9943e-kube-api-access-swjbx\") pod \"44cd6ac5-7db5-4298-a099-f79687a9943e\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") "
Sep 11 01:16:59.867779 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.867637    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-dshm\") pod \"44cd6ac5-7db5-4298-a099-f79687a9943e\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") "
Sep 11 01:16:59.867779 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.867683    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-tmp-dir\") pod \"44cd6ac5-7db5-4298-a099-f79687a9943e\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") "
Sep 11 01:16:59.867779 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.867772    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-home\") pod \"44cd6ac5-7db5-4298-a099-f79687a9943e\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") "
Sep 11 01:16:59.868027 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.867873    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-model-cache\") pod \"44cd6ac5-7db5-4298-a099-f79687a9943e\" (UID: \"44cd6ac5-7db5-4298-a099-f79687a9943e\") "
Sep 11 01:16:59.868154 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.868077    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-home" (OuterVolumeSpecName: "home") pod "44cd6ac5-7db5-4298-a099-f79687a9943e" (UID: "44cd6ac5-7db5-4298-a099-f79687a9943e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:16:59.868282 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.868218    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-model-cache" (OuterVolumeSpecName: "model-cache") pod "44cd6ac5-7db5-4298-a099-f79687a9943e" (UID: "44cd6ac5-7db5-4298-a099-f79687a9943e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:16:59.868350 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.868290    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-home\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:16:59.868350 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.868294    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "44cd6ac5-7db5-4298-a099-f79687a9943e" (UID: "44cd6ac5-7db5-4298-a099-f79687a9943e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:16:59.869932 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.869886    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44cd6ac5-7db5-4298-a099-f79687a9943e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "44cd6ac5-7db5-4298-a099-f79687a9943e" (UID: "44cd6ac5-7db5-4298-a099-f79687a9943e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:16:59.870035 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.869950    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-dshm" (OuterVolumeSpecName: "dshm") pod "44cd6ac5-7db5-4298-a099-f79687a9943e" (UID: "44cd6ac5-7db5-4298-a099-f79687a9943e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:16:59.870035 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.869979    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44cd6ac5-7db5-4298-a099-f79687a9943e-kube-api-access-swjbx" (OuterVolumeSpecName: "kube-api-access-swjbx") pod "44cd6ac5-7db5-4298-a099-f79687a9943e" (UID: "44cd6ac5-7db5-4298-a099-f79687a9943e"). InnerVolumeSpecName "kube-api-access-swjbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:16:59.969836 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.969782    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-model-cache\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:16:59.969836 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.969830    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/44cd6ac5-7db5-4298-a099-f79687a9943e-tls-certs\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:16:59.969836 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.969840    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swjbx\" (UniqueName: \"kubernetes.io/projected/44cd6ac5-7db5-4298-a099-f79687a9943e-kube-api-access-swjbx\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:16:59.970061 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.969849    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-dshm\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:16:59.970061 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:16:59.969859    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/44cd6ac5-7db5-4298-a099-f79687a9943e-tmp-dir\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:17:00.675596 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:00.675566    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"
Sep 11 01:17:00.676072 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:00.675605    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz" event={"ID":"44cd6ac5-7db5-4298-a099-f79687a9943e","Type":"ContainerDied","Data":"33dec43795649d6abfecd094a26cf873cfe6d8092a632cc946d2483b1bf2cc70"}
Sep 11 01:17:00.676072 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:00.675672    2565 scope.go:117] "RemoveContainer" containerID="daa9941e78b886d035869cd3f8fb0cedd605c673ed396dc86edf43a8b0f4f350"
Sep 11 01:17:00.697697 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:00.697669    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"]
Sep 11 01:17:00.700215 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:00.700197    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-cef92e/test-model-cef92e-kserve-86554fb565-p6twz"]
Sep 11 01:17:01.472288 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:01.472253    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44cd6ac5-7db5-4298-a099-f79687a9943e" path="/var/lib/kubelet/pods/44cd6ac5-7db5-4298-a099-f79687a9943e/volumes"
Sep 11 01:17:06.690957 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.690914    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"]
Sep 11 01:17:06.691855 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.691836    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44cd6ac5-7db5-4298-a099-f79687a9943e" containerName="main"
Sep 11 01:17:06.691977 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.691878    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="44cd6ac5-7db5-4298-a099-f79687a9943e" containerName="main"
Sep 11 01:17:06.692222 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.692206    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="44cd6ac5-7db5-4298-a099-f79687a9943e" containerName="main"
Sep 11 01:17:06.698016 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.697989    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:06.699107 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.699084    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"]
Sep 11 01:17:06.700368 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.700345    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-651569\"/\"embedding-w4-651569-kserve-self-signed-certs\""
Sep 11 01:17:06.837246 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.837209    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5177913-2cc0-4398-8cc7-201d5a14ef25-tls-certs\") pod \"embedding-w4-651569-kserve-55bdfb5594-hnzt4\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") " pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:06.837430 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.837283    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzcxp\" (UniqueName: \"kubernetes.io/projected/b5177913-2cc0-4398-8cc7-201d5a14ef25-kube-api-access-wzcxp\") pod \"embedding-w4-651569-kserve-55bdfb5594-hnzt4\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") " pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:06.837430 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.837301    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-home\") pod \"embedding-w4-651569-kserve-55bdfb5594-hnzt4\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") " pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:06.837430 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.837333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-dshm\") pod \"embedding-w4-651569-kserve-55bdfb5594-hnzt4\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") " pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:06.837430 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.837352    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-model-cache\") pod \"embedding-w4-651569-kserve-55bdfb5594-hnzt4\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") " pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:06.837430 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.837395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-tmp-dir\") pod \"embedding-w4-651569-kserve-55bdfb5594-hnzt4\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") " pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:06.937869 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.937837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-dshm\") pod \"embedding-w4-651569-kserve-55bdfb5594-hnzt4\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") " pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:06.937869 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.937876    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-model-cache\") pod \"embedding-w4-651569-kserve-55bdfb5594-hnzt4\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") " pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:06.938112 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.937903    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-tmp-dir\") pod \"embedding-w4-651569-kserve-55bdfb5594-hnzt4\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") " pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:06.938112 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.937937    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5177913-2cc0-4398-8cc7-201d5a14ef25-tls-certs\") pod \"embedding-w4-651569-kserve-55bdfb5594-hnzt4\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") " pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:06.938112 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.938014    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzcxp\" (UniqueName: \"kubernetes.io/projected/b5177913-2cc0-4398-8cc7-201d5a14ef25-kube-api-access-wzcxp\") pod \"embedding-w4-651569-kserve-55bdfb5594-hnzt4\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") " pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:06.938112 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.938041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-home\") pod \"embedding-w4-651569-kserve-55bdfb5594-hnzt4\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") " pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:06.938328 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.938307    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-model-cache\") pod \"embedding-w4-651569-kserve-55bdfb5594-hnzt4\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") " pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:06.938386 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.938349    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-home\") pod \"embedding-w4-651569-kserve-55bdfb5594-hnzt4\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") " pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:06.938512 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.938487    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-tmp-dir\") pod \"embedding-w4-651569-kserve-55bdfb5594-hnzt4\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") " pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:06.940221 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.940199    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-dshm\") pod \"embedding-w4-651569-kserve-55bdfb5594-hnzt4\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") " pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:06.940493 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.940473    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5177913-2cc0-4398-8cc7-201d5a14ef25-tls-certs\") pod \"embedding-w4-651569-kserve-55bdfb5594-hnzt4\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") " pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:06.947940 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:06.947881    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzcxp\" (UniqueName: \"kubernetes.io/projected/b5177913-2cc0-4398-8cc7-201d5a14ef25-kube-api-access-wzcxp\") pod \"embedding-w4-651569-kserve-55bdfb5594-hnzt4\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") " pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:07.010776 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:07.010737    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:07.286276 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:07.286249    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"]
Sep 11 01:17:07.287245 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:17:07.287207    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5177913_2cc0_4398_8cc7_201d5a14ef25.slice/crio-04031f2299091cccacea46823b0f5429bef29ed203b12a86edfde96d22bd31ae WatchSource:0}: Error finding container 04031f2299091cccacea46823b0f5429bef29ed203b12a86edfde96d22bd31ae: Status 404 returned error can't find the container with id 04031f2299091cccacea46823b0f5429bef29ed203b12a86edfde96d22bd31ae
Sep 11 01:17:07.721344 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:07.721308    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4" event={"ID":"b5177913-2cc0-4398-8cc7-201d5a14ef25","Type":"ContainerStarted","Data":"da2ee3c0a285a06d2906291c0e840244f9c54a50e46daca03409243c7652dbab"}
Sep 11 01:17:07.721732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:07.721360    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4" event={"ID":"b5177913-2cc0-4398-8cc7-201d5a14ef25","Type":"ContainerStarted","Data":"04031f2299091cccacea46823b0f5429bef29ed203b12a86edfde96d22bd31ae"}
Sep 11 01:17:07.739071 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:07.739015    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4" podStartSLOduration=1.738999804 podStartE2EDuration="1.738999804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:17:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:17:07.73647288 +0000 UTC m=+1144.784561106" watchObservedRunningTime="2026-09-11 01:17:07.738999804 +0000 UTC m=+1144.787088081"
Sep 11 01:17:17.011176 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:17.011136    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:17.011711 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:17.011421    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:17.024241 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:17.024213    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:17.808315 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:17.808283    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:17:58.648105 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:58.648067    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6ba087-857zn"]
Sep 11 01:17:58.651605 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:58.651587    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6ba087-857zn"
Sep 11 01:17:58.654110 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:58.654087    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 01:17:58.654412 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:58.654156    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pppkt\""
Sep 11 01:17:58.658858 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:58.658840    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6ba087-857zn"]
Sep 11 01:17:58.737006 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:58.736970    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/106588d0-0992-423c-92d2-25ab460a9e89-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-6ba087-857zn\" (UID: \"106588d0-0992-423c-92d2-25ab460a9e89\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6ba087-857zn"
Sep 11 01:17:58.838017 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:58.837968    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/106588d0-0992-423c-92d2-25ab460a9e89-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-6ba087-857zn\" (UID: \"106588d0-0992-423c-92d2-25ab460a9e89\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6ba087-857zn"
Sep 11 01:17:58.838639 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:58.838614    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/106588d0-0992-423c-92d2-25ab460a9e89-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-6ba087-857zn\" (UID: \"106588d0-0992-423c-92d2-25ab460a9e89\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6ba087-857zn"
Sep 11 01:17:58.966665 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:58.966580    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6ba087-857zn"
Sep 11 01:17:59.247669 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:17:59.247627    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6ba087-857zn"]
Sep 11 01:17:59.249135 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:17:59.249105    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod106588d0_0992_423c_92d2_25ab460a9e89.slice/crio-962c8c7bc0104c94d78e6bc4621e91d46fbb170c1a48675d8c1867b21c00f9fd WatchSource:0}: Error finding container 962c8c7bc0104c94d78e6bc4621e91d46fbb170c1a48675d8c1867b21c00f9fd: Status 404 returned error can't find the container with id 962c8c7bc0104c94d78e6bc4621e91d46fbb170c1a48675d8c1867b21c00f9fd
Sep 11 01:18:00.054734 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:00.054704    2565 generic.go:356] "Generic (PLEG): container finished" podID="106588d0-0992-423c-92d2-25ab460a9e89" containerID="d61ef4254fcbeb46a7030be4f83fceab6626fb975f6d88f86edbd25b77535f4c" exitCode=0
Sep 11 01:18:00.055228 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:00.054793    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6ba087-857zn" event={"ID":"106588d0-0992-423c-92d2-25ab460a9e89","Type":"ContainerDied","Data":"d61ef4254fcbeb46a7030be4f83fceab6626fb975f6d88f86edbd25b77535f4c"}
Sep 11 01:18:00.055228 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:00.054863    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6ba087-857zn" event={"ID":"106588d0-0992-423c-92d2-25ab460a9e89","Type":"ContainerStarted","Data":"962c8c7bc0104c94d78e6bc4621e91d46fbb170c1a48675d8c1867b21c00f9fd"}
Sep 11 01:18:01.194338 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:01.194315    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6ba087-857zn"
Sep 11 01:18:01.261243 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:01.261214    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/106588d0-0992-423c-92d2-25ab460a9e89-maas-api-service-ca\") pod \"106588d0-0992-423c-92d2-25ab460a9e89\" (UID: \"106588d0-0992-423c-92d2-25ab460a9e89\") "
Sep 11 01:18:01.261566 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:01.261543    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/106588d0-0992-423c-92d2-25ab460a9e89-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "106588d0-0992-423c-92d2-25ab460a9e89" (UID: "106588d0-0992-423c-92d2-25ab460a9e89"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:18:01.362378 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:01.362282    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/106588d0-0992-423c-92d2-25ab460a9e89-maas-api-service-ca\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:18:02.068455 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:02.068429    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6ba087-857zn"
Sep 11 01:18:02.068638 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:02.068452    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6ba087-857zn" event={"ID":"106588d0-0992-423c-92d2-25ab460a9e89","Type":"ContainerDied","Data":"962c8c7bc0104c94d78e6bc4621e91d46fbb170c1a48675d8c1867b21c00f9fd"}
Sep 11 01:18:02.068638 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:02.068494    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="962c8c7bc0104c94d78e6bc4621e91d46fbb170c1a48675d8c1867b21c00f9fd"
Sep 11 01:18:03.510283 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:03.510255    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/1.log"
Sep 11 01:18:03.512765 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:03.512735    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/1.log"
Sep 11 01:18:03.526937 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:03.526912    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"]
Sep 11 01:18:03.598209 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:03.598179    2565 scope.go:117] "RemoveContainer" containerID="64a58bad8ac0ac2651cd7fc2eaf2a6c3a705faddf87c9729d36505743ec8fe20"
Sep 11 01:18:09.778870 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:09.778829    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"]
Sep 11 01:18:09.780042 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:09.779994    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc" podUID="0db135f1-2ba1-404c-ab6b-fba56c6ec419" containerName="istio-proxy" containerID="cri-o://a2fc192a638b513095dec5e19c69fdd70192dc4362a7bc9814bc23e6454916c9" gracePeriod=30
Sep 11 01:18:10.128478 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:10.128436    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-891e67-xscnj"]
Sep 11 01:18:10.128871 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:10.128856    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="106588d0-0992-423c-92d2-25ab460a9e89" containerName="revoke-keys"
Sep 11 01:18:10.128871 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:10.128871    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="106588d0-0992-423c-92d2-25ab460a9e89" containerName="revoke-keys"
Sep 11 01:18:10.129034 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:10.128944    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="106588d0-0992-423c-92d2-25ab460a9e89" containerName="revoke-keys"
Sep 11 01:18:10.133321 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:10.133302    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-891e67-xscnj"
Sep 11 01:18:10.135916 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:10.135894    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 01:18:10.136029 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:10.135944    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pppkt\""
Sep 11 01:18:10.145640 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:10.145612    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-891e67-xscnj"]
Sep 11 01:18:10.256325 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:10.256290    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4aef9038-5756-4494-84bf-1096bbf1dbe6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-891e67-xscnj\" (UID: \"4aef9038-5756-4494-84bf-1096bbf1dbe6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-891e67-xscnj"
Sep 11 01:18:10.357118 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:10.357087    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4aef9038-5756-4494-84bf-1096bbf1dbe6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-891e67-xscnj\" (UID: \"4aef9038-5756-4494-84bf-1096bbf1dbe6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-891e67-xscnj"
Sep 11 01:18:10.357691 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:10.357670    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4aef9038-5756-4494-84bf-1096bbf1dbe6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-891e67-xscnj\" (UID: \"4aef9038-5756-4494-84bf-1096bbf1dbe6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-891e67-xscnj"
Sep 11 01:18:10.444854 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:10.444748    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-891e67-xscnj"
Sep 11 01:18:10.733885 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:10.733854    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-891e67-xscnj"]
Sep 11 01:18:10.734784 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:18:10.734759    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aef9038_5756_4494_84bf_1096bbf1dbe6.slice/crio-b332efaf641bc3fe4a7ffbaeeac6b81133044852cf9e69c73bd654a917867d06 WatchSource:0}: Error finding container b332efaf641bc3fe4a7ffbaeeac6b81133044852cf9e69c73bd654a917867d06: Status 404 returned error can't find the container with id b332efaf641bc3fe4a7ffbaeeac6b81133044852cf9e69c73bd654a917867d06
Sep 11 01:18:11.127363 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:11.127334    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-891e67-xscnj" event={"ID":"4aef9038-5756-4494-84bf-1096bbf1dbe6","Type":"ContainerStarted","Data":"53cccb749948e632f361350eded10e62e06d0df87cf4a79086fbf95552e6b117"}
Sep 11 01:18:11.127711 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:11.127387    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-891e67-xscnj" event={"ID":"4aef9038-5756-4494-84bf-1096bbf1dbe6","Type":"ContainerStarted","Data":"b332efaf641bc3fe4a7ffbaeeac6b81133044852cf9e69c73bd654a917867d06"}
Sep 11 01:18:11.144710 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:11.144670    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-891e67-xscnj" podStartSLOduration=1.144656985 podStartE2EDuration="1.144656985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:18:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:18:11.141580462 +0000 UTC m=+1208.189668686" watchObservedRunningTime="2026-09-11 01:18:11.144656985 +0000 UTC m=+1208.192745209"
Sep 11 01:18:11.316110 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:11.316030    2565 patch_prober.go:28] interesting pod/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 01:18:11.316110 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:11.316087    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc" podUID="0db135f1-2ba1-404c-ab6b-fba56c6ec419" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 01:18:12.136094 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:12.136064    2565 generic.go:356] "Generic (PLEG): container finished" podID="4aef9038-5756-4494-84bf-1096bbf1dbe6" containerID="53cccb749948e632f361350eded10e62e06d0df87cf4a79086fbf95552e6b117" exitCode=0
Sep 11 01:18:12.136501 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:12.136106    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-891e67-xscnj" event={"ID":"4aef9038-5756-4494-84bf-1096bbf1dbe6","Type":"ContainerDied","Data":"53cccb749948e632f361350eded10e62e06d0df87cf4a79086fbf95552e6b117"}
Sep 11 01:18:13.275595 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:13.275570    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-891e67-xscnj"
Sep 11 01:18:13.385692 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:13.385662    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4aef9038-5756-4494-84bf-1096bbf1dbe6-maas-api-service-ca\") pod \"4aef9038-5756-4494-84bf-1096bbf1dbe6\" (UID: \"4aef9038-5756-4494-84bf-1096bbf1dbe6\") "
Sep 11 01:18:13.386049 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:13.386029    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aef9038-5756-4494-84bf-1096bbf1dbe6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4aef9038-5756-4494-84bf-1096bbf1dbe6" (UID: "4aef9038-5756-4494-84bf-1096bbf1dbe6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:18:13.487292 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:13.487263    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4aef9038-5756-4494-84bf-1096bbf1dbe6-maas-api-service-ca\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:18:14.154014 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:14.153972    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-891e67-xscnj" event={"ID":"4aef9038-5756-4494-84bf-1096bbf1dbe6","Type":"ContainerDied","Data":"b332efaf641bc3fe4a7ffbaeeac6b81133044852cf9e69c73bd654a917867d06"}
Sep 11 01:18:14.154195 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:14.154057    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b332efaf641bc3fe4a7ffbaeeac6b81133044852cf9e69c73bd654a917867d06"
Sep 11 01:18:14.154195 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:14.153989    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-891e67-xscnj"
Sep 11 01:18:14.272507 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:14.272469    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf"]
Sep 11 01:18:14.272720 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:14.272679    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf" podUID="71155bc3-28cd-4229-8f79-4fd11c3cf88c" containerName="payload-processing" containerID="cri-o://283d2ccb833d2ff3ab401a6f482f2bb1434a7ba27c73d2fc4f971e4ffa6f525c" gracePeriod=30
Sep 11 01:18:14.538939 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:14.538916    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf"
Sep 11 01:18:14.591200 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:14.591165    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6ba087-857zn"]
Sep 11 01:18:14.595074 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:14.595050    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-6ba087-857zn"]
Sep 11 01:18:14.598365 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:14.598345    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n47nx\" (UniqueName: \"kubernetes.io/projected/71155bc3-28cd-4229-8f79-4fd11c3cf88c-kube-api-access-n47nx\") pod \"71155bc3-28cd-4229-8f79-4fd11c3cf88c\" (UID: \"71155bc3-28cd-4229-8f79-4fd11c3cf88c\") "
Sep 11 01:18:14.598468 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:14.598456    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71155bc3-28cd-4229-8f79-4fd11c3cf88c-plugins-config-volume\") pod \"71155bc3-28cd-4229-8f79-4fd11c3cf88c\" (UID: \"71155bc3-28cd-4229-8f79-4fd11c3cf88c\") "
Sep 11 01:18:14.598836 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:14.598784    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71155bc3-28cd-4229-8f79-4fd11c3cf88c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "71155bc3-28cd-4229-8f79-4fd11c3cf88c" (UID: "71155bc3-28cd-4229-8f79-4fd11c3cf88c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:18:14.600772 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:14.600744    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71155bc3-28cd-4229-8f79-4fd11c3cf88c-kube-api-access-n47nx" (OuterVolumeSpecName: "kube-api-access-n47nx") pod "71155bc3-28cd-4229-8f79-4fd11c3cf88c" (UID: "71155bc3-28cd-4229-8f79-4fd11c3cf88c"). InnerVolumeSpecName "kube-api-access-n47nx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:18:14.699887 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:14.699781    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n47nx\" (UniqueName: \"kubernetes.io/projected/71155bc3-28cd-4229-8f79-4fd11c3cf88c-kube-api-access-n47nx\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:18:14.699887 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:14.699832    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71155bc3-28cd-4229-8f79-4fd11c3cf88c-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:18:15.012363 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.012334    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:18:15.104529 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.104492    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-podinfo\") pod \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") "
Sep 11 01:18:15.104713 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.104568    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-envoy\") pod \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") "
Sep 11 01:18:15.104713 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.104628    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-credential-socket\") pod \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") "
Sep 11 01:18:15.104713 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.104646    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-token\") pod \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") "
Sep 11 01:18:15.104713 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.104669    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istiod-ca-cert\") pod \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") "
Sep 11 01:18:15.104713 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.104699    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8c59l\" (UniqueName: \"kubernetes.io/projected/0db135f1-2ba1-404c-ab6b-fba56c6ec419-kube-api-access-8c59l\") pod \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") "
Sep 11 01:18:15.104997 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.104715    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-data\") pod \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") "
Sep 11 01:18:15.104997 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.104918    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-workload-certs\") pod \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") "
Sep 11 01:18:15.104997 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.104942    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0db135f1-2ba1-404c-ab6b-fba56c6ec419" (UID: "0db135f1-2ba1-404c-ab6b-fba56c6ec419"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:18:15.104997 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.104982    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-workload-socket\") pod \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\" (UID: \"0db135f1-2ba1-404c-ab6b-fba56c6ec419\") "
Sep 11 01:18:15.105199 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.105095    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-data" (OuterVolumeSpecName: "istio-data") pod "0db135f1-2ba1-404c-ab6b-fba56c6ec419" (UID: "0db135f1-2ba1-404c-ab6b-fba56c6ec419"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:18:15.105199 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.105107    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0db135f1-2ba1-404c-ab6b-fba56c6ec419" (UID: "0db135f1-2ba1-404c-ab6b-fba56c6ec419"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:18:15.105303 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.105205    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0db135f1-2ba1-404c-ab6b-fba56c6ec419" (UID: "0db135f1-2ba1-404c-ab6b-fba56c6ec419"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:18:15.105303 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.105296    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0db135f1-2ba1-404c-ab6b-fba56c6ec419" (UID: "0db135f1-2ba1-404c-ab6b-fba56c6ec419"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:18:15.105493 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.105471    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-credential-socket\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:18:15.105588 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.105493    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istiod-ca-cert\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:18:15.105588 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.105506    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-data\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:18:15.105588 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.105520    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-workload-certs\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:18:15.105588 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.105532    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-workload-socket\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:18:15.106882 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.106849    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0db135f1-2ba1-404c-ab6b-fba56c6ec419" (UID: "0db135f1-2ba1-404c-ab6b-fba56c6ec419"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 01:18:15.106999 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.106957    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0db135f1-2ba1-404c-ab6b-fba56c6ec419" (UID: "0db135f1-2ba1-404c-ab6b-fba56c6ec419"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:18:15.106999 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.106978    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-token" (OuterVolumeSpecName: "istio-token") pod "0db135f1-2ba1-404c-ab6b-fba56c6ec419" (UID: "0db135f1-2ba1-404c-ab6b-fba56c6ec419"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:18:15.107097 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.107022    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0db135f1-2ba1-404c-ab6b-fba56c6ec419-kube-api-access-8c59l" (OuterVolumeSpecName: "kube-api-access-8c59l") pod "0db135f1-2ba1-404c-ab6b-fba56c6ec419" (UID: "0db135f1-2ba1-404c-ab6b-fba56c6ec419"). InnerVolumeSpecName "kube-api-access-8c59l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:18:15.160898 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.160867    2565 generic.go:356] "Generic (PLEG): container finished" podID="0db135f1-2ba1-404c-ab6b-fba56c6ec419" containerID="a2fc192a638b513095dec5e19c69fdd70192dc4362a7bc9814bc23e6454916c9" exitCode=0
Sep 11 01:18:15.161029 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.160914    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"
Sep 11 01:18:15.161029 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.160956    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc" event={"ID":"0db135f1-2ba1-404c-ab6b-fba56c6ec419","Type":"ContainerDied","Data":"a2fc192a638b513095dec5e19c69fdd70192dc4362a7bc9814bc23e6454916c9"}
Sep 11 01:18:15.161029 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.161002    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc" event={"ID":"0db135f1-2ba1-404c-ab6b-fba56c6ec419","Type":"ContainerDied","Data":"b7818feab04a92e24fcdff592dd43659bec95e79a28f9e55bee013a366c70304"}
Sep 11 01:18:15.161029 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.161022    2565 scope.go:117] "RemoveContainer" containerID="a2fc192a638b513095dec5e19c69fdd70192dc4362a7bc9814bc23e6454916c9"
Sep 11 01:18:15.162374 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.162350    2565 generic.go:356] "Generic (PLEG): container finished" podID="71155bc3-28cd-4229-8f79-4fd11c3cf88c" containerID="283d2ccb833d2ff3ab401a6f482f2bb1434a7ba27c73d2fc4f971e4ffa6f525c" exitCode=0
Sep 11 01:18:15.162487 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.162402    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf"
Sep 11 01:18:15.162487 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.162469    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf" event={"ID":"71155bc3-28cd-4229-8f79-4fd11c3cf88c","Type":"ContainerDied","Data":"283d2ccb833d2ff3ab401a6f482f2bb1434a7ba27c73d2fc4f971e4ffa6f525c"}
Sep 11 01:18:15.162593 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.162509    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf" event={"ID":"71155bc3-28cd-4229-8f79-4fd11c3cf88c","Type":"ContainerDied","Data":"09f16b8f02de65afcd07c7a1f6f2c3f27ead63c3bc08d1b3344e9a41766ca585"}
Sep 11 01:18:15.172555 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.172536    2565 scope.go:117] "RemoveContainer" containerID="a2e5c0ba6a85d855a6a4c5388cbfea21dc989b394cc38cc8c5da56e9e79355b8"
Sep 11 01:18:15.181788 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.181768    2565 scope.go:117] "RemoveContainer" containerID="a2fc192a638b513095dec5e19c69fdd70192dc4362a7bc9814bc23e6454916c9"
Sep 11 01:18:15.182061 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:18:15.182042    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2fc192a638b513095dec5e19c69fdd70192dc4362a7bc9814bc23e6454916c9\": container with ID starting with a2fc192a638b513095dec5e19c69fdd70192dc4362a7bc9814bc23e6454916c9 not found: ID does not exist" containerID="a2fc192a638b513095dec5e19c69fdd70192dc4362a7bc9814bc23e6454916c9"
Sep 11 01:18:15.182162 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.182070    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2fc192a638b513095dec5e19c69fdd70192dc4362a7bc9814bc23e6454916c9"} err="failed to get container status \"a2fc192a638b513095dec5e19c69fdd70192dc4362a7bc9814bc23e6454916c9\": rpc error: code = NotFound desc = could not find container \"a2fc192a638b513095dec5e19c69fdd70192dc4362a7bc9814bc23e6454916c9\": container with ID starting with a2fc192a638b513095dec5e19c69fdd70192dc4362a7bc9814bc23e6454916c9 not found: ID does not exist"
Sep 11 01:18:15.182162 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.182088    2565 scope.go:117] "RemoveContainer" containerID="a2e5c0ba6a85d855a6a4c5388cbfea21dc989b394cc38cc8c5da56e9e79355b8"
Sep 11 01:18:15.185084 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.185022    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"]
Sep 11 01:18:15.186554 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:18:15.186503    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2e5c0ba6a85d855a6a4c5388cbfea21dc989b394cc38cc8c5da56e9e79355b8\": container with ID starting with a2e5c0ba6a85d855a6a4c5388cbfea21dc989b394cc38cc8c5da56e9e79355b8 not found: ID does not exist" containerID="a2e5c0ba6a85d855a6a4c5388cbfea21dc989b394cc38cc8c5da56e9e79355b8"
Sep 11 01:18:15.186554 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.186538    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2e5c0ba6a85d855a6a4c5388cbfea21dc989b394cc38cc8c5da56e9e79355b8"} err="failed to get container status \"a2e5c0ba6a85d855a6a4c5388cbfea21dc989b394cc38cc8c5da56e9e79355b8\": rpc error: code = NotFound desc = could not find container \"a2e5c0ba6a85d855a6a4c5388cbfea21dc989b394cc38cc8c5da56e9e79355b8\": container with ID starting with a2e5c0ba6a85d855a6a4c5388cbfea21dc989b394cc38cc8c5da56e9e79355b8 not found: ID does not exist"
Sep 11 01:18:15.186739 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.186561    2565 scope.go:117] "RemoveContainer" containerID="283d2ccb833d2ff3ab401a6f482f2bb1434a7ba27c73d2fc4f971e4ffa6f525c"
Sep 11 01:18:15.189968 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.189949    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-cef92e-openshift-default-685dfdf9fd-knbjc"]
Sep 11 01:18:15.194896 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.194868    2565 scope.go:117] "RemoveContainer" containerID="283d2ccb833d2ff3ab401a6f482f2bb1434a7ba27c73d2fc4f971e4ffa6f525c"
Sep 11 01:18:15.195098 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:18:15.195079    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"283d2ccb833d2ff3ab401a6f482f2bb1434a7ba27c73d2fc4f971e4ffa6f525c\": container with ID starting with 283d2ccb833d2ff3ab401a6f482f2bb1434a7ba27c73d2fc4f971e4ffa6f525c not found: ID does not exist" containerID="283d2ccb833d2ff3ab401a6f482f2bb1434a7ba27c73d2fc4f971e4ffa6f525c"
Sep 11 01:18:15.195154 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.195105    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"283d2ccb833d2ff3ab401a6f482f2bb1434a7ba27c73d2fc4f971e4ffa6f525c"} err="failed to get container status \"283d2ccb833d2ff3ab401a6f482f2bb1434a7ba27c73d2fc4f971e4ffa6f525c\": rpc error: code = NotFound desc = could not find container \"283d2ccb833d2ff3ab401a6f482f2bb1434a7ba27c73d2fc4f971e4ffa6f525c\": container with ID starting with 283d2ccb833d2ff3ab401a6f482f2bb1434a7ba27c73d2fc4f971e4ffa6f525c not found: ID does not exist"
Sep 11 01:18:15.199511 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.199490    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf"]
Sep 11 01:18:15.204880 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.204861    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-6ba087-7f7fcd6f95-j2vlf"]
Sep 11 01:18:15.206658 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.206640    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-podinfo\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:18:15.206715 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.206661    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-envoy\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:18:15.206715 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.206669    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0db135f1-2ba1-404c-ab6b-fba56c6ec419-istio-token\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:18:15.206715 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.206678    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8c59l\" (UniqueName: \"kubernetes.io/projected/0db135f1-2ba1-404c-ab6b-fba56c6ec419-kube-api-access-8c59l\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:18:15.473494 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.473451    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0db135f1-2ba1-404c-ab6b-fba56c6ec419" path="/var/lib/kubelet/pods/0db135f1-2ba1-404c-ab6b-fba56c6ec419/volumes"
Sep 11 01:18:15.473935 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.473917    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="106588d0-0992-423c-92d2-25ab460a9e89" path="/var/lib/kubelet/pods/106588d0-0992-423c-92d2-25ab460a9e89/volumes"
Sep 11 01:18:15.474262 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:15.474242    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71155bc3-28cd-4229-8f79-4fd11c3cf88c" path="/var/lib/kubelet/pods/71155bc3-28cd-4229-8f79-4fd11c3cf88c/volumes"
Sep 11 01:18:18.546772 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:18.546708    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz" podUID="8f1de61d-8c87-4a73-aa56-4000653dc1e8" containerName="main" containerID="cri-o://a4e582516067beb58191f62d9c6be3f469cc5b0a310aa642f4632e3bab546170" gracePeriod=45
Sep 11 01:18:18.800496 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:18.800438    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:18:18.943436 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:18.943399    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f1de61d-8c87-4a73-aa56-4000653dc1e8-tls-certs\") pod \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") "
Sep 11 01:18:18.943436 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:18.943443    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-home\") pod \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") "
Sep 11 01:18:18.943633 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:18.943464    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-tmp-dir\") pod \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") "
Sep 11 01:18:18.943633 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:18.943596    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hp6v\" (UniqueName: \"kubernetes.io/projected/8f1de61d-8c87-4a73-aa56-4000653dc1e8-kube-api-access-5hp6v\") pod \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") "
Sep 11 01:18:18.943714 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:18.943704    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-model-cache\") pod \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") "
Sep 11 01:18:18.943748 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:18.943720    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8f1de61d-8c87-4a73-aa56-4000653dc1e8" (UID: "8f1de61d-8c87-4a73-aa56-4000653dc1e8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:18:18.943748 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:18.943734    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-home" (OuterVolumeSpecName: "home") pod "8f1de61d-8c87-4a73-aa56-4000653dc1e8" (UID: "8f1de61d-8c87-4a73-aa56-4000653dc1e8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:18:18.943843 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:18.943766    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-dshm\") pod \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\" (UID: \"8f1de61d-8c87-4a73-aa56-4000653dc1e8\") "
Sep 11 01:18:18.943974 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:18.943951    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-model-cache" (OuterVolumeSpecName: "model-cache") pod "8f1de61d-8c87-4a73-aa56-4000653dc1e8" (UID: "8f1de61d-8c87-4a73-aa56-4000653dc1e8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:18:18.944161 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:18.944145    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-home\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:18:18.944218 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:18.944163    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-tmp-dir\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:18:18.944218 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:18.944172    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-model-cache\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:18:18.945764 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:18.945736    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f1de61d-8c87-4a73-aa56-4000653dc1e8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8f1de61d-8c87-4a73-aa56-4000653dc1e8" (UID: "8f1de61d-8c87-4a73-aa56-4000653dc1e8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:18:18.945764 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:18.945737    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f1de61d-8c87-4a73-aa56-4000653dc1e8-kube-api-access-5hp6v" (OuterVolumeSpecName: "kube-api-access-5hp6v") pod "8f1de61d-8c87-4a73-aa56-4000653dc1e8" (UID: "8f1de61d-8c87-4a73-aa56-4000653dc1e8"). InnerVolumeSpecName "kube-api-access-5hp6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:18:18.945935 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:18.945761    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-dshm" (OuterVolumeSpecName: "dshm") pod "8f1de61d-8c87-4a73-aa56-4000653dc1e8" (UID: "8f1de61d-8c87-4a73-aa56-4000653dc1e8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:18:19.045260 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:19.045229    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f1de61d-8c87-4a73-aa56-4000653dc1e8-tls-certs\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:18:19.045260 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:19.045258    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hp6v\" (UniqueName: \"kubernetes.io/projected/8f1de61d-8c87-4a73-aa56-4000653dc1e8-kube-api-access-5hp6v\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:18:19.045260 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:19.045267    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f1de61d-8c87-4a73-aa56-4000653dc1e8-dshm\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:18:19.190197 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:19.190107    2565 generic.go:356] "Generic (PLEG): container finished" podID="8f1de61d-8c87-4a73-aa56-4000653dc1e8" containerID="a4e582516067beb58191f62d9c6be3f469cc5b0a310aa642f4632e3bab546170" exitCode=0
Sep 11 01:18:19.190197 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:19.190150    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"
Sep 11 01:18:19.190437 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:19.190200    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz" event={"ID":"8f1de61d-8c87-4a73-aa56-4000653dc1e8","Type":"ContainerDied","Data":"a4e582516067beb58191f62d9c6be3f469cc5b0a310aa642f4632e3bab546170"}
Sep 11 01:18:19.190437 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:19.190247    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz" event={"ID":"8f1de61d-8c87-4a73-aa56-4000653dc1e8","Type":"ContainerDied","Data":"5390668fc7eb4ac9a5d429f56952e9bf1bf3be0bc3cc7bfded00e5edab7e2e6e"}
Sep 11 01:18:19.190437 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:19.190269    2565 scope.go:117] "RemoveContainer" containerID="a4e582516067beb58191f62d9c6be3f469cc5b0a310aa642f4632e3bab546170"
Sep 11 01:18:19.200132 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:19.200114    2565 scope.go:117] "RemoveContainer" containerID="a4e582516067beb58191f62d9c6be3f469cc5b0a310aa642f4632e3bab546170"
Sep 11 01:18:19.200425 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:18:19.200407    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4e582516067beb58191f62d9c6be3f469cc5b0a310aa642f4632e3bab546170\": container with ID starting with a4e582516067beb58191f62d9c6be3f469cc5b0a310aa642f4632e3bab546170 not found: ID does not exist" containerID="a4e582516067beb58191f62d9c6be3f469cc5b0a310aa642f4632e3bab546170"
Sep 11 01:18:19.200469 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:19.200434    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4e582516067beb58191f62d9c6be3f469cc5b0a310aa642f4632e3bab546170"} err="failed to get container status \"a4e582516067beb58191f62d9c6be3f469cc5b0a310aa642f4632e3bab546170\": rpc error: code = NotFound desc = could not find container \"a4e582516067beb58191f62d9c6be3f469cc5b0a310aa642f4632e3bab546170\": container with ID starting with a4e582516067beb58191f62d9c6be3f469cc5b0a310aa642f4632e3bab546170 not found: ID does not exist"
Sep 11 01:18:19.213314 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:19.213293    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"]
Sep 11 01:18:19.215787 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:19.215768    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-6ba087/premium-w0-6ba087-kserve-67df86f79b-5rsgz"]
Sep 11 01:18:19.472996 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:19.472913    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f1de61d-8c87-4a73-aa56-4000653dc1e8" path="/var/lib/kubelet/pods/8f1de61d-8c87-4a73-aa56-4000653dc1e8/volumes"
Sep 11 01:18:20.957194 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:20.957143    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-891e67-xscnj"]
Sep 11 01:18:20.959838 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:20.959802    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-891e67-xscnj"]
Sep 11 01:18:21.474842 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:18:21.473264    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4aef9038-5756-4494-84bf-1096bbf1dbe6" path="/var/lib/kubelet/pods/4aef9038-5756-4494-84bf-1096bbf1dbe6/volumes"
Sep 11 01:19:03.621077 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:03.620996    2565 scope.go:117] "RemoveContainer" containerID="e4e660d3e9535450f08f775b3bc664bd8bb9102c1b9f8ad081dcf99b5710ea2c"
Sep 11 01:19:15.728205 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:15.728169    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"]
Sep 11 01:19:15.728608 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:15.728412    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6" podUID="7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5" containerName="istio-proxy" containerID="cri-o://5116a5220ae5fb73baaa911d586ece48e31ac24e54af23bd20544f6c68e3ac22" gracePeriod=30
Sep 11 01:19:20.988946 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:20.988882    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:19:21.021051 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.021019    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istiod-ca-cert\") pod \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") "
Sep 11 01:19:21.021222 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.021065    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-envoy\") pod \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") "
Sep 11 01:19:21.021222 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.021089    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-data\") pod \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") "
Sep 11 01:19:21.021222 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.021150    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-token\") pod \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") "
Sep 11 01:19:21.021222 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.021192    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-workload-socket\") pod \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") "
Sep 11 01:19:21.021222 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.021223    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-podinfo\") pod \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") "
Sep 11 01:19:21.021465 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.021259    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-workload-certs\") pod \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") "
Sep 11 01:19:21.021465 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.021338    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-credential-socket\") pod \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") "
Sep 11 01:19:21.021465 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.021405    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65c4z\" (UniqueName: \"kubernetes.io/projected/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-kube-api-access-65c4z\") pod \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\" (UID: \"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5\") "
Sep 11 01:19:21.021465 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.021410    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-data" (OuterVolumeSpecName: "istio-data") pod "7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5" (UID: "7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:19:21.021465 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.021434    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5" (UID: "7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:19:21.021732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.021537    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5" (UID: "7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:19:21.021732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.021622    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5" (UID: "7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:19:21.021732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.021715    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5" (UID: "7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:19:21.021931 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.021832    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istiod-ca-cert\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:19:21.021931 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.021852    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-data\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:19:21.021931 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.021866    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-workload-socket\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:19:21.021931 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.021878    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-workload-certs\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:19:21.021931 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.021892    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-credential-socket\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:19:21.023577 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.023545    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-token" (OuterVolumeSpecName: "istio-token") pod "7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5" (UID: "7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:19:21.023695 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.023677    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5" (UID: "7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 01:19:21.023922 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.023891    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5" (UID: "7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:19:21.023922 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.023904    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-kube-api-access-65c4z" (OuterVolumeSpecName: "kube-api-access-65c4z") pod "7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5" (UID: "7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5"). InnerVolumeSpecName "kube-api-access-65c4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:19:21.122652 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.122619    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65c4z\" (UniqueName: \"kubernetes.io/projected/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-kube-api-access-65c4z\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:19:21.122652 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.122648    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-envoy\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:19:21.122652 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.122657    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-token\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:19:21.123027 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.122666    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5-istio-podinfo\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:19:21.566302 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.566263    2565 generic.go:356] "Generic (PLEG): container finished" podID="7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5" containerID="5116a5220ae5fb73baaa911d586ece48e31ac24e54af23bd20544f6c68e3ac22" exitCode=0
Sep 11 01:19:21.566463 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.566319    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"
Sep 11 01:19:21.566463 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.566334    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6" event={"ID":"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5","Type":"ContainerDied","Data":"5116a5220ae5fb73baaa911d586ece48e31ac24e54af23bd20544f6c68e3ac22"}
Sep 11 01:19:21.566463 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.566383    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6" event={"ID":"7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5","Type":"ContainerDied","Data":"d6536cdc0a2e0b7199a4e1b8bdf6aec99985fff5e363d437fa2e3c8093293012"}
Sep 11 01:19:21.566463 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.566411    2565 scope.go:117] "RemoveContainer" containerID="5116a5220ae5fb73baaa911d586ece48e31ac24e54af23bd20544f6c68e3ac22"
Sep 11 01:19:21.575740 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.575720    2565 scope.go:117] "RemoveContainer" containerID="5116a5220ae5fb73baaa911d586ece48e31ac24e54af23bd20544f6c68e3ac22"
Sep 11 01:19:21.576058 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:19:21.576038    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5116a5220ae5fb73baaa911d586ece48e31ac24e54af23bd20544f6c68e3ac22\": container with ID starting with 5116a5220ae5fb73baaa911d586ece48e31ac24e54af23bd20544f6c68e3ac22 not found: ID does not exist" containerID="5116a5220ae5fb73baaa911d586ece48e31ac24e54af23bd20544f6c68e3ac22"
Sep 11 01:19:21.576163 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.576063    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5116a5220ae5fb73baaa911d586ece48e31ac24e54af23bd20544f6c68e3ac22"} err="failed to get container status \"5116a5220ae5fb73baaa911d586ece48e31ac24e54af23bd20544f6c68e3ac22\": rpc error: code = NotFound desc = could not find container \"5116a5220ae5fb73baaa911d586ece48e31ac24e54af23bd20544f6c68e3ac22\": container with ID starting with 5116a5220ae5fb73baaa911d586ece48e31ac24e54af23bd20544f6c68e3ac22 not found: ID does not exist"
Sep 11 01:19:21.585254 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.585232    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"]
Sep 11 01:19:21.588958 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:21.588937    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-836d37-openshift-default-58bc769474-4gtk6"]
Sep 11 01:19:23.108708 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.108674    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"]
Sep 11 01:19:23.109115 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.109100    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0db135f1-2ba1-404c-ab6b-fba56c6ec419" containerName="istio-proxy"
Sep 11 01:19:23.109162 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.109117    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0db135f1-2ba1-404c-ab6b-fba56c6ec419" containerName="istio-proxy"
Sep 11 01:19:23.109162 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.109125    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5" containerName="istio-proxy"
Sep 11 01:19:23.109162 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.109131    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5" containerName="istio-proxy"
Sep 11 01:19:23.109162 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.109139    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71155bc3-28cd-4229-8f79-4fd11c3cf88c" containerName="payload-processing"
Sep 11 01:19:23.109162 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.109145    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="71155bc3-28cd-4229-8f79-4fd11c3cf88c" containerName="payload-processing"
Sep 11 01:19:23.109162 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.109155    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f1de61d-8c87-4a73-aa56-4000653dc1e8" containerName="main"
Sep 11 01:19:23.109162 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.109160    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f1de61d-8c87-4a73-aa56-4000653dc1e8" containerName="main"
Sep 11 01:19:23.109380 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.109170    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aef9038-5756-4494-84bf-1096bbf1dbe6" containerName="revoke-keys"
Sep 11 01:19:23.109380 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.109175    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aef9038-5756-4494-84bf-1096bbf1dbe6" containerName="revoke-keys"
Sep 11 01:19:23.109380 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.109182    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0db135f1-2ba1-404c-ab6b-fba56c6ec419" containerName="istio-proxy"
Sep 11 01:19:23.109380 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.109187    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0db135f1-2ba1-404c-ab6b-fba56c6ec419" containerName="istio-proxy"
Sep 11 01:19:23.109380 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.109252    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0db135f1-2ba1-404c-ab6b-fba56c6ec419" containerName="istio-proxy"
Sep 11 01:19:23.109380 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.109260    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0db135f1-2ba1-404c-ab6b-fba56c6ec419" containerName="istio-proxy"
Sep 11 01:19:23.109380 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.109267    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4aef9038-5756-4494-84bf-1096bbf1dbe6" containerName="revoke-keys"
Sep 11 01:19:23.109380 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.109275    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f1de61d-8c87-4a73-aa56-4000653dc1e8" containerName="main"
Sep 11 01:19:23.109380 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.109281    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="71155bc3-28cd-4229-8f79-4fd11c3cf88c" containerName="payload-processing"
Sep 11 01:19:23.109380 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.109288    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5" containerName="istio-proxy"
Sep 11 01:19:23.113263 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.113244    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"
Sep 11 01:19:23.116653 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.116585    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 01:19:23.116653 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.116601    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 01:19:23.116653 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.116644    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-2482ac-serving-cert\""
Sep 11 01:19:23.116920 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.116647    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fzpvb\""
Sep 11 01:19:23.116920 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.116601    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 01:19:23.123611 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.123587    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"]
Sep 11 01:19:23.143363 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.143338    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz\" (UID: \"53586bfd-bf0d-4cc5-b2f3-d5828d965f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"
Sep 11 01:19:23.143492 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.143373    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz\" (UID: \"53586bfd-bf0d-4cc5-b2f3-d5828d965f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"
Sep 11 01:19:23.143560 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.143481    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz\" (UID: \"53586bfd-bf0d-4cc5-b2f3-d5828d965f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"
Sep 11 01:19:23.143616 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.143572    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rvrt\" (UniqueName: \"kubernetes.io/projected/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-kube-api-access-8rvrt\") pod \"maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz\" (UID: \"53586bfd-bf0d-4cc5-b2f3-d5828d965f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"
Sep 11 01:19:23.244516 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.244482    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rvrt\" (UniqueName: \"kubernetes.io/projected/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-kube-api-access-8rvrt\") pod \"maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz\" (UID: \"53586bfd-bf0d-4cc5-b2f3-d5828d965f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"
Sep 11 01:19:23.244688 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.244563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz\" (UID: \"53586bfd-bf0d-4cc5-b2f3-d5828d965f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"
Sep 11 01:19:23.244688 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.244597    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz\" (UID: \"53586bfd-bf0d-4cc5-b2f3-d5828d965f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"
Sep 11 01:19:23.244688 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.244658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz\" (UID: \"53586bfd-bf0d-4cc5-b2f3-d5828d965f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"
Sep 11 01:19:23.244828 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:19:23.244687    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-serving-cert: secret "maas-api-e2e-shared-a-w3-2482ac-serving-cert" not found
Sep 11 01:19:23.244828 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:19:23.244762    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-maas-api-tls podName:53586bfd-bf0d-4cc5-b2f3-d5828d965f27 nodeName:}" failed. No retries permitted until 2026-09-11 01:19:23.744740518 +0000 UTC m=+1280.792828724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-maas-api-tls") pod "maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz" (UID: "53586bfd-bf0d-4cc5-b2f3-d5828d965f27") : secret "maas-api-e2e-shared-a-w3-2482ac-serving-cert" not found
Sep 11 01:19:23.245392 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.245373    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz\" (UID: \"53586bfd-bf0d-4cc5-b2f3-d5828d965f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"
Sep 11 01:19:23.247002 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.246984    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz\" (UID: \"53586bfd-bf0d-4cc5-b2f3-d5828d965f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"
Sep 11 01:19:23.253049 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.253027    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rvrt\" (UniqueName: \"kubernetes.io/projected/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-kube-api-access-8rvrt\") pod \"maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz\" (UID: \"53586bfd-bf0d-4cc5-b2f3-d5828d965f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"
Sep 11 01:19:23.479727 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.479643    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5" path="/var/lib/kubelet/pods/7aac4e8d-e35c-43bf-b5d6-a70c089ef6b5/volumes"
Sep 11 01:19:23.749756 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.749674    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz\" (UID: \"53586bfd-bf0d-4cc5-b2f3-d5828d965f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"
Sep 11 01:19:23.752311 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:23.752284    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz\" (UID: \"53586bfd-bf0d-4cc5-b2f3-d5828d965f27\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"
Sep 11 01:19:24.027175 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:24.027095    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"
Sep 11 01:19:24.301232 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:24.301203    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"]
Sep 11 01:19:24.302281 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:19:24.302258    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53586bfd_bf0d_4cc5_b2f3_d5828d965f27.slice/crio-33a2e0acb35f9fd6029aeb9961e5ee567382ef4d8dae1a97ee365904cac56730 WatchSource:0}: Error finding container 33a2e0acb35f9fd6029aeb9961e5ee567382ef4d8dae1a97ee365904cac56730: Status 404 returned error can't find the container with id 33a2e0acb35f9fd6029aeb9961e5ee567382ef4d8dae1a97ee365904cac56730
Sep 11 01:19:24.303735 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:24.303715    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 01:19:24.586647 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:24.586546    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz" event={"ID":"53586bfd-bf0d-4cc5-b2f3-d5828d965f27","Type":"ContainerStarted","Data":"33a2e0acb35f9fd6029aeb9961e5ee567382ef4d8dae1a97ee365904cac56730"}
Sep 11 01:19:26.600744 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:26.600705    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz" event={"ID":"53586bfd-bf0d-4cc5-b2f3-d5828d965f27","Type":"ContainerStarted","Data":"dd03fa18ce0df87736446bfee517bc00fbd2f3b2686d8079e588d757f7c38f4a"}
Sep 11 01:19:26.601158 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:26.600783    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"
Sep 11 01:19:26.618169 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:26.618122    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz" podStartSLOduration=2.185611566 podStartE2EDuration="3.618108242s" totalImagesPullingTime="1.432496676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:19:26.616271573 +0000 UTC m=+1283.664359809" watchObservedRunningTime="2026-09-11 01:19:26.618108242 +0000 UTC m=+1283.666196511"
Sep 11 01:19:32.611594 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:32.611556    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"
Sep 11 01:19:47.483388 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.483351    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"]
Sep 11 01:19:47.486634 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.486611    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.489195 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.489170    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-9433b9-openshift-default-dockercfg-8mhc8\""
Sep 11 01:19:47.497871 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.497846    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"]
Sep 11 01:19:47.588479 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.588439    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-data\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.588479 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.588476    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-token\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.588677 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.588567    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03574d19-749e-4bf1-8f24-0413e26c3a25-istiod-ca-cert\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.588677 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.588615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-workload-socket\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.588677 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.588654    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-credential-socket\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.588781 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.588674    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-podinfo\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.588781 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.588728    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-envoy\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.588892 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.588780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-workload-certs\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.588892 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.588799    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm4l4\" (UniqueName: \"kubernetes.io/projected/03574d19-749e-4bf1-8f24-0413e26c3a25-kube-api-access-vm4l4\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.690109 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.690064    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-envoy\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.690296 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.690129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-workload-certs\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.690296 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.690146    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm4l4\" (UniqueName: \"kubernetes.io/projected/03574d19-749e-4bf1-8f24-0413e26c3a25-kube-api-access-vm4l4\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.690296 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.690196    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-data\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.690476 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.690312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-token\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.690476 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.690428    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03574d19-749e-4bf1-8f24-0413e26c3a25-istiod-ca-cert\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.690571 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.690481    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-workload-socket\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.690571 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.690490    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-workload-certs\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.690571 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.690505    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-data\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.690732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.690510    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-credential-socket\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.690732 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.690627    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-podinfo\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.690860 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.690753    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-credential-socket\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.690923 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.690868    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-workload-socket\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.691228 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.691196    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03574d19-749e-4bf1-8f24-0413e26c3a25-istiod-ca-cert\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.692487 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.692457    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-envoy\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.692910 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.692893    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-podinfo\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.697537 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.697511    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-token\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.697637 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.697579    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm4l4\" (UniqueName: \"kubernetes.io/projected/03574d19-749e-4bf1-8f24-0413e26c3a25-kube-api-access-vm4l4\") pod \"e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") " pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:47.798084 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:47.798054    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:48.081880 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:48.081852    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"]
Sep 11 01:19:48.083320 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:19:48.083293    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03574d19_749e_4bf1_8f24_0413e26c3a25.slice/crio-94b2f77cfbf30c2bcd2f72d1045873ada58db83a52a7dfdd3366be2f4814361c WatchSource:0}: Error finding container 94b2f77cfbf30c2bcd2f72d1045873ada58db83a52a7dfdd3366be2f4814361c: Status 404 returned error can't find the container with id 94b2f77cfbf30c2bcd2f72d1045873ada58db83a52a7dfdd3366be2f4814361c
Sep 11 01:19:48.085621 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:48.085585    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:19:48.085713 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:48.085664    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:19:48.085776 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:48.085709    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:19:48.728148 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:48.728113    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv" event={"ID":"03574d19-749e-4bf1-8f24-0413e26c3a25","Type":"ContainerStarted","Data":"6a08b39b83e95decfd7a11b820845c6cb30bc128a5d29ba47deea5e372dbb2f2"}
Sep 11 01:19:48.728507 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:48.728162    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv" event={"ID":"03574d19-749e-4bf1-8f24-0413e26c3a25","Type":"ContainerStarted","Data":"94b2f77cfbf30c2bcd2f72d1045873ada58db83a52a7dfdd3366be2f4814361c"}
Sep 11 01:19:48.752430 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:48.752381    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv" podStartSLOduration=1.7523603730000001 podStartE2EDuration="1.752360373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:19:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:19:48.75205694 +0000 UTC m=+1305.800145164" watchObservedRunningTime="2026-09-11 01:19:48.752360373 +0000 UTC m=+1305.800448600"
Sep 11 01:19:48.798457 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:48.798420    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:49.803769 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:49.803743    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:50.741306 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:50.741270    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:50.742287 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:50.742265    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:19:51.798129 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:51.798090    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"]
Sep 11 01:19:51.801363 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:51.801338    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"
Sep 11 01:19:51.803702 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:51.803679    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-9433b9-serving-cert\""
Sep 11 01:19:51.812940 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:51.812916    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"]
Sep 11 01:19:51.823058 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:51.823028    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/720e7f30-8240-4f52-9329-715f8d2d313f-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g\" (UID: \"720e7f30-8240-4f52-9329-715f8d2d313f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"
Sep 11 01:19:51.823172 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:51.823061    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bgg6\" (UniqueName: \"kubernetes.io/projected/720e7f30-8240-4f52-9329-715f8d2d313f-kube-api-access-7bgg6\") pod \"maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g\" (UID: \"720e7f30-8240-4f52-9329-715f8d2d313f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"
Sep 11 01:19:51.823270 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:51.823245    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/720e7f30-8240-4f52-9329-715f8d2d313f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g\" (UID: \"720e7f30-8240-4f52-9329-715f8d2d313f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"
Sep 11 01:19:51.823329 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:51.823303    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/720e7f30-8240-4f52-9329-715f8d2d313f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g\" (UID: \"720e7f30-8240-4f52-9329-715f8d2d313f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"
Sep 11 01:19:51.923877 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:51.923844    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/720e7f30-8240-4f52-9329-715f8d2d313f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g\" (UID: \"720e7f30-8240-4f52-9329-715f8d2d313f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"
Sep 11 01:19:51.924089 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:51.923897    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/720e7f30-8240-4f52-9329-715f8d2d313f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g\" (UID: \"720e7f30-8240-4f52-9329-715f8d2d313f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"
Sep 11 01:19:51.924089 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:51.924008    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/720e7f30-8240-4f52-9329-715f8d2d313f-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g\" (UID: \"720e7f30-8240-4f52-9329-715f8d2d313f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"
Sep 11 01:19:51.924089 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:51.924036    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bgg6\" (UniqueName: \"kubernetes.io/projected/720e7f30-8240-4f52-9329-715f8d2d313f-kube-api-access-7bgg6\") pod \"maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g\" (UID: \"720e7f30-8240-4f52-9329-715f8d2d313f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"
Sep 11 01:19:51.924089 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:19:51.924009    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-serving-cert: secret "maas-api-e2e-shared-b-w3-9433b9-serving-cert" not found
Sep 11 01:19:51.924296 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:19:51.924148    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/720e7f30-8240-4f52-9329-715f8d2d313f-maas-api-tls podName:720e7f30-8240-4f52-9329-715f8d2d313f nodeName:}" failed. No retries permitted until 2026-09-11 01:19:52.424132705 +0000 UTC m=+1309.472220906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/720e7f30-8240-4f52-9329-715f8d2d313f-maas-api-tls") pod "maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g" (UID: "720e7f30-8240-4f52-9329-715f8d2d313f") : secret "maas-api-e2e-shared-b-w3-9433b9-serving-cert" not found
Sep 11 01:19:51.924573 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:51.924539    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/720e7f30-8240-4f52-9329-715f8d2d313f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g\" (UID: \"720e7f30-8240-4f52-9329-715f8d2d313f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"
Sep 11 01:19:51.926577 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:51.926554    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/720e7f30-8240-4f52-9329-715f8d2d313f-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g\" (UID: \"720e7f30-8240-4f52-9329-715f8d2d313f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"
Sep 11 01:19:51.941616 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:51.941594    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bgg6\" (UniqueName: \"kubernetes.io/projected/720e7f30-8240-4f52-9329-715f8d2d313f-kube-api-access-7bgg6\") pod \"maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g\" (UID: \"720e7f30-8240-4f52-9329-715f8d2d313f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"
Sep 11 01:19:52.429168 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:52.429132    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/720e7f30-8240-4f52-9329-715f8d2d313f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g\" (UID: \"720e7f30-8240-4f52-9329-715f8d2d313f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"
Sep 11 01:19:52.431551 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:52.431528    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/720e7f30-8240-4f52-9329-715f8d2d313f-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g\" (UID: \"720e7f30-8240-4f52-9329-715f8d2d313f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"
Sep 11 01:19:52.714970 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:52.714880    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"
Sep 11 01:19:52.995221 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:52.995188    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"]
Sep 11 01:19:52.996639 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:19:52.996612    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod720e7f30_8240_4f52_9329_715f8d2d313f.slice/crio-e6f89583c9809c3905a830ece5cc2932ad490d150c95dd1c45242d57a71167d7 WatchSource:0}: Error finding container e6f89583c9809c3905a830ece5cc2932ad490d150c95dd1c45242d57a71167d7: Status 404 returned error can't find the container with id e6f89583c9809c3905a830ece5cc2932ad490d150c95dd1c45242d57a71167d7
Sep 11 01:19:53.761517 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:53.761421    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g" event={"ID":"720e7f30-8240-4f52-9329-715f8d2d313f","Type":"ContainerStarted","Data":"5f344afacac7a2b000570391a50d2ea952952b0d7c4125cf39a3fc7bc94f2bb3"}
Sep 11 01:19:53.761681 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:53.761583    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"
Sep 11 01:19:53.761681 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:53.761631    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g" event={"ID":"720e7f30-8240-4f52-9329-715f8d2d313f","Type":"ContainerStarted","Data":"e6f89583c9809c3905a830ece5cc2932ad490d150c95dd1c45242d57a71167d7"}
Sep 11 01:19:53.777782 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:53.777732    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g" podStartSLOduration=2.479624888 podStartE2EDuration="2.777710954s" totalImagesPullingTime="298.086066ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:19:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:19:53.776969751 +0000 UTC m=+1310.825057992" watchObservedRunningTime="2026-09-11 01:19:53.777710954 +0000 UTC m=+1310.825799198"
Sep 11 01:19:59.773434 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:19:59.773406    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"
Sep 11 01:20:06.783053 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:06.782999    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 01:20:06.783496 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:06.783096    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv" podUID="03574d19-749e-4bf1-8f24-0413e26c3a25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 01:20:08.853379 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:08.853346    2565 generic.go:356] "Generic (PLEG): container finished" podID="03574d19-749e-4bf1-8f24-0413e26c3a25" containerID="6a08b39b83e95decfd7a11b820845c6cb30bc128a5d29ba47deea5e372dbb2f2" exitCode=0
Sep 11 01:20:08.853762 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:08.853392    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv" event={"ID":"03574d19-749e-4bf1-8f24-0413e26c3a25","Type":"ContainerDied","Data":"6a08b39b83e95decfd7a11b820845c6cb30bc128a5d29ba47deea5e372dbb2f2"}
Sep 11 01:20:08.853808 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:08.853787    2565 scope.go:117] "RemoveContainer" containerID="6a08b39b83e95decfd7a11b820845c6cb30bc128a5d29ba47deea5e372dbb2f2"
Sep 11 01:20:08.855072 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:08.855036    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:20:08.855172 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:08.855128    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:20:08.855241 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:08.855176    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:20:09.867318 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:09.867272    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv" event={"ID":"03574d19-749e-4bf1-8f24-0413e26c3a25","Type":"ContainerStarted","Data":"8d28467d599ec5b4d0423b56d7355d52c769fa479f097856305a5e65cb8b98ef"}
Sep 11 01:20:10.799003 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:10.798967    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:20:10.799176 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:10.799137    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 11 01:20:10.799223 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:10.799184    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv" podUID="03574d19-749e-4bf1-8f24-0413e26c3a25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 11 01:20:11.799392 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:11.799354    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 11 01:20:11.799769 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:11.799411    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv" podUID="03574d19-749e-4bf1-8f24-0413e26c3a25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 11 01:20:12.799180 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:12.799142    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 11 01:20:12.799359 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:12.799202    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv" podUID="03574d19-749e-4bf1-8f24-0413e26c3a25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 11 01:20:13.799318 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:13.799278    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 11 01:20:13.799725 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:13.799347    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv" podUID="03574d19-749e-4bf1-8f24-0413e26c3a25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 11 01:20:14.798784 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:14.798749    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 11 01:20:14.798985 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:14.798806    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv" podUID="03574d19-749e-4bf1-8f24-0413e26c3a25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 11 01:20:15.802150 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:15.802119    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:20:15.802581 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:15.802560    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:20:15.803384 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:15.803364    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:20:24.555301 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:24.555263    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf"]
Sep 11 01:20:24.555763 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:24.555505    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf" podUID="0cee4817-5899-43ab-8cdd-3d4ab729ecad" containerName="payload-processing" containerID="cri-o://4f789dbb67356cd6d8c19a161a7961ef2154a4de26175307ba608234670965c9" gracePeriod=30
Sep 11 01:20:24.807317 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:24.807256    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf"
Sep 11 01:20:24.949868 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:24.949800    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0cee4817-5899-43ab-8cdd-3d4ab729ecad-plugins-config-volume\") pod \"0cee4817-5899-43ab-8cdd-3d4ab729ecad\" (UID: \"0cee4817-5899-43ab-8cdd-3d4ab729ecad\") "
Sep 11 01:20:24.950045 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:24.949905    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7g5x\" (UniqueName: \"kubernetes.io/projected/0cee4817-5899-43ab-8cdd-3d4ab729ecad-kube-api-access-w7g5x\") pod \"0cee4817-5899-43ab-8cdd-3d4ab729ecad\" (UID: \"0cee4817-5899-43ab-8cdd-3d4ab729ecad\") "
Sep 11 01:20:24.950162 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:24.950141    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cee4817-5899-43ab-8cdd-3d4ab729ecad-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0cee4817-5899-43ab-8cdd-3d4ab729ecad" (UID: "0cee4817-5899-43ab-8cdd-3d4ab729ecad"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:20:24.950316 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:24.950304    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0cee4817-5899-43ab-8cdd-3d4ab729ecad-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:20:24.952074 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:24.952051    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cee4817-5899-43ab-8cdd-3d4ab729ecad-kube-api-access-w7g5x" (OuterVolumeSpecName: "kube-api-access-w7g5x") pod "0cee4817-5899-43ab-8cdd-3d4ab729ecad" (UID: "0cee4817-5899-43ab-8cdd-3d4ab729ecad"). InnerVolumeSpecName "kube-api-access-w7g5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:20:24.958850 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:24.958803    2565 generic.go:356] "Generic (PLEG): container finished" podID="0cee4817-5899-43ab-8cdd-3d4ab729ecad" containerID="4f789dbb67356cd6d8c19a161a7961ef2154a4de26175307ba608234670965c9" exitCode=0
Sep 11 01:20:24.958976 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:24.958844    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf" event={"ID":"0cee4817-5899-43ab-8cdd-3d4ab729ecad","Type":"ContainerDied","Data":"4f789dbb67356cd6d8c19a161a7961ef2154a4de26175307ba608234670965c9"}
Sep 11 01:20:24.958976 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:24.958868    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf"
Sep 11 01:20:24.958976 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:24.958913    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf" event={"ID":"0cee4817-5899-43ab-8cdd-3d4ab729ecad","Type":"ContainerDied","Data":"2a5ac340e42576771c4b8cbc9d1ad933c1b20c24b918aa6e3ac32a0917e3c6f4"}
Sep 11 01:20:24.958976 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:24.958948    2565 scope.go:117] "RemoveContainer" containerID="4f789dbb67356cd6d8c19a161a7961ef2154a4de26175307ba608234670965c9"
Sep 11 01:20:24.968588 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:24.968572    2565 scope.go:117] "RemoveContainer" containerID="4f789dbb67356cd6d8c19a161a7961ef2154a4de26175307ba608234670965c9"
Sep 11 01:20:24.968897 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:20:24.968870    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f789dbb67356cd6d8c19a161a7961ef2154a4de26175307ba608234670965c9\": container with ID starting with 4f789dbb67356cd6d8c19a161a7961ef2154a4de26175307ba608234670965c9 not found: ID does not exist" containerID="4f789dbb67356cd6d8c19a161a7961ef2154a4de26175307ba608234670965c9"
Sep 11 01:20:24.968963 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:24.968912    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f789dbb67356cd6d8c19a161a7961ef2154a4de26175307ba608234670965c9"} err="failed to get container status \"4f789dbb67356cd6d8c19a161a7961ef2154a4de26175307ba608234670965c9\": rpc error: code = NotFound desc = could not find container \"4f789dbb67356cd6d8c19a161a7961ef2154a4de26175307ba608234670965c9\": container with ID starting with 4f789dbb67356cd6d8c19a161a7961ef2154a4de26175307ba608234670965c9 not found: ID does not exist"
Sep 11 01:20:25.001569 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:25.001541    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf"]
Sep 11 01:20:25.029524 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:25.029495    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-194eb64c-5b7bb5f7d9-v9knf"]
Sep 11 01:20:25.051600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:25.051574    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7g5x\" (UniqueName: \"kubernetes.io/projected/0cee4817-5899-43ab-8cdd-3d4ab729ecad-kube-api-access-w7g5x\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:20:25.471893 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:20:25.471859    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cee4817-5899-43ab-8cdd-3d4ab729ecad" path="/var/lib/kubelet/pods/0cee4817-5899-43ab-8cdd-3d4ab729ecad/volumes"
Sep 11 01:21:03.679507 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:03.679470    2565 scope.go:117] "RemoveContainer" containerID="fdb10a64b2c5c60d766ca84b67e0c159cbb14972ef03cc972f033994b0058ab9"
Sep 11 01:21:30.613430 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.613395    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx"]
Sep 11 01:21:30.613858 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.613786    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cee4817-5899-43ab-8cdd-3d4ab729ecad" containerName="payload-processing"
Sep 11 01:21:30.613858 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.613797    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cee4817-5899-43ab-8cdd-3d4ab729ecad" containerName="payload-processing"
Sep 11 01:21:30.613962 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.613886    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cee4817-5899-43ab-8cdd-3d4ab729ecad" containerName="payload-processing"
Sep 11 01:21:30.616903 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.616882    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx"
Sep 11 01:21:30.619377 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.619360    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-f1f91d-dockercfg-p8wm7\""
Sep 11 01:21:30.619468 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.619363    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-f1f91d\""
Sep 11 01:21:30.628740 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.628711    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx"]
Sep 11 01:21:30.656758 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.656720    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db"]
Sep 11 01:21:30.662002 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.661977    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db"
Sep 11 01:21:30.667511 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.667487    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db"]
Sep 11 01:21:30.687221 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.686853    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1-plugins-config-volume\") pod \"payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx\" (UID: \"a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1\") " pod="openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx"
Sep 11 01:21:30.687221 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.687104    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r59hh\" (UniqueName: \"kubernetes.io/projected/a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1-kube-api-access-r59hh\") pod \"payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx\" (UID: \"a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1\") " pod="openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx"
Sep 11 01:21:30.788041 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.787993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1-plugins-config-volume\") pod \"payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx\" (UID: \"a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1\") " pod="openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx"
Sep 11 01:21:30.788234 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.788096    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/805d191e-d0a4-4d7e-b758-66597da4bfd8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db\" (UID: \"805d191e-d0a4-4d7e-b758-66597da4bfd8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db"
Sep 11 01:21:30.788234 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.788152    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6f5z\" (UniqueName: \"kubernetes.io/projected/805d191e-d0a4-4d7e-b758-66597da4bfd8-kube-api-access-c6f5z\") pod \"payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db\" (UID: \"805d191e-d0a4-4d7e-b758-66597da4bfd8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db"
Sep 11 01:21:30.788362 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.788237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r59hh\" (UniqueName: \"kubernetes.io/projected/a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1-kube-api-access-r59hh\") pod \"payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx\" (UID: \"a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1\") " pod="openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx"
Sep 11 01:21:30.788672 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.788650    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1-plugins-config-volume\") pod \"payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx\" (UID: \"a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1\") " pod="openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx"
Sep 11 01:21:30.795888 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.795864    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r59hh\" (UniqueName: \"kubernetes.io/projected/a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1-kube-api-access-r59hh\") pod \"payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx\" (UID: \"a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1\") " pod="openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx"
Sep 11 01:21:30.889772 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.889682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/805d191e-d0a4-4d7e-b758-66597da4bfd8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db\" (UID: \"805d191e-d0a4-4d7e-b758-66597da4bfd8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db"
Sep 11 01:21:30.889772 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.889733    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6f5z\" (UniqueName: \"kubernetes.io/projected/805d191e-d0a4-4d7e-b758-66597da4bfd8-kube-api-access-c6f5z\") pod \"payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db\" (UID: \"805d191e-d0a4-4d7e-b758-66597da4bfd8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db"
Sep 11 01:21:30.890395 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.890375    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/805d191e-d0a4-4d7e-b758-66597da4bfd8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db\" (UID: \"805d191e-d0a4-4d7e-b758-66597da4bfd8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db"
Sep 11 01:21:30.899189 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.899163    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6f5z\" (UniqueName: \"kubernetes.io/projected/805d191e-d0a4-4d7e-b758-66597da4bfd8-kube-api-access-c6f5z\") pod \"payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db\" (UID: \"805d191e-d0a4-4d7e-b758-66597da4bfd8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db"
Sep 11 01:21:30.927850 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.927804    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx"
Sep 11 01:21:30.976750 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:30.975920    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db"
Sep 11 01:21:31.200881 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:31.200855    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx"]
Sep 11 01:21:31.201871 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:21:31.201846    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda23a8eb4_0fb1_40e2_8a72_5ea0015c1ea1.slice/crio-3f3cbe113b464127a44b150a1844443b26170754fde715c440f10031dea3cef0 WatchSource:0}: Error finding container 3f3cbe113b464127a44b150a1844443b26170754fde715c440f10031dea3cef0: Status 404 returned error can't find the container with id 3f3cbe113b464127a44b150a1844443b26170754fde715c440f10031dea3cef0
Sep 11 01:21:31.256653 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:31.256627    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db"]
Sep 11 01:21:31.258351 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:21:31.258321    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805d191e_d0a4_4d7e_b758_66597da4bfd8.slice/crio-e5f38466246e00fb7001807887d82cb5852b70932944c8b9140f81f6a9f0c255 WatchSource:0}: Error finding container e5f38466246e00fb7001807887d82cb5852b70932944c8b9140f81f6a9f0c255: Status 404 returned error can't find the container with id e5f38466246e00fb7001807887d82cb5852b70932944c8b9140f81f6a9f0c255
Sep 11 01:21:31.356840 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:31.356785    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx" event={"ID":"a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1","Type":"ContainerStarted","Data":"e3e59f80b40197116f7eebcb76d308633337c0385bc10d089885e4a3481b2d83"}
Sep 11 01:21:31.357001 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:31.356858    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx" event={"ID":"a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1","Type":"ContainerStarted","Data":"3f3cbe113b464127a44b150a1844443b26170754fde715c440f10031dea3cef0"}
Sep 11 01:21:31.357075 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:31.357011    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx"
Sep 11 01:21:31.358612 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:31.358586    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db" event={"ID":"805d191e-d0a4-4d7e-b758-66597da4bfd8","Type":"ContainerStarted","Data":"e90c4b89d358b36b40de278a4e60aa6f5c63a6e81adb156ce5e6657fde029abb"}
Sep 11 01:21:31.358716 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:31.358633    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db" event={"ID":"805d191e-d0a4-4d7e-b758-66597da4bfd8","Type":"ContainerStarted","Data":"e5f38466246e00fb7001807887d82cb5852b70932944c8b9140f81f6a9f0c255"}
Sep 11 01:21:31.358775 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:31.358718    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db"
Sep 11 01:21:31.373400 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:31.373355    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx" podStartSLOduration=1.3733426180000001 podStartE2EDuration="1.373342618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:21:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:21:31.372663126 +0000 UTC m=+1408.420751361" watchObservedRunningTime="2026-09-11 01:21:31.373342618 +0000 UTC m=+1408.421430841"
Sep 11 01:21:31.389095 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:31.389045    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db" podStartSLOduration=1.389029195 podStartE2EDuration="1.389029195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:21:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:21:31.388475225 +0000 UTC m=+1408.436563469" watchObservedRunningTime="2026-09-11 01:21:31.389029195 +0000 UTC m=+1408.437117463"
Sep 11 01:21:42.366873 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:42.366842    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx"
Sep 11 01:21:42.367288 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:42.366912    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db"
Sep 11 01:21:59.518483 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.518394    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6"]
Sep 11 01:21:59.522493 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.522470    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6"
Sep 11 01:21:59.527204 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.527186    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-816605\""
Sep 11 01:21:59.527502 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.527485    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-816605-dockercfg-5fsxx\""
Sep 11 01:21:59.537219 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.537148    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6"]
Sep 11 01:21:59.543575 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.543553    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5"]
Sep 11 01:21:59.559737 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.559705    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5"
Sep 11 01:21:59.565508 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.565479    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5"]
Sep 11 01:21:59.568468 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.568435    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebf2cdc5-7c79-4784-92cc-8bd78f162f6d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6\" (UID: \"ebf2cdc5-7c79-4784-92cc-8bd78f162f6d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6"
Sep 11 01:21:59.568595 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.568531    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlb5j\" (UniqueName: \"kubernetes.io/projected/ebf2cdc5-7c79-4784-92cc-8bd78f162f6d-kube-api-access-tlb5j\") pod \"payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6\" (UID: \"ebf2cdc5-7c79-4784-92cc-8bd78f162f6d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6"
Sep 11 01:21:59.669446 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.669407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlb5j\" (UniqueName: \"kubernetes.io/projected/ebf2cdc5-7c79-4784-92cc-8bd78f162f6d-kube-api-access-tlb5j\") pod \"payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6\" (UID: \"ebf2cdc5-7c79-4784-92cc-8bd78f162f6d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6"
Sep 11 01:21:59.669638 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.669475    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b6c41c9-2190-4a5d-814c-fa01d14128bf-plugins-config-volume\") pod \"payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5\" (UID: \"4b6c41c9-2190-4a5d-814c-fa01d14128bf\") " pod="openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5"
Sep 11 01:21:59.669638 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.669607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp2gg\" (UniqueName: \"kubernetes.io/projected/4b6c41c9-2190-4a5d-814c-fa01d14128bf-kube-api-access-zp2gg\") pod \"payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5\" (UID: \"4b6c41c9-2190-4a5d-814c-fa01d14128bf\") " pod="openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5"
Sep 11 01:21:59.669758 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.669645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebf2cdc5-7c79-4784-92cc-8bd78f162f6d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6\" (UID: \"ebf2cdc5-7c79-4784-92cc-8bd78f162f6d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6"
Sep 11 01:21:59.670360 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.670342    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebf2cdc5-7c79-4784-92cc-8bd78f162f6d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6\" (UID: \"ebf2cdc5-7c79-4784-92cc-8bd78f162f6d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6"
Sep 11 01:21:59.677724 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.677706    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlb5j\" (UniqueName: \"kubernetes.io/projected/ebf2cdc5-7c79-4784-92cc-8bd78f162f6d-kube-api-access-tlb5j\") pod \"payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6\" (UID: \"ebf2cdc5-7c79-4784-92cc-8bd78f162f6d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6"
Sep 11 01:21:59.771092 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.771008    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp2gg\" (UniqueName: \"kubernetes.io/projected/4b6c41c9-2190-4a5d-814c-fa01d14128bf-kube-api-access-zp2gg\") pod \"payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5\" (UID: \"4b6c41c9-2190-4a5d-814c-fa01d14128bf\") " pod="openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5"
Sep 11 01:21:59.771092 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.771091    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b6c41c9-2190-4a5d-814c-fa01d14128bf-plugins-config-volume\") pod \"payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5\" (UID: \"4b6c41c9-2190-4a5d-814c-fa01d14128bf\") " pod="openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5"
Sep 11 01:21:59.771927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.771898    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b6c41c9-2190-4a5d-814c-fa01d14128bf-plugins-config-volume\") pod \"payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5\" (UID: \"4b6c41c9-2190-4a5d-814c-fa01d14128bf\") " pod="openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5"
Sep 11 01:21:59.779154 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.779132    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp2gg\" (UniqueName: \"kubernetes.io/projected/4b6c41c9-2190-4a5d-814c-fa01d14128bf-kube-api-access-zp2gg\") pod \"payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5\" (UID: \"4b6c41c9-2190-4a5d-814c-fa01d14128bf\") " pod="openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5"
Sep 11 01:21:59.835439 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.835402    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6"
Sep 11 01:21:59.874177 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:21:59.874136    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5"
Sep 11 01:22:00.116592 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:00.116564    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6"]
Sep 11 01:22:00.118269 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:22:00.118243    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf2cdc5_7c79_4784_92cc_8bd78f162f6d.slice/crio-9a84d5299367d96525baaf186b4b8411388d3092c77baef9ddc9bfb062ab7110 WatchSource:0}: Error finding container 9a84d5299367d96525baaf186b4b8411388d3092c77baef9ddc9bfb062ab7110: Status 404 returned error can't find the container with id 9a84d5299367d96525baaf186b4b8411388d3092c77baef9ddc9bfb062ab7110
Sep 11 01:22:00.168552 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:00.168525    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5"]
Sep 11 01:22:00.169215 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:22:00.169191    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6c41c9_2190_4a5d_814c_fa01d14128bf.slice/crio-8ea624e8b11f2abd92398e987658a1a9a42b1d491623e67d5b2bdf501b2dc4e1 WatchSource:0}: Error finding container 8ea624e8b11f2abd92398e987658a1a9a42b1d491623e67d5b2bdf501b2dc4e1: Status 404 returned error can't find the container with id 8ea624e8b11f2abd92398e987658a1a9a42b1d491623e67d5b2bdf501b2dc4e1
Sep 11 01:22:00.541218 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:00.541177    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6" event={"ID":"ebf2cdc5-7c79-4784-92cc-8bd78f162f6d","Type":"ContainerStarted","Data":"e6944993fecd9637817bd52a190e4b839cdf3261cf178e67092ac000a07fe253"}
Sep 11 01:22:00.541688 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:00.541246    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6" event={"ID":"ebf2cdc5-7c79-4784-92cc-8bd78f162f6d","Type":"ContainerStarted","Data":"9a84d5299367d96525baaf186b4b8411388d3092c77baef9ddc9bfb062ab7110"}
Sep 11 01:22:00.541688 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:00.541274    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6"
Sep 11 01:22:00.542835 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:00.542791    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5" event={"ID":"4b6c41c9-2190-4a5d-814c-fa01d14128bf","Type":"ContainerStarted","Data":"d75f774f67e08e18802fde635f227a867329f5c7178a55d49c4c0f9d2d672bf9"}
Sep 11 01:22:00.542962 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:00.542864    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5"
Sep 11 01:22:00.542962 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:00.542888    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5" event={"ID":"4b6c41c9-2190-4a5d-814c-fa01d14128bf","Type":"ContainerStarted","Data":"8ea624e8b11f2abd92398e987658a1a9a42b1d491623e67d5b2bdf501b2dc4e1"}
Sep 11 01:22:00.557633 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:00.557583    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6" podStartSLOduration=1.557566046 podStartE2EDuration="1.557566046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:21:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:22:00.555616803 +0000 UTC m=+1437.603705028" watchObservedRunningTime="2026-09-11 01:22:00.557566046 +0000 UTC m=+1437.605654276"
Sep 11 01:22:00.574768 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:00.574714    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5" podStartSLOduration=1.574699971 podStartE2EDuration="1.574699971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:21:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:22:00.572092871 +0000 UTC m=+1437.620181120" watchObservedRunningTime="2026-09-11 01:22:00.574699971 +0000 UTC m=+1437.622788196"
Sep 11 01:22:03.704897 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:03.704867    2565 scope.go:117] "RemoveContainer" containerID="50c6fa31bb76ce1edd7897d1e5ed168c16a016e0acdb84d20f4020b8a51dfdde"
Sep 11 01:22:11.551589 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:11.551552    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5"
Sep 11 01:22:11.552028 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:11.551626    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6"
Sep 11 01:22:15.225197 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:15.225163    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"]
Sep 11 01:22:15.238191 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:15.238160    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"]
Sep 11 01:22:15.255310 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:15.255277    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"]
Sep 11 01:22:26.514189 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.514145    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-651569-29818155-cbhph"]
Sep 11 01:22:26.517248 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.517219    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-651569-29818155-cbhph"]
Sep 11 01:22:26.539958 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.539928    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk"]
Sep 11 01:22:26.540172 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.540131    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk" podUID="3f82db2c-1a10-465b-a339-cf42289489f8" containerName="payload-processing" containerID="cri-o://b3e89024699b004a7d482a483b5d388e21ca1ce1dde6d7b039222158e32eb05f" gracePeriod=30
Sep 11 01:22:26.552744 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.552711    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp"]
Sep 11 01:22:26.553041 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.552991    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp" podUID="69d5c781-c8be-4f1c-868e-18e6aacfdd91" containerName="payload-pre-processing" containerID="cri-o://d2958c92b3d4791a53cb99fed32e2fd7d1cb670b1ca5fdb005c29d223a1bd15b" gracePeriod=30
Sep 11 01:22:26.715359 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.715328    2565 generic.go:356] "Generic (PLEG): container finished" podID="3f82db2c-1a10-465b-a339-cf42289489f8" containerID="b3e89024699b004a7d482a483b5d388e21ca1ce1dde6d7b039222158e32eb05f" exitCode=0
Sep 11 01:22:26.715576 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.715459    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk" event={"ID":"3f82db2c-1a10-465b-a339-cf42289489f8","Type":"ContainerDied","Data":"b3e89024699b004a7d482a483b5d388e21ca1ce1dde6d7b039222158e32eb05f"}
Sep 11 01:22:26.717842 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.717778    2565 generic.go:356] "Generic (PLEG): container finished" podID="69d5c781-c8be-4f1c-868e-18e6aacfdd91" containerID="d2958c92b3d4791a53cb99fed32e2fd7d1cb670b1ca5fdb005c29d223a1bd15b" exitCode=0
Sep 11 01:22:26.717961 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.717848    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp" event={"ID":"69d5c781-c8be-4f1c-868e-18e6aacfdd91","Type":"ContainerDied","Data":"d2958c92b3d4791a53cb99fed32e2fd7d1cb670b1ca5fdb005c29d223a1bd15b"}
Sep 11 01:22:26.826398 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.826378    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk"
Sep 11 01:22:26.829508 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.829489    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp"
Sep 11 01:22:26.851789 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.851766    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f82db2c-1a10-465b-a339-cf42289489f8-plugins-config-volume\") pod \"3f82db2c-1a10-465b-a339-cf42289489f8\" (UID: \"3f82db2c-1a10-465b-a339-cf42289489f8\") "
Sep 11 01:22:26.851912 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.851828    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7f524\" (UniqueName: \"kubernetes.io/projected/69d5c781-c8be-4f1c-868e-18e6aacfdd91-kube-api-access-7f524\") pod \"69d5c781-c8be-4f1c-868e-18e6aacfdd91\" (UID: \"69d5c781-c8be-4f1c-868e-18e6aacfdd91\") "
Sep 11 01:22:26.851912 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.851865    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69d5c781-c8be-4f1c-868e-18e6aacfdd91-plugins-config-volume\") pod \"69d5c781-c8be-4f1c-868e-18e6aacfdd91\" (UID: \"69d5c781-c8be-4f1c-868e-18e6aacfdd91\") "
Sep 11 01:22:26.852014 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.851928    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khm9j\" (UniqueName: \"kubernetes.io/projected/3f82db2c-1a10-465b-a339-cf42289489f8-kube-api-access-khm9j\") pod \"3f82db2c-1a10-465b-a339-cf42289489f8\" (UID: \"3f82db2c-1a10-465b-a339-cf42289489f8\") "
Sep 11 01:22:26.852211 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.852188    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f82db2c-1a10-465b-a339-cf42289489f8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3f82db2c-1a10-465b-a339-cf42289489f8" (UID: "3f82db2c-1a10-465b-a339-cf42289489f8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:22:26.852311 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.852287    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69d5c781-c8be-4f1c-868e-18e6aacfdd91-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "69d5c781-c8be-4f1c-868e-18e6aacfdd91" (UID: "69d5c781-c8be-4f1c-868e-18e6aacfdd91"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:22:26.852364 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.852300    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3f82db2c-1a10-465b-a339-cf42289489f8-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:26.854083 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.854058    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f82db2c-1a10-465b-a339-cf42289489f8-kube-api-access-khm9j" (OuterVolumeSpecName: "kube-api-access-khm9j") pod "3f82db2c-1a10-465b-a339-cf42289489f8" (UID: "3f82db2c-1a10-465b-a339-cf42289489f8"). InnerVolumeSpecName "kube-api-access-khm9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:22:26.854177 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.854088    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69d5c781-c8be-4f1c-868e-18e6aacfdd91-kube-api-access-7f524" (OuterVolumeSpecName: "kube-api-access-7f524") pod "69d5c781-c8be-4f1c-868e-18e6aacfdd91" (UID: "69d5c781-c8be-4f1c-868e-18e6aacfdd91"). InnerVolumeSpecName "kube-api-access-7f524". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:22:26.953238 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.953203    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/69d5c781-c8be-4f1c-868e-18e6aacfdd91-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:26.953238 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.953232    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khm9j\" (UniqueName: \"kubernetes.io/projected/3f82db2c-1a10-465b-a339-cf42289489f8-kube-api-access-khm9j\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:26.953238 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:26.953244    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7f524\" (UniqueName: \"kubernetes.io/projected/69d5c781-c8be-4f1c-868e-18e6aacfdd91-kube-api-access-7f524\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:27.472196 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:27.472164    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2edb9deb-8812-4a01-87d6-4ad0a9a05bde" path="/var/lib/kubelet/pods/2edb9deb-8812-4a01-87d6-4ad0a9a05bde/volumes"
Sep 11 01:22:27.725548 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:27.725466    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp"
Sep 11 01:22:27.725548 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:27.725497    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp" event={"ID":"69d5c781-c8be-4f1c-868e-18e6aacfdd91","Type":"ContainerDied","Data":"f4ea7e9267abd6bd25f36433954d666480ca26a116fc5d10b58cd6f043a384fc"}
Sep 11 01:22:27.726042 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:27.725557    2565 scope.go:117] "RemoveContainer" containerID="d2958c92b3d4791a53cb99fed32e2fd7d1cb670b1ca5fdb005c29d223a1bd15b"
Sep 11 01:22:27.727072 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:27.727050    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk" event={"ID":"3f82db2c-1a10-465b-a339-cf42289489f8","Type":"ContainerDied","Data":"bcc4bc32f50cb27488bb95a7bcc9326d10006e2a9ccc3fdd4284ad3cfe557c04"}
Sep 11 01:22:27.727140 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:27.727057    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk"
Sep 11 01:22:27.735066 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:27.735049    2565 scope.go:117] "RemoveContainer" containerID="b3e89024699b004a7d482a483b5d388e21ca1ce1dde6d7b039222158e32eb05f"
Sep 11 01:22:27.746583 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:27.746559    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk"]
Sep 11 01:22:27.749165 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:27.749143    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-651569-5b8f855699-ss9dk"]
Sep 11 01:22:27.755983 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:27.755963    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp"]
Sep 11 01:22:27.759839 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:27.759804    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-651569-57fcd4cddb-cfmdp"]
Sep 11 01:22:29.471659 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:29.471612    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f82db2c-1a10-465b-a339-cf42289489f8" path="/var/lib/kubelet/pods/3f82db2c-1a10-465b-a339-cf42289489f8/volumes"
Sep 11 01:22:29.472063 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:29.472031    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69d5c781-c8be-4f1c-868e-18e6aacfdd91" path="/var/lib/kubelet/pods/69d5c781-c8be-4f1c-868e-18e6aacfdd91/volumes"
Sep 11 01:22:30.245373 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.245326    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw" podUID="a1d069cd-c786-4b21-bbc3-bfe2e024f110" containerName="main" containerID="cri-o://50afab841e7e5a296ae0008d32f70c5d82df243854ca5e4cb24b345467663815" gracePeriod=45
Sep 11 01:22:30.263265 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.263188    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4" podUID="b5177913-2cc0-4398-8cc7-201d5a14ef25" containerName="main" containerID="cri-o://da2ee3c0a285a06d2906291c0e840244f9c54a50e46daca03409243c7652dbab" gracePeriod=45
Sep 11 01:22:30.274855 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.274810    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs" podUID="5e3bb054-65ad-4f4e-9694-a6073210c7da" containerName="main" containerID="cri-o://d77ae19654763eabc0b387586e43a46e8a2aa2d3cbab1ec89a7c38824fd7d099" gracePeriod=45
Sep 11 01:22:30.563966 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.563909    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:22:30.568400 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.568379    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:22:30.571486 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.571467    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:22:30.589751 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.589728    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1d069cd-c786-4b21-bbc3-bfe2e024f110-tls-certs\") pod \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") "
Sep 11 01:22:30.589890 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.589782    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-tmp-dir\") pod \"b5177913-2cc0-4398-8cc7-201d5a14ef25\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") "
Sep 11 01:22:30.589890 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.589873    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-dshm\") pod \"b5177913-2cc0-4398-8cc7-201d5a14ef25\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") "
Sep 11 01:22:30.590019 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.589936    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-home\") pod \"5e3bb054-65ad-4f4e-9694-a6073210c7da\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") "
Sep 11 01:22:30.590019 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.589965    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-dshm\") pod \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") "
Sep 11 01:22:30.590019 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.589993    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-dshm\") pod \"5e3bb054-65ad-4f4e-9694-a6073210c7da\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") "
Sep 11 01:22:30.590173 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.590022    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-home\") pod \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") "
Sep 11 01:22:30.590173 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.590024    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b5177913-2cc0-4398-8cc7-201d5a14ef25" (UID: "b5177913-2cc0-4398-8cc7-201d5a14ef25"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:22:30.590743 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.590715    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-tmp-dir\") pod \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") "
Sep 11 01:22:30.590870 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.590766    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e3bb054-65ad-4f4e-9694-a6073210c7da-tls-certs\") pod \"5e3bb054-65ad-4f4e-9694-a6073210c7da\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") "
Sep 11 01:22:30.590870 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.590792    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5177913-2cc0-4398-8cc7-201d5a14ef25-tls-certs\") pod \"b5177913-2cc0-4398-8cc7-201d5a14ef25\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") "
Sep 11 01:22:30.590870 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.590850    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzcxp\" (UniqueName: \"kubernetes.io/projected/b5177913-2cc0-4398-8cc7-201d5a14ef25-kube-api-access-wzcxp\") pod \"b5177913-2cc0-4398-8cc7-201d5a14ef25\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") "
Sep 11 01:22:30.591065 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.590900    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-model-cache\") pod \"5e3bb054-65ad-4f4e-9694-a6073210c7da\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") "
Sep 11 01:22:30.591065 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.590935    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-model-cache\") pod \"b5177913-2cc0-4398-8cc7-201d5a14ef25\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") "
Sep 11 01:22:30.591065 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.591006    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6cs2\" (UniqueName: \"kubernetes.io/projected/a1d069cd-c786-4b21-bbc3-bfe2e024f110-kube-api-access-r6cs2\") pod \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") "
Sep 11 01:22:30.591065 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.591053    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-tmp-dir\") pod \"5e3bb054-65ad-4f4e-9694-a6073210c7da\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") "
Sep 11 01:22:30.591289 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.591081    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqg7p\" (UniqueName: \"kubernetes.io/projected/5e3bb054-65ad-4f4e-9694-a6073210c7da-kube-api-access-fqg7p\") pod \"5e3bb054-65ad-4f4e-9694-a6073210c7da\" (UID: \"5e3bb054-65ad-4f4e-9694-a6073210c7da\") "
Sep 11 01:22:30.591289 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.591105    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-home\") pod \"b5177913-2cc0-4398-8cc7-201d5a14ef25\" (UID: \"b5177913-2cc0-4398-8cc7-201d5a14ef25\") "
Sep 11 01:22:30.591289 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.591139    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-model-cache\") pod \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\" (UID: \"a1d069cd-c786-4b21-bbc3-bfe2e024f110\") "
Sep 11 01:22:30.591545 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.591522    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-tmp-dir\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:30.591783 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.591758    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-model-cache" (OuterVolumeSpecName: "model-cache") pod "a1d069cd-c786-4b21-bbc3-bfe2e024f110" (UID: "a1d069cd-c786-4b21-bbc3-bfe2e024f110"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:22:30.591995 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.591975    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-home" (OuterVolumeSpecName: "home") pod "a1d069cd-c786-4b21-bbc3-bfe2e024f110" (UID: "a1d069cd-c786-4b21-bbc3-bfe2e024f110"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:22:30.592249 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.592227    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a1d069cd-c786-4b21-bbc3-bfe2e024f110" (UID: "a1d069cd-c786-4b21-bbc3-bfe2e024f110"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:22:30.593365 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.592618    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-home" (OuterVolumeSpecName: "home") pod "5e3bb054-65ad-4f4e-9694-a6073210c7da" (UID: "5e3bb054-65ad-4f4e-9694-a6073210c7da"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:22:30.593365 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.593086    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-model-cache" (OuterVolumeSpecName: "model-cache") pod "b5177913-2cc0-4398-8cc7-201d5a14ef25" (UID: "b5177913-2cc0-4398-8cc7-201d5a14ef25"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:22:30.593365 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.593116    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5e3bb054-65ad-4f4e-9694-a6073210c7da" (UID: "5e3bb054-65ad-4f4e-9694-a6073210c7da"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:22:30.593365 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.593278    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-model-cache" (OuterVolumeSpecName: "model-cache") pod "5e3bb054-65ad-4f4e-9694-a6073210c7da" (UID: "5e3bb054-65ad-4f4e-9694-a6073210c7da"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:22:30.593365 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.593329    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-home" (OuterVolumeSpecName: "home") pod "b5177913-2cc0-4398-8cc7-201d5a14ef25" (UID: "b5177913-2cc0-4398-8cc7-201d5a14ef25"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:22:30.594766 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.594723    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-dshm" (OuterVolumeSpecName: "dshm") pod "a1d069cd-c786-4b21-bbc3-bfe2e024f110" (UID: "a1d069cd-c786-4b21-bbc3-bfe2e024f110"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:22:30.594882 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.594738    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-dshm" (OuterVolumeSpecName: "dshm") pod "5e3bb054-65ad-4f4e-9694-a6073210c7da" (UID: "5e3bb054-65ad-4f4e-9694-a6073210c7da"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:22:30.594963 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.594944    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1d069cd-c786-4b21-bbc3-bfe2e024f110-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a1d069cd-c786-4b21-bbc3-bfe2e024f110" (UID: "a1d069cd-c786-4b21-bbc3-bfe2e024f110"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:22:30.595046 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.595026    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-dshm" (OuterVolumeSpecName: "dshm") pod "b5177913-2cc0-4398-8cc7-201d5a14ef25" (UID: "b5177913-2cc0-4398-8cc7-201d5a14ef25"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:22:30.595117 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.595061    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1d069cd-c786-4b21-bbc3-bfe2e024f110-kube-api-access-r6cs2" (OuterVolumeSpecName: "kube-api-access-r6cs2") pod "a1d069cd-c786-4b21-bbc3-bfe2e024f110" (UID: "a1d069cd-c786-4b21-bbc3-bfe2e024f110"). InnerVolumeSpecName "kube-api-access-r6cs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:22:30.595570 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.595535    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e3bb054-65ad-4f4e-9694-a6073210c7da-kube-api-access-fqg7p" (OuterVolumeSpecName: "kube-api-access-fqg7p") pod "5e3bb054-65ad-4f4e-9694-a6073210c7da" (UID: "5e3bb054-65ad-4f4e-9694-a6073210c7da"). InnerVolumeSpecName "kube-api-access-fqg7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:22:30.595643 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.595626    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5177913-2cc0-4398-8cc7-201d5a14ef25-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b5177913-2cc0-4398-8cc7-201d5a14ef25" (UID: "b5177913-2cc0-4398-8cc7-201d5a14ef25"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:22:30.596174 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.596147    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e3bb054-65ad-4f4e-9694-a6073210c7da-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5e3bb054-65ad-4f4e-9694-a6073210c7da" (UID: "5e3bb054-65ad-4f4e-9694-a6073210c7da"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:22:30.596283 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.596183    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5177913-2cc0-4398-8cc7-201d5a14ef25-kube-api-access-wzcxp" (OuterVolumeSpecName: "kube-api-access-wzcxp") pod "b5177913-2cc0-4398-8cc7-201d5a14ef25" (UID: "b5177913-2cc0-4398-8cc7-201d5a14ef25"). InnerVolumeSpecName "kube-api-access-wzcxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:22:30.693088 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.693058    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-model-cache\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:30.693088 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.693084    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a1d069cd-c786-4b21-bbc3-bfe2e024f110-tls-certs\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:30.693088 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.693093    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-dshm\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:30.693305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.693100    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-home\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:30.693305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.693108    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-dshm\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:30.693305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.693115    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-dshm\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:30.693305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.693121    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-home\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:30.693305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.693128    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1d069cd-c786-4b21-bbc3-bfe2e024f110-tmp-dir\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:30.693305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.693136    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e3bb054-65ad-4f4e-9694-a6073210c7da-tls-certs\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:30.693305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.693143    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5177913-2cc0-4398-8cc7-201d5a14ef25-tls-certs\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:30.693305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.693151    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzcxp\" (UniqueName: \"kubernetes.io/projected/b5177913-2cc0-4398-8cc7-201d5a14ef25-kube-api-access-wzcxp\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:30.693305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.693161    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-model-cache\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:30.693305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.693168    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-model-cache\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:30.693305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.693176    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6cs2\" (UniqueName: \"kubernetes.io/projected/a1d069cd-c786-4b21-bbc3-bfe2e024f110-kube-api-access-r6cs2\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:30.693305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.693183    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e3bb054-65ad-4f4e-9694-a6073210c7da-tmp-dir\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:30.693305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.693192    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqg7p\" (UniqueName: \"kubernetes.io/projected/5e3bb054-65ad-4f4e-9694-a6073210c7da-kube-api-access-fqg7p\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:30.693305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.693200    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5177913-2cc0-4398-8cc7-201d5a14ef25-home\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:30.751490 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.751454    2565 generic.go:356] "Generic (PLEG): container finished" podID="5e3bb054-65ad-4f4e-9694-a6073210c7da" containerID="d77ae19654763eabc0b387586e43a46e8a2aa2d3cbab1ec89a7c38824fd7d099" exitCode=0
Sep 11 01:22:30.751663 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.751502    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"
Sep 11 01:22:30.751663 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.751540    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs" event={"ID":"5e3bb054-65ad-4f4e-9694-a6073210c7da","Type":"ContainerDied","Data":"d77ae19654763eabc0b387586e43a46e8a2aa2d3cbab1ec89a7c38824fd7d099"}
Sep 11 01:22:30.751663 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.751583    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs" event={"ID":"5e3bb054-65ad-4f4e-9694-a6073210c7da","Type":"ContainerDied","Data":"ebec224509cdacd7dc3c9260661dc3fe35323e554584032edd8193931060f3ff"}
Sep 11 01:22:30.751663 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.751600    2565 scope.go:117] "RemoveContainer" containerID="d77ae19654763eabc0b387586e43a46e8a2aa2d3cbab1ec89a7c38824fd7d099"
Sep 11 01:22:30.753402 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.753364    2565 generic.go:356] "Generic (PLEG): container finished" podID="a1d069cd-c786-4b21-bbc3-bfe2e024f110" containerID="50afab841e7e5a296ae0008d32f70c5d82df243854ca5e4cb24b345467663815" exitCode=0
Sep 11 01:22:30.753532 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.753414    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"
Sep 11 01:22:30.753532 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.753441    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw" event={"ID":"a1d069cd-c786-4b21-bbc3-bfe2e024f110","Type":"ContainerDied","Data":"50afab841e7e5a296ae0008d32f70c5d82df243854ca5e4cb24b345467663815"}
Sep 11 01:22:30.753532 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.753502    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw" event={"ID":"a1d069cd-c786-4b21-bbc3-bfe2e024f110","Type":"ContainerDied","Data":"14d9bc711164402716faa4babe037f84665e0cb10fa7524563695f875795e852"}
Sep 11 01:22:30.755141 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.755118    2565 generic.go:356] "Generic (PLEG): container finished" podID="b5177913-2cc0-4398-8cc7-201d5a14ef25" containerID="da2ee3c0a285a06d2906291c0e840244f9c54a50e46daca03409243c7652dbab" exitCode=0
Sep 11 01:22:30.755266 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.755173    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"
Sep 11 01:22:30.755266 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.755173    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4" event={"ID":"b5177913-2cc0-4398-8cc7-201d5a14ef25","Type":"ContainerDied","Data":"da2ee3c0a285a06d2906291c0e840244f9c54a50e46daca03409243c7652dbab"}
Sep 11 01:22:30.755373 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.755278    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4" event={"ID":"b5177913-2cc0-4398-8cc7-201d5a14ef25","Type":"ContainerDied","Data":"04031f2299091cccacea46823b0f5429bef29ed203b12a86edfde96d22bd31ae"}
Sep 11 01:22:30.763475 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.763458    2565 scope.go:117] "RemoveContainer" containerID="d77ae19654763eabc0b387586e43a46e8a2aa2d3cbab1ec89a7c38824fd7d099"
Sep 11 01:22:30.763788 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:22:30.763761    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d77ae19654763eabc0b387586e43a46e8a2aa2d3cbab1ec89a7c38824fd7d099\": container with ID starting with d77ae19654763eabc0b387586e43a46e8a2aa2d3cbab1ec89a7c38824fd7d099 not found: ID does not exist" containerID="d77ae19654763eabc0b387586e43a46e8a2aa2d3cbab1ec89a7c38824fd7d099"
Sep 11 01:22:30.763925 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.763802    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d77ae19654763eabc0b387586e43a46e8a2aa2d3cbab1ec89a7c38824fd7d099"} err="failed to get container status \"d77ae19654763eabc0b387586e43a46e8a2aa2d3cbab1ec89a7c38824fd7d099\": rpc error: code = NotFound desc = could not find container \"d77ae19654763eabc0b387586e43a46e8a2aa2d3cbab1ec89a7c38824fd7d099\": container with ID starting with d77ae19654763eabc0b387586e43a46e8a2aa2d3cbab1ec89a7c38824fd7d099 not found: ID does not exist"
Sep 11 01:22:30.763925 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.763860    2565 scope.go:117] "RemoveContainer" containerID="50afab841e7e5a296ae0008d32f70c5d82df243854ca5e4cb24b345467663815"
Sep 11 01:22:30.772325 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.772308    2565 scope.go:117] "RemoveContainer" containerID="50afab841e7e5a296ae0008d32f70c5d82df243854ca5e4cb24b345467663815"
Sep 11 01:22:30.772569 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:22:30.772554    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50afab841e7e5a296ae0008d32f70c5d82df243854ca5e4cb24b345467663815\": container with ID starting with 50afab841e7e5a296ae0008d32f70c5d82df243854ca5e4cb24b345467663815 not found: ID does not exist" containerID="50afab841e7e5a296ae0008d32f70c5d82df243854ca5e4cb24b345467663815"
Sep 11 01:22:30.772616 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.772574    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50afab841e7e5a296ae0008d32f70c5d82df243854ca5e4cb24b345467663815"} err="failed to get container status \"50afab841e7e5a296ae0008d32f70c5d82df243854ca5e4cb24b345467663815\": rpc error: code = NotFound desc = could not find container \"50afab841e7e5a296ae0008d32f70c5d82df243854ca5e4cb24b345467663815\": container with ID starting with 50afab841e7e5a296ae0008d32f70c5d82df243854ca5e4cb24b345467663815 not found: ID does not exist"
Sep 11 01:22:30.772616 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.772588    2565 scope.go:117] "RemoveContainer" containerID="da2ee3c0a285a06d2906291c0e840244f9c54a50e46daca03409243c7652dbab"
Sep 11 01:22:30.776724 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.776703    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"]
Sep 11 01:22:30.780253 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.780230    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-651569/premium-w4-651569-kserve-74f6b774-vw8zs"]
Sep 11 01:22:30.781278 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.781263    2565 scope.go:117] "RemoveContainer" containerID="da2ee3c0a285a06d2906291c0e840244f9c54a50e46daca03409243c7652dbab"
Sep 11 01:22:30.781517 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:22:30.781501    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da2ee3c0a285a06d2906291c0e840244f9c54a50e46daca03409243c7652dbab\": container with ID starting with da2ee3c0a285a06d2906291c0e840244f9c54a50e46daca03409243c7652dbab not found: ID does not exist" containerID="da2ee3c0a285a06d2906291c0e840244f9c54a50e46daca03409243c7652dbab"
Sep 11 01:22:30.781575 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.781521    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da2ee3c0a285a06d2906291c0e840244f9c54a50e46daca03409243c7652dbab"} err="failed to get container status \"da2ee3c0a285a06d2906291c0e840244f9c54a50e46daca03409243c7652dbab\": rpc error: code = NotFound desc = could not find container \"da2ee3c0a285a06d2906291c0e840244f9c54a50e46daca03409243c7652dbab\": container with ID starting with da2ee3c0a285a06d2906291c0e840244f9c54a50e46daca03409243c7652dbab not found: ID does not exist"
Sep 11 01:22:30.790670 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.790648    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"]
Sep 11 01:22:30.793399 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.793375    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-651569/embedding-w4-651569-kserve-55bdfb5594-hnzt4"]
Sep 11 01:22:30.802340 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.802320    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"]
Sep 11 01:22:30.808099 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:30.808075    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-651569/distinct-2-w4-651569-kserve-66d69f6d8b-gzwzw"]
Sep 11 01:22:31.471964 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:31.471929    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e3bb054-65ad-4f4e-9694-a6073210c7da" path="/var/lib/kubelet/pods/5e3bb054-65ad-4f4e-9694-a6073210c7da/volumes"
Sep 11 01:22:31.472347 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:31.472334    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1d069cd-c786-4b21-bbc3-bfe2e024f110" path="/var/lib/kubelet/pods/a1d069cd-c786-4b21-bbc3-bfe2e024f110/volumes"
Sep 11 01:22:31.472687 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:31.472675    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5177913-2cc0-4398-8cc7-201d5a14ef25" path="/var/lib/kubelet/pods/b5177913-2cc0-4398-8cc7-201d5a14ef25/volumes"
Sep 11 01:22:33.473544 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:33.473514    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"]
Sep 11 01:22:33.474067 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:33.473770    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf" podUID="438eba62-ffb0-4bf7-ac00-60f8f10a11f6" containerName="istio-proxy" containerID="cri-o://ce5dd52b8c542d638b29891ed455b0078ce1a4da75bfb034b6f7c1b12b842534" gracePeriod=30
Sep 11 01:22:38.722373 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.722342    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:22:38.776854 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.776763    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh8wx\" (UniqueName: \"kubernetes.io/projected/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-kube-api-access-kh8wx\") pod \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") "
Sep 11 01:22:38.776854 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.776846    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-workload-certs\") pod \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") "
Sep 11 01:22:38.777070 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.776864    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-token\") pod \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") "
Sep 11 01:22:38.777070 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.776910    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-data\") pod \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") "
Sep 11 01:22:38.777070 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.776929    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-workload-socket\") pod \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") "
Sep 11 01:22:38.777226 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.777064    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-credential-socket\") pod \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") "
Sep 11 01:22:38.777226 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.777097    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-envoy\") pod \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") "
Sep 11 01:22:38.777226 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.777165    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-podinfo\") pod \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") "
Sep 11 01:22:38.777226 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.777185    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "438eba62-ffb0-4bf7-ac00-60f8f10a11f6" (UID: "438eba62-ffb0-4bf7-ac00-60f8f10a11f6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:22:38.777226 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.777218    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "438eba62-ffb0-4bf7-ac00-60f8f10a11f6" (UID: "438eba62-ffb0-4bf7-ac00-60f8f10a11f6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:22:38.777467 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.777235    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-data" (OuterVolumeSpecName: "istio-data") pod "438eba62-ffb0-4bf7-ac00-60f8f10a11f6" (UID: "438eba62-ffb0-4bf7-ac00-60f8f10a11f6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:22:38.777467 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.777253    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istiod-ca-cert\") pod \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\" (UID: \"438eba62-ffb0-4bf7-ac00-60f8f10a11f6\") "
Sep 11 01:22:38.777467 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.777308    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "438eba62-ffb0-4bf7-ac00-60f8f10a11f6" (UID: "438eba62-ffb0-4bf7-ac00-60f8f10a11f6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:22:38.777594 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.777542    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "438eba62-ffb0-4bf7-ac00-60f8f10a11f6" (UID: "438eba62-ffb0-4bf7-ac00-60f8f10a11f6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:22:38.777673 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.777654    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-data\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:38.777721 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.777678    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-workload-socket\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:38.777721 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.777692    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-credential-socket\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:38.777721 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.777707    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istiod-ca-cert\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:38.777851 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.777720    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-workload-certs\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:38.779092 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.779067    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-token" (OuterVolumeSpecName: "istio-token") pod "438eba62-ffb0-4bf7-ac00-60f8f10a11f6" (UID: "438eba62-ffb0-4bf7-ac00-60f8f10a11f6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:22:38.779210 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.779126    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-kube-api-access-kh8wx" (OuterVolumeSpecName: "kube-api-access-kh8wx") pod "438eba62-ffb0-4bf7-ac00-60f8f10a11f6" (UID: "438eba62-ffb0-4bf7-ac00-60f8f10a11f6"). InnerVolumeSpecName "kube-api-access-kh8wx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:22:38.779550 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.779525    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "438eba62-ffb0-4bf7-ac00-60f8f10a11f6" (UID: "438eba62-ffb0-4bf7-ac00-60f8f10a11f6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:22:38.779550 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.779535    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "438eba62-ffb0-4bf7-ac00-60f8f10a11f6" (UID: "438eba62-ffb0-4bf7-ac00-60f8f10a11f6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 01:22:38.806512 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.806471    2565 generic.go:356] "Generic (PLEG): container finished" podID="438eba62-ffb0-4bf7-ac00-60f8f10a11f6" containerID="ce5dd52b8c542d638b29891ed455b0078ce1a4da75bfb034b6f7c1b12b842534" exitCode=0
Sep 11 01:22:38.806660 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.806516    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf" event={"ID":"438eba62-ffb0-4bf7-ac00-60f8f10a11f6","Type":"ContainerDied","Data":"ce5dd52b8c542d638b29891ed455b0078ce1a4da75bfb034b6f7c1b12b842534"}
Sep 11 01:22:38.806660 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.806524    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"
Sep 11 01:22:38.806660 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.806605    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf" event={"ID":"438eba62-ffb0-4bf7-ac00-60f8f10a11f6","Type":"ContainerDied","Data":"48765210a3eef96eddbd24b35b992f934bea57302f71ab4ec1a946500d7302eb"}
Sep 11 01:22:38.806660 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.806635    2565 scope.go:117] "RemoveContainer" containerID="ce5dd52b8c542d638b29891ed455b0078ce1a4da75bfb034b6f7c1b12b842534"
Sep 11 01:22:38.816676 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.816658    2565 scope.go:117] "RemoveContainer" containerID="0007b95f0c8c0186099c9f7d48cd2fe5eec4df43c55c4a1737ad0c1ee058e3dd"
Sep 11 01:22:38.825441 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.825423    2565 scope.go:117] "RemoveContainer" containerID="ce5dd52b8c542d638b29891ed455b0078ce1a4da75bfb034b6f7c1b12b842534"
Sep 11 01:22:38.825706 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:22:38.825685    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce5dd52b8c542d638b29891ed455b0078ce1a4da75bfb034b6f7c1b12b842534\": container with ID starting with ce5dd52b8c542d638b29891ed455b0078ce1a4da75bfb034b6f7c1b12b842534 not found: ID does not exist" containerID="ce5dd52b8c542d638b29891ed455b0078ce1a4da75bfb034b6f7c1b12b842534"
Sep 11 01:22:38.825796 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.825718    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce5dd52b8c542d638b29891ed455b0078ce1a4da75bfb034b6f7c1b12b842534"} err="failed to get container status \"ce5dd52b8c542d638b29891ed455b0078ce1a4da75bfb034b6f7c1b12b842534\": rpc error: code = NotFound desc = could not find container \"ce5dd52b8c542d638b29891ed455b0078ce1a4da75bfb034b6f7c1b12b842534\": container with ID starting with ce5dd52b8c542d638b29891ed455b0078ce1a4da75bfb034b6f7c1b12b842534 not found: ID does not exist"
Sep 11 01:22:38.825796 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.825742    2565 scope.go:117] "RemoveContainer" containerID="0007b95f0c8c0186099c9f7d48cd2fe5eec4df43c55c4a1737ad0c1ee058e3dd"
Sep 11 01:22:38.826082 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:22:38.826053    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0007b95f0c8c0186099c9f7d48cd2fe5eec4df43c55c4a1737ad0c1ee058e3dd\": container with ID starting with 0007b95f0c8c0186099c9f7d48cd2fe5eec4df43c55c4a1737ad0c1ee058e3dd not found: ID does not exist" containerID="0007b95f0c8c0186099c9f7d48cd2fe5eec4df43c55c4a1737ad0c1ee058e3dd"
Sep 11 01:22:38.826152 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.826090    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0007b95f0c8c0186099c9f7d48cd2fe5eec4df43c55c4a1737ad0c1ee058e3dd"} err="failed to get container status \"0007b95f0c8c0186099c9f7d48cd2fe5eec4df43c55c4a1737ad0c1ee058e3dd\": rpc error: code = NotFound desc = could not find container \"0007b95f0c8c0186099c9f7d48cd2fe5eec4df43c55c4a1737ad0c1ee058e3dd\": container with ID starting with 0007b95f0c8c0186099c9f7d48cd2fe5eec4df43c55c4a1737ad0c1ee058e3dd not found: ID does not exist"
Sep 11 01:22:38.829941 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.829919    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"]
Sep 11 01:22:38.832895 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.832875    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-651569-openshift-default-cdcc9bdb4-2hsjf"]
Sep 11 01:22:38.878733 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.878699    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh8wx\" (UniqueName: \"kubernetes.io/projected/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-kube-api-access-kh8wx\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:38.878733 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.878728    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-token\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:38.878733 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.878738    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-envoy\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:38.878956 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:38.878746    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/438eba62-ffb0-4bf7-ac00-60f8f10a11f6-istio-podinfo\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:39.471413 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:39.471381    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="438eba62-ffb0-4bf7-ac00-60f8f10a11f6" path="/var/lib/kubelet/pods/438eba62-ffb0-4bf7-ac00-60f8f10a11f6/volumes"
Sep 11 01:22:41.486920 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.486839    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx"]
Sep 11 01:22:41.487369 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.487054    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx" podUID="a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1" containerName="payload-processing" containerID="cri-o://e3e59f80b40197116f7eebcb76d308633337c0385bc10d089885e4a3481b2d83" gracePeriod=30
Sep 11 01:22:41.494092 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.494045    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db"]
Sep 11 01:22:41.494313 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.494288    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db" podUID="805d191e-d0a4-4d7e-b758-66597da4bfd8" containerName="payload-pre-processing" containerID="cri-o://e90c4b89d358b36b40de278a4e60aa6f5c63a6e81adb156ce5e6657fde029abb" gracePeriod=30
Sep 11 01:22:41.742224 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.742167    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx"
Sep 11 01:22:41.775616 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.775591    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db"
Sep 11 01:22:41.805071 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.805044    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r59hh\" (UniqueName: \"kubernetes.io/projected/a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1-kube-api-access-r59hh\") pod \"a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1\" (UID: \"a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1\") "
Sep 11 01:22:41.805243 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.805148    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1-plugins-config-volume\") pod \"a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1\" (UID: \"a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1\") "
Sep 11 01:22:41.805528 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.805504    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1" (UID: "a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:22:41.807315 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.807294    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1-kube-api-access-r59hh" (OuterVolumeSpecName: "kube-api-access-r59hh") pod "a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1" (UID: "a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1"). InnerVolumeSpecName "kube-api-access-r59hh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:22:41.832357 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.832324    2565 generic.go:356] "Generic (PLEG): container finished" podID="a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1" containerID="e3e59f80b40197116f7eebcb76d308633337c0385bc10d089885e4a3481b2d83" exitCode=0
Sep 11 01:22:41.832540 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.832375    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx"
Sep 11 01:22:41.832540 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.832417    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx" event={"ID":"a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1","Type":"ContainerDied","Data":"e3e59f80b40197116f7eebcb76d308633337c0385bc10d089885e4a3481b2d83"}
Sep 11 01:22:41.832540 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.832496    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx" event={"ID":"a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1","Type":"ContainerDied","Data":"3f3cbe113b464127a44b150a1844443b26170754fde715c440f10031dea3cef0"}
Sep 11 01:22:41.832755 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.832741    2565 scope.go:117] "RemoveContainer" containerID="e3e59f80b40197116f7eebcb76d308633337c0385bc10d089885e4a3481b2d83"
Sep 11 01:22:41.834186 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.834161    2565 generic.go:356] "Generic (PLEG): container finished" podID="805d191e-d0a4-4d7e-b758-66597da4bfd8" containerID="e90c4b89d358b36b40de278a4e60aa6f5c63a6e81adb156ce5e6657fde029abb" exitCode=0
Sep 11 01:22:41.834268 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.834218    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db"
Sep 11 01:22:41.834315 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.834271    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db" event={"ID":"805d191e-d0a4-4d7e-b758-66597da4bfd8","Type":"ContainerDied","Data":"e90c4b89d358b36b40de278a4e60aa6f5c63a6e81adb156ce5e6657fde029abb"}
Sep 11 01:22:41.834365 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.834324    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db" event={"ID":"805d191e-d0a4-4d7e-b758-66597da4bfd8","Type":"ContainerDied","Data":"e5f38466246e00fb7001807887d82cb5852b70932944c8b9140f81f6a9f0c255"}
Sep 11 01:22:41.845774 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.845750    2565 scope.go:117] "RemoveContainer" containerID="e3e59f80b40197116f7eebcb76d308633337c0385bc10d089885e4a3481b2d83"
Sep 11 01:22:41.846164 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:22:41.846135    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3e59f80b40197116f7eebcb76d308633337c0385bc10d089885e4a3481b2d83\": container with ID starting with e3e59f80b40197116f7eebcb76d308633337c0385bc10d089885e4a3481b2d83 not found: ID does not exist" containerID="e3e59f80b40197116f7eebcb76d308633337c0385bc10d089885e4a3481b2d83"
Sep 11 01:22:41.846321 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.846174    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3e59f80b40197116f7eebcb76d308633337c0385bc10d089885e4a3481b2d83"} err="failed to get container status \"e3e59f80b40197116f7eebcb76d308633337c0385bc10d089885e4a3481b2d83\": rpc error: code = NotFound desc = could not find container \"e3e59f80b40197116f7eebcb76d308633337c0385bc10d089885e4a3481b2d83\": container with ID starting with e3e59f80b40197116f7eebcb76d308633337c0385bc10d089885e4a3481b2d83 not found: ID does not exist"
Sep 11 01:22:41.846321 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.846196    2565 scope.go:117] "RemoveContainer" containerID="e90c4b89d358b36b40de278a4e60aa6f5c63a6e81adb156ce5e6657fde029abb"
Sep 11 01:22:41.858098 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.858071    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx"]
Sep 11 01:22:41.859835 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.859791    2565 scope.go:117] "RemoveContainer" containerID="e90c4b89d358b36b40de278a4e60aa6f5c63a6e81adb156ce5e6657fde029abb"
Sep 11 01:22:41.860108 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:22:41.860086    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e90c4b89d358b36b40de278a4e60aa6f5c63a6e81adb156ce5e6657fde029abb\": container with ID starting with e90c4b89d358b36b40de278a4e60aa6f5c63a6e81adb156ce5e6657fde029abb not found: ID does not exist" containerID="e90c4b89d358b36b40de278a4e60aa6f5c63a6e81adb156ce5e6657fde029abb"
Sep 11 01:22:41.860159 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.860115    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e90c4b89d358b36b40de278a4e60aa6f5c63a6e81adb156ce5e6657fde029abb"} err="failed to get container status \"e90c4b89d358b36b40de278a4e60aa6f5c63a6e81adb156ce5e6657fde029abb\": rpc error: code = NotFound desc = could not find container \"e90c4b89d358b36b40de278a4e60aa6f5c63a6e81adb156ce5e6657fde029abb\": container with ID starting with e90c4b89d358b36b40de278a4e60aa6f5c63a6e81adb156ce5e6657fde029abb not found: ID does not exist"
Sep 11 01:22:41.864310 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.864290    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-f1f91d-89966b557-gzxnx"]
Sep 11 01:22:41.906481 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.906453    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6f5z\" (UniqueName: \"kubernetes.io/projected/805d191e-d0a4-4d7e-b758-66597da4bfd8-kube-api-access-c6f5z\") pod \"805d191e-d0a4-4d7e-b758-66597da4bfd8\" (UID: \"805d191e-d0a4-4d7e-b758-66597da4bfd8\") "
Sep 11 01:22:41.906582 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.906491    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/805d191e-d0a4-4d7e-b758-66597da4bfd8-plugins-config-volume\") pod \"805d191e-d0a4-4d7e-b758-66597da4bfd8\" (UID: \"805d191e-d0a4-4d7e-b758-66597da4bfd8\") "
Sep 11 01:22:41.906762 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.906745    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r59hh\" (UniqueName: \"kubernetes.io/projected/a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1-kube-api-access-r59hh\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:41.906805 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.906767    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:41.906922 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.906905    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/805d191e-d0a4-4d7e-b758-66597da4bfd8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "805d191e-d0a4-4d7e-b758-66597da4bfd8" (UID: "805d191e-d0a4-4d7e-b758-66597da4bfd8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:22:41.908487 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:41.908468    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/805d191e-d0a4-4d7e-b758-66597da4bfd8-kube-api-access-c6f5z" (OuterVolumeSpecName: "kube-api-access-c6f5z") pod "805d191e-d0a4-4d7e-b758-66597da4bfd8" (UID: "805d191e-d0a4-4d7e-b758-66597da4bfd8"). InnerVolumeSpecName "kube-api-access-c6f5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:22:42.007669 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:42.007576    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6f5z\" (UniqueName: \"kubernetes.io/projected/805d191e-d0a4-4d7e-b758-66597da4bfd8-kube-api-access-c6f5z\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:42.007669 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:42.007612    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/805d191e-d0a4-4d7e-b758-66597da4bfd8-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:22:42.154859 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:42.154830    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db"]
Sep 11 01:22:42.159188 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:42.159151    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-f1f91d-75ffbb7fd-sj4db"]
Sep 11 01:22:43.472375 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:43.472341    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="805d191e-d0a4-4d7e-b758-66597da4bfd8" path="/var/lib/kubelet/pods/805d191e-d0a4-4d7e-b758-66597da4bfd8/volumes"
Sep 11 01:22:43.472724 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:22:43.472679    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1" path="/var/lib/kubelet/pods/a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1/volumes"
Sep 11 01:23:03.552253 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:03.552225    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/1.log"
Sep 11 01:23:03.556670 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:03.556634    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/1.log"
Sep 11 01:23:03.726749 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:03.726713    2565 scope.go:117] "RemoveContainer" containerID="17bb7a92d6b98765e5cf4ff9d3eed043b3f26e91f89c7160acd76a610369c339"
Sep 11 01:23:03.907606 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:03.907522    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5"]
Sep 11 01:23:03.907863 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:03.907785    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5" podUID="4b6c41c9-2190-4a5d-814c-fa01d14128bf" containerName="payload-processing" containerID="cri-o://d75f774f67e08e18802fde635f227a867329f5c7178a55d49c4c0f9d2d672bf9" gracePeriod=30
Sep 11 01:23:03.915186 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:03.915158    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6"]
Sep 11 01:23:03.915442 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:03.915376    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6" podUID="ebf2cdc5-7c79-4784-92cc-8bd78f162f6d" containerName="payload-pre-processing" containerID="cri-o://e6944993fecd9637817bd52a190e4b839cdf3261cf178e67092ac000a07fe253" gracePeriod=30
Sep 11 01:23:04.197367 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.197340    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5"
Sep 11 01:23:04.200338 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.200316    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6"
Sep 11 01:23:04.206031 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.206010    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebf2cdc5-7c79-4784-92cc-8bd78f162f6d-plugins-config-volume\") pod \"ebf2cdc5-7c79-4784-92cc-8bd78f162f6d\" (UID: \"ebf2cdc5-7c79-4784-92cc-8bd78f162f6d\") "
Sep 11 01:23:04.206114 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.206039    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlb5j\" (UniqueName: \"kubernetes.io/projected/ebf2cdc5-7c79-4784-92cc-8bd78f162f6d-kube-api-access-tlb5j\") pod \"ebf2cdc5-7c79-4784-92cc-8bd78f162f6d\" (UID: \"ebf2cdc5-7c79-4784-92cc-8bd78f162f6d\") "
Sep 11 01:23:04.206114 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.206068    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b6c41c9-2190-4a5d-814c-fa01d14128bf-plugins-config-volume\") pod \"4b6c41c9-2190-4a5d-814c-fa01d14128bf\" (UID: \"4b6c41c9-2190-4a5d-814c-fa01d14128bf\") "
Sep 11 01:23:04.206114 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.206104    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zp2gg\" (UniqueName: \"kubernetes.io/projected/4b6c41c9-2190-4a5d-814c-fa01d14128bf-kube-api-access-zp2gg\") pod \"4b6c41c9-2190-4a5d-814c-fa01d14128bf\" (UID: \"4b6c41c9-2190-4a5d-814c-fa01d14128bf\") "
Sep 11 01:23:04.206436 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.206404    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebf2cdc5-7c79-4784-92cc-8bd78f162f6d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ebf2cdc5-7c79-4784-92cc-8bd78f162f6d" (UID: "ebf2cdc5-7c79-4784-92cc-8bd78f162f6d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:23:04.206436 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.206423    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b6c41c9-2190-4a5d-814c-fa01d14128bf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4b6c41c9-2190-4a5d-814c-fa01d14128bf" (UID: "4b6c41c9-2190-4a5d-814c-fa01d14128bf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:23:04.208218 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.208196    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b6c41c9-2190-4a5d-814c-fa01d14128bf-kube-api-access-zp2gg" (OuterVolumeSpecName: "kube-api-access-zp2gg") pod "4b6c41c9-2190-4a5d-814c-fa01d14128bf" (UID: "4b6c41c9-2190-4a5d-814c-fa01d14128bf"). InnerVolumeSpecName "kube-api-access-zp2gg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:23:04.208300 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.208230    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebf2cdc5-7c79-4784-92cc-8bd78f162f6d-kube-api-access-tlb5j" (OuterVolumeSpecName: "kube-api-access-tlb5j") pod "ebf2cdc5-7c79-4784-92cc-8bd78f162f6d" (UID: "ebf2cdc5-7c79-4784-92cc-8bd78f162f6d"). InnerVolumeSpecName "kube-api-access-tlb5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:23:04.307791 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.307753    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b6c41c9-2190-4a5d-814c-fa01d14128bf-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:23:04.307791 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.307783    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zp2gg\" (UniqueName: \"kubernetes.io/projected/4b6c41c9-2190-4a5d-814c-fa01d14128bf-kube-api-access-zp2gg\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:23:04.307791 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.307792    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebf2cdc5-7c79-4784-92cc-8bd78f162f6d-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:23:04.308067 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.307801    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlb5j\" (UniqueName: \"kubernetes.io/projected/ebf2cdc5-7c79-4784-92cc-8bd78f162f6d-kube-api-access-tlb5j\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:23:04.975928 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.975895    2565 generic.go:356] "Generic (PLEG): container finished" podID="4b6c41c9-2190-4a5d-814c-fa01d14128bf" containerID="d75f774f67e08e18802fde635f227a867329f5c7178a55d49c4c0f9d2d672bf9" exitCode=0
Sep 11 01:23:04.976359 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.975948    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5"
Sep 11 01:23:04.976359 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.975986    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5" event={"ID":"4b6c41c9-2190-4a5d-814c-fa01d14128bf","Type":"ContainerDied","Data":"d75f774f67e08e18802fde635f227a867329f5c7178a55d49c4c0f9d2d672bf9"}
Sep 11 01:23:04.976359 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.976040    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5" event={"ID":"4b6c41c9-2190-4a5d-814c-fa01d14128bf","Type":"ContainerDied","Data":"8ea624e8b11f2abd92398e987658a1a9a42b1d491623e67d5b2bdf501b2dc4e1"}
Sep 11 01:23:04.976359 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.976071    2565 scope.go:117] "RemoveContainer" containerID="d75f774f67e08e18802fde635f227a867329f5c7178a55d49c4c0f9d2d672bf9"
Sep 11 01:23:04.977449 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.977429    2565 generic.go:356] "Generic (PLEG): container finished" podID="ebf2cdc5-7c79-4784-92cc-8bd78f162f6d" containerID="e6944993fecd9637817bd52a190e4b839cdf3261cf178e67092ac000a07fe253" exitCode=0
Sep 11 01:23:04.977517 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.977473    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6"
Sep 11 01:23:04.977574 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.977515    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6" event={"ID":"ebf2cdc5-7c79-4784-92cc-8bd78f162f6d","Type":"ContainerDied","Data":"e6944993fecd9637817bd52a190e4b839cdf3261cf178e67092ac000a07fe253"}
Sep 11 01:23:04.977574 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.977556    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6" event={"ID":"ebf2cdc5-7c79-4784-92cc-8bd78f162f6d","Type":"ContainerDied","Data":"9a84d5299367d96525baaf186b4b8411388d3092c77baef9ddc9bfb062ab7110"}
Sep 11 01:23:04.986035 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.986008    2565 scope.go:117] "RemoveContainer" containerID="d75f774f67e08e18802fde635f227a867329f5c7178a55d49c4c0f9d2d672bf9"
Sep 11 01:23:04.986288 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:23:04.986271    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d75f774f67e08e18802fde635f227a867329f5c7178a55d49c4c0f9d2d672bf9\": container with ID starting with d75f774f67e08e18802fde635f227a867329f5c7178a55d49c4c0f9d2d672bf9 not found: ID does not exist" containerID="d75f774f67e08e18802fde635f227a867329f5c7178a55d49c4c0f9d2d672bf9"
Sep 11 01:23:04.986362 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.986298    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d75f774f67e08e18802fde635f227a867329f5c7178a55d49c4c0f9d2d672bf9"} err="failed to get container status \"d75f774f67e08e18802fde635f227a867329f5c7178a55d49c4c0f9d2d672bf9\": rpc error: code = NotFound desc = could not find container \"d75f774f67e08e18802fde635f227a867329f5c7178a55d49c4c0f9d2d672bf9\": container with ID starting with d75f774f67e08e18802fde635f227a867329f5c7178a55d49c4c0f9d2d672bf9 not found: ID does not exist"
Sep 11 01:23:04.986362 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.986323    2565 scope.go:117] "RemoveContainer" containerID="e6944993fecd9637817bd52a190e4b839cdf3261cf178e67092ac000a07fe253"
Sep 11 01:23:04.994522 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.994505    2565 scope.go:117] "RemoveContainer" containerID="e6944993fecd9637817bd52a190e4b839cdf3261cf178e67092ac000a07fe253"
Sep 11 01:23:04.994785 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:23:04.994767    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6944993fecd9637817bd52a190e4b839cdf3261cf178e67092ac000a07fe253\": container with ID starting with e6944993fecd9637817bd52a190e4b839cdf3261cf178e67092ac000a07fe253 not found: ID does not exist" containerID="e6944993fecd9637817bd52a190e4b839cdf3261cf178e67092ac000a07fe253"
Sep 11 01:23:04.994887 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:04.994790    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6944993fecd9637817bd52a190e4b839cdf3261cf178e67092ac000a07fe253"} err="failed to get container status \"e6944993fecd9637817bd52a190e4b839cdf3261cf178e67092ac000a07fe253\": rpc error: code = NotFound desc = could not find container \"e6944993fecd9637817bd52a190e4b839cdf3261cf178e67092ac000a07fe253\": container with ID starting with e6944993fecd9637817bd52a190e4b839cdf3261cf178e67092ac000a07fe253 not found: ID does not exist"
Sep 11 01:23:05.000839 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:05.000792    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6"]
Sep 11 01:23:05.004896 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:05.004874    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-816605-7d6f684b86-h22p6"]
Sep 11 01:23:05.015105 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:05.015085    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5"]
Sep 11 01:23:05.018347 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:05.018328    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-816605-85b8cdc57c-2jjg5"]
Sep 11 01:23:05.472293 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:05.472252    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b6c41c9-2190-4a5d-814c-fa01d14128bf" path="/var/lib/kubelet/pods/4b6c41c9-2190-4a5d-814c-fa01d14128bf/volumes"
Sep 11 01:23:05.472720 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:05.472700    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebf2cdc5-7c79-4784-92cc-8bd78f162f6d" path="/var/lib/kubelet/pods/ebf2cdc5-7c79-4784-92cc-8bd78f162f6d/volumes"
Sep 11 01:23:38.952574 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:38.952491    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp"]
Sep 11 01:23:38.953086 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:38.952750    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp" podUID="87966ea8-25e6-47c6-be6f-9ae24ef74844" containerName="payload-processing" containerID="cri-o://5d7071a78a7d95fc308fd289aa28536011fee3f1b51c62ed33118d91ed33fcfc" gracePeriod=30
Sep 11 01:23:38.965684 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:38.965652    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl"]
Sep 11 01:23:38.966183 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:38.966130    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl" podUID="a18a14c8-5761-4e52-b366-62b40c77ad99" containerName="payload-pre-processing" containerID="cri-o://92e43d098f1506c638b9305149d5789fbd6b9ef156bda312430094f3efebfa07" gracePeriod=30
Sep 11 01:23:39.172444 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:39.172405    2565 generic.go:356] "Generic (PLEG): container finished" podID="a18a14c8-5761-4e52-b366-62b40c77ad99" containerID="92e43d098f1506c638b9305149d5789fbd6b9ef156bda312430094f3efebfa07" exitCode=0
Sep 11 01:23:39.172629 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:39.172495    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl" event={"ID":"a18a14c8-5761-4e52-b366-62b40c77ad99","Type":"ContainerDied","Data":"92e43d098f1506c638b9305149d5789fbd6b9ef156bda312430094f3efebfa07"}
Sep 11 01:23:39.174555 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:39.174529    2565 generic.go:356] "Generic (PLEG): container finished" podID="87966ea8-25e6-47c6-be6f-9ae24ef74844" containerID="5d7071a78a7d95fc308fd289aa28536011fee3f1b51c62ed33118d91ed33fcfc" exitCode=0
Sep 11 01:23:39.174685 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:39.174603    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp" event={"ID":"87966ea8-25e6-47c6-be6f-9ae24ef74844","Type":"ContainerDied","Data":"5d7071a78a7d95fc308fd289aa28536011fee3f1b51c62ed33118d91ed33fcfc"}
Sep 11 01:23:39.250799 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:39.250772    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp"
Sep 11 01:23:39.253557 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:39.253538    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl"
Sep 11 01:23:39.343342 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:39.343310    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a18a14c8-5761-4e52-b366-62b40c77ad99-plugins-config-volume\") pod \"a18a14c8-5761-4e52-b366-62b40c77ad99\" (UID: \"a18a14c8-5761-4e52-b366-62b40c77ad99\") "
Sep 11 01:23:39.343342 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:39.343349    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87966ea8-25e6-47c6-be6f-9ae24ef74844-plugins-config-volume\") pod \"87966ea8-25e6-47c6-be6f-9ae24ef74844\" (UID: \"87966ea8-25e6-47c6-be6f-9ae24ef74844\") "
Sep 11 01:23:39.343598 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:39.343413    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z5bt\" (UniqueName: \"kubernetes.io/projected/a18a14c8-5761-4e52-b366-62b40c77ad99-kube-api-access-2z5bt\") pod \"a18a14c8-5761-4e52-b366-62b40c77ad99\" (UID: \"a18a14c8-5761-4e52-b366-62b40c77ad99\") "
Sep 11 01:23:39.343598 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:39.343453    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rq2r\" (UniqueName: \"kubernetes.io/projected/87966ea8-25e6-47c6-be6f-9ae24ef74844-kube-api-access-6rq2r\") pod \"87966ea8-25e6-47c6-be6f-9ae24ef74844\" (UID: \"87966ea8-25e6-47c6-be6f-9ae24ef74844\") "
Sep 11 01:23:39.343793 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:39.343767    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a18a14c8-5761-4e52-b366-62b40c77ad99-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a18a14c8-5761-4e52-b366-62b40c77ad99" (UID: "a18a14c8-5761-4e52-b366-62b40c77ad99"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:23:39.343896 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:39.343875    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87966ea8-25e6-47c6-be6f-9ae24ef74844-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "87966ea8-25e6-47c6-be6f-9ae24ef74844" (UID: "87966ea8-25e6-47c6-be6f-9ae24ef74844"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:23:39.345532 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:39.345504    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a18a14c8-5761-4e52-b366-62b40c77ad99-kube-api-access-2z5bt" (OuterVolumeSpecName: "kube-api-access-2z5bt") pod "a18a14c8-5761-4e52-b366-62b40c77ad99" (UID: "a18a14c8-5761-4e52-b366-62b40c77ad99"). InnerVolumeSpecName "kube-api-access-2z5bt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:23:39.345632 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:39.345529    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87966ea8-25e6-47c6-be6f-9ae24ef74844-kube-api-access-6rq2r" (OuterVolumeSpecName: "kube-api-access-6rq2r") pod "87966ea8-25e6-47c6-be6f-9ae24ef74844" (UID: "87966ea8-25e6-47c6-be6f-9ae24ef74844"). InnerVolumeSpecName "kube-api-access-6rq2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:23:39.444300 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:39.444256    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z5bt\" (UniqueName: \"kubernetes.io/projected/a18a14c8-5761-4e52-b366-62b40c77ad99-kube-api-access-2z5bt\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:23:39.444300 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:39.444295    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rq2r\" (UniqueName: \"kubernetes.io/projected/87966ea8-25e6-47c6-be6f-9ae24ef74844-kube-api-access-6rq2r\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:23:39.444300 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:39.444310    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a18a14c8-5761-4e52-b366-62b40c77ad99-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:23:39.444596 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:39.444323    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87966ea8-25e6-47c6-be6f-9ae24ef74844-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:23:40.181315 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:40.181282    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp"
Sep 11 01:23:40.181750 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:40.181311    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp" event={"ID":"87966ea8-25e6-47c6-be6f-9ae24ef74844","Type":"ContainerDied","Data":"43d1147fe333c43553c465ebb8ccc49aa618ac205d468cbbf3775155f2fb8034"}
Sep 11 01:23:40.181750 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:40.181391    2565 scope.go:117] "RemoveContainer" containerID="5d7071a78a7d95fc308fd289aa28536011fee3f1b51c62ed33118d91ed33fcfc"
Sep 11 01:23:40.182777 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:40.182667    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl" event={"ID":"a18a14c8-5761-4e52-b366-62b40c77ad99","Type":"ContainerDied","Data":"3c3bd0b6e9a2b15bacbc9cf1058deb0ac28b48e9274c905451a3996b95a2ae01"}
Sep 11 01:23:40.182777 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:40.182684    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl"
Sep 11 01:23:40.190567 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:40.190552    2565 scope.go:117] "RemoveContainer" containerID="92e43d098f1506c638b9305149d5789fbd6b9ef156bda312430094f3efebfa07"
Sep 11 01:23:40.201299 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:40.201276    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp"]
Sep 11 01:23:40.207527 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:40.207506    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-71ba6d-5dbcff57-jr8mp"]
Sep 11 01:23:40.217875 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:40.217855    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl"]
Sep 11 01:23:40.221641 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:40.221622    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-71ba6d-6fd54f89c8-dgxjl"]
Sep 11 01:23:41.471536 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:41.471456    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87966ea8-25e6-47c6-be6f-9ae24ef74844" path="/var/lib/kubelet/pods/87966ea8-25e6-47c6-be6f-9ae24ef74844/volumes"
Sep 11 01:23:41.471919 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:23:41.471896    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a18a14c8-5761-4e52-b366-62b40c77ad99" path="/var/lib/kubelet/pods/a18a14c8-5761-4e52-b366-62b40c77ad99/volumes"
Sep 11 01:24:03.778483 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:03.778448    2565 scope.go:117] "RemoveContainer" containerID="d61ef4254fcbeb46a7030be4f83fceab6626fb975f6d88f86edbd25b77535f4c"
Sep 11 01:24:21.063421 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063385    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7691-6466ff"]
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063773    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1d069cd-c786-4b21-bbc3-bfe2e024f110" containerName="main"
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063785    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1d069cd-c786-4b21-bbc3-bfe2e024f110" containerName="main"
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063792    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87966ea8-25e6-47c6-be6f-9ae24ef74844" containerName="payload-processing"
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063799    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="87966ea8-25e6-47c6-be6f-9ae24ef74844" containerName="payload-processing"
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063807    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5177913-2cc0-4398-8cc7-201d5a14ef25" containerName="main"
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063825    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5177913-2cc0-4398-8cc7-201d5a14ef25" containerName="main"
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063832    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b6c41c9-2190-4a5d-814c-fa01d14128bf" containerName="payload-processing"
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063840    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b6c41c9-2190-4a5d-814c-fa01d14128bf" containerName="payload-processing"
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063850    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1" containerName="payload-processing"
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063855    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1" containerName="payload-processing"
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063863    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="438eba62-ffb0-4bf7-ac00-60f8f10a11f6" containerName="istio-proxy"
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063869    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="438eba62-ffb0-4bf7-ac00-60f8f10a11f6" containerName="istio-proxy"
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063878    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebf2cdc5-7c79-4784-92cc-8bd78f162f6d" containerName="payload-pre-processing"
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063883    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebf2cdc5-7c79-4784-92cc-8bd78f162f6d" containerName="payload-pre-processing"
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063889    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="438eba62-ffb0-4bf7-ac00-60f8f10a11f6" containerName="istio-proxy"
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063894    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="438eba62-ffb0-4bf7-ac00-60f8f10a11f6" containerName="istio-proxy"
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063900    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a18a14c8-5761-4e52-b366-62b40c77ad99" containerName="payload-pre-processing"
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063905    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a18a14c8-5761-4e52-b366-62b40c77ad99" containerName="payload-pre-processing"
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063917    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69d5c781-c8be-4f1c-868e-18e6aacfdd91" containerName="payload-pre-processing"
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063922    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="69d5c781-c8be-4f1c-868e-18e6aacfdd91" containerName="payload-pre-processing"
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063930    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e3bb054-65ad-4f4e-9694-a6073210c7da" containerName="main"
Sep 11 01:24:21.063927 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063935    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e3bb054-65ad-4f4e-9694-a6073210c7da" containerName="main"
Sep 11 01:24:21.064600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063942    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f82db2c-1a10-465b-a339-cf42289489f8" containerName="payload-processing"
Sep 11 01:24:21.064600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063947    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f82db2c-1a10-465b-a339-cf42289489f8" containerName="payload-processing"
Sep 11 01:24:21.064600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063952    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="805d191e-d0a4-4d7e-b758-66597da4bfd8" containerName="payload-pre-processing"
Sep 11 01:24:21.064600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.063957    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="805d191e-d0a4-4d7e-b758-66597da4bfd8" containerName="payload-pre-processing"
Sep 11 01:24:21.064600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.064009    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5177913-2cc0-4398-8cc7-201d5a14ef25" containerName="main"
Sep 11 01:24:21.064600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.064017    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b6c41c9-2190-4a5d-814c-fa01d14128bf" containerName="payload-processing"
Sep 11 01:24:21.064600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.064023    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="438eba62-ffb0-4bf7-ac00-60f8f10a11f6" containerName="istio-proxy"
Sep 11 01:24:21.064600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.064029    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1d069cd-c786-4b21-bbc3-bfe2e024f110" containerName="main"
Sep 11 01:24:21.064600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.064033    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f82db2c-1a10-465b-a339-cf42289489f8" containerName="payload-processing"
Sep 11 01:24:21.064600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.064039    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e3bb054-65ad-4f4e-9694-a6073210c7da" containerName="main"
Sep 11 01:24:21.064600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.064044    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="87966ea8-25e6-47c6-be6f-9ae24ef74844" containerName="payload-processing"
Sep 11 01:24:21.064600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.064049    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="805d191e-d0a4-4d7e-b758-66597da4bfd8" containerName="payload-pre-processing"
Sep 11 01:24:21.064600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.064054    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a23a8eb4-0fb1-40e2-8a72-5ea0015c1ea1" containerName="payload-processing"
Sep 11 01:24:21.064600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.064059    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a18a14c8-5761-4e52-b366-62b40c77ad99" containerName="payload-pre-processing"
Sep 11 01:24:21.064600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.064064    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebf2cdc5-7c79-4784-92cc-8bd78f162f6d" containerName="payload-pre-processing"
Sep 11 01:24:21.064600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.064069    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="69d5c781-c8be-4f1c-868e-18e6aacfdd91" containerName="payload-pre-processing"
Sep 11 01:24:21.067113 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.067096    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7691-6466ff"
Sep 11 01:24:21.069517 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.069496    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-d5ldp\""
Sep 11 01:24:21.072941 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.072918    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7691-6466ff"]
Sep 11 01:24:21.124370 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.124341    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8wjk\" (UniqueName: \"kubernetes.io/projected/6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43-kube-api-access-t8wjk\") pod \"test-curl-7691-6466ff\" (UID: \"6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43\") " pod="opendatahub/test-curl-7691-6466ff"
Sep 11 01:24:21.225352 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.225320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8wjk\" (UniqueName: \"kubernetes.io/projected/6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43-kube-api-access-t8wjk\") pod \"test-curl-7691-6466ff\" (UID: \"6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43\") " pod="opendatahub/test-curl-7691-6466ff"
Sep 11 01:24:21.233619 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.233592    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8wjk\" (UniqueName: \"kubernetes.io/projected/6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43-kube-api-access-t8wjk\") pod \"test-curl-7691-6466ff\" (UID: \"6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43\") " pod="opendatahub/test-curl-7691-6466ff"
Sep 11 01:24:21.378509 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.378410    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7691-6466ff"
Sep 11 01:24:21.650394 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:21.650366    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7691-6466ff"]
Sep 11 01:24:21.652036 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:24:21.652002    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6aa8038a_c7e6_4dcd_9cb0_bb64e1be5a43.slice/crio-de3d59a7260423348406f40106cf77edae343a41165e59f0247cca2dd9d4e5d7 WatchSource:0}: Error finding container de3d59a7260423348406f40106cf77edae343a41165e59f0247cca2dd9d4e5d7: Status 404 returned error can't find the container with id de3d59a7260423348406f40106cf77edae343a41165e59f0247cca2dd9d4e5d7
Sep 11 01:24:22.420631 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:22.420592    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7691-6466ff" event={"ID":"6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43","Type":"ContainerStarted","Data":"de3d59a7260423348406f40106cf77edae343a41165e59f0247cca2dd9d4e5d7"}
Sep 11 01:24:23.426902 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:23.426867    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7691-6466ff" event={"ID":"6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43","Type":"ContainerStarted","Data":"f7eea729fb1a72e0fdf807453a94de756bfeea663b603ce2d2299c87c6317c67"}
Sep 11 01:24:23.442761 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:23.442714    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7691-6466ff" podStartSLOduration=1.514846998 podStartE2EDuration="2.442698995s" totalImagesPullingTime="927.851997ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:24:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:24:23.441053017 +0000 UTC m=+1580.489141240" watchObservedRunningTime="2026-09-11 01:24:23.442698995 +0000 UTC m=+1580.490787223"
Sep 11 01:24:24.053719 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:24.053682    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7691-6466ff"]
Sep 11 01:24:24.057687 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:24.057652    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7691-6466ff"]
Sep 11 01:24:24.432312 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:24:24.432280    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7691-6466ff" container="test-curl-7691-6466ff"
Sep 11 01:24:25.438580 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:25.438536    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7691-6466ff" podUID="6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43" containerName="test-curl-7691-6466ff" containerID="cri-o://f7eea729fb1a72e0fdf807453a94de756bfeea663b603ce2d2299c87c6317c67" gracePeriod=2
Sep 11 01:24:25.441529 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:24:25.441437    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7691-6466ff\" is forbidden: User \"system:node:ip-10-0-133-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-50.ec2.internal' and this object" podUID="6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43" pod="opendatahub/test-curl-7691-6466ff"
Sep 11 01:24:27.619153 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:27.619125    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7691-6466ff"
Sep 11 01:24:27.684525 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:27.684490    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8wjk\" (UniqueName: \"kubernetes.io/projected/6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43-kube-api-access-t8wjk\") pod \"6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43\" (UID: \"6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43\") "
Sep 11 01:24:27.686609 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:27.686583    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43-kube-api-access-t8wjk" (OuterVolumeSpecName: "kube-api-access-t8wjk") pod "6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43" (UID: "6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43"). InnerVolumeSpecName "kube-api-access-t8wjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:24:27.785546 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:27.785470    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8wjk\" (UniqueName: \"kubernetes.io/projected/6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43-kube-api-access-t8wjk\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:24:28.455972 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:28.455938    2565 generic.go:356] "Generic (PLEG): container finished" podID="6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43" containerID="f7eea729fb1a72e0fdf807453a94de756bfeea663b603ce2d2299c87c6317c67" exitCode=137
Sep 11 01:24:28.456150 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:28.455978    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7691-6466ff"
Sep 11 01:24:28.456150 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:28.456040    2565 scope.go:117] "RemoveContainer" containerID="f7eea729fb1a72e0fdf807453a94de756bfeea663b603ce2d2299c87c6317c67"
Sep 11 01:24:28.465246 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:28.465231    2565 scope.go:117] "RemoveContainer" containerID="f7eea729fb1a72e0fdf807453a94de756bfeea663b603ce2d2299c87c6317c67"
Sep 11 01:24:28.465500 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:24:28.465483    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7eea729fb1a72e0fdf807453a94de756bfeea663b603ce2d2299c87c6317c67\": container with ID starting with f7eea729fb1a72e0fdf807453a94de756bfeea663b603ce2d2299c87c6317c67 not found: ID does not exist" containerID="f7eea729fb1a72e0fdf807453a94de756bfeea663b603ce2d2299c87c6317c67"
Sep 11 01:24:28.465552 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:28.465509    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7eea729fb1a72e0fdf807453a94de756bfeea663b603ce2d2299c87c6317c67"} err="failed to get container status \"f7eea729fb1a72e0fdf807453a94de756bfeea663b603ce2d2299c87c6317c67\": rpc error: code = NotFound desc = could not find container \"f7eea729fb1a72e0fdf807453a94de756bfeea663b603ce2d2299c87c6317c67\": container with ID starting with f7eea729fb1a72e0fdf807453a94de756bfeea663b603ce2d2299c87c6317c67 not found: ID does not exist"
Sep 11 01:24:28.466280 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:24:28.466257    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7691-6466ff\" is forbidden: User \"system:node:ip-10-0-133-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-50.ec2.internal' and this object" podUID="6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43" pod="opendatahub/test-curl-7691-6466ff"
Sep 11 01:24:29.471039 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:24:29.471007    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43" path="/var/lib/kubelet/pods/6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43/volumes"
Sep 11 01:25:03.813050 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:03.812975    2565 scope.go:117] "RemoveContainer" containerID="53cccb749948e632f361350eded10e62e06d0df87cf4a79086fbf95552e6b117"
Sep 11 01:25:34.590488 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:34.590446    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7691-25912e"]
Sep 11 01:25:34.592503 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:34.590805    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43" containerName="test-curl-7691-6466ff"
Sep 11 01:25:34.592503 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:34.590829    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43" containerName="test-curl-7691-6466ff"
Sep 11 01:25:34.592503 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:34.590900    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="438eba62-ffb0-4bf7-ac00-60f8f10a11f6" containerName="istio-proxy"
Sep 11 01:25:34.592503 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:34.590908    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6aa8038a-c7e6-4dcd-9cb0-bb64e1be5a43" containerName="test-curl-7691-6466ff"
Sep 11 01:25:34.593670 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:34.593655    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7691-25912e"
Sep 11 01:25:34.596131 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:34.596104    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-d5ldp\""
Sep 11 01:25:34.597776 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:34.597754    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7691-25912e"]
Sep 11 01:25:34.691513 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:34.691476    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbq2z\" (UniqueName: \"kubernetes.io/projected/ed284f43-79ad-4891-baca-4f11f6a28183-kube-api-access-mbq2z\") pod \"test-curl-7691-25912e\" (UID: \"ed284f43-79ad-4891-baca-4f11f6a28183\") " pod="opendatahub/test-curl-7691-25912e"
Sep 11 01:25:34.792905 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:34.792872    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbq2z\" (UniqueName: \"kubernetes.io/projected/ed284f43-79ad-4891-baca-4f11f6a28183-kube-api-access-mbq2z\") pod \"test-curl-7691-25912e\" (UID: \"ed284f43-79ad-4891-baca-4f11f6a28183\") " pod="opendatahub/test-curl-7691-25912e"
Sep 11 01:25:34.800767 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:34.800744    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbq2z\" (UniqueName: \"kubernetes.io/projected/ed284f43-79ad-4891-baca-4f11f6a28183-kube-api-access-mbq2z\") pod \"test-curl-7691-25912e\" (UID: \"ed284f43-79ad-4891-baca-4f11f6a28183\") " pod="opendatahub/test-curl-7691-25912e"
Sep 11 01:25:34.906031 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:34.905936    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7691-25912e"
Sep 11 01:25:35.174093 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:35.174066    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7691-25912e"]
Sep 11 01:25:35.175875 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:25:35.175846    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded284f43_79ad_4891_baca_4f11f6a28183.slice/crio-df9ebab166770c85e3436d9b6cdfaacf93328a6bb91ddcea101d749aa0e71b91 WatchSource:0}: Error finding container df9ebab166770c85e3436d9b6cdfaacf93328a6bb91ddcea101d749aa0e71b91: Status 404 returned error can't find the container with id df9ebab166770c85e3436d9b6cdfaacf93328a6bb91ddcea101d749aa0e71b91
Sep 11 01:25:35.811690 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:35.811635    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7691-25912e" event={"ID":"ed284f43-79ad-4891-baca-4f11f6a28183","Type":"ContainerStarted","Data":"148ae5300eb856c068dab9583836ae911b03ff60ed72d48a8ed4c3d0780cdb0f"}
Sep 11 01:25:35.811690 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:35.811696    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7691-25912e" event={"ID":"ed284f43-79ad-4891-baca-4f11f6a28183","Type":"ContainerStarted","Data":"df9ebab166770c85e3436d9b6cdfaacf93328a6bb91ddcea101d749aa0e71b91"}
Sep 11 01:25:35.827098 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:35.827053    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7691-25912e" podStartSLOduration=1.827039054 podStartE2EDuration="1.827039054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:25:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:25:35.82512849 +0000 UTC m=+1652.873216715" watchObservedRunningTime="2026-09-11 01:25:35.827039054 +0000 UTC m=+1652.875127278"
Sep 11 01:25:36.426019 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:36.425972    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7691-25912e"]
Sep 11 01:25:36.431686 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:36.431657    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7691-25912e"]
Sep 11 01:25:36.553514 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:36.553476    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7691-7fe6c1"]
Sep 11 01:25:36.553898 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:36.553882    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed284f43-79ad-4891-baca-4f11f6a28183" containerName="test-curl-7691-25912e"
Sep 11 01:25:36.553954 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:36.553900    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed284f43-79ad-4891-baca-4f11f6a28183" containerName="test-curl-7691-25912e"
Sep 11 01:25:36.553989 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:36.553970    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed284f43-79ad-4891-baca-4f11f6a28183" containerName="test-curl-7691-25912e"
Sep 11 01:25:36.556995 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:36.556980    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7691-7fe6c1"
Sep 11 01:25:36.566656 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:36.566633    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7691-7fe6c1"]
Sep 11 01:25:36.712595 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:36.712553    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kbpr\" (UniqueName: \"kubernetes.io/projected/19bc901d-23c7-4ca4-8f51-ef113cf48cc3-kube-api-access-9kbpr\") pod \"test-curl-7691-7fe6c1\" (UID: \"19bc901d-23c7-4ca4-8f51-ef113cf48cc3\") " pod="opendatahub/test-curl-7691-7fe6c1"
Sep 11 01:25:36.813140 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:36.813052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kbpr\" (UniqueName: \"kubernetes.io/projected/19bc901d-23c7-4ca4-8f51-ef113cf48cc3-kube-api-access-9kbpr\") pod \"test-curl-7691-7fe6c1\" (UID: \"19bc901d-23c7-4ca4-8f51-ef113cf48cc3\") " pod="opendatahub/test-curl-7691-7fe6c1"
Sep 11 01:25:36.817644 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:25:36.817615    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7691-25912e" container="test-curl-7691-25912e"
Sep 11 01:25:36.821306 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:36.821286    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kbpr\" (UniqueName: \"kubernetes.io/projected/19bc901d-23c7-4ca4-8f51-ef113cf48cc3-kube-api-access-9kbpr\") pod \"test-curl-7691-7fe6c1\" (UID: \"19bc901d-23c7-4ca4-8f51-ef113cf48cc3\") " pod="opendatahub/test-curl-7691-7fe6c1"
Sep 11 01:25:36.866842 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:36.866788    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7691-7fe6c1"
Sep 11 01:25:37.135715 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:37.135691    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7691-7fe6c1"]
Sep 11 01:25:37.137358 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:25:37.137330    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19bc901d_23c7_4ca4_8f51_ef113cf48cc3.slice/crio-c5158a871a35d60f4edf39e1494afd4ded7b43c12a086c89fe12192478787534 WatchSource:0}: Error finding container c5158a871a35d60f4edf39e1494afd4ded7b43c12a086c89fe12192478787534: Status 404 returned error can't find the container with id c5158a871a35d60f4edf39e1494afd4ded7b43c12a086c89fe12192478787534
Sep 11 01:25:37.825552 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:37.825510    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7691-7fe6c1" event={"ID":"19bc901d-23c7-4ca4-8f51-ef113cf48cc3","Type":"ContainerStarted","Data":"3e2db7f8a12cdce285ba7b50cda0d157262c0b4ab9d0acff9c62d30254dcef57"}
Sep 11 01:25:37.825979 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:37.825560    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7691-7fe6c1" event={"ID":"19bc901d-23c7-4ca4-8f51-ef113cf48cc3","Type":"ContainerStarted","Data":"c5158a871a35d60f4edf39e1494afd4ded7b43c12a086c89fe12192478787534"}
Sep 11 01:25:37.825979 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:37.825601    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7691-25912e" podUID="ed284f43-79ad-4891-baca-4f11f6a28183" containerName="test-curl-7691-25912e" containerID="cri-o://148ae5300eb856c068dab9583836ae911b03ff60ed72d48a8ed4c3d0780cdb0f" gracePeriod=2
Sep 11 01:25:37.841043 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:37.840995    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7691-7fe6c1" podStartSLOduration=1.840979979 podStartE2EDuration="1.840979979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:25:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:25:37.839183729 +0000 UTC m=+1654.887271955" watchObservedRunningTime="2026-09-11 01:25:37.840979979 +0000 UTC m=+1654.889068203"
Sep 11 01:25:38.419078 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:38.419040    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7691-7fe6c1"]
Sep 11 01:25:38.422258 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:38.422232    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7691-7fe6c1"]
Sep 11 01:25:38.830561 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:25:38.830525    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7691-7fe6c1" container="test-curl-7691-7fe6c1"
Sep 11 01:25:39.837123 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:39.837086    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7691-7fe6c1" podUID="19bc901d-23c7-4ca4-8f51-ef113cf48cc3" containerName="test-curl-7691-7fe6c1" containerID="cri-o://3e2db7f8a12cdce285ba7b50cda0d157262c0b4ab9d0acff9c62d30254dcef57" gracePeriod=2
Sep 11 01:25:39.989845 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:39.989808    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7691-25912e"
Sep 11 01:25:40.140876 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:40.140759    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbq2z\" (UniqueName: \"kubernetes.io/projected/ed284f43-79ad-4891-baca-4f11f6a28183-kube-api-access-mbq2z\") pod \"ed284f43-79ad-4891-baca-4f11f6a28183\" (UID: \"ed284f43-79ad-4891-baca-4f11f6a28183\") "
Sep 11 01:25:40.142880 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:40.142853    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed284f43-79ad-4891-baca-4f11f6a28183-kube-api-access-mbq2z" (OuterVolumeSpecName: "kube-api-access-mbq2z") pod "ed284f43-79ad-4891-baca-4f11f6a28183" (UID: "ed284f43-79ad-4891-baca-4f11f6a28183"). InnerVolumeSpecName "kube-api-access-mbq2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:25:40.241906 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:40.241864    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbq2z\" (UniqueName: \"kubernetes.io/projected/ed284f43-79ad-4891-baca-4f11f6a28183-kube-api-access-mbq2z\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:25:40.844667 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:40.844627    2565 generic.go:356] "Generic (PLEG): container finished" podID="ed284f43-79ad-4891-baca-4f11f6a28183" containerID="148ae5300eb856c068dab9583836ae911b03ff60ed72d48a8ed4c3d0780cdb0f" exitCode=137
Sep 11 01:25:40.844667 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:40.844670    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7691-25912e"
Sep 11 01:25:40.845238 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:40.844693    2565 scope.go:117] "RemoveContainer" containerID="148ae5300eb856c068dab9583836ae911b03ff60ed72d48a8ed4c3d0780cdb0f"
Sep 11 01:25:40.853665 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:40.853642    2565 scope.go:117] "RemoveContainer" containerID="148ae5300eb856c068dab9583836ae911b03ff60ed72d48a8ed4c3d0780cdb0f"
Sep 11 01:25:40.853988 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:25:40.853966    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"148ae5300eb856c068dab9583836ae911b03ff60ed72d48a8ed4c3d0780cdb0f\": container with ID starting with 148ae5300eb856c068dab9583836ae911b03ff60ed72d48a8ed4c3d0780cdb0f not found: ID does not exist" containerID="148ae5300eb856c068dab9583836ae911b03ff60ed72d48a8ed4c3d0780cdb0f"
Sep 11 01:25:40.854050 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:40.854000    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"148ae5300eb856c068dab9583836ae911b03ff60ed72d48a8ed4c3d0780cdb0f"} err="failed to get container status \"148ae5300eb856c068dab9583836ae911b03ff60ed72d48a8ed4c3d0780cdb0f\": rpc error: code = NotFound desc = could not find container \"148ae5300eb856c068dab9583836ae911b03ff60ed72d48a8ed4c3d0780cdb0f\": container with ID starting with 148ae5300eb856c068dab9583836ae911b03ff60ed72d48a8ed4c3d0780cdb0f not found: ID does not exist"
Sep 11 01:25:40.860352 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:25:40.860319    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7691-25912e\" is forbidden: User \"system:node:ip-10-0-133-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-50.ec2.internal' and this object" podUID="ed284f43-79ad-4891-baca-4f11f6a28183" pod="opendatahub/test-curl-7691-25912e"
Sep 11 01:25:41.471492 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:41.471397    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed284f43-79ad-4891-baca-4f11f6a28183" path="/var/lib/kubelet/pods/ed284f43-79ad-4891-baca-4f11f6a28183/volumes"
Sep 11 01:25:42.002851 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:42.002825    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7691-7fe6c1"
Sep 11 01:25:42.055829 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:42.055793    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kbpr\" (UniqueName: \"kubernetes.io/projected/19bc901d-23c7-4ca4-8f51-ef113cf48cc3-kube-api-access-9kbpr\") pod \"19bc901d-23c7-4ca4-8f51-ef113cf48cc3\" (UID: \"19bc901d-23c7-4ca4-8f51-ef113cf48cc3\") "
Sep 11 01:25:42.057797 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:42.057767    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19bc901d-23c7-4ca4-8f51-ef113cf48cc3-kube-api-access-9kbpr" (OuterVolumeSpecName: "kube-api-access-9kbpr") pod "19bc901d-23c7-4ca4-8f51-ef113cf48cc3" (UID: "19bc901d-23c7-4ca4-8f51-ef113cf48cc3"). InnerVolumeSpecName "kube-api-access-9kbpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:25:42.156975 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:42.156869    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kbpr\" (UniqueName: \"kubernetes.io/projected/19bc901d-23c7-4ca4-8f51-ef113cf48cc3-kube-api-access-9kbpr\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:25:42.857207 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:42.857162    2565 generic.go:356] "Generic (PLEG): container finished" podID="19bc901d-23c7-4ca4-8f51-ef113cf48cc3" containerID="3e2db7f8a12cdce285ba7b50cda0d157262c0b4ab9d0acff9c62d30254dcef57" exitCode=137
Sep 11 01:25:42.857207 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:42.857209    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7691-7fe6c1"
Sep 11 01:25:42.857465 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:42.857231    2565 scope.go:117] "RemoveContainer" containerID="3e2db7f8a12cdce285ba7b50cda0d157262c0b4ab9d0acff9c62d30254dcef57"
Sep 11 01:25:42.866083 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:42.866059    2565 scope.go:117] "RemoveContainer" containerID="3e2db7f8a12cdce285ba7b50cda0d157262c0b4ab9d0acff9c62d30254dcef57"
Sep 11 01:25:42.866354 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:25:42.866336    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e2db7f8a12cdce285ba7b50cda0d157262c0b4ab9d0acff9c62d30254dcef57\": container with ID starting with 3e2db7f8a12cdce285ba7b50cda0d157262c0b4ab9d0acff9c62d30254dcef57 not found: ID does not exist" containerID="3e2db7f8a12cdce285ba7b50cda0d157262c0b4ab9d0acff9c62d30254dcef57"
Sep 11 01:25:42.866399 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:42.866363    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e2db7f8a12cdce285ba7b50cda0d157262c0b4ab9d0acff9c62d30254dcef57"} err="failed to get container status \"3e2db7f8a12cdce285ba7b50cda0d157262c0b4ab9d0acff9c62d30254dcef57\": rpc error: code = NotFound desc = could not find container \"3e2db7f8a12cdce285ba7b50cda0d157262c0b4ab9d0acff9c62d30254dcef57\": container with ID starting with 3e2db7f8a12cdce285ba7b50cda0d157262c0b4ab9d0acff9c62d30254dcef57 not found: ID does not exist"
Sep 11 01:25:42.867579 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:25:42.867557    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7691-7fe6c1\" is forbidden: User \"system:node:ip-10-0-133-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-50.ec2.internal' and this object" podUID="19bc901d-23c7-4ca4-8f51-ef113cf48cc3" pod="opendatahub/test-curl-7691-7fe6c1"
Sep 11 01:25:43.470358 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:25:43.470325    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7691-7fe6c1\" is forbidden: User \"system:node:ip-10-0-133-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-50.ec2.internal' and this object" podUID="19bc901d-23c7-4ca4-8f51-ef113cf48cc3" pod="opendatahub/test-curl-7691-7fe6c1"
Sep 11 01:25:43.471335 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:43.471314    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19bc901d-23c7-4ca4-8f51-ef113cf48cc3" path="/var/lib/kubelet/pods/19bc901d-23c7-4ca4-8f51-ef113cf48cc3/volumes"
Sep 11 01:25:54.080670 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.080637    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"]
Sep 11 01:25:54.081160 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.081145    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19bc901d-23c7-4ca4-8f51-ef113cf48cc3" containerName="test-curl-7691-7fe6c1"
Sep 11 01:25:54.081210 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.081162    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="19bc901d-23c7-4ca4-8f51-ef113cf48cc3" containerName="test-curl-7691-7fe6c1"
Sep 11 01:25:54.081246 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.081234    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="19bc901d-23c7-4ca4-8f51-ef113cf48cc3" containerName="test-curl-7691-7fe6c1"
Sep 11 01:25:54.085588 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.085568    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:25:54.087846 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.087823    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-2482ac\"/\"rate-test-model-2482ac-kserve-self-signed-certs\""
Sep 11 01:25:54.089051 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.089026    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-2482ac\"/\"default-dockercfg-w9chz\""
Sep 11 01:25:54.089269 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.089251    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-2482ac\"/\"openshift-service-ca.crt\""
Sep 11 01:25:54.089593 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.089448    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-2482ac\"/\"kube-root-ca.crt\""
Sep 11 01:25:54.092070 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.092048    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"]
Sep 11 01:25:54.144060 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.144026    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-home\") pod \"rate-test-model-2482ac-kserve-55df4bcd7-4thhk\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") " pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:25:54.144220 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.144075    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-dshm\") pod \"rate-test-model-2482ac-kserve-55df4bcd7-4thhk\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") " pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:25:54.144220 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.144139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtjcd\" (UniqueName: \"kubernetes.io/projected/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-kube-api-access-xtjcd\") pod \"rate-test-model-2482ac-kserve-55df4bcd7-4thhk\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") " pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:25:54.144339 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.144228    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-tmp-dir\") pod \"rate-test-model-2482ac-kserve-55df4bcd7-4thhk\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") " pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:25:54.144339 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.144277    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-model-cache\") pod \"rate-test-model-2482ac-kserve-55df4bcd7-4thhk\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") " pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:25:54.144339 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.144312    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-tls-certs\") pod \"rate-test-model-2482ac-kserve-55df4bcd7-4thhk\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") " pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:25:54.244888 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.244856    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-tls-certs\") pod \"rate-test-model-2482ac-kserve-55df4bcd7-4thhk\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") " pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:25:54.245063 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.244901    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-home\") pod \"rate-test-model-2482ac-kserve-55df4bcd7-4thhk\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") " pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:25:54.245063 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.244932    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-dshm\") pod \"rate-test-model-2482ac-kserve-55df4bcd7-4thhk\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") " pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:25:54.245063 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.244959    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtjcd\" (UniqueName: \"kubernetes.io/projected/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-kube-api-access-xtjcd\") pod \"rate-test-model-2482ac-kserve-55df4bcd7-4thhk\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") " pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:25:54.245063 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.244996    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-tmp-dir\") pod \"rate-test-model-2482ac-kserve-55df4bcd7-4thhk\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") " pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:25:54.245063 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.245033    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-model-cache\") pod \"rate-test-model-2482ac-kserve-55df4bcd7-4thhk\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") " pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:25:54.245370 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.245344    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-home\") pod \"rate-test-model-2482ac-kserve-55df4bcd7-4thhk\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") " pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:25:54.245464 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.245435    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-model-cache\") pod \"rate-test-model-2482ac-kserve-55df4bcd7-4thhk\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") " pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:25:54.245531 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.245487    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-tmp-dir\") pod \"rate-test-model-2482ac-kserve-55df4bcd7-4thhk\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") " pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:25:54.247300 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.247275    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-dshm\") pod \"rate-test-model-2482ac-kserve-55df4bcd7-4thhk\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") " pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:25:54.247427 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.247409    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-tls-certs\") pod \"rate-test-model-2482ac-kserve-55df4bcd7-4thhk\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") " pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:25:54.254513 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.254491    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtjcd\" (UniqueName: \"kubernetes.io/projected/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-kube-api-access-xtjcd\") pod \"rate-test-model-2482ac-kserve-55df4bcd7-4thhk\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") " pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:25:54.398382 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.398284    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:25:54.686922 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.686894    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"]
Sep 11 01:25:54.688390 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:25:54.688362    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod773ba5e1_f8e9_48e6_9f42_5ef68e43a23e.slice/crio-3f082c95f20039fa8ee3f577592ead388aa2435ad837b8d9db5dc03f213ae026 WatchSource:0}: Error finding container 3f082c95f20039fa8ee3f577592ead388aa2435ad837b8d9db5dc03f213ae026: Status 404 returned error can't find the container with id 3f082c95f20039fa8ee3f577592ead388aa2435ad837b8d9db5dc03f213ae026
Sep 11 01:25:54.925117 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.925080    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk" event={"ID":"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e","Type":"ContainerStarted","Data":"8d1a1e9e462c53287f2aee02f79633dc5f07980b57cab90a8703c26580be275d"}
Sep 11 01:25:54.925286 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.925123    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk" event={"ID":"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e","Type":"ContainerStarted","Data":"3f082c95f20039fa8ee3f577592ead388aa2435ad837b8d9db5dc03f213ae026"}
Sep 11 01:25:54.941504 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:25:54.941410    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk" podStartSLOduration=0.94139658 podStartE2EDuration="941.39658ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:25:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:25:54.939769683 +0000 UTC m=+1671.987857908" watchObservedRunningTime="2026-09-11 01:25:54.94139658 +0000 UTC m=+1671.989484804"
Sep 11 01:26:04.399011 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:26:04.398977    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:26:04.399422 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:26:04.399069    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:26:04.411414 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:26:04.411391    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:26:04.989162 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:26:04.989127    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:27:05.711399 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:05.711366    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"]
Sep 11 01:27:07.443387 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.443354    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"]
Sep 11 01:27:07.446847 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.446828    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.449461 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.449440    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-976998-openshift-default-dockercfg-nfwgx\""
Sep 11 01:27:07.457581 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.457559    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"]
Sep 11 01:27:07.528861 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.528805    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-credential-socket\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.529077 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.528882    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-workload-certs\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.529077 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.528945    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/668bded3-69fa-4298-8cff-eac9b149517e-istio-podinfo\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.529077 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.528996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/668bded3-69fa-4298-8cff-eac9b149517e-istio-token\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.529077 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.529051    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/668bded3-69fa-4298-8cff-eac9b149517e-istiod-ca-cert\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.529310 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.529095    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mb2n\" (UniqueName: \"kubernetes.io/projected/668bded3-69fa-4298-8cff-eac9b149517e-kube-api-access-7mb2n\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.529310 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.529128    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-istio-envoy\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.529310 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.529155    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-workload-socket\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.529310 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.529238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-istio-data\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.629739 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.629704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-istio-envoy\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.629739 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.629743    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-workload-socket\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.629977 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.629872    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-istio-data\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.629977 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.629927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-credential-socket\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.629977 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.629957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-workload-certs\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.630124 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.630020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/668bded3-69fa-4298-8cff-eac9b149517e-istio-podinfo\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.630124 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.630071    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/668bded3-69fa-4298-8cff-eac9b149517e-istio-token\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.630124 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.630104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/668bded3-69fa-4298-8cff-eac9b149517e-istiod-ca-cert\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.630288 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.630141    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mb2n\" (UniqueName: \"kubernetes.io/projected/668bded3-69fa-4298-8cff-eac9b149517e-kube-api-access-7mb2n\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.630288 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.630222    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-istio-data\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.630288 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.630271    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-credential-socket\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.630447 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.630336    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-workload-certs\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.630447 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.630341    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-workload-socket\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.630750 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.630730    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/668bded3-69fa-4298-8cff-eac9b149517e-istiod-ca-cert\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.632062 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.632042    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-istio-envoy\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.632507 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.632489    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/668bded3-69fa-4298-8cff-eac9b149517e-istio-podinfo\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.637882 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.637855    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/668bded3-69fa-4298-8cff-eac9b149517e-istio-token\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.638034 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.638017    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mb2n\" (UniqueName: \"kubernetes.io/projected/668bded3-69fa-4298-8cff-eac9b149517e-kube-api-access-7mb2n\") pod \"e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") " pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:07.758591 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:07.758509    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:08.037729 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:08.037699    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"]
Sep 11 01:27:08.039332 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:27:08.039307    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod668bded3_69fa_4298_8cff_eac9b149517e.slice/crio-23ac9720392dca3c55a7587aa085de7f95d0c1756e8dead4c22470539511952b WatchSource:0}: Error finding container 23ac9720392dca3c55a7587aa085de7f95d0c1756e8dead4c22470539511952b: Status 404 returned error can't find the container with id 23ac9720392dca3c55a7587aa085de7f95d0c1756e8dead4c22470539511952b
Sep 11 01:27:08.041716 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:08.041676    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:27:08.041793 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:08.041770    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:27:08.041867 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:08.041840    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:27:08.312133 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:08.312091    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm" event={"ID":"668bded3-69fa-4298-8cff-eac9b149517e","Type":"ContainerStarted","Data":"6e2d7653ab3b4e99cb1cb17dd1ee11a346a10b05d2e6a888ae1f029d1628db00"}
Sep 11 01:27:08.312352 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:08.312153    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm" event={"ID":"668bded3-69fa-4298-8cff-eac9b149517e","Type":"ContainerStarted","Data":"23ac9720392dca3c55a7587aa085de7f95d0c1756e8dead4c22470539511952b"}
Sep 11 01:27:08.337297 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:08.337248    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm" podStartSLOduration=1.337232295 podStartE2EDuration="1.337232295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:27:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:27:08.333488361 +0000 UTC m=+1745.381576619" watchObservedRunningTime="2026-09-11 01:27:08.337232295 +0000 UTC m=+1745.385320553"
Sep 11 01:27:08.759521 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:08.759448    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:09.764842 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:09.764786    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:10.323757 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:10.323727    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:10.324741 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:10.324720    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:12.217128 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.217094    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc"]
Sep 11 01:27:12.220875 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.220854    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc"
Sep 11 01:27:12.223474 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.223445    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-976998-dockercfg-r2ghh\""
Sep 11 01:27:12.223673 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.223659    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-976998\""
Sep 11 01:27:12.233714 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.233688    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc"]
Sep 11 01:27:12.236983 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.236961    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl"]
Sep 11 01:27:12.240273 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.240256    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl"
Sep 11 01:27:12.257282 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.257170    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl"]
Sep 11 01:27:12.378993 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.378960    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d23baab9-94e8-46f0-a886-af91eade7dc6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc\" (UID: \"d23baab9-94e8-46f0-a886-af91eade7dc6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc"
Sep 11 01:27:12.378993 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.379007    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drkg6\" (UniqueName: \"kubernetes.io/projected/d23baab9-94e8-46f0-a886-af91eade7dc6-kube-api-access-drkg6\") pod \"payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc\" (UID: \"d23baab9-94e8-46f0-a886-af91eade7dc6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc"
Sep 11 01:27:12.379305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.379062    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcmhn\" (UniqueName: \"kubernetes.io/projected/64dce8df-08f1-4721-ac5e-876e59d199fe-kube-api-access-vcmhn\") pod \"payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl\" (UID: \"64dce8df-08f1-4721-ac5e-876e59d199fe\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl"
Sep 11 01:27:12.379305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.379133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64dce8df-08f1-4721-ac5e-876e59d199fe-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl\" (UID: \"64dce8df-08f1-4721-ac5e-876e59d199fe\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl"
Sep 11 01:27:12.479571 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.479487    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d23baab9-94e8-46f0-a886-af91eade7dc6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc\" (UID: \"d23baab9-94e8-46f0-a886-af91eade7dc6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc"
Sep 11 01:27:12.479571 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.479522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drkg6\" (UniqueName: \"kubernetes.io/projected/d23baab9-94e8-46f0-a886-af91eade7dc6-kube-api-access-drkg6\") pod \"payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc\" (UID: \"d23baab9-94e8-46f0-a886-af91eade7dc6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc"
Sep 11 01:27:12.479571 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.479547    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcmhn\" (UniqueName: \"kubernetes.io/projected/64dce8df-08f1-4721-ac5e-876e59d199fe-kube-api-access-vcmhn\") pod \"payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl\" (UID: \"64dce8df-08f1-4721-ac5e-876e59d199fe\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl"
Sep 11 01:27:12.479875 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.479618    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64dce8df-08f1-4721-ac5e-876e59d199fe-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl\" (UID: \"64dce8df-08f1-4721-ac5e-876e59d199fe\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl"
Sep 11 01:27:12.480294 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.480273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d23baab9-94e8-46f0-a886-af91eade7dc6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc\" (UID: \"d23baab9-94e8-46f0-a886-af91eade7dc6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc"
Sep 11 01:27:12.480393 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.480342    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64dce8df-08f1-4721-ac5e-876e59d199fe-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl\" (UID: \"64dce8df-08f1-4721-ac5e-876e59d199fe\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl"
Sep 11 01:27:12.488103 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.488075    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcmhn\" (UniqueName: \"kubernetes.io/projected/64dce8df-08f1-4721-ac5e-876e59d199fe-kube-api-access-vcmhn\") pod \"payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl\" (UID: \"64dce8df-08f1-4721-ac5e-876e59d199fe\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl"
Sep 11 01:27:12.488103 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.488096    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drkg6\" (UniqueName: \"kubernetes.io/projected/d23baab9-94e8-46f0-a886-af91eade7dc6-kube-api-access-drkg6\") pod \"payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc\" (UID: \"d23baab9-94e8-46f0-a886-af91eade7dc6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc"
Sep 11 01:27:12.532118 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.532073    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc"
Sep 11 01:27:12.550100 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.550065    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl"
Sep 11 01:27:12.805213 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.805188    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc"]
Sep 11 01:27:12.806462 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:27:12.806436    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd23baab9_94e8_46f0_a886_af91eade7dc6.slice/crio-22ad5f5f6001807a0bd99b2a3e18e74ded545d5498c9587d877e1aaa100efee3 WatchSource:0}: Error finding container 22ad5f5f6001807a0bd99b2a3e18e74ded545d5498c9587d877e1aaa100efee3: Status 404 returned error can't find the container with id 22ad5f5f6001807a0bd99b2a3e18e74ded545d5498c9587d877e1aaa100efee3
Sep 11 01:27:12.835667 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:12.835636    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl"]
Sep 11 01:27:12.844959 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:27:12.844932    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64dce8df_08f1_4721_ac5e_876e59d199fe.slice/crio-061a3a30d52668fa196ab3442d6e3b2954d38db6fa9130b9ca4176fefa195492 WatchSource:0}: Error finding container 061a3a30d52668fa196ab3442d6e3b2954d38db6fa9130b9ca4176fefa195492: Status 404 returned error can't find the container with id 061a3a30d52668fa196ab3442d6e3b2954d38db6fa9130b9ca4176fefa195492
Sep 11 01:27:13.351322 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:13.351279    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl" event={"ID":"64dce8df-08f1-4721-ac5e-876e59d199fe","Type":"ContainerStarted","Data":"cfb15997d23af21a392bfe67dd5f3b0e938a260e476f78977137b791ff5d7d14"}
Sep 11 01:27:13.351838 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:13.351355    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl"
Sep 11 01:27:13.351838 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:13.351379    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl" event={"ID":"64dce8df-08f1-4721-ac5e-876e59d199fe","Type":"ContainerStarted","Data":"061a3a30d52668fa196ab3442d6e3b2954d38db6fa9130b9ca4176fefa195492"}
Sep 11 01:27:13.353139 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:13.353109    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc" event={"ID":"d23baab9-94e8-46f0-a886-af91eade7dc6","Type":"ContainerStarted","Data":"e69874283ead803d8a6dcd29d3822779aac2273225e2592a8b03ce2c8f797214"}
Sep 11 01:27:13.353289 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:13.353160    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc" event={"ID":"d23baab9-94e8-46f0-a886-af91eade7dc6","Type":"ContainerStarted","Data":"22ad5f5f6001807a0bd99b2a3e18e74ded545d5498c9587d877e1aaa100efee3"}
Sep 11 01:27:13.353289 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:13.353189    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc"
Sep 11 01:27:13.367481 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:13.367431    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl" podStartSLOduration=1.367415776 podStartE2EDuration="1.367415776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:27:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:27:13.366518853 +0000 UTC m=+1750.414607096" watchObservedRunningTime="2026-09-11 01:27:13.367415776 +0000 UTC m=+1750.415504000"
Sep 11 01:27:13.381420 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:13.381356    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc" podStartSLOduration=1.381336562 podStartE2EDuration="1.381336562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:27:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:27:13.380701733 +0000 UTC m=+1750.428789978" watchObservedRunningTime="2026-09-11 01:27:13.381336562 +0000 UTC m=+1750.429424787"
Sep 11 01:27:20.730824 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:20.730784    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk" podUID="773ba5e1-f8e9-48e6-9f42-5ef68e43a23e" containerName="main" containerID="cri-o://8d1a1e9e462c53287f2aee02f79633dc5f07980b57cab90a8703c26580be275d" gracePeriod=45
Sep 11 01:27:21.024994 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.024972    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:27:21.074162 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.074120    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtjcd\" (UniqueName: \"kubernetes.io/projected/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-kube-api-access-xtjcd\") pod \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") "
Sep 11 01:27:21.074162 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.074164    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-tls-certs\") pod \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") "
Sep 11 01:27:21.074411 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.074194    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-tmp-dir\") pod \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") "
Sep 11 01:27:21.074411 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.074255    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-home\") pod \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") "
Sep 11 01:27:21.074411 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.074287    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-model-cache\") pod \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") "
Sep 11 01:27:21.074411 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.074331    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-dshm\") pod \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\" (UID: \"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e\") "
Sep 11 01:27:21.075048 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.074989    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "773ba5e1-f8e9-48e6-9f42-5ef68e43a23e" (UID: "773ba5e1-f8e9-48e6-9f42-5ef68e43a23e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:27:21.075048 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.074992    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-home" (OuterVolumeSpecName: "home") pod "773ba5e1-f8e9-48e6-9f42-5ef68e43a23e" (UID: "773ba5e1-f8e9-48e6-9f42-5ef68e43a23e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:27:21.075201 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.075091    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-model-cache" (OuterVolumeSpecName: "model-cache") pod "773ba5e1-f8e9-48e6-9f42-5ef68e43a23e" (UID: "773ba5e1-f8e9-48e6-9f42-5ef68e43a23e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:27:21.077028 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.076998    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-dshm" (OuterVolumeSpecName: "dshm") pod "773ba5e1-f8e9-48e6-9f42-5ef68e43a23e" (UID: "773ba5e1-f8e9-48e6-9f42-5ef68e43a23e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:27:21.077143 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.077081    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-kube-api-access-xtjcd" (OuterVolumeSpecName: "kube-api-access-xtjcd") pod "773ba5e1-f8e9-48e6-9f42-5ef68e43a23e" (UID: "773ba5e1-f8e9-48e6-9f42-5ef68e43a23e"). InnerVolumeSpecName "kube-api-access-xtjcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:27:21.077320 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.077300    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "773ba5e1-f8e9-48e6-9f42-5ef68e43a23e" (UID: "773ba5e1-f8e9-48e6-9f42-5ef68e43a23e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:27:21.175722 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.175693    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-home\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:27:21.175930 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.175868    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-model-cache\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:27:21.175930 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.175890    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-dshm\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:27:21.175930 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.175902    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtjcd\" (UniqueName: \"kubernetes.io/projected/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-kube-api-access-xtjcd\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:27:21.176064 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.175930    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-tls-certs\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:27:21.176064 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.175948    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e-tmp-dir\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:27:21.397268 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.397227    2565 generic.go:356] "Generic (PLEG): container finished" podID="773ba5e1-f8e9-48e6-9f42-5ef68e43a23e" containerID="8d1a1e9e462c53287f2aee02f79633dc5f07980b57cab90a8703c26580be275d" exitCode=0
Sep 11 01:27:21.397449 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.397276    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"
Sep 11 01:27:21.397449 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.397312    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk" event={"ID":"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e","Type":"ContainerDied","Data":"8d1a1e9e462c53287f2aee02f79633dc5f07980b57cab90a8703c26580be275d"}
Sep 11 01:27:21.397449 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.397359    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk" event={"ID":"773ba5e1-f8e9-48e6-9f42-5ef68e43a23e","Type":"ContainerDied","Data":"3f082c95f20039fa8ee3f577592ead388aa2435ad837b8d9db5dc03f213ae026"}
Sep 11 01:27:21.397449 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.397381    2565 scope.go:117] "RemoveContainer" containerID="8d1a1e9e462c53287f2aee02f79633dc5f07980b57cab90a8703c26580be275d"
Sep 11 01:27:21.409903 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.409885    2565 scope.go:117] "RemoveContainer" containerID="8d1a1e9e462c53287f2aee02f79633dc5f07980b57cab90a8703c26580be275d"
Sep 11 01:27:21.410184 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:27:21.410166    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d1a1e9e462c53287f2aee02f79633dc5f07980b57cab90a8703c26580be275d\": container with ID starting with 8d1a1e9e462c53287f2aee02f79633dc5f07980b57cab90a8703c26580be275d not found: ID does not exist" containerID="8d1a1e9e462c53287f2aee02f79633dc5f07980b57cab90a8703c26580be275d"
Sep 11 01:27:21.410235 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.410193    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d1a1e9e462c53287f2aee02f79633dc5f07980b57cab90a8703c26580be275d"} err="failed to get container status \"8d1a1e9e462c53287f2aee02f79633dc5f07980b57cab90a8703c26580be275d\": rpc error: code = NotFound desc = could not find container \"8d1a1e9e462c53287f2aee02f79633dc5f07980b57cab90a8703c26580be275d\": container with ID starting with 8d1a1e9e462c53287f2aee02f79633dc5f07980b57cab90a8703c26580be275d not found: ID does not exist"
Sep 11 01:27:21.419951 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.419912    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"]
Sep 11 01:27:21.425808 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.425786    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-2482ac/rate-test-model-2482ac-kserve-55df4bcd7-4thhk"]
Sep 11 01:27:21.482614 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:21.482578    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="773ba5e1-f8e9-48e6-9f42-5ef68e43a23e" path="/var/lib/kubelet/pods/773ba5e1-f8e9-48e6-9f42-5ef68e43a23e/volumes"
Sep 11 01:27:24.360680 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:24.360647    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl"
Sep 11 01:27:24.361084 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:24.360856    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc"
Sep 11 01:27:25.779181 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:25.779150    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": read tcp 10.134.0.2:42142->10.134.0.88:15021: read: connection reset by peer" start-of-body=
Sep 11 01:27:25.779694 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:25.779661    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm" podUID="668bded3-69fa-4298-8cff-eac9b149517e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": read tcp 10.134.0.2:42142->10.134.0.88:15021: read: connection reset by peer"
Sep 11 01:27:26.430563 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:26.430531    2565 generic.go:356] "Generic (PLEG): container finished" podID="668bded3-69fa-4298-8cff-eac9b149517e" containerID="6e2d7653ab3b4e99cb1cb17dd1ee11a346a10b05d2e6a888ae1f029d1628db00" exitCode=0
Sep 11 01:27:26.430736 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:26.430599    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm" event={"ID":"668bded3-69fa-4298-8cff-eac9b149517e","Type":"ContainerDied","Data":"6e2d7653ab3b4e99cb1cb17dd1ee11a346a10b05d2e6a888ae1f029d1628db00"}
Sep 11 01:27:26.431023 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:26.431009    2565 scope.go:117] "RemoveContainer" containerID="6e2d7653ab3b4e99cb1cb17dd1ee11a346a10b05d2e6a888ae1f029d1628db00"
Sep 11 01:27:26.432106 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:26.432077    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:27:26.432172 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:26.432160    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:27:26.432209 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:26.432194    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:27:27.437689 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:27.437635    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm" event={"ID":"668bded3-69fa-4298-8cff-eac9b149517e","Type":"ContainerStarted","Data":"7f77685a8e43c2b5dc696e953edd9655fe503d86c03f3ab999a38a09528cc474"}
Sep 11 01:27:27.759365 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:27.759255    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:27.759651 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:27.759622    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Sep 11 01:27:27.759901 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:27.759871    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm" podUID="668bded3-69fa-4298-8cff-eac9b149517e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Sep 11 01:27:28.759555 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:28.759514    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Sep 11 01:27:28.760206 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:28.760172    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm" podUID="668bded3-69fa-4298-8cff-eac9b149517e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Sep 11 01:27:29.759922 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:29.759876    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Sep 11 01:27:29.760444 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:29.759945    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm" podUID="668bded3-69fa-4298-8cff-eac9b149517e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Sep 11 01:27:30.759267 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:30.759230    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Sep 11 01:27:30.760771 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:30.759536    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm" podUID="668bded3-69fa-4298-8cff-eac9b149517e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Sep 11 01:27:31.760850 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:31.759271    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Sep 11 01:27:31.760850 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:31.759342    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm" podUID="668bded3-69fa-4298-8cff-eac9b149517e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Sep 11 01:27:32.763305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:32.763267    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:32.763688 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:32.763527    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:32.764329 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:32.764310    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:27:36.286547 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.286515    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"]
Sep 11 01:27:36.286978 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.286961    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773ba5e1-f8e9-48e6-9f42-5ef68e43a23e" containerName="main"
Sep 11 01:27:36.286978 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.286979    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="773ba5e1-f8e9-48e6-9f42-5ef68e43a23e" containerName="main"
Sep 11 01:27:36.287059 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.287046    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="773ba5e1-f8e9-48e6-9f42-5ef68e43a23e" containerName="main"
Sep 11 01:27:36.289039 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.289017    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.291365 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.291346    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-bae8d3-openshift-default-dockercfg-4vnm5\""
Sep 11 01:27:36.302106 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.302085    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"]
Sep 11 01:27:36.432338 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.432295    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-workload-socket\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.432338 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.432338    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-workload-certs\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.432577 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.432413    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-envoy\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.432577 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.432481    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-data\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.432577 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.432502    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-token\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.432740 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.432587    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/295c6e97-f932-40af-9e5f-1d234ff6bc22-istiod-ca-cert\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.432740 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.432628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-podinfo\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.432740 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.432689    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-credential-socket\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.432740 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.432716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xss48\" (UniqueName: \"kubernetes.io/projected/295c6e97-f932-40af-9e5f-1d234ff6bc22-kube-api-access-xss48\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.534005 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.533971    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-credential-socket\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.534005 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.534003    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xss48\" (UniqueName: \"kubernetes.io/projected/295c6e97-f932-40af-9e5f-1d234ff6bc22-kube-api-access-xss48\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.534235 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.534045    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-workload-socket\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.534235 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.534071    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-workload-certs\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.534235 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.534116    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-envoy\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.534235 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.534151    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-data\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.534439 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.534279    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-token\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.534439 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.534400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/295c6e97-f932-40af-9e5f-1d234ff6bc22-istiod-ca-cert\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.534439 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.534425    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-credential-socket\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.534587 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.534445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-podinfo\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.534587 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.534566    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-workload-certs\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.534737 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.534716    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-workload-socket\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.535015 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.534993    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-data\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.535113 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.535095    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/295c6e97-f932-40af-9e5f-1d234ff6bc22-istiod-ca-cert\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.536383 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.536363    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-envoy\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.537017 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.536974    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-podinfo\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.541589 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.541569    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-token\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.542010 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.541990    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xss48\" (UniqueName: \"kubernetes.io/projected/295c6e97-f932-40af-9e5f-1d234ff6bc22-kube-api-access-xss48\") pod \"e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") " pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.600943 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.600915    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:36.876446 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.876422    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"]
Sep 11 01:27:36.877637 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:27:36.877611    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod295c6e97_f932_40af_9e5f_1d234ff6bc22.slice/crio-f1986bcaddddf091bd304fc5d49449a2540238dc999b80fa1b3c4873fb8b4140 WatchSource:0}: Error finding container f1986bcaddddf091bd304fc5d49449a2540238dc999b80fa1b3c4873fb8b4140: Status 404 returned error can't find the container with id f1986bcaddddf091bd304fc5d49449a2540238dc999b80fa1b3c4873fb8b4140
Sep 11 01:27:36.879917 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.879879    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:27:36.879994 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.879945    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:27:36.879994 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:36.879972    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:27:37.509347 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:37.509292    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2" event={"ID":"295c6e97-f932-40af-9e5f-1d234ff6bc22","Type":"ContainerStarted","Data":"05a944400a99c4f637405f5413e302cd233bf686f1417bf69b974c655fa886fc"}
Sep 11 01:27:37.509832 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:37.509404    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2" event={"ID":"295c6e97-f932-40af-9e5f-1d234ff6bc22","Type":"ContainerStarted","Data":"f1986bcaddddf091bd304fc5d49449a2540238dc999b80fa1b3c4873fb8b4140"}
Sep 11 01:27:37.530275 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:37.530222    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2" podStartSLOduration=1.530207586 podStartE2EDuration="1.530207586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:27:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:27:37.528354652 +0000 UTC m=+1774.576442895" watchObservedRunningTime="2026-09-11 01:27:37.530207586 +0000 UTC m=+1774.578295809"
Sep 11 01:27:37.601602 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:37.601570    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:37.603005 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:37.602982    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused" start-of-body=
Sep 11 01:27:37.603122 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:37.603031    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2" podUID="295c6e97-f932-40af-9e5f-1d234ff6bc22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused"
Sep 11 01:27:38.605756 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:38.605725    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:39.520067 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:39.520033    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:39.521088 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:39.521065    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:55.560992 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:55.560947    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 01:27:55.561410 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:55.561019    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2" podUID="295c6e97-f932-40af-9e5f-1d234ff6bc22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 01:27:57.628711 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:57.628675    2565 generic.go:356] "Generic (PLEG): container finished" podID="295c6e97-f932-40af-9e5f-1d234ff6bc22" containerID="05a944400a99c4f637405f5413e302cd233bf686f1417bf69b974c655fa886fc" exitCode=0
Sep 11 01:27:57.629192 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:57.628746    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2" event={"ID":"295c6e97-f932-40af-9e5f-1d234ff6bc22","Type":"ContainerDied","Data":"05a944400a99c4f637405f5413e302cd233bf686f1417bf69b974c655fa886fc"}
Sep 11 01:27:57.629192 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:57.629156    2565 scope.go:117] "RemoveContainer" containerID="05a944400a99c4f637405f5413e302cd233bf686f1417bf69b974c655fa886fc"
Sep 11 01:27:57.630249 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:57.630216    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:27:57.630351 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:57.630287    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:27:57.630351 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:57.630320    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 11 01:27:58.636908 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:58.636872    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2" event={"ID":"295c6e97-f932-40af-9e5f-1d234ff6bc22","Type":"ContainerStarted","Data":"2855cc4248b4e9255f95a623d8fd64e42d97ee696fc739f70bec7d10f1f9b44b"}
Sep 11 01:27:59.602077 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:59.602041    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:27:59.602252 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:59.602220    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused" start-of-body=
Sep 11 01:27:59.602300 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:27:59.602264    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2" podUID="295c6e97-f932-40af-9e5f-1d234ff6bc22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused"
Sep 11 01:28:00.602003 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:28:00.601960    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused" start-of-body=
Sep 11 01:28:00.602412 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:28:00.602019    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2" podUID="295c6e97-f932-40af-9e5f-1d234ff6bc22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused"
Sep 11 01:28:01.601592 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:28:01.601553    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused" start-of-body=
Sep 11 01:28:01.601781 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:28:01.601622    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2" podUID="295c6e97-f932-40af-9e5f-1d234ff6bc22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused"
Sep 11 01:28:02.601777 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:28:02.601737    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused" start-of-body=
Sep 11 01:28:02.602199 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:28:02.601851    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2" podUID="295c6e97-f932-40af-9e5f-1d234ff6bc22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.91:15021/healthz/ready\": dial tcp 10.134.0.91:15021: connect: connection refused"
Sep 11 01:28:03.596623 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:28:03.596588    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/1.log"
Sep 11 01:28:03.601715 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:28:03.601686    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/1.log"
Sep 11 01:28:03.763477 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:28:03.763435    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:28:03.764042 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:28:03.764019    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:28:03.765046 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:28:03.765024    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:28:09.546770 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:28:09.546730    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-wcfks_0804bf91-e319-401b-8eff-7964f1dc0d8c/payload-processing/0.log"
Sep 11 01:28:55.795200 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:28:55.795168    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl_64dce8df-08f1-4721-ac5e-876e59d199fe/payload-processing/0.log"
Sep 11 01:28:55.931128 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:28:55.931090    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-wcfks_0804bf91-e319-401b-8eff-7964f1dc0d8c/payload-processing/0.log"
Sep 11 01:29:02.094041 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.094005    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs"]
Sep 11 01:29:02.096678 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.096658    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs"
Sep 11 01:29:02.099143 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.099122    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-40e6bb\""
Sep 11 01:29:02.099271 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.099257    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-40e6bb-dockercfg-4mqgt\""
Sep 11 01:29:02.111061 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.111030    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs"]
Sep 11 01:29:02.129126 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.129087    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks"]
Sep 11 01:29:02.131719 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.131696    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks"
Sep 11 01:29:02.148207 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.148182    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks"]
Sep 11 01:29:02.166477 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.166451    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs92q\" (UniqueName: \"kubernetes.io/projected/5076697a-5edb-4b15-843f-052317c737ca-kube-api-access-hs92q\") pod \"payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs\" (UID: \"5076697a-5edb-4b15-843f-052317c737ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs"
Sep 11 01:29:02.166582 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.166485    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scnpr\" (UniqueName: \"kubernetes.io/projected/2f6c2230-e67f-4085-89c8-c496373ec8a7-kube-api-access-scnpr\") pod \"payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks\" (UID: \"2f6c2230-e67f-4085-89c8-c496373ec8a7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks"
Sep 11 01:29:02.166582 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.166501    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5076697a-5edb-4b15-843f-052317c737ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs\" (UID: \"5076697a-5edb-4b15-843f-052317c737ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs"
Sep 11 01:29:02.166670 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.166583    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f6c2230-e67f-4085-89c8-c496373ec8a7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks\" (UID: \"2f6c2230-e67f-4085-89c8-c496373ec8a7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks"
Sep 11 01:29:02.267899 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.267857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f6c2230-e67f-4085-89c8-c496373ec8a7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks\" (UID: \"2f6c2230-e67f-4085-89c8-c496373ec8a7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks"
Sep 11 01:29:02.268098 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.267963    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs92q\" (UniqueName: \"kubernetes.io/projected/5076697a-5edb-4b15-843f-052317c737ca-kube-api-access-hs92q\") pod \"payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs\" (UID: \"5076697a-5edb-4b15-843f-052317c737ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs"
Sep 11 01:29:02.268098 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.267991    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scnpr\" (UniqueName: \"kubernetes.io/projected/2f6c2230-e67f-4085-89c8-c496373ec8a7-kube-api-access-scnpr\") pod \"payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks\" (UID: \"2f6c2230-e67f-4085-89c8-c496373ec8a7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks"
Sep 11 01:29:02.268098 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.268014    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5076697a-5edb-4b15-843f-052317c737ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs\" (UID: \"5076697a-5edb-4b15-843f-052317c737ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs"
Sep 11 01:29:02.268695 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.268671    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f6c2230-e67f-4085-89c8-c496373ec8a7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks\" (UID: \"2f6c2230-e67f-4085-89c8-c496373ec8a7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks"
Sep 11 01:29:02.268777 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.268700    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5076697a-5edb-4b15-843f-052317c737ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs\" (UID: \"5076697a-5edb-4b15-843f-052317c737ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs"
Sep 11 01:29:02.276396 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.276368    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs92q\" (UniqueName: \"kubernetes.io/projected/5076697a-5edb-4b15-843f-052317c737ca-kube-api-access-hs92q\") pod \"payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs\" (UID: \"5076697a-5edb-4b15-843f-052317c737ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs"
Sep 11 01:29:02.276493 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.276442    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scnpr\" (UniqueName: \"kubernetes.io/projected/2f6c2230-e67f-4085-89c8-c496373ec8a7-kube-api-access-scnpr\") pod \"payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks\" (UID: \"2f6c2230-e67f-4085-89c8-c496373ec8a7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks"
Sep 11 01:29:02.410353 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.410254    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs"
Sep 11 01:29:02.443909 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.443877    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks"
Sep 11 01:29:02.682435 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.682405    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs"]
Sep 11 01:29:02.683977 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:29:02.683951    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5076697a_5edb_4b15_843f_052317c737ca.slice/crio-3e38fdb7892163ec63506e34bb26e20cc07aa03532c164d49ff7af5acf03fb00 WatchSource:0}: Error finding container 3e38fdb7892163ec63506e34bb26e20cc07aa03532c164d49ff7af5acf03fb00: Status 404 returned error can't find the container with id 3e38fdb7892163ec63506e34bb26e20cc07aa03532c164d49ff7af5acf03fb00
Sep 11 01:29:02.729164 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:02.729137    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks"]
Sep 11 01:29:02.731420 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:29:02.731397    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f6c2230_e67f_4085_89c8_c496373ec8a7.slice/crio-4880e94a0925ebbc14010cf02d40a38bebc25bed96670a11a920174bc2eccdac WatchSource:0}: Error finding container 4880e94a0925ebbc14010cf02d40a38bebc25bed96670a11a920174bc2eccdac: Status 404 returned error can't find the container with id 4880e94a0925ebbc14010cf02d40a38bebc25bed96670a11a920174bc2eccdac
Sep 11 01:29:03.020386 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:03.020294    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs" event={"ID":"5076697a-5edb-4b15-843f-052317c737ca","Type":"ContainerStarted","Data":"d9ad772196a5a43b3d1c81e3c66d7fd040ae6cb9ca58c4085484b9eb930c0e58"}
Sep 11 01:29:03.020386 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:03.020347    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs" event={"ID":"5076697a-5edb-4b15-843f-052317c737ca","Type":"ContainerStarted","Data":"3e38fdb7892163ec63506e34bb26e20cc07aa03532c164d49ff7af5acf03fb00"}
Sep 11 01:29:03.020614 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:03.020524    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs"
Sep 11 01:29:03.022019 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:03.021991    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks" event={"ID":"2f6c2230-e67f-4085-89c8-c496373ec8a7","Type":"ContainerStarted","Data":"1bc556ed61a30e60f3c7adc291c6e6619a7bc1b005c1e93ce7fa8d92f29df209"}
Sep 11 01:29:03.022160 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:03.022032    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks" event={"ID":"2f6c2230-e67f-4085-89c8-c496373ec8a7","Type":"ContainerStarted","Data":"4880e94a0925ebbc14010cf02d40a38bebc25bed96670a11a920174bc2eccdac"}
Sep 11 01:29:03.022160 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:03.022080    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks"
Sep 11 01:29:03.039380 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:03.039330    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs" podStartSLOduration=1.039313087 podStartE2EDuration="1.039313087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:29:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:29:03.03726504 +0000 UTC m=+1860.085353275" watchObservedRunningTime="2026-09-11 01:29:03.039313087 +0000 UTC m=+1860.087401311"
Sep 11 01:29:03.054723 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:03.054679    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks" podStartSLOduration=1.054663881 podStartE2EDuration="1.054663881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:29:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:29:03.054646341 +0000 UTC m=+1860.102734592" watchObservedRunningTime="2026-09-11 01:29:03.054663881 +0000 UTC m=+1860.102752106"
Sep 11 01:29:14.029787 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:14.029755    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks"
Sep 11 01:29:14.030398 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:14.029864    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs"
Sep 11 01:29:32.050743 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.050656    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks"]
Sep 11 01:29:32.051203 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.050917    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks" podUID="2f6c2230-e67f-4085-89c8-c496373ec8a7" containerName="payload-processing" containerID="cri-o://1bc556ed61a30e60f3c7adc291c6e6619a7bc1b005c1e93ce7fa8d92f29df209" gracePeriod=30
Sep 11 01:29:32.062807 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.062779    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs"]
Sep 11 01:29:32.063051 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.063025    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs" podUID="5076697a-5edb-4b15-843f-052317c737ca" containerName="payload-pre-processing" containerID="cri-o://d9ad772196a5a43b3d1c81e3c66d7fd040ae6cb9ca58c4085484b9eb930c0e58" gracePeriod=30
Sep 11 01:29:32.190333 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.190298    2565 generic.go:356] "Generic (PLEG): container finished" podID="5076697a-5edb-4b15-843f-052317c737ca" containerID="d9ad772196a5a43b3d1c81e3c66d7fd040ae6cb9ca58c4085484b9eb930c0e58" exitCode=0
Sep 11 01:29:32.190488 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.190386    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs" event={"ID":"5076697a-5edb-4b15-843f-052317c737ca","Type":"ContainerDied","Data":"d9ad772196a5a43b3d1c81e3c66d7fd040ae6cb9ca58c4085484b9eb930c0e58"}
Sep 11 01:29:32.192183 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.192153    2565 generic.go:356] "Generic (PLEG): container finished" podID="2f6c2230-e67f-4085-89c8-c496373ec8a7" containerID="1bc556ed61a30e60f3c7adc291c6e6619a7bc1b005c1e93ce7fa8d92f29df209" exitCode=0
Sep 11 01:29:32.192282 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.192230    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks" event={"ID":"2f6c2230-e67f-4085-89c8-c496373ec8a7","Type":"ContainerDied","Data":"1bc556ed61a30e60f3c7adc291c6e6619a7bc1b005c1e93ce7fa8d92f29df209"}
Sep 11 01:29:32.340993 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.340971    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks"
Sep 11 01:29:32.345673 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.345652    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs"
Sep 11 01:29:32.351847 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.351801    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scnpr\" (UniqueName: \"kubernetes.io/projected/2f6c2230-e67f-4085-89c8-c496373ec8a7-kube-api-access-scnpr\") pod \"2f6c2230-e67f-4085-89c8-c496373ec8a7\" (UID: \"2f6c2230-e67f-4085-89c8-c496373ec8a7\") "
Sep 11 01:29:32.351957 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.351941    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hs92q\" (UniqueName: \"kubernetes.io/projected/5076697a-5edb-4b15-843f-052317c737ca-kube-api-access-hs92q\") pod \"5076697a-5edb-4b15-843f-052317c737ca\" (UID: \"5076697a-5edb-4b15-843f-052317c737ca\") "
Sep 11 01:29:32.352010 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.351980    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5076697a-5edb-4b15-843f-052317c737ca-plugins-config-volume\") pod \"5076697a-5edb-4b15-843f-052317c737ca\" (UID: \"5076697a-5edb-4b15-843f-052317c737ca\") "
Sep 11 01:29:32.352010 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.352004    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f6c2230-e67f-4085-89c8-c496373ec8a7-plugins-config-volume\") pod \"2f6c2230-e67f-4085-89c8-c496373ec8a7\" (UID: \"2f6c2230-e67f-4085-89c8-c496373ec8a7\") "
Sep 11 01:29:32.352361 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.352340    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5076697a-5edb-4b15-843f-052317c737ca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5076697a-5edb-4b15-843f-052317c737ca" (UID: "5076697a-5edb-4b15-843f-052317c737ca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:29:32.352434 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.352357    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f6c2230-e67f-4085-89c8-c496373ec8a7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2f6c2230-e67f-4085-89c8-c496373ec8a7" (UID: "2f6c2230-e67f-4085-89c8-c496373ec8a7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:29:32.353923 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.353906    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5076697a-5edb-4b15-843f-052317c737ca-kube-api-access-hs92q" (OuterVolumeSpecName: "kube-api-access-hs92q") pod "5076697a-5edb-4b15-843f-052317c737ca" (UID: "5076697a-5edb-4b15-843f-052317c737ca"). InnerVolumeSpecName "kube-api-access-hs92q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:29:32.353980 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.353934    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f6c2230-e67f-4085-89c8-c496373ec8a7-kube-api-access-scnpr" (OuterVolumeSpecName: "kube-api-access-scnpr") pod "2f6c2230-e67f-4085-89c8-c496373ec8a7" (UID: "2f6c2230-e67f-4085-89c8-c496373ec8a7"). InnerVolumeSpecName "kube-api-access-scnpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:29:32.452990 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.452953    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scnpr\" (UniqueName: \"kubernetes.io/projected/2f6c2230-e67f-4085-89c8-c496373ec8a7-kube-api-access-scnpr\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:29:32.452990 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.452983    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hs92q\" (UniqueName: \"kubernetes.io/projected/5076697a-5edb-4b15-843f-052317c737ca-kube-api-access-hs92q\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:29:32.452990 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.452992    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5076697a-5edb-4b15-843f-052317c737ca-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:29:32.452990 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:32.453001    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f6c2230-e67f-4085-89c8-c496373ec8a7-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:29:33.199454 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:33.199424    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs"
Sep 11 01:29:33.199947 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:33.199413    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs" event={"ID":"5076697a-5edb-4b15-843f-052317c737ca","Type":"ContainerDied","Data":"3e38fdb7892163ec63506e34bb26e20cc07aa03532c164d49ff7af5acf03fb00"}
Sep 11 01:29:33.199947 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:33.199590    2565 scope.go:117] "RemoveContainer" containerID="d9ad772196a5a43b3d1c81e3c66d7fd040ae6cb9ca58c4085484b9eb930c0e58"
Sep 11 01:29:33.201064 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:33.200783    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks" event={"ID":"2f6c2230-e67f-4085-89c8-c496373ec8a7","Type":"ContainerDied","Data":"4880e94a0925ebbc14010cf02d40a38bebc25bed96670a11a920174bc2eccdac"}
Sep 11 01:29:33.201064 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:33.200838    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks"
Sep 11 01:29:33.209485 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:33.209456    2565 scope.go:117] "RemoveContainer" containerID="1bc556ed61a30e60f3c7adc291c6e6619a7bc1b005c1e93ce7fa8d92f29df209"
Sep 11 01:29:33.224945 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:33.224919    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs"]
Sep 11 01:29:33.229205 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:33.229183    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-40e6bb-698cf8bff8-hqtvs"]
Sep 11 01:29:33.238918 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:33.238898    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks"]
Sep 11 01:29:33.244637 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:33.244615    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-40e6bb-688df5f6c7-5srks"]
Sep 11 01:29:33.472408 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:33.472331    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f6c2230-e67f-4085-89c8-c496373ec8a7" path="/var/lib/kubelet/pods/2f6c2230-e67f-4085-89c8-c496373ec8a7/volumes"
Sep 11 01:29:33.472698 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:33.472685    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5076697a-5edb-4b15-843f-052317c737ca" path="/var/lib/kubelet/pods/5076697a-5edb-4b15-843f-052317c737ca/volumes"
Sep 11 01:29:58.035762 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.035713    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl"]
Sep 11 01:29:58.036474 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.036035    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl" podUID="64dce8df-08f1-4721-ac5e-876e59d199fe" containerName="payload-processing" containerID="cri-o://cfb15997d23af21a392bfe67dd5f3b0e938a260e476f78977137b791ff5d7d14" gracePeriod=30
Sep 11 01:29:58.042241 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.042209    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc"]
Sep 11 01:29:58.042442 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.042414    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc" podUID="d23baab9-94e8-46f0-a886-af91eade7dc6" containerName="payload-pre-processing" containerID="cri-o://e69874283ead803d8a6dcd29d3822779aac2273225e2592a8b03ce2c8f797214" gracePeriod=30
Sep 11 01:29:58.321289 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.321264    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl"
Sep 11 01:29:58.325087 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.325062    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc"
Sep 11 01:29:58.345266 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.345235    2565 generic.go:356] "Generic (PLEG): container finished" podID="64dce8df-08f1-4721-ac5e-876e59d199fe" containerID="cfb15997d23af21a392bfe67dd5f3b0e938a260e476f78977137b791ff5d7d14" exitCode=0
Sep 11 01:29:58.345448 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.345278    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl"
Sep 11 01:29:58.345448 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.345325    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl" event={"ID":"64dce8df-08f1-4721-ac5e-876e59d199fe","Type":"ContainerDied","Data":"cfb15997d23af21a392bfe67dd5f3b0e938a260e476f78977137b791ff5d7d14"}
Sep 11 01:29:58.345448 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.345425    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl" event={"ID":"64dce8df-08f1-4721-ac5e-876e59d199fe","Type":"ContainerDied","Data":"061a3a30d52668fa196ab3442d6e3b2954d38db6fa9130b9ca4176fefa195492"}
Sep 11 01:29:58.345635 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.345449    2565 scope.go:117] "RemoveContainer" containerID="cfb15997d23af21a392bfe67dd5f3b0e938a260e476f78977137b791ff5d7d14"
Sep 11 01:29:58.346929 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.346907    2565 generic.go:356] "Generic (PLEG): container finished" podID="d23baab9-94e8-46f0-a886-af91eade7dc6" containerID="e69874283ead803d8a6dcd29d3822779aac2273225e2592a8b03ce2c8f797214" exitCode=0
Sep 11 01:29:58.347042 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.346957    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc"
Sep 11 01:29:58.347042 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.347003    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc" event={"ID":"d23baab9-94e8-46f0-a886-af91eade7dc6","Type":"ContainerDied","Data":"e69874283ead803d8a6dcd29d3822779aac2273225e2592a8b03ce2c8f797214"}
Sep 11 01:29:58.347042 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.347040    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc" event={"ID":"d23baab9-94e8-46f0-a886-af91eade7dc6","Type":"ContainerDied","Data":"22ad5f5f6001807a0bd99b2a3e18e74ded545d5498c9587d877e1aaa100efee3"}
Sep 11 01:29:58.355738 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.355717    2565 scope.go:117] "RemoveContainer" containerID="cfb15997d23af21a392bfe67dd5f3b0e938a260e476f78977137b791ff5d7d14"
Sep 11 01:29:58.356397 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:29:58.356344    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfb15997d23af21a392bfe67dd5f3b0e938a260e476f78977137b791ff5d7d14\": container with ID starting with cfb15997d23af21a392bfe67dd5f3b0e938a260e476f78977137b791ff5d7d14 not found: ID does not exist" containerID="cfb15997d23af21a392bfe67dd5f3b0e938a260e476f78977137b791ff5d7d14"
Sep 11 01:29:58.356511 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.356426    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfb15997d23af21a392bfe67dd5f3b0e938a260e476f78977137b791ff5d7d14"} err="failed to get container status \"cfb15997d23af21a392bfe67dd5f3b0e938a260e476f78977137b791ff5d7d14\": rpc error: code = NotFound desc = could not find container \"cfb15997d23af21a392bfe67dd5f3b0e938a260e476f78977137b791ff5d7d14\": container with ID starting with cfb15997d23af21a392bfe67dd5f3b0e938a260e476f78977137b791ff5d7d14 not found: ID does not exist"
Sep 11 01:29:58.356511 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.356457    2565 scope.go:117] "RemoveContainer" containerID="e69874283ead803d8a6dcd29d3822779aac2273225e2592a8b03ce2c8f797214"
Sep 11 01:29:58.371834 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.371323    2565 scope.go:117] "RemoveContainer" containerID="e69874283ead803d8a6dcd29d3822779aac2273225e2592a8b03ce2c8f797214"
Sep 11 01:29:58.371834 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:29:58.371773    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e69874283ead803d8a6dcd29d3822779aac2273225e2592a8b03ce2c8f797214\": container with ID starting with e69874283ead803d8a6dcd29d3822779aac2273225e2592a8b03ce2c8f797214 not found: ID does not exist" containerID="e69874283ead803d8a6dcd29d3822779aac2273225e2592a8b03ce2c8f797214"
Sep 11 01:29:58.372115 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.372079    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e69874283ead803d8a6dcd29d3822779aac2273225e2592a8b03ce2c8f797214"} err="failed to get container status \"e69874283ead803d8a6dcd29d3822779aac2273225e2592a8b03ce2c8f797214\": rpc error: code = NotFound desc = could not find container \"e69874283ead803d8a6dcd29d3822779aac2273225e2592a8b03ce2c8f797214\": container with ID starting with e69874283ead803d8a6dcd29d3822779aac2273225e2592a8b03ce2c8f797214 not found: ID does not exist"
Sep 11 01:29:58.397191 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.397156    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcmhn\" (UniqueName: \"kubernetes.io/projected/64dce8df-08f1-4721-ac5e-876e59d199fe-kube-api-access-vcmhn\") pod \"64dce8df-08f1-4721-ac5e-876e59d199fe\" (UID: \"64dce8df-08f1-4721-ac5e-876e59d199fe\") "
Sep 11 01:29:58.397191 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.397209    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64dce8df-08f1-4721-ac5e-876e59d199fe-plugins-config-volume\") pod \"64dce8df-08f1-4721-ac5e-876e59d199fe\" (UID: \"64dce8df-08f1-4721-ac5e-876e59d199fe\") "
Sep 11 01:29:58.397468 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.397240    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d23baab9-94e8-46f0-a886-af91eade7dc6-plugins-config-volume\") pod \"d23baab9-94e8-46f0-a886-af91eade7dc6\" (UID: \"d23baab9-94e8-46f0-a886-af91eade7dc6\") "
Sep 11 01:29:58.397468 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.397363    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drkg6\" (UniqueName: \"kubernetes.io/projected/d23baab9-94e8-46f0-a886-af91eade7dc6-kube-api-access-drkg6\") pod \"d23baab9-94e8-46f0-a886-af91eade7dc6\" (UID: \"d23baab9-94e8-46f0-a886-af91eade7dc6\") "
Sep 11 01:29:58.397633 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.397603    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64dce8df-08f1-4721-ac5e-876e59d199fe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "64dce8df-08f1-4721-ac5e-876e59d199fe" (UID: "64dce8df-08f1-4721-ac5e-876e59d199fe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:29:58.397982 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.397941    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d23baab9-94e8-46f0-a886-af91eade7dc6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d23baab9-94e8-46f0-a886-af91eade7dc6" (UID: "d23baab9-94e8-46f0-a886-af91eade7dc6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:29:58.400921 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.400863    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64dce8df-08f1-4721-ac5e-876e59d199fe-kube-api-access-vcmhn" (OuterVolumeSpecName: "kube-api-access-vcmhn") pod "64dce8df-08f1-4721-ac5e-876e59d199fe" (UID: "64dce8df-08f1-4721-ac5e-876e59d199fe"). InnerVolumeSpecName "kube-api-access-vcmhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:29:58.401045 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.400965    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d23baab9-94e8-46f0-a886-af91eade7dc6-kube-api-access-drkg6" (OuterVolumeSpecName: "kube-api-access-drkg6") pod "d23baab9-94e8-46f0-a886-af91eade7dc6" (UID: "d23baab9-94e8-46f0-a886-af91eade7dc6"). InnerVolumeSpecName "kube-api-access-drkg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:29:58.499049 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.499011    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drkg6\" (UniqueName: \"kubernetes.io/projected/d23baab9-94e8-46f0-a886-af91eade7dc6-kube-api-access-drkg6\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:29:58.499049 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.499042    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcmhn\" (UniqueName: \"kubernetes.io/projected/64dce8df-08f1-4721-ac5e-876e59d199fe-kube-api-access-vcmhn\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:29:58.499049 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.499052    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64dce8df-08f1-4721-ac5e-876e59d199fe-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:29:58.499289 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.499062    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d23baab9-94e8-46f0-a886-af91eade7dc6-plugins-config-volume\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:29:58.670099 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.670074    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl"]
Sep 11 01:29:58.673397 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.673374    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-976998-758f86d9c-c6lsl"]
Sep 11 01:29:58.683810 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.683775    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc"]
Sep 11 01:29:58.685822 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:58.685791    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-976998-fd6c96c5d-r9btc"]
Sep 11 01:29:59.472092 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:59.472058    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64dce8df-08f1-4721-ac5e-876e59d199fe" path="/var/lib/kubelet/pods/64dce8df-08f1-4721-ac5e-876e59d199fe/volumes"
Sep 11 01:29:59.472494 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:29:59.472478    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d23baab9-94e8-46f0-a886-af91eade7dc6" path="/var/lib/kubelet/pods/d23baab9-94e8-46f0-a886-af91eade7dc6/volumes"
Sep 11 01:30:00.156527 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:00.156491    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818170-l95vl"]
Sep 11 01:30:00.156870 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:00.156858    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64dce8df-08f1-4721-ac5e-876e59d199fe" containerName="payload-processing"
Sep 11 01:30:00.156921 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:00.156872    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="64dce8df-08f1-4721-ac5e-876e59d199fe" containerName="payload-processing"
Sep 11 01:30:00.156921 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:00.156884    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f6c2230-e67f-4085-89c8-c496373ec8a7" containerName="payload-processing"
Sep 11 01:30:00.156921 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:00.156890    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f6c2230-e67f-4085-89c8-c496373ec8a7" containerName="payload-processing"
Sep 11 01:30:00.156921 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:00.156908    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d23baab9-94e8-46f0-a886-af91eade7dc6" containerName="payload-pre-processing"
Sep 11 01:30:00.156921 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:00.156914    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d23baab9-94e8-46f0-a886-af91eade7dc6" containerName="payload-pre-processing"
Sep 11 01:30:00.156921 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:00.156921    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5076697a-5edb-4b15-843f-052317c737ca" containerName="payload-pre-processing"
Sep 11 01:30:00.157104 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:00.156926    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5076697a-5edb-4b15-843f-052317c737ca" containerName="payload-pre-processing"
Sep 11 01:30:00.157104 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:00.156981    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d23baab9-94e8-46f0-a886-af91eade7dc6" containerName="payload-pre-processing"
Sep 11 01:30:00.157104 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:00.156991    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f6c2230-e67f-4085-89c8-c496373ec8a7" containerName="payload-processing"
Sep 11 01:30:00.157104 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:00.156997    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5076697a-5edb-4b15-843f-052317c737ca" containerName="payload-pre-processing"
Sep 11 01:30:00.157104 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:00.157004    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="64dce8df-08f1-4721-ac5e-876e59d199fe" containerName="payload-processing"
Sep 11 01:30:00.160253 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:00.160230    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818170-l95vl"
Sep 11 01:30:00.164224 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:00.164201    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pppkt\""
Sep 11 01:30:00.170776 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:00.170757    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818170-l95vl"
Sep 11 01:30:00.182543 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:00.182452    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818170-l95vl"]
Sep 11 01:30:00.460339 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:00.460315    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818170-l95vl"]
Sep 11 01:30:00.461973 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:30:00.461950    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice/crio-9b913e330b00bcb765ddbd193da6e058da273347451b7e35104d00ff0ed099c9 WatchSource:0}: Error finding container 9b913e330b00bcb765ddbd193da6e058da273347451b7e35104d00ff0ed099c9: Status 404 returned error can't find the container with id 9b913e330b00bcb765ddbd193da6e058da273347451b7e35104d00ff0ed099c9
Sep 11 01:30:01.373752 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:01.373711    2565 generic.go:356] "Generic (PLEG): container finished" podID="a092fb9e-17dd-45a4-80e3-6fc617eff9bf" containerID="d08929e44a37a8abc944f77882125e59ff5e006d46a9166ebc060a9471321b98" exitCode=0
Sep 11 01:30:01.374235 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:01.373761    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818170-l95vl" event={"ID":"a092fb9e-17dd-45a4-80e3-6fc617eff9bf","Type":"ContainerDied","Data":"d08929e44a37a8abc944f77882125e59ff5e006d46a9166ebc060a9471321b98"}
Sep 11 01:30:01.374235 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:01.373872    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818170-l95vl" event={"ID":"a092fb9e-17dd-45a4-80e3-6fc617eff9bf","Type":"ContainerStarted","Data":"9b913e330b00bcb765ddbd193da6e058da273347451b7e35104d00ff0ed099c9"}
Sep 11 01:30:02.507428 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:02.507404    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818170-l95vl"
Sep 11 01:30:03.386011 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:03.385979    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818170-l95vl"
Sep 11 01:30:03.386267 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:03.386021    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818170-l95vl" event={"ID":"a092fb9e-17dd-45a4-80e3-6fc617eff9bf","Type":"ContainerDied","Data":"9b913e330b00bcb765ddbd193da6e058da273347451b7e35104d00ff0ed099c9"}
Sep 11 01:30:03.386267 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:03.386069    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b913e330b00bcb765ddbd193da6e058da273347451b7e35104d00ff0ed099c9"
Sep 11 01:30:09.265006 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:30:09.264968    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice/crio-9b913e330b00bcb765ddbd193da6e058da273347451b7e35104d00ff0ed099c9\": RecentStats: unable to find data in memory cache]"
Sep 11 01:30:14.386016 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:30:14.385973    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice/crio-9b913e330b00bcb765ddbd193da6e058da273347451b7e35104d00ff0ed099c9\": RecentStats: unable to find data in memory cache]"
Sep 11 01:30:19.274532 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:30:19.274494    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice/crio-9b913e330b00bcb765ddbd193da6e058da273347451b7e35104d00ff0ed099c9\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice\": RecentStats: unable to find data in memory cache]"
Sep 11 01:30:29.319789 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:30:29.319750    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice/crio-9b913e330b00bcb765ddbd193da6e058da273347451b7e35104d00ff0ed099c9\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice\": RecentStats: unable to find data in memory cache]"
Sep 11 01:30:29.375087 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:30:29.368137    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice/crio-9b913e330b00bcb765ddbd193da6e058da273347451b7e35104d00ff0ed099c9\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice\": RecentStats: unable to find data in memory cache]"
Sep 11 01:30:39.365141 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:30:39.365106    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice/crio-9b913e330b00bcb765ddbd193da6e058da273347451b7e35104d00ff0ed099c9\": RecentStats: unable to find data in memory cache]"
Sep 11 01:30:44.372909 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:30:44.372872    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice/crio-9b913e330b00bcb765ddbd193da6e058da273347451b7e35104d00ff0ed099c9\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice\": RecentStats: unable to find data in memory cache]"
Sep 11 01:30:46.049278 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:30:46.049240    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice/crio-9b913e330b00bcb765ddbd193da6e058da273347451b7e35104d00ff0ed099c9\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice\": RecentStats: unable to find data in memory cache]"
Sep 11 01:30:46.049718 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:30:46.049295    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice/crio-9b913e330b00bcb765ddbd193da6e058da273347451b7e35104d00ff0ed099c9\": RecentStats: unable to find data in memory cache]"
Sep 11 01:30:46.572256 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:46.572221    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"]
Sep 11 01:30:46.572477 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:46.572455    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm" podUID="668bded3-69fa-4298-8cff-eac9b149517e" containerName="istio-proxy" containerID="cri-o://7f77685a8e43c2b5dc696e953edd9655fe503d86c03f3ab999a38a09528cc474" gracePeriod=30
Sep 11 01:30:47.765740 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:47.765701    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 01:30:47.766148 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:47.765767    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm" podUID="668bded3-69fa-4298-8cff-eac9b149517e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 01:30:49.402280 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:30:49.402241    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice/crio-9b913e330b00bcb765ddbd193da6e058da273347451b7e35104d00ff0ed099c9\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice\": RecentStats: unable to find data in memory cache]"
Sep 11 01:30:51.824022 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:51.823994    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:30:51.999553 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:51.999466    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-credential-socket\") pod \"668bded3-69fa-4298-8cff-eac9b149517e\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") "
Sep 11 01:30:51.999553 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:51.999515    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-istio-data\") pod \"668bded3-69fa-4298-8cff-eac9b149517e\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") "
Sep 11 01:30:51.999553 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:51.999540    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/668bded3-69fa-4298-8cff-eac9b149517e-istio-podinfo\") pod \"668bded3-69fa-4298-8cff-eac9b149517e\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") "
Sep 11 01:30:51.999860 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:51.999589    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/668bded3-69fa-4298-8cff-eac9b149517e-istio-token\") pod \"668bded3-69fa-4298-8cff-eac9b149517e\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") "
Sep 11 01:30:51.999860 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:51.999617    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-workload-certs\") pod \"668bded3-69fa-4298-8cff-eac9b149517e\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") "
Sep 11 01:30:51.999860 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:51.999645    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-istio-envoy\") pod \"668bded3-69fa-4298-8cff-eac9b149517e\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") "
Sep 11 01:30:51.999860 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:51.999728    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-workload-socket\") pod \"668bded3-69fa-4298-8cff-eac9b149517e\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") "
Sep 11 01:30:51.999860 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:51.999766    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/668bded3-69fa-4298-8cff-eac9b149517e-istiod-ca-cert\") pod \"668bded3-69fa-4298-8cff-eac9b149517e\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") "
Sep 11 01:30:51.999860 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:51.999790    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mb2n\" (UniqueName: \"kubernetes.io/projected/668bded3-69fa-4298-8cff-eac9b149517e-kube-api-access-7mb2n\") pod \"668bded3-69fa-4298-8cff-eac9b149517e\" (UID: \"668bded3-69fa-4298-8cff-eac9b149517e\") "
Sep 11 01:30:51.999860 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:51.999830    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "668bded3-69fa-4298-8cff-eac9b149517e" (UID: "668bded3-69fa-4298-8cff-eac9b149517e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:30:52.000215 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.000056    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "668bded3-69fa-4298-8cff-eac9b149517e" (UID: "668bded3-69fa-4298-8cff-eac9b149517e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:30:52.000215 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.000045    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "668bded3-69fa-4298-8cff-eac9b149517e" (UID: "668bded3-69fa-4298-8cff-eac9b149517e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:30:52.000215 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.000129    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-istio-data" (OuterVolumeSpecName: "istio-data") pod "668bded3-69fa-4298-8cff-eac9b149517e" (UID: "668bded3-69fa-4298-8cff-eac9b149517e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:30:52.000215 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.000203    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-workload-certs\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:30:52.000215 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.000209    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/668bded3-69fa-4298-8cff-eac9b149517e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "668bded3-69fa-4298-8cff-eac9b149517e" (UID: "668bded3-69fa-4298-8cff-eac9b149517e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:30:52.000475 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.000217    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-workload-socket\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:30:52.000475 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.000251    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-credential-socket\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:30:52.001954 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.001928    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "668bded3-69fa-4298-8cff-eac9b149517e" (UID: "668bded3-69fa-4298-8cff-eac9b149517e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:30:52.002061 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.001981    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/668bded3-69fa-4298-8cff-eac9b149517e-istio-token" (OuterVolumeSpecName: "istio-token") pod "668bded3-69fa-4298-8cff-eac9b149517e" (UID: "668bded3-69fa-4298-8cff-eac9b149517e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:30:52.002061 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.002019    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/668bded3-69fa-4298-8cff-eac9b149517e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "668bded3-69fa-4298-8cff-eac9b149517e" (UID: "668bded3-69fa-4298-8cff-eac9b149517e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 01:30:52.002137 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.002064    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/668bded3-69fa-4298-8cff-eac9b149517e-kube-api-access-7mb2n" (OuterVolumeSpecName: "kube-api-access-7mb2n") pod "668bded3-69fa-4298-8cff-eac9b149517e" (UID: "668bded3-69fa-4298-8cff-eac9b149517e"). InnerVolumeSpecName "kube-api-access-7mb2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:30:52.101337 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.101300    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-istio-data\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:30:52.101337 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.101331    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/668bded3-69fa-4298-8cff-eac9b149517e-istio-podinfo\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:30:52.101337 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.101341    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/668bded3-69fa-4298-8cff-eac9b149517e-istio-token\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:30:52.101553 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.101348    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/668bded3-69fa-4298-8cff-eac9b149517e-istio-envoy\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:30:52.101553 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.101356    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/668bded3-69fa-4298-8cff-eac9b149517e-istiod-ca-cert\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:30:52.101553 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.101364    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mb2n\" (UniqueName: \"kubernetes.io/projected/668bded3-69fa-4298-8cff-eac9b149517e-kube-api-access-7mb2n\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:30:52.652520 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.652485    2565 generic.go:356] "Generic (PLEG): container finished" podID="668bded3-69fa-4298-8cff-eac9b149517e" containerID="7f77685a8e43c2b5dc696e953edd9655fe503d86c03f3ab999a38a09528cc474" exitCode=0
Sep 11 01:30:52.652719 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.652539    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"
Sep 11 01:30:52.652719 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.652560    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm" event={"ID":"668bded3-69fa-4298-8cff-eac9b149517e","Type":"ContainerDied","Data":"7f77685a8e43c2b5dc696e953edd9655fe503d86c03f3ab999a38a09528cc474"}
Sep 11 01:30:52.652719 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.652613    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm" event={"ID":"668bded3-69fa-4298-8cff-eac9b149517e","Type":"ContainerDied","Data":"23ac9720392dca3c55a7587aa085de7f95d0c1756e8dead4c22470539511952b"}
Sep 11 01:30:52.652719 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.652634    2565 scope.go:117] "RemoveContainer" containerID="7f77685a8e43c2b5dc696e953edd9655fe503d86c03f3ab999a38a09528cc474"
Sep 11 01:30:52.662683 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.662665    2565 scope.go:117] "RemoveContainer" containerID="6e2d7653ab3b4e99cb1cb17dd1ee11a346a10b05d2e6a888ae1f029d1628db00"
Sep 11 01:30:52.676789 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.676765    2565 scope.go:117] "RemoveContainer" containerID="7f77685a8e43c2b5dc696e953edd9655fe503d86c03f3ab999a38a09528cc474"
Sep 11 01:30:52.676789 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.676780    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"]
Sep 11 01:30:52.677101 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:30:52.677081    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f77685a8e43c2b5dc696e953edd9655fe503d86c03f3ab999a38a09528cc474\": container with ID starting with 7f77685a8e43c2b5dc696e953edd9655fe503d86c03f3ab999a38a09528cc474 not found: ID does not exist" containerID="7f77685a8e43c2b5dc696e953edd9655fe503d86c03f3ab999a38a09528cc474"
Sep 11 01:30:52.677165 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.677108    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f77685a8e43c2b5dc696e953edd9655fe503d86c03f3ab999a38a09528cc474"} err="failed to get container status \"7f77685a8e43c2b5dc696e953edd9655fe503d86c03f3ab999a38a09528cc474\": rpc error: code = NotFound desc = could not find container \"7f77685a8e43c2b5dc696e953edd9655fe503d86c03f3ab999a38a09528cc474\": container with ID starting with 7f77685a8e43c2b5dc696e953edd9655fe503d86c03f3ab999a38a09528cc474 not found: ID does not exist"
Sep 11 01:30:52.677165 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.677124    2565 scope.go:117] "RemoveContainer" containerID="6e2d7653ab3b4e99cb1cb17dd1ee11a346a10b05d2e6a888ae1f029d1628db00"
Sep 11 01:30:52.677527 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:30:52.677500    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e2d7653ab3b4e99cb1cb17dd1ee11a346a10b05d2e6a888ae1f029d1628db00\": container with ID starting with 6e2d7653ab3b4e99cb1cb17dd1ee11a346a10b05d2e6a888ae1f029d1628db00 not found: ID does not exist" containerID="6e2d7653ab3b4e99cb1cb17dd1ee11a346a10b05d2e6a888ae1f029d1628db00"
Sep 11 01:30:52.677853 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.677658    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e2d7653ab3b4e99cb1cb17dd1ee11a346a10b05d2e6a888ae1f029d1628db00"} err="failed to get container status \"6e2d7653ab3b4e99cb1cb17dd1ee11a346a10b05d2e6a888ae1f029d1628db00\": rpc error: code = NotFound desc = could not find container \"6e2d7653ab3b4e99cb1cb17dd1ee11a346a10b05d2e6a888ae1f029d1628db00\": container with ID starting with 6e2d7653ab3b4e99cb1cb17dd1ee11a346a10b05d2e6a888ae1f029d1628db00 not found: ID does not exist"
Sep 11 01:30:52.680338 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:52.680318    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-976998-openshift-default-c8888dc98-lw4rm"]
Sep 11 01:30:53.471462 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:30:53.471426    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="668bded3-69fa-4298-8cff-eac9b149517e" path="/var/lib/kubelet/pods/668bded3-69fa-4298-8cff-eac9b149517e/volumes"
Sep 11 01:30:59.387426 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:30:59.387347    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice/crio-9b913e330b00bcb765ddbd193da6e058da273347451b7e35104d00ff0ed099c9\": RecentStats: unable to find data in memory cache]"
Sep 11 01:30:59.412062 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:30:59.412031    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice/crio-9b913e330b00bcb765ddbd193da6e058da273347451b7e35104d00ff0ed099c9\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda092fb9e_17dd_45a4_80e3_6fc617eff9bf.slice\": RecentStats: unable to find data in memory cache]"
Sep 11 01:31:04.071587 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:04.071552    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"]
Sep 11 01:31:04.072084 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:04.071768    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2" podUID="295c6e97-f932-40af-9e5f-1d234ff6bc22" containerName="istio-proxy" containerID="cri-o://2855cc4248b4e9255f95a623d8fd64e42d97ee696fc739f70bec7d10f1f9b44b" gracePeriod=30
Sep 11 01:31:09.320069 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.320043    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:31:09.350804 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.350709    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-token\") pod \"295c6e97-f932-40af-9e5f-1d234ff6bc22\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") "
Sep 11 01:31:09.350804 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.350759    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-envoy\") pod \"295c6e97-f932-40af-9e5f-1d234ff6bc22\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") "
Sep 11 01:31:09.350804 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.350796    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-data\") pod \"295c6e97-f932-40af-9e5f-1d234ff6bc22\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") "
Sep 11 01:31:09.351182 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.350850    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-podinfo\") pod \"295c6e97-f932-40af-9e5f-1d234ff6bc22\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") "
Sep 11 01:31:09.351182 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.350917    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/295c6e97-f932-40af-9e5f-1d234ff6bc22-istiod-ca-cert\") pod \"295c6e97-f932-40af-9e5f-1d234ff6bc22\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") "
Sep 11 01:31:09.351182 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.350945    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-credential-socket\") pod \"295c6e97-f932-40af-9e5f-1d234ff6bc22\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") "
Sep 11 01:31:09.351182 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.350978    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xss48\" (UniqueName: \"kubernetes.io/projected/295c6e97-f932-40af-9e5f-1d234ff6bc22-kube-api-access-xss48\") pod \"295c6e97-f932-40af-9e5f-1d234ff6bc22\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") "
Sep 11 01:31:09.351182 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.351019    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-workload-certs\") pod \"295c6e97-f932-40af-9e5f-1d234ff6bc22\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") "
Sep 11 01:31:09.351182 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.351044    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-workload-socket\") pod \"295c6e97-f932-40af-9e5f-1d234ff6bc22\" (UID: \"295c6e97-f932-40af-9e5f-1d234ff6bc22\") "
Sep 11 01:31:09.351858 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.351497    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "295c6e97-f932-40af-9e5f-1d234ff6bc22" (UID: "295c6e97-f932-40af-9e5f-1d234ff6bc22"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:31:09.351858 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.351574    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "295c6e97-f932-40af-9e5f-1d234ff6bc22" (UID: "295c6e97-f932-40af-9e5f-1d234ff6bc22"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:31:09.351858 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.351620    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "295c6e97-f932-40af-9e5f-1d234ff6bc22" (UID: "295c6e97-f932-40af-9e5f-1d234ff6bc22"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:31:09.352096 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.351957    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/295c6e97-f932-40af-9e5f-1d234ff6bc22-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "295c6e97-f932-40af-9e5f-1d234ff6bc22" (UID: "295c6e97-f932-40af-9e5f-1d234ff6bc22"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:31:09.352096 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.352020    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-data" (OuterVolumeSpecName: "istio-data") pod "295c6e97-f932-40af-9e5f-1d234ff6bc22" (UID: "295c6e97-f932-40af-9e5f-1d234ff6bc22"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:31:09.354218 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.354163    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "295c6e97-f932-40af-9e5f-1d234ff6bc22" (UID: "295c6e97-f932-40af-9e5f-1d234ff6bc22"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 01:31:09.354331 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.354215    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-token" (OuterVolumeSpecName: "istio-token") pod "295c6e97-f932-40af-9e5f-1d234ff6bc22" (UID: "295c6e97-f932-40af-9e5f-1d234ff6bc22"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:31:09.354331 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.354280    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "295c6e97-f932-40af-9e5f-1d234ff6bc22" (UID: "295c6e97-f932-40af-9e5f-1d234ff6bc22"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:31:09.356012 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.355984    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/295c6e97-f932-40af-9e5f-1d234ff6bc22-kube-api-access-xss48" (OuterVolumeSpecName: "kube-api-access-xss48") pod "295c6e97-f932-40af-9e5f-1d234ff6bc22" (UID: "295c6e97-f932-40af-9e5f-1d234ff6bc22"). InnerVolumeSpecName "kube-api-access-xss48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:31:09.452362 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.452330    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/295c6e97-f932-40af-9e5f-1d234ff6bc22-istiod-ca-cert\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:09.452362 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.452357    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-credential-socket\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:09.452362 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.452367    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xss48\" (UniqueName: \"kubernetes.io/projected/295c6e97-f932-40af-9e5f-1d234ff6bc22-kube-api-access-xss48\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:09.452600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.452376    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-workload-certs\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:09.452600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.452385    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-workload-socket\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:09.452600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.452393    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-token\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:09.452600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.452401    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-envoy\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:09.452600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.452409    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-data\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:09.452600 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.452416    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/295c6e97-f932-40af-9e5f-1d234ff6bc22-istio-podinfo\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:09.746313 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.746226    2565 generic.go:356] "Generic (PLEG): container finished" podID="295c6e97-f932-40af-9e5f-1d234ff6bc22" containerID="2855cc4248b4e9255f95a623d8fd64e42d97ee696fc739f70bec7d10f1f9b44b" exitCode=0
Sep 11 01:31:09.746313 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.746281    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"
Sep 11 01:31:09.746487 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.746315    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2" event={"ID":"295c6e97-f932-40af-9e5f-1d234ff6bc22","Type":"ContainerDied","Data":"2855cc4248b4e9255f95a623d8fd64e42d97ee696fc739f70bec7d10f1f9b44b"}
Sep 11 01:31:09.746487 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.746361    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2" event={"ID":"295c6e97-f932-40af-9e5f-1d234ff6bc22","Type":"ContainerDied","Data":"f1986bcaddddf091bd304fc5d49449a2540238dc999b80fa1b3c4873fb8b4140"}
Sep 11 01:31:09.746487 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.746383    2565 scope.go:117] "RemoveContainer" containerID="2855cc4248b4e9255f95a623d8fd64e42d97ee696fc739f70bec7d10f1f9b44b"
Sep 11 01:31:09.755295 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.755270    2565 scope.go:117] "RemoveContainer" containerID="05a944400a99c4f637405f5413e302cd233bf686f1417bf69b974c655fa886fc"
Sep 11 01:31:09.765176 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.765114    2565 scope.go:117] "RemoveContainer" containerID="2855cc4248b4e9255f95a623d8fd64e42d97ee696fc739f70bec7d10f1f9b44b"
Sep 11 01:31:09.765484 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:31:09.765459    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2855cc4248b4e9255f95a623d8fd64e42d97ee696fc739f70bec7d10f1f9b44b\": container with ID starting with 2855cc4248b4e9255f95a623d8fd64e42d97ee696fc739f70bec7d10f1f9b44b not found: ID does not exist" containerID="2855cc4248b4e9255f95a623d8fd64e42d97ee696fc739f70bec7d10f1f9b44b"
Sep 11 01:31:09.765563 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.765498    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2855cc4248b4e9255f95a623d8fd64e42d97ee696fc739f70bec7d10f1f9b44b"} err="failed to get container status \"2855cc4248b4e9255f95a623d8fd64e42d97ee696fc739f70bec7d10f1f9b44b\": rpc error: code = NotFound desc = could not find container \"2855cc4248b4e9255f95a623d8fd64e42d97ee696fc739f70bec7d10f1f9b44b\": container with ID starting with 2855cc4248b4e9255f95a623d8fd64e42d97ee696fc739f70bec7d10f1f9b44b not found: ID does not exist"
Sep 11 01:31:09.765563 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.765526    2565 scope.go:117] "RemoveContainer" containerID="05a944400a99c4f637405f5413e302cd233bf686f1417bf69b974c655fa886fc"
Sep 11 01:31:09.765650 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.765558    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"]
Sep 11 01:31:09.765881 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:31:09.765802    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05a944400a99c4f637405f5413e302cd233bf686f1417bf69b974c655fa886fc\": container with ID starting with 05a944400a99c4f637405f5413e302cd233bf686f1417bf69b974c655fa886fc not found: ID does not exist" containerID="05a944400a99c4f637405f5413e302cd233bf686f1417bf69b974c655fa886fc"
Sep 11 01:31:09.765881 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.765852    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05a944400a99c4f637405f5413e302cd233bf686f1417bf69b974c655fa886fc"} err="failed to get container status \"05a944400a99c4f637405f5413e302cd233bf686f1417bf69b974c655fa886fc\": rpc error: code = NotFound desc = could not find container \"05a944400a99c4f637405f5413e302cd233bf686f1417bf69b974c655fa886fc\": container with ID starting with 05a944400a99c4f637405f5413e302cd233bf686f1417bf69b974c655fa886fc not found: ID does not exist"
Sep 11 01:31:09.767992 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:09.767973    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-bae8d3-openshift-default-6c47f765b6-tt4d2"]
Sep 11 01:31:11.471413 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:11.471378    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="295c6e97-f932-40af-9e5f-1d234ff6bc22" path="/var/lib/kubelet/pods/295c6e97-f932-40af-9e5f-1d234ff6bc22/volumes"
Sep 11 01:31:15.008869 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.008835    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"]
Sep 11 01:31:15.009409 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.009365    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz" podUID="53586bfd-bf0d-4cc5-b2f3-d5828d965f27" containerName="maas-api" containerID="cri-o://dd03fa18ce0df87736446bfee517bc00fbd2f3b2686d8079e588d757f7c38f4a" gracePeriod=30
Sep 11 01:31:15.254360 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.254337    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"
Sep 11 01:31:15.305542 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.305508    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-maas-api-tls\") pod \"53586bfd-bf0d-4cc5-b2f3-d5828d965f27\" (UID: \"53586bfd-bf0d-4cc5-b2f3-d5828d965f27\") "
Sep 11 01:31:15.305691 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.305584    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rvrt\" (UniqueName: \"kubernetes.io/projected/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-kube-api-access-8rvrt\") pod \"53586bfd-bf0d-4cc5-b2f3-d5828d965f27\" (UID: \"53586bfd-bf0d-4cc5-b2f3-d5828d965f27\") "
Sep 11 01:31:15.305691 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.305620    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-openshift-service-ca\") pod \"53586bfd-bf0d-4cc5-b2f3-d5828d965f27\" (UID: \"53586bfd-bf0d-4cc5-b2f3-d5828d965f27\") "
Sep 11 01:31:15.305691 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.305671    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-metrics-certs\") pod \"53586bfd-bf0d-4cc5-b2f3-d5828d965f27\" (UID: \"53586bfd-bf0d-4cc5-b2f3-d5828d965f27\") "
Sep 11 01:31:15.306076 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.306044    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "53586bfd-bf0d-4cc5-b2f3-d5828d965f27" (UID: "53586bfd-bf0d-4cc5-b2f3-d5828d965f27"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:31:15.307741 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.307716    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "53586bfd-bf0d-4cc5-b2f3-d5828d965f27" (UID: "53586bfd-bf0d-4cc5-b2f3-d5828d965f27"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:31:15.307868 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.307734    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "53586bfd-bf0d-4cc5-b2f3-d5828d965f27" (UID: "53586bfd-bf0d-4cc5-b2f3-d5828d965f27"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:31:15.307868 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.307783    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-kube-api-access-8rvrt" (OuterVolumeSpecName: "kube-api-access-8rvrt") pod "53586bfd-bf0d-4cc5-b2f3-d5828d965f27" (UID: "53586bfd-bf0d-4cc5-b2f3-d5828d965f27"). InnerVolumeSpecName "kube-api-access-8rvrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:31:15.407079 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.407023    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-maas-api-tls\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:15.407079 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.407059    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rvrt\" (UniqueName: \"kubernetes.io/projected/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-kube-api-access-8rvrt\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:15.407079 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.407074    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-openshift-service-ca\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:15.407402 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.407090    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53586bfd-bf0d-4cc5-b2f3-d5828d965f27-metrics-certs\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:15.781136 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.781047    2565 generic.go:356] "Generic (PLEG): container finished" podID="53586bfd-bf0d-4cc5-b2f3-d5828d965f27" containerID="dd03fa18ce0df87736446bfee517bc00fbd2f3b2686d8079e588d757f7c38f4a" exitCode=0
Sep 11 01:31:15.781136 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.781091    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"
Sep 11 01:31:15.781367 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.781143    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz" event={"ID":"53586bfd-bf0d-4cc5-b2f3-d5828d965f27","Type":"ContainerDied","Data":"dd03fa18ce0df87736446bfee517bc00fbd2f3b2686d8079e588d757f7c38f4a"}
Sep 11 01:31:15.781367 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.781203    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz" event={"ID":"53586bfd-bf0d-4cc5-b2f3-d5828d965f27","Type":"ContainerDied","Data":"33a2e0acb35f9fd6029aeb9961e5ee567382ef4d8dae1a97ee365904cac56730"}
Sep 11 01:31:15.781367 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.781234    2565 scope.go:117] "RemoveContainer" containerID="dd03fa18ce0df87736446bfee517bc00fbd2f3b2686d8079e588d757f7c38f4a"
Sep 11 01:31:15.789876 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.789854    2565 scope.go:117] "RemoveContainer" containerID="dd03fa18ce0df87736446bfee517bc00fbd2f3b2686d8079e588d757f7c38f4a"
Sep 11 01:31:15.790155 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:31:15.790135    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd03fa18ce0df87736446bfee517bc00fbd2f3b2686d8079e588d757f7c38f4a\": container with ID starting with dd03fa18ce0df87736446bfee517bc00fbd2f3b2686d8079e588d757f7c38f4a not found: ID does not exist" containerID="dd03fa18ce0df87736446bfee517bc00fbd2f3b2686d8079e588d757f7c38f4a"
Sep 11 01:31:15.790221 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.790163    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd03fa18ce0df87736446bfee517bc00fbd2f3b2686d8079e588d757f7c38f4a"} err="failed to get container status \"dd03fa18ce0df87736446bfee517bc00fbd2f3b2686d8079e588d757f7c38f4a\": rpc error: code = NotFound desc = could not find container \"dd03fa18ce0df87736446bfee517bc00fbd2f3b2686d8079e588d757f7c38f4a\": container with ID starting with dd03fa18ce0df87736446bfee517bc00fbd2f3b2686d8079e588d757f7c38f4a not found: ID does not exist"
Sep 11 01:31:15.798021 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.797996    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"]
Sep 11 01:31:15.802000 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:15.801982    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2482ac-894cbcc6-hq4dz"]
Sep 11 01:31:17.471430 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:17.471395    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53586bfd-bf0d-4cc5-b2f3-d5828d965f27" path="/var/lib/kubelet/pods/53586bfd-bf0d-4cc5-b2f3-d5828d965f27/volumes"
Sep 11 01:31:32.491638 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.491602    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"]
Sep 11 01:31:32.492142 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.491921    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g" podUID="720e7f30-8240-4f52-9329-715f8d2d313f" containerName="maas-api" containerID="cri-o://5f344afacac7a2b000570391a50d2ea952952b0d7c4125cf39a3fc7bc94f2bb3" gracePeriod=30
Sep 11 01:31:32.735616 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.735592    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"
Sep 11 01:31:32.860660 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.860631    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/720e7f30-8240-4f52-9329-715f8d2d313f-openshift-service-ca\") pod \"720e7f30-8240-4f52-9329-715f8d2d313f\" (UID: \"720e7f30-8240-4f52-9329-715f8d2d313f\") "
Sep 11 01:31:32.860844 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.860676    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/720e7f30-8240-4f52-9329-715f8d2d313f-maas-api-tls\") pod \"720e7f30-8240-4f52-9329-715f8d2d313f\" (UID: \"720e7f30-8240-4f52-9329-715f8d2d313f\") "
Sep 11 01:31:32.860844 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.860710    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bgg6\" (UniqueName: \"kubernetes.io/projected/720e7f30-8240-4f52-9329-715f8d2d313f-kube-api-access-7bgg6\") pod \"720e7f30-8240-4f52-9329-715f8d2d313f\" (UID: \"720e7f30-8240-4f52-9329-715f8d2d313f\") "
Sep 11 01:31:32.860844 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.860758    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/720e7f30-8240-4f52-9329-715f8d2d313f-metrics-certs\") pod \"720e7f30-8240-4f52-9329-715f8d2d313f\" (UID: \"720e7f30-8240-4f52-9329-715f8d2d313f\") "
Sep 11 01:31:32.861079 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.861051    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/720e7f30-8240-4f52-9329-715f8d2d313f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "720e7f30-8240-4f52-9329-715f8d2d313f" (UID: "720e7f30-8240-4f52-9329-715f8d2d313f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:31:32.862882 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.862853    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/720e7f30-8240-4f52-9329-715f8d2d313f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "720e7f30-8240-4f52-9329-715f8d2d313f" (UID: "720e7f30-8240-4f52-9329-715f8d2d313f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:31:32.863026 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.862923    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/720e7f30-8240-4f52-9329-715f8d2d313f-kube-api-access-7bgg6" (OuterVolumeSpecName: "kube-api-access-7bgg6") pod "720e7f30-8240-4f52-9329-715f8d2d313f" (UID: "720e7f30-8240-4f52-9329-715f8d2d313f"). InnerVolumeSpecName "kube-api-access-7bgg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:31:32.863026 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.863011    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/720e7f30-8240-4f52-9329-715f8d2d313f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "720e7f30-8240-4f52-9329-715f8d2d313f" (UID: "720e7f30-8240-4f52-9329-715f8d2d313f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:31:32.877973 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.877938    2565 generic.go:356] "Generic (PLEG): container finished" podID="720e7f30-8240-4f52-9329-715f8d2d313f" containerID="5f344afacac7a2b000570391a50d2ea952952b0d7c4125cf39a3fc7bc94f2bb3" exitCode=0
Sep 11 01:31:32.878120 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.877997    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"
Sep 11 01:31:32.878185 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.878132    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g" event={"ID":"720e7f30-8240-4f52-9329-715f8d2d313f","Type":"ContainerDied","Data":"5f344afacac7a2b000570391a50d2ea952952b0d7c4125cf39a3fc7bc94f2bb3"}
Sep 11 01:31:32.878185 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.878180    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g" event={"ID":"720e7f30-8240-4f52-9329-715f8d2d313f","Type":"ContainerDied","Data":"e6f89583c9809c3905a830ece5cc2932ad490d150c95dd1c45242d57a71167d7"}
Sep 11 01:31:32.878293 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.878210    2565 scope.go:117] "RemoveContainer" containerID="5f344afacac7a2b000570391a50d2ea952952b0d7c4125cf39a3fc7bc94f2bb3"
Sep 11 01:31:32.890012 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.889807    2565 scope.go:117] "RemoveContainer" containerID="5f344afacac7a2b000570391a50d2ea952952b0d7c4125cf39a3fc7bc94f2bb3"
Sep 11 01:31:32.890206 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:31:32.890179    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f344afacac7a2b000570391a50d2ea952952b0d7c4125cf39a3fc7bc94f2bb3\": container with ID starting with 5f344afacac7a2b000570391a50d2ea952952b0d7c4125cf39a3fc7bc94f2bb3 not found: ID does not exist" containerID="5f344afacac7a2b000570391a50d2ea952952b0d7c4125cf39a3fc7bc94f2bb3"
Sep 11 01:31:32.890322 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.890217    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f344afacac7a2b000570391a50d2ea952952b0d7c4125cf39a3fc7bc94f2bb3"} err="failed to get container status \"5f344afacac7a2b000570391a50d2ea952952b0d7c4125cf39a3fc7bc94f2bb3\": rpc error: code = NotFound desc = could not find container \"5f344afacac7a2b000570391a50d2ea952952b0d7c4125cf39a3fc7bc94f2bb3\": container with ID starting with 5f344afacac7a2b000570391a50d2ea952952b0d7c4125cf39a3fc7bc94f2bb3 not found: ID does not exist"
Sep 11 01:31:32.905005 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.904970    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"]
Sep 11 01:31:32.909179 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.909153    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-9433b9-bb6c765c7-v765g"]
Sep 11 01:31:32.962085 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.962042    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/720e7f30-8240-4f52-9329-715f8d2d313f-metrics-certs\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:32.962085 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.962076    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/720e7f30-8240-4f52-9329-715f8d2d313f-openshift-service-ca\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:32.962085 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.962086    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/720e7f30-8240-4f52-9329-715f8d2d313f-maas-api-tls\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:32.962085 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:32.962094    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bgg6\" (UniqueName: \"kubernetes.io/projected/720e7f30-8240-4f52-9329-715f8d2d313f-kube-api-access-7bgg6\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:33.471988 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:33.471945    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="720e7f30-8240-4f52-9329-715f8d2d313f" path="/var/lib/kubelet/pods/720e7f30-8240-4f52-9329-715f8d2d313f/volumes"
Sep 11 01:31:39.229903 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:39.229865    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"]
Sep 11 01:31:39.230335 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:39.230158    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv" podUID="03574d19-749e-4bf1-8f24-0413e26c3a25" containerName="istio-proxy" containerID="cri-o://8d28467d599ec5b4d0423b56d7355d52c769fa479f097856305a5e65cb8b98ef" gracePeriod=30
Sep 11 01:31:44.475352 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.475326    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:31:44.568457 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.568423    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-workload-socket\") pod \"03574d19-749e-4bf1-8f24-0413e26c3a25\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") "
Sep 11 01:31:44.568457 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.568458    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-credential-socket\") pod \"03574d19-749e-4bf1-8f24-0413e26c3a25\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") "
Sep 11 01:31:44.568702 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.568499    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-podinfo\") pod \"03574d19-749e-4bf1-8f24-0413e26c3a25\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") "
Sep 11 01:31:44.568702 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.568532    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03574d19-749e-4bf1-8f24-0413e26c3a25-istiod-ca-cert\") pod \"03574d19-749e-4bf1-8f24-0413e26c3a25\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") "
Sep 11 01:31:44.568702 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.568609    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-data\") pod \"03574d19-749e-4bf1-8f24-0413e26c3a25\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") "
Sep 11 01:31:44.568702 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.568633    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-workload-certs\") pod \"03574d19-749e-4bf1-8f24-0413e26c3a25\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") "
Sep 11 01:31:44.568702 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.568667    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-token\") pod \"03574d19-749e-4bf1-8f24-0413e26c3a25\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") "
Sep 11 01:31:44.568702 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.568703    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm4l4\" (UniqueName: \"kubernetes.io/projected/03574d19-749e-4bf1-8f24-0413e26c3a25-kube-api-access-vm4l4\") pod \"03574d19-749e-4bf1-8f24-0413e26c3a25\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") "
Sep 11 01:31:44.569032 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.568728    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-envoy\") pod \"03574d19-749e-4bf1-8f24-0413e26c3a25\" (UID: \"03574d19-749e-4bf1-8f24-0413e26c3a25\") "
Sep 11 01:31:44.569032 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.568806    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "03574d19-749e-4bf1-8f24-0413e26c3a25" (UID: "03574d19-749e-4bf1-8f24-0413e26c3a25"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:31:44.569032 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.568853    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "03574d19-749e-4bf1-8f24-0413e26c3a25" (UID: "03574d19-749e-4bf1-8f24-0413e26c3a25"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:31:44.569032 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.568953    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-data" (OuterVolumeSpecName: "istio-data") pod "03574d19-749e-4bf1-8f24-0413e26c3a25" (UID: "03574d19-749e-4bf1-8f24-0413e26c3a25"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:31:44.569032 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.569024    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "03574d19-749e-4bf1-8f24-0413e26c3a25" (UID: "03574d19-749e-4bf1-8f24-0413e26c3a25"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:31:44.569305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.569129    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-data\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:44.569305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.569150    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-workload-certs\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:44.569305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.569165    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-workload-socket\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:44.569305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.569177    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-credential-socket\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:44.569305 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.569182    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03574d19-749e-4bf1-8f24-0413e26c3a25-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "03574d19-749e-4bf1-8f24-0413e26c3a25" (UID: "03574d19-749e-4bf1-8f24-0413e26c3a25"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:31:44.570883 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.570851    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "03574d19-749e-4bf1-8f24-0413e26c3a25" (UID: "03574d19-749e-4bf1-8f24-0413e26c3a25"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 01:31:44.571013 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.570982    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-token" (OuterVolumeSpecName: "istio-token") pod "03574d19-749e-4bf1-8f24-0413e26c3a25" (UID: "03574d19-749e-4bf1-8f24-0413e26c3a25"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:31:44.571013 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.571003    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03574d19-749e-4bf1-8f24-0413e26c3a25-kube-api-access-vm4l4" (OuterVolumeSpecName: "kube-api-access-vm4l4") pod "03574d19-749e-4bf1-8f24-0413e26c3a25" (UID: "03574d19-749e-4bf1-8f24-0413e26c3a25"). InnerVolumeSpecName "kube-api-access-vm4l4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:31:44.571129 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.571024    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "03574d19-749e-4bf1-8f24-0413e26c3a25" (UID: "03574d19-749e-4bf1-8f24-0413e26c3a25"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:31:44.669962 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.669922    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-token\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:44.669962 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.669955    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm4l4\" (UniqueName: \"kubernetes.io/projected/03574d19-749e-4bf1-8f24-0413e26c3a25-kube-api-access-vm4l4\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:44.669962 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.669965    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-envoy\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:44.669962 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.669974    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03574d19-749e-4bf1-8f24-0413e26c3a25-istio-podinfo\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:44.670232 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.669982    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03574d19-749e-4bf1-8f24-0413e26c3a25-istiod-ca-cert\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:31:44.942941 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.942840    2565 generic.go:356] "Generic (PLEG): container finished" podID="03574d19-749e-4bf1-8f24-0413e26c3a25" containerID="8d28467d599ec5b4d0423b56d7355d52c769fa479f097856305a5e65cb8b98ef" exitCode=0
Sep 11 01:31:44.942941 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.942888    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"
Sep 11 01:31:44.942941 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.942909    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv" event={"ID":"03574d19-749e-4bf1-8f24-0413e26c3a25","Type":"ContainerDied","Data":"8d28467d599ec5b4d0423b56d7355d52c769fa479f097856305a5e65cb8b98ef"}
Sep 11 01:31:44.943184 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.942974    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv" event={"ID":"03574d19-749e-4bf1-8f24-0413e26c3a25","Type":"ContainerDied","Data":"94b2f77cfbf30c2bcd2f72d1045873ada58db83a52a7dfdd3366be2f4814361c"}
Sep 11 01:31:44.943184 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.942998    2565 scope.go:117] "RemoveContainer" containerID="8d28467d599ec5b4d0423b56d7355d52c769fa479f097856305a5e65cb8b98ef"
Sep 11 01:31:44.952745 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.952726    2565 scope.go:117] "RemoveContainer" containerID="6a08b39b83e95decfd7a11b820845c6cb30bc128a5d29ba47deea5e372dbb2f2"
Sep 11 01:31:44.960846 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.960792    2565 scope.go:117] "RemoveContainer" containerID="8d28467d599ec5b4d0423b56d7355d52c769fa479f097856305a5e65cb8b98ef"
Sep 11 01:31:44.961111 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:31:44.961092    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d28467d599ec5b4d0423b56d7355d52c769fa479f097856305a5e65cb8b98ef\": container with ID starting with 8d28467d599ec5b4d0423b56d7355d52c769fa479f097856305a5e65cb8b98ef not found: ID does not exist" containerID="8d28467d599ec5b4d0423b56d7355d52c769fa479f097856305a5e65cb8b98ef"
Sep 11 01:31:44.961172 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.961119    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d28467d599ec5b4d0423b56d7355d52c769fa479f097856305a5e65cb8b98ef"} err="failed to get container status \"8d28467d599ec5b4d0423b56d7355d52c769fa479f097856305a5e65cb8b98ef\": rpc error: code = NotFound desc = could not find container \"8d28467d599ec5b4d0423b56d7355d52c769fa479f097856305a5e65cb8b98ef\": container with ID starting with 8d28467d599ec5b4d0423b56d7355d52c769fa479f097856305a5e65cb8b98ef not found: ID does not exist"
Sep 11 01:31:44.961172 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.961135    2565 scope.go:117] "RemoveContainer" containerID="6a08b39b83e95decfd7a11b820845c6cb30bc128a5d29ba47deea5e372dbb2f2"
Sep 11 01:31:44.961366 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:31:44.961349    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a08b39b83e95decfd7a11b820845c6cb30bc128a5d29ba47deea5e372dbb2f2\": container with ID starting with 6a08b39b83e95decfd7a11b820845c6cb30bc128a5d29ba47deea5e372dbb2f2 not found: ID does not exist" containerID="6a08b39b83e95decfd7a11b820845c6cb30bc128a5d29ba47deea5e372dbb2f2"
Sep 11 01:31:44.961407 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.961371    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a08b39b83e95decfd7a11b820845c6cb30bc128a5d29ba47deea5e372dbb2f2"} err="failed to get container status \"6a08b39b83e95decfd7a11b820845c6cb30bc128a5d29ba47deea5e372dbb2f2\": rpc error: code = NotFound desc = could not find container \"6a08b39b83e95decfd7a11b820845c6cb30bc128a5d29ba47deea5e372dbb2f2\": container with ID starting with 6a08b39b83e95decfd7a11b820845c6cb30bc128a5d29ba47deea5e372dbb2f2 not found: ID does not exist"
Sep 11 01:31:44.965730 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.965708    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"]
Sep 11 01:31:44.969402 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:44.969381    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-9433b9-openshift-default-5754d85b74-mvnvv"]
Sep 11 01:31:45.471903 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:31:45.471870    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03574d19-749e-4bf1-8f24-0413e26c3a25" path="/var/lib/kubelet/pods/03574d19-749e-4bf1-8f24-0413e26c3a25/volumes"
Sep 11 01:32:43.386464 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386424    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8f8d984c8-t7j69"]
Sep 11 01:32:43.386961 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386772    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="720e7f30-8240-4f52-9329-715f8d2d313f" containerName="maas-api"
Sep 11 01:32:43.386961 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386784    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="720e7f30-8240-4f52-9329-715f8d2d313f" containerName="maas-api"
Sep 11 01:32:43.386961 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386800    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03574d19-749e-4bf1-8f24-0413e26c3a25" containerName="istio-proxy"
Sep 11 01:32:43.386961 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386807    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="03574d19-749e-4bf1-8f24-0413e26c3a25" containerName="istio-proxy"
Sep 11 01:32:43.386961 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386829    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53586bfd-bf0d-4cc5-b2f3-d5828d965f27" containerName="maas-api"
Sep 11 01:32:43.386961 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386838    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="53586bfd-bf0d-4cc5-b2f3-d5828d965f27" containerName="maas-api"
Sep 11 01:32:43.386961 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386844    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03574d19-749e-4bf1-8f24-0413e26c3a25" containerName="istio-proxy"
Sep 11 01:32:43.386961 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386850    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="03574d19-749e-4bf1-8f24-0413e26c3a25" containerName="istio-proxy"
Sep 11 01:32:43.386961 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386859    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a092fb9e-17dd-45a4-80e3-6fc617eff9bf" containerName="cleanup"
Sep 11 01:32:43.386961 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386864    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a092fb9e-17dd-45a4-80e3-6fc617eff9bf" containerName="cleanup"
Sep 11 01:32:43.386961 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386872    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="668bded3-69fa-4298-8cff-eac9b149517e" containerName="istio-proxy"
Sep 11 01:32:43.386961 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386878    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="668bded3-69fa-4298-8cff-eac9b149517e" containerName="istio-proxy"
Sep 11 01:32:43.386961 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386886    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="295c6e97-f932-40af-9e5f-1d234ff6bc22" containerName="istio-proxy"
Sep 11 01:32:43.386961 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386891    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="295c6e97-f932-40af-9e5f-1d234ff6bc22" containerName="istio-proxy"
Sep 11 01:32:43.386961 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386898    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="668bded3-69fa-4298-8cff-eac9b149517e" containerName="istio-proxy"
Sep 11 01:32:43.386961 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386906    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="668bded3-69fa-4298-8cff-eac9b149517e" containerName="istio-proxy"
Sep 11 01:32:43.386961 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386916    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="295c6e97-f932-40af-9e5f-1d234ff6bc22" containerName="istio-proxy"
Sep 11 01:32:43.386961 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386922    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="295c6e97-f932-40af-9e5f-1d234ff6bc22" containerName="istio-proxy"
Sep 11 01:32:43.386961 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386975    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="720e7f30-8240-4f52-9329-715f8d2d313f" containerName="maas-api"
Sep 11 01:32:43.387610 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386989    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="668bded3-69fa-4298-8cff-eac9b149517e" containerName="istio-proxy"
Sep 11 01:32:43.387610 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.386997    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="295c6e97-f932-40af-9e5f-1d234ff6bc22" containerName="istio-proxy"
Sep 11 01:32:43.387610 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.387004    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="03574d19-749e-4bf1-8f24-0413e26c3a25" containerName="istio-proxy"
Sep 11 01:32:43.387610 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.387009    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="668bded3-69fa-4298-8cff-eac9b149517e" containerName="istio-proxy"
Sep 11 01:32:43.387610 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.387015    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a092fb9e-17dd-45a4-80e3-6fc617eff9bf" containerName="cleanup"
Sep 11 01:32:43.387610 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.387020    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="53586bfd-bf0d-4cc5-b2f3-d5828d965f27" containerName="maas-api"
Sep 11 01:32:43.387610 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.387024    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="03574d19-749e-4bf1-8f24-0413e26c3a25" containerName="istio-proxy"
Sep 11 01:32:43.387610 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.387029    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="295c6e97-f932-40af-9e5f-1d234ff6bc22" containerName="istio-proxy"
Sep 11 01:32:43.390036 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.390019    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f8d984c8-t7j69"
Sep 11 01:32:43.393339 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.393315    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wp4dg\""
Sep 11 01:32:43.393451 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.393391    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 01:32:43.393451 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.393436    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 01:32:43.393543 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.393391    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 01:32:43.400576 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.400550    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f8d984c8-t7j69"]
Sep 11 01:32:43.472454 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.472406    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36b023e4-b54a-49f8-9b64-5e928bc67dbf-metrics-certs\") pod \"maas-controller-8f8d984c8-t7j69\" (UID: \"36b023e4-b54a-49f8-9b64-5e928bc67dbf\") " pod="opendatahub/maas-controller-8f8d984c8-t7j69"
Sep 11 01:32:43.472787 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.472765    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djglj\" (UniqueName: \"kubernetes.io/projected/36b023e4-b54a-49f8-9b64-5e928bc67dbf-kube-api-access-djglj\") pod \"maas-controller-8f8d984c8-t7j69\" (UID: \"36b023e4-b54a-49f8-9b64-5e928bc67dbf\") " pod="opendatahub/maas-controller-8f8d984c8-t7j69"
Sep 11 01:32:43.472962 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.472944    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36b023e4-b54a-49f8-9b64-5e928bc67dbf-webhook-cert\") pod \"maas-controller-8f8d984c8-t7j69\" (UID: \"36b023e4-b54a-49f8-9b64-5e928bc67dbf\") " pod="opendatahub/maas-controller-8f8d984c8-t7j69"
Sep 11 01:32:43.573980 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.573934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36b023e4-b54a-49f8-9b64-5e928bc67dbf-metrics-certs\") pod \"maas-controller-8f8d984c8-t7j69\" (UID: \"36b023e4-b54a-49f8-9b64-5e928bc67dbf\") " pod="opendatahub/maas-controller-8f8d984c8-t7j69"
Sep 11 01:32:43.574190 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.574027    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djglj\" (UniqueName: \"kubernetes.io/projected/36b023e4-b54a-49f8-9b64-5e928bc67dbf-kube-api-access-djglj\") pod \"maas-controller-8f8d984c8-t7j69\" (UID: \"36b023e4-b54a-49f8-9b64-5e928bc67dbf\") " pod="opendatahub/maas-controller-8f8d984c8-t7j69"
Sep 11 01:32:43.574190 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.574058    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36b023e4-b54a-49f8-9b64-5e928bc67dbf-webhook-cert\") pod \"maas-controller-8f8d984c8-t7j69\" (UID: \"36b023e4-b54a-49f8-9b64-5e928bc67dbf\") " pod="opendatahub/maas-controller-8f8d984c8-t7j69"
Sep 11 01:32:43.576532 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.576499    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36b023e4-b54a-49f8-9b64-5e928bc67dbf-metrics-certs\") pod \"maas-controller-8f8d984c8-t7j69\" (UID: \"36b023e4-b54a-49f8-9b64-5e928bc67dbf\") " pod="opendatahub/maas-controller-8f8d984c8-t7j69"
Sep 11 01:32:43.576624 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.576510    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36b023e4-b54a-49f8-9b64-5e928bc67dbf-webhook-cert\") pod \"maas-controller-8f8d984c8-t7j69\" (UID: \"36b023e4-b54a-49f8-9b64-5e928bc67dbf\") " pod="opendatahub/maas-controller-8f8d984c8-t7j69"
Sep 11 01:32:43.581955 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.581935    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djglj\" (UniqueName: \"kubernetes.io/projected/36b023e4-b54a-49f8-9b64-5e928bc67dbf-kube-api-access-djglj\") pod \"maas-controller-8f8d984c8-t7j69\" (UID: \"36b023e4-b54a-49f8-9b64-5e928bc67dbf\") " pod="opendatahub/maas-controller-8f8d984c8-t7j69"
Sep 11 01:32:43.701537 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.701450    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f8d984c8-t7j69"
Sep 11 01:32:43.975174 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.975149    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f8d984c8-t7j69"]
Sep 11 01:32:43.976721 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:32:43.976688    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b023e4_b54a_49f8_9b64_5e928bc67dbf.slice/crio-ecbb463cfec5647a4552566e17d5655dacb542375dc9b1a0f7c0413b5e48b8e6 WatchSource:0}: Error finding container ecbb463cfec5647a4552566e17d5655dacb542375dc9b1a0f7c0413b5e48b8e6: Status 404 returned error can't find the container with id ecbb463cfec5647a4552566e17d5655dacb542375dc9b1a0f7c0413b5e48b8e6
Sep 11 01:32:43.978042 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:43.978022    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 01:32:44.248194 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:44.248104    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f8d984c8-t7j69" event={"ID":"36b023e4-b54a-49f8-9b64-5e928bc67dbf","Type":"ContainerStarted","Data":"ecbb463cfec5647a4552566e17d5655dacb542375dc9b1a0f7c0413b5e48b8e6"}
Sep 11 01:32:45.254312 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:45.254276    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f8d984c8-t7j69" event={"ID":"36b023e4-b54a-49f8-9b64-5e928bc67dbf","Type":"ContainerStarted","Data":"c5c03767f0e2b7907599d921cf1d50372fb04d1498dd9b58d6b04974572e498a"}
Sep 11 01:32:45.254705 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:45.254409    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8f8d984c8-t7j69"
Sep 11 01:32:45.269737 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:45.269691    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8f8d984c8-t7j69" podStartSLOduration=1.793975351 podStartE2EDuration="2.269675718s" totalImagesPullingTime="475.700367ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:32:45.269559056 +0000 UTC m=+2082.317647310" watchObservedRunningTime="2026-09-11 01:32:45.269675718 +0000 UTC m=+2082.317763945"
Sep 11 01:32:56.261467 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:32:56.261432    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8f8d984c8-t7j69"
Sep 11 01:33:03.635472 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:03.635445    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/1.log"
Sep 11 01:33:03.639807 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:03.639783    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/1.log"
Sep 11 01:33:05.558382 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:05.558350    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8f8d984c8-t7j69"]
Sep 11 01:33:05.558800 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:05.558561    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8f8d984c8-t7j69" podUID="36b023e4-b54a-49f8-9b64-5e928bc67dbf" containerName="manager" containerID="cri-o://c5c03767f0e2b7907599d921cf1d50372fb04d1498dd9b58d6b04974572e498a" gracePeriod=30
Sep 11 01:33:05.801621 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:05.801597    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f8d984c8-t7j69"
Sep 11 01:33:05.870648 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:05.870568    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djglj\" (UniqueName: \"kubernetes.io/projected/36b023e4-b54a-49f8-9b64-5e928bc67dbf-kube-api-access-djglj\") pod \"36b023e4-b54a-49f8-9b64-5e928bc67dbf\" (UID: \"36b023e4-b54a-49f8-9b64-5e928bc67dbf\") "
Sep 11 01:33:05.870836 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:05.870656    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36b023e4-b54a-49f8-9b64-5e928bc67dbf-webhook-cert\") pod \"36b023e4-b54a-49f8-9b64-5e928bc67dbf\" (UID: \"36b023e4-b54a-49f8-9b64-5e928bc67dbf\") "
Sep 11 01:33:05.870836 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:05.870675    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36b023e4-b54a-49f8-9b64-5e928bc67dbf-metrics-certs\") pod \"36b023e4-b54a-49f8-9b64-5e928bc67dbf\" (UID: \"36b023e4-b54a-49f8-9b64-5e928bc67dbf\") "
Sep 11 01:33:05.872798 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:05.872767    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36b023e4-b54a-49f8-9b64-5e928bc67dbf-kube-api-access-djglj" (OuterVolumeSpecName: "kube-api-access-djglj") pod "36b023e4-b54a-49f8-9b64-5e928bc67dbf" (UID: "36b023e4-b54a-49f8-9b64-5e928bc67dbf"). InnerVolumeSpecName "kube-api-access-djglj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:33:05.873151 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:05.873125    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36b023e4-b54a-49f8-9b64-5e928bc67dbf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "36b023e4-b54a-49f8-9b64-5e928bc67dbf" (UID: "36b023e4-b54a-49f8-9b64-5e928bc67dbf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:33:05.873213 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:05.873181    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36b023e4-b54a-49f8-9b64-5e928bc67dbf-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "36b023e4-b54a-49f8-9b64-5e928bc67dbf" (UID: "36b023e4-b54a-49f8-9b64-5e928bc67dbf"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:33:05.971828 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:05.971788    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djglj\" (UniqueName: \"kubernetes.io/projected/36b023e4-b54a-49f8-9b64-5e928bc67dbf-kube-api-access-djglj\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:33:05.972005 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:05.971846    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36b023e4-b54a-49f8-9b64-5e928bc67dbf-webhook-cert\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:33:05.972005 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:05.971855    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36b023e4-b54a-49f8-9b64-5e928bc67dbf-metrics-certs\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:33:06.363619 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:06.363587    2565 generic.go:356] "Generic (PLEG): container finished" podID="36b023e4-b54a-49f8-9b64-5e928bc67dbf" containerID="c5c03767f0e2b7907599d921cf1d50372fb04d1498dd9b58d6b04974572e498a" exitCode=0
Sep 11 01:33:06.363834 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:06.363627    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f8d984c8-t7j69"
Sep 11 01:33:06.363834 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:06.363667    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f8d984c8-t7j69" event={"ID":"36b023e4-b54a-49f8-9b64-5e928bc67dbf","Type":"ContainerDied","Data":"c5c03767f0e2b7907599d921cf1d50372fb04d1498dd9b58d6b04974572e498a"}
Sep 11 01:33:06.363834 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:06.363724    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f8d984c8-t7j69" event={"ID":"36b023e4-b54a-49f8-9b64-5e928bc67dbf","Type":"ContainerDied","Data":"ecbb463cfec5647a4552566e17d5655dacb542375dc9b1a0f7c0413b5e48b8e6"}
Sep 11 01:33:06.363834 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:06.363747    2565 scope.go:117] "RemoveContainer" containerID="c5c03767f0e2b7907599d921cf1d50372fb04d1498dd9b58d6b04974572e498a"
Sep 11 01:33:06.373485 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:06.373467    2565 scope.go:117] "RemoveContainer" containerID="c5c03767f0e2b7907599d921cf1d50372fb04d1498dd9b58d6b04974572e498a"
Sep 11 01:33:06.373751 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:33:06.373732    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5c03767f0e2b7907599d921cf1d50372fb04d1498dd9b58d6b04974572e498a\": container with ID starting with c5c03767f0e2b7907599d921cf1d50372fb04d1498dd9b58d6b04974572e498a not found: ID does not exist" containerID="c5c03767f0e2b7907599d921cf1d50372fb04d1498dd9b58d6b04974572e498a"
Sep 11 01:33:06.373799 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:06.373759    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5c03767f0e2b7907599d921cf1d50372fb04d1498dd9b58d6b04974572e498a"} err="failed to get container status \"c5c03767f0e2b7907599d921cf1d50372fb04d1498dd9b58d6b04974572e498a\": rpc error: code = NotFound desc = could not find container \"c5c03767f0e2b7907599d921cf1d50372fb04d1498dd9b58d6b04974572e498a\": container with ID starting with c5c03767f0e2b7907599d921cf1d50372fb04d1498dd9b58d6b04974572e498a not found: ID does not exist"
Sep 11 01:33:06.385218 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:06.385196    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8f8d984c8-t7j69"]
Sep 11 01:33:06.390842 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:06.390806    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8f8d984c8-t7j69"]
Sep 11 01:33:07.160996 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.160958    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8f8d984c8-k2djv"]
Sep 11 01:33:07.161357 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.161309    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b023e4-b54a-49f8-9b64-5e928bc67dbf" containerName="manager"
Sep 11 01:33:07.161357 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.161321    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b023e4-b54a-49f8-9b64-5e928bc67dbf" containerName="manager"
Sep 11 01:33:07.161430 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.161382    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="36b023e4-b54a-49f8-9b64-5e928bc67dbf" containerName="manager"
Sep 11 01:33:07.165473 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.165454    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f8d984c8-k2djv"
Sep 11 01:33:07.168406 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.168373    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 01:33:07.168406 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.168388    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 01:33:07.168597 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.168387    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 01:33:07.168597 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.168388    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wp4dg\""
Sep 11 01:33:07.174582 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.174558    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f8d984c8-k2djv"]
Sep 11 01:33:07.282032 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.282000    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a63d62-e729-4f2b-9844-c80fdd9a4b37-metrics-certs\") pod \"maas-controller-8f8d984c8-k2djv\" (UID: \"a0a63d62-e729-4f2b-9844-c80fdd9a4b37\") " pod="opendatahub/maas-controller-8f8d984c8-k2djv"
Sep 11 01:33:07.282032 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.282035    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d79lw\" (UniqueName: \"kubernetes.io/projected/a0a63d62-e729-4f2b-9844-c80fdd9a4b37-kube-api-access-d79lw\") pod \"maas-controller-8f8d984c8-k2djv\" (UID: \"a0a63d62-e729-4f2b-9844-c80fdd9a4b37\") " pod="opendatahub/maas-controller-8f8d984c8-k2djv"
Sep 11 01:33:07.282238 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.282059    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0a63d62-e729-4f2b-9844-c80fdd9a4b37-webhook-cert\") pod \"maas-controller-8f8d984c8-k2djv\" (UID: \"a0a63d62-e729-4f2b-9844-c80fdd9a4b37\") " pod="opendatahub/maas-controller-8f8d984c8-k2djv"
Sep 11 01:33:07.383214 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.383182    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a63d62-e729-4f2b-9844-c80fdd9a4b37-metrics-certs\") pod \"maas-controller-8f8d984c8-k2djv\" (UID: \"a0a63d62-e729-4f2b-9844-c80fdd9a4b37\") " pod="opendatahub/maas-controller-8f8d984c8-k2djv"
Sep 11 01:33:07.383391 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.383220    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d79lw\" (UniqueName: \"kubernetes.io/projected/a0a63d62-e729-4f2b-9844-c80fdd9a4b37-kube-api-access-d79lw\") pod \"maas-controller-8f8d984c8-k2djv\" (UID: \"a0a63d62-e729-4f2b-9844-c80fdd9a4b37\") " pod="opendatahub/maas-controller-8f8d984c8-k2djv"
Sep 11 01:33:07.383391 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.383244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0a63d62-e729-4f2b-9844-c80fdd9a4b37-webhook-cert\") pod \"maas-controller-8f8d984c8-k2djv\" (UID: \"a0a63d62-e729-4f2b-9844-c80fdd9a4b37\") " pod="opendatahub/maas-controller-8f8d984c8-k2djv"
Sep 11 01:33:07.385678 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.385648    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a0a63d62-e729-4f2b-9844-c80fdd9a4b37-webhook-cert\") pod \"maas-controller-8f8d984c8-k2djv\" (UID: \"a0a63d62-e729-4f2b-9844-c80fdd9a4b37\") " pod="opendatahub/maas-controller-8f8d984c8-k2djv"
Sep 11 01:33:07.385797 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.385652    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a0a63d62-e729-4f2b-9844-c80fdd9a4b37-metrics-certs\") pod \"maas-controller-8f8d984c8-k2djv\" (UID: \"a0a63d62-e729-4f2b-9844-c80fdd9a4b37\") " pod="opendatahub/maas-controller-8f8d984c8-k2djv"
Sep 11 01:33:07.391655 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.391633    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d79lw\" (UniqueName: \"kubernetes.io/projected/a0a63d62-e729-4f2b-9844-c80fdd9a4b37-kube-api-access-d79lw\") pod \"maas-controller-8f8d984c8-k2djv\" (UID: \"a0a63d62-e729-4f2b-9844-c80fdd9a4b37\") " pod="opendatahub/maas-controller-8f8d984c8-k2djv"
Sep 11 01:33:07.471731 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.471635    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36b023e4-b54a-49f8-9b64-5e928bc67dbf" path="/var/lib/kubelet/pods/36b023e4-b54a-49f8-9b64-5e928bc67dbf/volumes"
Sep 11 01:33:07.476086 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.476062    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f8d984c8-k2djv"
Sep 11 01:33:07.747482 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:07.747454    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f8d984c8-k2djv"]
Sep 11 01:33:07.749067 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:33:07.749038    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0a63d62_e729_4f2b_9844_c80fdd9a4b37.slice/crio-c59b2c3cd35afe1aaa87a91ebe41fea2208c4093c616377b11ee41ce3e0d0a06 WatchSource:0}: Error finding container c59b2c3cd35afe1aaa87a91ebe41fea2208c4093c616377b11ee41ce3e0d0a06: Status 404 returned error can't find the container with id c59b2c3cd35afe1aaa87a91ebe41fea2208c4093c616377b11ee41ce3e0d0a06
Sep 11 01:33:08.379404 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:08.379303    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f8d984c8-k2djv" event={"ID":"a0a63d62-e729-4f2b-9844-c80fdd9a4b37","Type":"ContainerStarted","Data":"44650721be96b79bafba1098945c852b376fc7a98a798d599acf0025c55fc744"}
Sep 11 01:33:08.379404 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:08.379365    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f8d984c8-k2djv" event={"ID":"a0a63d62-e729-4f2b-9844-c80fdd9a4b37","Type":"ContainerStarted","Data":"c59b2c3cd35afe1aaa87a91ebe41fea2208c4093c616377b11ee41ce3e0d0a06"}
Sep 11 01:33:08.379950 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:08.379448    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8f8d984c8-k2djv"
Sep 11 01:33:08.397805 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:08.397746    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8f8d984c8-k2djv" podStartSLOduration=1.0993786110000001 podStartE2EDuration="1.397731258s" totalImagesPullingTime="298.352647ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:33:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:33:08.39499833 +0000 UTC m=+2105.443086575" watchObservedRunningTime="2026-09-11 01:33:08.397731258 +0000 UTC m=+2105.445819481"
Sep 11 01:33:19.388182 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:33:19.388152    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8f8d984c8-k2djv"
Sep 11 01:36:15.994749 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:15.994697    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"]
Sep 11 01:36:15.998633 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:15.998603    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:16.000987 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.000964    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-1626d3e3-kserve-self-signed-certs\""
Sep 11 01:36:16.005669 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.005645    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"]
Sep 11 01:36:16.034071 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.034038    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-dshm\") pod \"e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") " pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:16.034257 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.034121    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-model-cache\") pod \"e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") " pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:16.034257 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.034147    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-tmp-dir\") pod \"e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") " pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:16.034257 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.034164    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/518e2c59-32cf-4fc9-9c8c-42162879f538-tls-certs\") pod \"e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") " pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:16.034257 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.034206    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drfbw\" (UniqueName: \"kubernetes.io/projected/518e2c59-32cf-4fc9-9c8c-42162879f538-kube-api-access-drfbw\") pod \"e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") " pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:16.034257 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.034227    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-home\") pod \"e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") " pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:16.135270 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.135234    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drfbw\" (UniqueName: \"kubernetes.io/projected/518e2c59-32cf-4fc9-9c8c-42162879f538-kube-api-access-drfbw\") pod \"e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") " pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:16.135270 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.135273    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-home\") pod \"e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") " pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:16.135506 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.135316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-dshm\") pod \"e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") " pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:16.135506 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.135365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-model-cache\") pod \"e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") " pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:16.135506 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.135399    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-tmp-dir\") pod \"e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") " pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:16.135659 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.135547    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/518e2c59-32cf-4fc9-9c8c-42162879f538-tls-certs\") pod \"e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") " pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:16.135878 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.135847    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-tmp-dir\") pod \"e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") " pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:16.135993 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.135878    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-home\") pod \"e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") " pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:16.135993 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.135926    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-model-cache\") pod \"e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") " pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:16.137713 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.137680    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-dshm\") pod \"e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") " pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:16.138000 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.137985    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/518e2c59-32cf-4fc9-9c8c-42162879f538-tls-certs\") pod \"e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") " pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:16.142411 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.142386    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drfbw\" (UniqueName: \"kubernetes.io/projected/518e2c59-32cf-4fc9-9c8c-42162879f538-kube-api-access-drfbw\") pod \"e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") " pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:16.310007 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.309972    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:16.580858 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:16.580829    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"]
Sep 11 01:36:16.582002 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:36:16.581970    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod518e2c59_32cf_4fc9_9c8c_42162879f538.slice/crio-4d2d5f504c36eb93dcdd8aa3c886988975486729f127690a469d33d4e1bb0b3b WatchSource:0}: Error finding container 4d2d5f504c36eb93dcdd8aa3c886988975486729f127690a469d33d4e1bb0b3b: Status 404 returned error can't find the container with id 4d2d5f504c36eb93dcdd8aa3c886988975486729f127690a469d33d4e1bb0b3b
Sep 11 01:36:17.375515 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:17.375475    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5" event={"ID":"518e2c59-32cf-4fc9-9c8c-42162879f538","Type":"ContainerStarted","Data":"57639e132c948ae3f2b6c589547475f22876c1f10b9513b497553cb9a74bebd8"}
Sep 11 01:36:17.375949 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:17.375529    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5" event={"ID":"518e2c59-32cf-4fc9-9c8c-42162879f538","Type":"ContainerStarted","Data":"4d2d5f504c36eb93dcdd8aa3c886988975486729f127690a469d33d4e1bb0b3b"}
Sep 11 01:36:17.396592 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:17.396536    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5" podStartSLOduration=2.396518706 podStartE2EDuration="2.396518706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:36:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:36:17.393918548 +0000 UTC m=+2294.442006772" watchObservedRunningTime="2026-09-11 01:36:17.396518706 +0000 UTC m=+2294.444606934"
Sep 11 01:36:26.310976 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:26.310938    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:26.311351 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:26.311016    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:26.323388 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:26.323365    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:26.432624 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:26.432590    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:43.116197 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:43.116159    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"]
Sep 11 01:36:58.136991 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.136901    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5" podUID="518e2c59-32cf-4fc9-9c8c-42162879f538" containerName="main" containerID="cri-o://57639e132c948ae3f2b6c589547475f22876c1f10b9513b497553cb9a74bebd8" gracePeriod=45
Sep 11 01:36:58.373519 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.373496    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:58.510416 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.510317    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-tmp-dir\") pod \"518e2c59-32cf-4fc9-9c8c-42162879f538\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") "
Sep 11 01:36:58.510416 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.510403    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/518e2c59-32cf-4fc9-9c8c-42162879f538-tls-certs\") pod \"518e2c59-32cf-4fc9-9c8c-42162879f538\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") "
Sep 11 01:36:58.510644 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.510433    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-model-cache\") pod \"518e2c59-32cf-4fc9-9c8c-42162879f538\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") "
Sep 11 01:36:58.510644 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.510456    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-dshm\") pod \"518e2c59-32cf-4fc9-9c8c-42162879f538\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") "
Sep 11 01:36:58.510644 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.510480    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drfbw\" (UniqueName: \"kubernetes.io/projected/518e2c59-32cf-4fc9-9c8c-42162879f538-kube-api-access-drfbw\") pod \"518e2c59-32cf-4fc9-9c8c-42162879f538\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") "
Sep 11 01:36:58.510644 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.510520    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-home\") pod \"518e2c59-32cf-4fc9-9c8c-42162879f538\" (UID: \"518e2c59-32cf-4fc9-9c8c-42162879f538\") "
Sep 11 01:36:58.510851 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.510637    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "518e2c59-32cf-4fc9-9c8c-42162879f538" (UID: "518e2c59-32cf-4fc9-9c8c-42162879f538"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:36:58.510851 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.510733    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-model-cache" (OuterVolumeSpecName: "model-cache") pod "518e2c59-32cf-4fc9-9c8c-42162879f538" (UID: "518e2c59-32cf-4fc9-9c8c-42162879f538"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:36:58.510979 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.510878    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-tmp-dir\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:36:58.510979 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.510873    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-home" (OuterVolumeSpecName: "home") pod "518e2c59-32cf-4fc9-9c8c-42162879f538" (UID: "518e2c59-32cf-4fc9-9c8c-42162879f538"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:36:58.510979 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.510892    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-model-cache\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:36:58.512772 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.512740    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-dshm" (OuterVolumeSpecName: "dshm") pod "518e2c59-32cf-4fc9-9c8c-42162879f538" (UID: "518e2c59-32cf-4fc9-9c8c-42162879f538"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 01:36:58.512901 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.512809    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/518e2c59-32cf-4fc9-9c8c-42162879f538-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "518e2c59-32cf-4fc9-9c8c-42162879f538" (UID: "518e2c59-32cf-4fc9-9c8c-42162879f538"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:36:58.512956 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.512899    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/518e2c59-32cf-4fc9-9c8c-42162879f538-kube-api-access-drfbw" (OuterVolumeSpecName: "kube-api-access-drfbw") pod "518e2c59-32cf-4fc9-9c8c-42162879f538" (UID: "518e2c59-32cf-4fc9-9c8c-42162879f538"). InnerVolumeSpecName "kube-api-access-drfbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:36:58.603226 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.603189    2565 generic.go:356] "Generic (PLEG): container finished" podID="518e2c59-32cf-4fc9-9c8c-42162879f538" containerID="57639e132c948ae3f2b6c589547475f22876c1f10b9513b497553cb9a74bebd8" exitCode=0
Sep 11 01:36:58.603415 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.603232    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"
Sep 11 01:36:58.603415 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.603237    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5" event={"ID":"518e2c59-32cf-4fc9-9c8c-42162879f538","Type":"ContainerDied","Data":"57639e132c948ae3f2b6c589547475f22876c1f10b9513b497553cb9a74bebd8"}
Sep 11 01:36:58.603415 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.603277    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5" event={"ID":"518e2c59-32cf-4fc9-9c8c-42162879f538","Type":"ContainerDied","Data":"4d2d5f504c36eb93dcdd8aa3c886988975486729f127690a469d33d4e1bb0b3b"}
Sep 11 01:36:58.603415 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.603298    2565 scope.go:117] "RemoveContainer" containerID="57639e132c948ae3f2b6c589547475f22876c1f10b9513b497553cb9a74bebd8"
Sep 11 01:36:58.611714 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.611691    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-home\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:36:58.611789 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.611719    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/518e2c59-32cf-4fc9-9c8c-42162879f538-tls-certs\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:36:58.611789 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.611733    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/518e2c59-32cf-4fc9-9c8c-42162879f538-dshm\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:36:58.611789 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.611748    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drfbw\" (UniqueName: \"kubernetes.io/projected/518e2c59-32cf-4fc9-9c8c-42162879f538-kube-api-access-drfbw\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:36:58.612795 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.612779    2565 scope.go:117] "RemoveContainer" containerID="57639e132c948ae3f2b6c589547475f22876c1f10b9513b497553cb9a74bebd8"
Sep 11 01:36:58.613081 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:36:58.613062    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57639e132c948ae3f2b6c589547475f22876c1f10b9513b497553cb9a74bebd8\": container with ID starting with 57639e132c948ae3f2b6c589547475f22876c1f10b9513b497553cb9a74bebd8 not found: ID does not exist" containerID="57639e132c948ae3f2b6c589547475f22876c1f10b9513b497553cb9a74bebd8"
Sep 11 01:36:58.613145 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.613088    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57639e132c948ae3f2b6c589547475f22876c1f10b9513b497553cb9a74bebd8"} err="failed to get container status \"57639e132c948ae3f2b6c589547475f22876c1f10b9513b497553cb9a74bebd8\": rpc error: code = NotFound desc = could not find container \"57639e132c948ae3f2b6c589547475f22876c1f10b9513b497553cb9a74bebd8\": container with ID starting with 57639e132c948ae3f2b6c589547475f22876c1f10b9513b497553cb9a74bebd8 not found: ID does not exist"
Sep 11 01:36:58.623578 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.623550    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"]
Sep 11 01:36:58.626635 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:58.626613    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-1626d3e3-kserve-69777db9dc-58pf5"]
Sep 11 01:36:59.471233 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:36:59.471198    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="518e2c59-32cf-4fc9-9c8c-42162879f538" path="/var/lib/kubelet/pods/518e2c59-32cf-4fc9-9c8c-42162879f538/volumes"
Sep 11 01:37:00.201681 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.201650    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"]
Sep 11 01:37:00.202207 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.202187    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="518e2c59-32cf-4fc9-9c8c-42162879f538" containerName="main"
Sep 11 01:37:00.202262 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.202212    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="518e2c59-32cf-4fc9-9c8c-42162879f538" containerName="main"
Sep 11 01:37:00.202320 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.202308    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="518e2c59-32cf-4fc9-9c8c-42162879f538" containerName="main"
Sep 11 01:37:00.206895 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.206877    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"
Sep 11 01:37:00.209256 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.209229    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 01:37:00.210249 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.210206    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 01:37:00.210357 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.210269    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fzpvb\""
Sep 11 01:37:00.210357 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.210284    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 01:37:00.210357 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.210345    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 01:37:00.215425 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.215354    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"]
Sep 11 01:37:00.218203 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.218180    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t"]
Sep 11 01:37:00.222057 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.222036    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t"
Sep 11 01:37:00.228367 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.228342    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t"]
Sep 11 01:37:00.325643 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.325607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccd9f1ac-9969-4368-be2c-a05ec67c6ba3-maas-api-tls\") pod \"maas-api-fcdb7dc4c-fbj5t\" (UID: \"ccd9f1ac-9969-4368-be2c-a05ec67c6ba3\") " pod="odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t"
Sep 11 01:37:00.325855 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.325691    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19c30af5-12bf-4de9-8335-ddd694206930-metrics-certs\") pod \"maas-api-7b7ff8bc87-547c9\" (UID: \"19c30af5-12bf-4de9-8335-ddd694206930\") " pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"
Sep 11 01:37:00.325855 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.325721    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8x97\" (UniqueName: \"kubernetes.io/projected/ccd9f1ac-9969-4368-be2c-a05ec67c6ba3-kube-api-access-q8x97\") pod \"maas-api-fcdb7dc4c-fbj5t\" (UID: \"ccd9f1ac-9969-4368-be2c-a05ec67c6ba3\") " pod="odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t"
Sep 11 01:37:00.325855 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.325757    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19c30af5-12bf-4de9-8335-ddd694206930-openshift-service-ca\") pod \"maas-api-7b7ff8bc87-547c9\" (UID: \"19c30af5-12bf-4de9-8335-ddd694206930\") " pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"
Sep 11 01:37:00.325855 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.325844    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccd9f1ac-9969-4368-be2c-a05ec67c6ba3-openshift-service-ca\") pod \"maas-api-fcdb7dc4c-fbj5t\" (UID: \"ccd9f1ac-9969-4368-be2c-a05ec67c6ba3\") " pod="odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t"
Sep 11 01:37:00.326037 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.325879    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19c30af5-12bf-4de9-8335-ddd694206930-maas-api-tls\") pod \"maas-api-7b7ff8bc87-547c9\" (UID: \"19c30af5-12bf-4de9-8335-ddd694206930\") " pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"
Sep 11 01:37:00.326037 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.325898    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjv69\" (UniqueName: \"kubernetes.io/projected/19c30af5-12bf-4de9-8335-ddd694206930-kube-api-access-fjv69\") pod \"maas-api-7b7ff8bc87-547c9\" (UID: \"19c30af5-12bf-4de9-8335-ddd694206930\") " pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"
Sep 11 01:37:00.326037 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.325919    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccd9f1ac-9969-4368-be2c-a05ec67c6ba3-metrics-certs\") pod \"maas-api-fcdb7dc4c-fbj5t\" (UID: \"ccd9f1ac-9969-4368-be2c-a05ec67c6ba3\") " pod="odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t"
Sep 11 01:37:00.427042 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.427005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19c30af5-12bf-4de9-8335-ddd694206930-metrics-certs\") pod \"maas-api-7b7ff8bc87-547c9\" (UID: \"19c30af5-12bf-4de9-8335-ddd694206930\") " pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"
Sep 11 01:37:00.427042 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.427046    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8x97\" (UniqueName: \"kubernetes.io/projected/ccd9f1ac-9969-4368-be2c-a05ec67c6ba3-kube-api-access-q8x97\") pod \"maas-api-fcdb7dc4c-fbj5t\" (UID: \"ccd9f1ac-9969-4368-be2c-a05ec67c6ba3\") " pod="odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t"
Sep 11 01:37:00.427298 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.427071    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19c30af5-12bf-4de9-8335-ddd694206930-openshift-service-ca\") pod \"maas-api-7b7ff8bc87-547c9\" (UID: \"19c30af5-12bf-4de9-8335-ddd694206930\") " pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"
Sep 11 01:37:00.427298 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.427220    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccd9f1ac-9969-4368-be2c-a05ec67c6ba3-openshift-service-ca\") pod \"maas-api-fcdb7dc4c-fbj5t\" (UID: \"ccd9f1ac-9969-4368-be2c-a05ec67c6ba3\") " pod="odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t"
Sep 11 01:37:00.427298 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.427271    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19c30af5-12bf-4de9-8335-ddd694206930-maas-api-tls\") pod \"maas-api-7b7ff8bc87-547c9\" (UID: \"19c30af5-12bf-4de9-8335-ddd694206930\") " pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"
Sep 11 01:37:00.427470 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.427358    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjv69\" (UniqueName: \"kubernetes.io/projected/19c30af5-12bf-4de9-8335-ddd694206930-kube-api-access-fjv69\") pod \"maas-api-7b7ff8bc87-547c9\" (UID: \"19c30af5-12bf-4de9-8335-ddd694206930\") " pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"
Sep 11 01:37:00.427470 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.427395    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccd9f1ac-9969-4368-be2c-a05ec67c6ba3-metrics-certs\") pod \"maas-api-fcdb7dc4c-fbj5t\" (UID: \"ccd9f1ac-9969-4368-be2c-a05ec67c6ba3\") " pod="odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t"
Sep 11 01:37:00.427470 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.427427    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccd9f1ac-9969-4368-be2c-a05ec67c6ba3-maas-api-tls\") pod \"maas-api-fcdb7dc4c-fbj5t\" (UID: \"ccd9f1ac-9969-4368-be2c-a05ec67c6ba3\") " pod="odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t"
Sep 11 01:37:00.427791 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.427767    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19c30af5-12bf-4de9-8335-ddd694206930-openshift-service-ca\") pod \"maas-api-7b7ff8bc87-547c9\" (UID: \"19c30af5-12bf-4de9-8335-ddd694206930\") " pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"
Sep 11 01:37:00.428073 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.428049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccd9f1ac-9969-4368-be2c-a05ec67c6ba3-openshift-service-ca\") pod \"maas-api-fcdb7dc4c-fbj5t\" (UID: \"ccd9f1ac-9969-4368-be2c-a05ec67c6ba3\") " pod="odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t"
Sep 11 01:37:00.429943 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.429920    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19c30af5-12bf-4de9-8335-ddd694206930-maas-api-tls\") pod \"maas-api-7b7ff8bc87-547c9\" (UID: \"19c30af5-12bf-4de9-8335-ddd694206930\") " pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"
Sep 11 01:37:00.430031 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.429923    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccd9f1ac-9969-4368-be2c-a05ec67c6ba3-metrics-certs\") pod \"maas-api-fcdb7dc4c-fbj5t\" (UID: \"ccd9f1ac-9969-4368-be2c-a05ec67c6ba3\") " pod="odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t"
Sep 11 01:37:00.430031 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.429930    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19c30af5-12bf-4de9-8335-ddd694206930-metrics-certs\") pod \"maas-api-7b7ff8bc87-547c9\" (UID: \"19c30af5-12bf-4de9-8335-ddd694206930\") " pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"
Sep 11 01:37:00.430031 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.429980    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccd9f1ac-9969-4368-be2c-a05ec67c6ba3-maas-api-tls\") pod \"maas-api-fcdb7dc4c-fbj5t\" (UID: \"ccd9f1ac-9969-4368-be2c-a05ec67c6ba3\") " pod="odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t"
Sep 11 01:37:00.434329 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.434307    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjv69\" (UniqueName: \"kubernetes.io/projected/19c30af5-12bf-4de9-8335-ddd694206930-kube-api-access-fjv69\") pod \"maas-api-7b7ff8bc87-547c9\" (UID: \"19c30af5-12bf-4de9-8335-ddd694206930\") " pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"
Sep 11 01:37:00.434420 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.434408    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8x97\" (UniqueName: \"kubernetes.io/projected/ccd9f1ac-9969-4368-be2c-a05ec67c6ba3-kube-api-access-q8x97\") pod \"maas-api-fcdb7dc4c-fbj5t\" (UID: \"ccd9f1ac-9969-4368-be2c-a05ec67c6ba3\") " pod="odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t"
Sep 11 01:37:00.519585 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.519498    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"
Sep 11 01:37:00.535984 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.535958    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t"
Sep 11 01:37:00.797884 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.797858    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"]
Sep 11 01:37:00.799577 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:37:00.799548    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c30af5_12bf_4de9_8335_ddd694206930.slice/crio-f3101dfd57e1074509f0b95ad455097407cc153ca2ca97ef0e9ef348137a081e WatchSource:0}: Error finding container f3101dfd57e1074509f0b95ad455097407cc153ca2ca97ef0e9ef348137a081e: Status 404 returned error can't find the container with id f3101dfd57e1074509f0b95ad455097407cc153ca2ca97ef0e9ef348137a081e
Sep 11 01:37:00.821043 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:00.821020    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t"]
Sep 11 01:37:00.822114 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:37:00.822094    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccd9f1ac_9969_4368_be2c_a05ec67c6ba3.slice/crio-bb23c25253b98282f66c6fac87a6e24f5b58df4e32a042bd2b46923693608c40 WatchSource:0}: Error finding container bb23c25253b98282f66c6fac87a6e24f5b58df4e32a042bd2b46923693608c40: Status 404 returned error can't find the container with id bb23c25253b98282f66c6fac87a6e24f5b58df4e32a042bd2b46923693608c40
Sep 11 01:37:01.624671 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:01.624629    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t" event={"ID":"ccd9f1ac-9969-4368-be2c-a05ec67c6ba3","Type":"ContainerStarted","Data":"595614a424d5efc810633805b6f69eda2a2cd73e39b5862dcd08cc21b206b709"}
Sep 11 01:37:01.625175 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:01.624700    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t" event={"ID":"ccd9f1ac-9969-4368-be2c-a05ec67c6ba3","Type":"ContainerStarted","Data":"bb23c25253b98282f66c6fac87a6e24f5b58df4e32a042bd2b46923693608c40"}
Sep 11 01:37:01.625175 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:01.624791    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t"
Sep 11 01:37:01.626162 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:01.626139    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9" event={"ID":"19c30af5-12bf-4de9-8335-ddd694206930","Type":"ContainerStarted","Data":"0e24938b69b0132ec274e9131d1492e1aee8ffa20008364543280db853a8cebb"}
Sep 11 01:37:01.626242 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:01.626184    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9" event={"ID":"19c30af5-12bf-4de9-8335-ddd694206930","Type":"ContainerStarted","Data":"f3101dfd57e1074509f0b95ad455097407cc153ca2ca97ef0e9ef348137a081e"}
Sep 11 01:37:01.626242 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:01.626210    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"
Sep 11 01:37:01.642578 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:01.642525    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t" podStartSLOduration=1.049772293 podStartE2EDuration="1.642506126s" totalImagesPullingTime="592.733833ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:37:01.640197297 +0000 UTC m=+2338.688285546" watchObservedRunningTime="2026-09-11 01:37:01.642506126 +0000 UTC m=+2338.690594352"
Sep 11 01:37:01.658569 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:01.658527    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9" podStartSLOduration=1.20587348 podStartE2EDuration="1.658512299s" totalImagesPullingTime="452.638819ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 01:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:37:01.65691834 +0000 UTC m=+2338.705006584" watchObservedRunningTime="2026-09-11 01:37:01.658512299 +0000 UTC m=+2338.706600523"
Sep 11 01:37:07.636765 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:07.636723    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-fcdb7dc4c-fbj5t"
Sep 11 01:37:07.637211 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:07.637102    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"
Sep 11 01:37:07.706008 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:07.705975    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"]
Sep 11 01:37:07.706270 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:07.706223    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9" podUID="19c30af5-12bf-4de9-8335-ddd694206930" containerName="maas-api" containerID="cri-o://0e24938b69b0132ec274e9131d1492e1aee8ffa20008364543280db853a8cebb" gracePeriod=30
Sep 11 01:37:07.947264 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:07.947233    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"
Sep 11 01:37:07.992893 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:07.992865    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19c30af5-12bf-4de9-8335-ddd694206930-metrics-certs\") pod \"19c30af5-12bf-4de9-8335-ddd694206930\" (UID: \"19c30af5-12bf-4de9-8335-ddd694206930\") "
Sep 11 01:37:07.993070 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:07.992925    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19c30af5-12bf-4de9-8335-ddd694206930-maas-api-tls\") pod \"19c30af5-12bf-4de9-8335-ddd694206930\" (UID: \"19c30af5-12bf-4de9-8335-ddd694206930\") "
Sep 11 01:37:07.993070 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:07.992944    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjv69\" (UniqueName: \"kubernetes.io/projected/19c30af5-12bf-4de9-8335-ddd694206930-kube-api-access-fjv69\") pod \"19c30af5-12bf-4de9-8335-ddd694206930\" (UID: \"19c30af5-12bf-4de9-8335-ddd694206930\") "
Sep 11 01:37:07.993070 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:07.992985    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19c30af5-12bf-4de9-8335-ddd694206930-openshift-service-ca\") pod \"19c30af5-12bf-4de9-8335-ddd694206930\" (UID: \"19c30af5-12bf-4de9-8335-ddd694206930\") "
Sep 11 01:37:07.993409 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:07.993368    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19c30af5-12bf-4de9-8335-ddd694206930-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "19c30af5-12bf-4de9-8335-ddd694206930" (UID: "19c30af5-12bf-4de9-8335-ddd694206930"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 01:37:07.995048 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:07.995023    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19c30af5-12bf-4de9-8335-ddd694206930-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "19c30af5-12bf-4de9-8335-ddd694206930" (UID: "19c30af5-12bf-4de9-8335-ddd694206930"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:37:07.995150 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:07.995117    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19c30af5-12bf-4de9-8335-ddd694206930-kube-api-access-fjv69" (OuterVolumeSpecName: "kube-api-access-fjv69") pod "19c30af5-12bf-4de9-8335-ddd694206930" (UID: "19c30af5-12bf-4de9-8335-ddd694206930"). InnerVolumeSpecName "kube-api-access-fjv69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 01:37:07.995193 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:07.995124    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19c30af5-12bf-4de9-8335-ddd694206930-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "19c30af5-12bf-4de9-8335-ddd694206930" (UID: "19c30af5-12bf-4de9-8335-ddd694206930"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 01:37:08.093758 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:08.093724    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19c30af5-12bf-4de9-8335-ddd694206930-metrics-certs\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:37:08.093758 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:08.093751    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19c30af5-12bf-4de9-8335-ddd694206930-maas-api-tls\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:37:08.093758 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:08.093761    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjv69\" (UniqueName: \"kubernetes.io/projected/19c30af5-12bf-4de9-8335-ddd694206930-kube-api-access-fjv69\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:37:08.094008 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:08.093772    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19c30af5-12bf-4de9-8335-ddd694206930-openshift-service-ca\") on node \"ip-10-0-133-50.ec2.internal\" DevicePath \"\""
Sep 11 01:37:08.664359 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:08.664322    2565 generic.go:356] "Generic (PLEG): container finished" podID="19c30af5-12bf-4de9-8335-ddd694206930" containerID="0e24938b69b0132ec274e9131d1492e1aee8ffa20008364543280db853a8cebb" exitCode=0
Sep 11 01:37:08.664359 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:08.664360    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9" event={"ID":"19c30af5-12bf-4de9-8335-ddd694206930","Type":"ContainerDied","Data":"0e24938b69b0132ec274e9131d1492e1aee8ffa20008364543280db853a8cebb"}
Sep 11 01:37:08.664922 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:08.664372    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"
Sep 11 01:37:08.664922 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:08.664400    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9" event={"ID":"19c30af5-12bf-4de9-8335-ddd694206930","Type":"ContainerDied","Data":"f3101dfd57e1074509f0b95ad455097407cc153ca2ca97ef0e9ef348137a081e"}
Sep 11 01:37:08.664922 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:08.664420    2565 scope.go:117] "RemoveContainer" containerID="0e24938b69b0132ec274e9131d1492e1aee8ffa20008364543280db853a8cebb"
Sep 11 01:37:08.674393 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:08.674372    2565 scope.go:117] "RemoveContainer" containerID="0e24938b69b0132ec274e9131d1492e1aee8ffa20008364543280db853a8cebb"
Sep 11 01:37:08.674655 ip-10-0-133-50 kubenswrapper[2565]: E0911 01:37:08.674636    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e24938b69b0132ec274e9131d1492e1aee8ffa20008364543280db853a8cebb\": container with ID starting with 0e24938b69b0132ec274e9131d1492e1aee8ffa20008364543280db853a8cebb not found: ID does not exist" containerID="0e24938b69b0132ec274e9131d1492e1aee8ffa20008364543280db853a8cebb"
Sep 11 01:37:08.674717 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:08.674668    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e24938b69b0132ec274e9131d1492e1aee8ffa20008364543280db853a8cebb"} err="failed to get container status \"0e24938b69b0132ec274e9131d1492e1aee8ffa20008364543280db853a8cebb\": rpc error: code = NotFound desc = could not find container \"0e24938b69b0132ec274e9131d1492e1aee8ffa20008364543280db853a8cebb\": container with ID starting with 0e24938b69b0132ec274e9131d1492e1aee8ffa20008364543280db853a8cebb not found: ID does not exist"
Sep 11 01:37:08.685474 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:08.685450    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"]
Sep 11 01:37:08.689516 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:08.689492    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b7ff8bc87-547c9"]
Sep 11 01:37:09.472165 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:09.472135    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19c30af5-12bf-4de9-8335-ddd694206930" path="/var/lib/kubelet/pods/19c30af5-12bf-4de9-8335-ddd694206930/volumes"
Sep 11 01:37:35.645054 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:35.645015    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8f8d984c8-k2djv_a0a63d62-e729-4f2b-9844-c80fdd9a4b37/manager/0.log"
Sep 11 01:37:35.879298 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:35.879266    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rdc7l_f9349ed9-e448-4010-801b-b514b82d32e6/manager/0.log"
Sep 11 01:37:36.134583 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:36.134553    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c49b45946-brnlr_1f084ee6-7b1a-4822-8690-958b65197142/copy-manifests/0.log"
Sep 11 01:37:36.147347 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:36.147326    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c49b45946-brnlr_1f084ee6-7b1a-4822-8690-958b65197142/manager/0.log"
Sep 11 01:37:36.713196 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:36.713165    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-fcdb7dc4c-fbj5t_ccd9f1ac-9969-4368-be2c-a05ec67c6ba3/maas-api/0.log"
Sep 11 01:37:36.828099 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:36.828072    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29818155-j7v6v_dbafed37-c98d-4f45-afff-27298d541f6a/cleanup/0.log"
Sep 11 01:37:36.938989 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:36.938958    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29818170-l95vl_a092fb9e-17dd-45a4-80e3-6fc617eff9bf/cleanup/0.log"
Sep 11 01:37:38.893897 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:38.893866    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44_68c1d6af-333a-45aa-9c5a-6c6362163748/istio-proxy/0.log"
Sep 11 01:37:39.013220 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:39.013172    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8dn7w_d8f41323-f1d9-4fd6-9bcc-161c98f6cb07/discovery/0.log"
Sep 11 01:37:39.516200 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:39.516160    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-jmnn9_b280d862-8dd9-4ca3-a01f-44c4199fab20/payload-pre-processing/0.log"
Sep 11 01:37:39.636488 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:39.636458    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-wcfks_0804bf91-e319-401b-8eff-7964f1dc0d8c/payload-processing/0.log"
Sep 11 01:37:40.235905 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:40.235806    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-j4rmw_6dbfcc0c-9180-4538-8b1a-f478b23a936d/main/0.log"
Sep 11 01:37:49.379320 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:49.379290    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-l5vqt_32548afa-eedf-4970-8638-fabf8025db48/global-pull-secret-syncer/0.log"
Sep 11 01:37:49.504364 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:49.504333    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5v8vh_74a7013b-1f33-426c-9578-83ded48a984a/konnectivity-agent/0.log"
Sep 11 01:37:49.578052 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:49.578019    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-50.ec2.internal_4fb1adafb19db39c244c8db6f1113504/haproxy/0.log"
Sep 11 01:37:56.167690 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:56.167663    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-f9fcbd86b-45dql_dc1b1e93-50d3-4de1-b7c4-c0cee6702b1d/metrics-server/0.log"
Sep 11 01:37:56.197722 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:56.197698    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-mlggs_e0212033-2228-43eb-87dd-6f7d2faed57c/monitoring-plugin/0.log"
Sep 11 01:37:56.226796 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:56.226771    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gglvp_b6e7ae42-9c2b-4d44-b6b2-d8aaea563812/node-exporter/0.log"
Sep 11 01:37:56.246066 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:56.246047    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gglvp_b6e7ae42-9c2b-4d44-b6b2-d8aaea563812/kube-rbac-proxy/0.log"
Sep 11 01:37:56.271427 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:56.271407    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gglvp_b6e7ae42-9c2b-4d44-b6b2-d8aaea563812/init-textfile/0.log"
Sep 11 01:37:56.762834 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:56.762737    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-trkvb_4685ecfb-cdfd-41bb-96bc-2c93bec17273/prometheus-operator/0.log"
Sep 11 01:37:56.779681 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:56.779654    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-trkvb_4685ecfb-cdfd-41bb-96bc-2c93bec17273/kube-rbac-proxy/0.log"
Sep 11 01:37:56.921918 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:56.921893    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756d6fd8fc-zpklt_26604ae6-2950-4a33-aa11-f14c952f5fbe/thanos-query/0.log"
Sep 11 01:37:56.941900 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:56.941874    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756d6fd8fc-zpklt_26604ae6-2950-4a33-aa11-f14c952f5fbe/kube-rbac-proxy-web/0.log"
Sep 11 01:37:56.962353 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:56.962332    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756d6fd8fc-zpklt_26604ae6-2950-4a33-aa11-f14c952f5fbe/kube-rbac-proxy/0.log"
Sep 11 01:37:56.981609 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:56.981586    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756d6fd8fc-zpklt_26604ae6-2950-4a33-aa11-f14c952f5fbe/prom-label-proxy/0.log"
Sep 11 01:37:57.001896 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:57.001868    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756d6fd8fc-zpklt_26604ae6-2950-4a33-aa11-f14c952f5fbe/kube-rbac-proxy-rules/0.log"
Sep 11 01:37:57.025471 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:57.025392    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-756d6fd8fc-zpklt_26604ae6-2950-4a33-aa11-f14c952f5fbe/kube-rbac-proxy-metrics/0.log"
Sep 11 01:37:59.041180 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.041114    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/1.log"
Sep 11 01:37:59.045896 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.045871    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/2.log"
Sep 11 01:37:59.623183 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.623144    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"]
Sep 11 01:37:59.623505 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.623493    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19c30af5-12bf-4de9-8335-ddd694206930" containerName="maas-api"
Sep 11 01:37:59.623555 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.623506    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="19c30af5-12bf-4de9-8335-ddd694206930" containerName="maas-api"
Sep 11 01:37:59.623593 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.623572    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="19c30af5-12bf-4de9-8335-ddd694206930" containerName="maas-api"
Sep 11 01:37:59.626605 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.626589    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"
Sep 11 01:37:59.628878 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.628846    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lvb79\"/\"default-dockercfg-s54hm\""
Sep 11 01:37:59.629015 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.628889    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lvb79\"/\"openshift-service-ca.crt\""
Sep 11 01:37:59.629838 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.629792    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lvb79\"/\"kube-root-ca.crt\""
Sep 11 01:37:59.633304 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.633284    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"]
Sep 11 01:37:59.652908 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.652887    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20168c70-3950-48fb-bb7a-c67ec144f7a9-lib-modules\") pod \"perf-node-gather-daemonset-5ztgp\" (UID: \"20168c70-3950-48fb-bb7a-c67ec144f7a9\") " pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"
Sep 11 01:37:59.653019 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.652921    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/20168c70-3950-48fb-bb7a-c67ec144f7a9-podres\") pod \"perf-node-gather-daemonset-5ztgp\" (UID: \"20168c70-3950-48fb-bb7a-c67ec144f7a9\") " pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"
Sep 11 01:37:59.653019 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.653004    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20168c70-3950-48fb-bb7a-c67ec144f7a9-sys\") pod \"perf-node-gather-daemonset-5ztgp\" (UID: \"20168c70-3950-48fb-bb7a-c67ec144f7a9\") " pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"
Sep 11 01:37:59.653113 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.653023    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8cb9\" (UniqueName: \"kubernetes.io/projected/20168c70-3950-48fb-bb7a-c67ec144f7a9-kube-api-access-j8cb9\") pod \"perf-node-gather-daemonset-5ztgp\" (UID: \"20168c70-3950-48fb-bb7a-c67ec144f7a9\") " pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"
Sep 11 01:37:59.653113 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.653039    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/20168c70-3950-48fb-bb7a-c67ec144f7a9-proc\") pod \"perf-node-gather-daemonset-5ztgp\" (UID: \"20168c70-3950-48fb-bb7a-c67ec144f7a9\") " pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"
Sep 11 01:37:59.754322 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.754292    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20168c70-3950-48fb-bb7a-c67ec144f7a9-sys\") pod \"perf-node-gather-daemonset-5ztgp\" (UID: \"20168c70-3950-48fb-bb7a-c67ec144f7a9\") " pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"
Sep 11 01:37:59.754524 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.754328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8cb9\" (UniqueName: \"kubernetes.io/projected/20168c70-3950-48fb-bb7a-c67ec144f7a9-kube-api-access-j8cb9\") pod \"perf-node-gather-daemonset-5ztgp\" (UID: \"20168c70-3950-48fb-bb7a-c67ec144f7a9\") " pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"
Sep 11 01:37:59.754524 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.754346    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/20168c70-3950-48fb-bb7a-c67ec144f7a9-proc\") pod \"perf-node-gather-daemonset-5ztgp\" (UID: \"20168c70-3950-48fb-bb7a-c67ec144f7a9\") " pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"
Sep 11 01:37:59.754524 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.754370    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20168c70-3950-48fb-bb7a-c67ec144f7a9-lib-modules\") pod \"perf-node-gather-daemonset-5ztgp\" (UID: \"20168c70-3950-48fb-bb7a-c67ec144f7a9\") " pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"
Sep 11 01:37:59.754524 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.754407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/20168c70-3950-48fb-bb7a-c67ec144f7a9-podres\") pod \"perf-node-gather-daemonset-5ztgp\" (UID: \"20168c70-3950-48fb-bb7a-c67ec144f7a9\") " pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"
Sep 11 01:37:59.754524 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.754410    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20168c70-3950-48fb-bb7a-c67ec144f7a9-sys\") pod \"perf-node-gather-daemonset-5ztgp\" (UID: \"20168c70-3950-48fb-bb7a-c67ec144f7a9\") " pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"
Sep 11 01:37:59.754524 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.754443    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/20168c70-3950-48fb-bb7a-c67ec144f7a9-proc\") pod \"perf-node-gather-daemonset-5ztgp\" (UID: \"20168c70-3950-48fb-bb7a-c67ec144f7a9\") " pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"
Sep 11 01:37:59.754524 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.754524    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/20168c70-3950-48fb-bb7a-c67ec144f7a9-podres\") pod \"perf-node-gather-daemonset-5ztgp\" (UID: \"20168c70-3950-48fb-bb7a-c67ec144f7a9\") " pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"
Sep 11 01:37:59.754854 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.754560    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20168c70-3950-48fb-bb7a-c67ec144f7a9-lib-modules\") pod \"perf-node-gather-daemonset-5ztgp\" (UID: \"20168c70-3950-48fb-bb7a-c67ec144f7a9\") " pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"
Sep 11 01:37:59.762042 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.762022    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8cb9\" (UniqueName: \"kubernetes.io/projected/20168c70-3950-48fb-bb7a-c67ec144f7a9-kube-api-access-j8cb9\") pod \"perf-node-gather-daemonset-5ztgp\" (UID: \"20168c70-3950-48fb-bb7a-c67ec144f7a9\") " pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"
Sep 11 01:37:59.937907 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:37:59.937786    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"
Sep 11 01:38:00.208086 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:00.208034    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"]
Sep 11 01:38:00.209759 ip-10-0-133-50 kubenswrapper[2565]: W0911 01:38:00.209733    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod20168c70_3950_48fb_bb7a_c67ec144f7a9.slice/crio-dabb7c9efc62ef7ef57b81b0ae46b4af1a046be27f87a5394ed748c13c505ca2 WatchSource:0}: Error finding container dabb7c9efc62ef7ef57b81b0ae46b4af1a046be27f87a5394ed748c13c505ca2: Status 404 returned error can't find the container with id dabb7c9efc62ef7ef57b81b0ae46b4af1a046be27f87a5394ed748c13c505ca2
Sep 11 01:38:00.938127 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:00.938092    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp" event={"ID":"20168c70-3950-48fb-bb7a-c67ec144f7a9","Type":"ContainerStarted","Data":"dcc693315f5f91df9e26ed1ee1143528fd6fca736c5d61340bb02e5f063e2ced"}
Sep 11 01:38:00.938301 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:00.938141    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp" event={"ID":"20168c70-3950-48fb-bb7a-c67ec144f7a9","Type":"ContainerStarted","Data":"dabb7c9efc62ef7ef57b81b0ae46b4af1a046be27f87a5394ed748c13c505ca2"}
Sep 11 01:38:00.938301 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:00.938214    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"
Sep 11 01:38:00.953834 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:00.953770    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp" podStartSLOduration=1.953755257 podStartE2EDuration="1.953755257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 01:37:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 01:38:00.952298645 +0000 UTC m=+2398.000386882" watchObservedRunningTime="2026-09-11 01:38:00.953755257 +0000 UTC m=+2398.001843523"
Sep 11 01:38:01.550466 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:01.550436    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wdgrd_fb827ac4-285f-42c4-ac45-9a7c946ff085/dns/0.log"
Sep 11 01:38:01.570487 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:01.570458    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wdgrd_fb827ac4-285f-42c4-ac45-9a7c946ff085/kube-rbac-proxy/0.log"
Sep 11 01:38:01.616184 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:01.616160    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j54j2_bdd051d0-68f0-449a-bd8c-5c1de79ec29d/dns-node-resolver/0.log"
Sep 11 01:38:02.211567 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:02.211532    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-67bcbf57bc-slv6g_bb214a58-3bf1-45da-8482-7b6790b8cef4/registry/0.log"
Sep 11 01:38:02.229579 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:02.229548    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-82qsg_1f60b232-db7b-49c6-b64e-94ff1b3873c6/node-ca/0.log"
Sep 11 01:38:03.167483 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:03.167455    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44_68c1d6af-333a-45aa-9c5a-6c6362163748/istio-proxy/0.log"
Sep 11 01:38:03.449937 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:03.449860    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8dn7w_d8f41323-f1d9-4fd6-9bcc-161c98f6cb07/discovery/0.log"
Sep 11 01:38:03.550378 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:03.550343    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-jmnn9_b280d862-8dd9-4ca3-a01f-44c4199fab20/payload-pre-processing/0.log"
Sep 11 01:38:03.579762 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:03.579730    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-wcfks_0804bf91-e319-401b-8eff-7964f1dc0d8c/payload-processing/0.log"
Sep 11 01:38:03.670109 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:03.669991    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/1.log"
Sep 11 01:38:03.688709 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:03.676856    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-k86cl_4058f2ae-f9bb-4e64-966a-b8c640efd48b/console-operator/1.log"
Sep 11 01:38:04.476330 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:04.476301    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9w6zm_2fb70ace-f631-46c3-884b-b03c73a1a3d9/serve-healthcheck-canary/0.log"
Sep 11 01:38:04.956153 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:04.956121    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-j6ntg_809b7e8f-d5a8-4dcf-a450-83222c1a5705/insights-operator/0.log"
Sep 11 01:38:04.956489 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:04.956471    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-j6ntg_809b7e8f-d5a8-4dcf-a450-83222c1a5705/insights-operator/1.log"
Sep 11 01:38:05.101254 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:05.101226    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xxjqk_9f850aba-3fda-478d-ad3b-01ccaee5c3f4/kube-rbac-proxy/0.log"
Sep 11 01:38:05.119919 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:05.119891    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xxjqk_9f850aba-3fda-478d-ad3b-01ccaee5c3f4/exporter/0.log"
Sep 11 01:38:05.138396 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:05.138371    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xxjqk_9f850aba-3fda-478d-ad3b-01ccaee5c3f4/extractor/0.log"
Sep 11 01:38:06.953286 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:06.953258    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lvb79/perf-node-gather-daemonset-5ztgp"
Sep 11 01:38:07.537461 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:07.537432    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8f8d984c8-k2djv_a0a63d62-e729-4f2b-9844-c80fdd9a4b37/manager/0.log"
Sep 11 01:38:07.636997 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:07.636966    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rdc7l_f9349ed9-e448-4010-801b-b514b82d32e6/manager/0.log"
Sep 11 01:38:07.770684 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:07.770658    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c49b45946-brnlr_1f084ee6-7b1a-4822-8690-958b65197142/manager/0.log"
Sep 11 01:38:07.787496 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:07.787443    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c49b45946-brnlr_1f084ee6-7b1a-4822-8690-958b65197142/copy-manifests/0.log"
Sep 11 01:38:09.209976 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:09.209943    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6cff9449b4-bmlcx_a4f3902f-cddb-40d7-babe-dabcc06c3ad8/manager/0.log"
Sep 11 01:38:09.923072 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:09.923038    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44_68c1d6af-333a-45aa-9c5a-6c6362163748/istio-proxy/0.log"
Sep 11 01:38:10.188840 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:10.188742    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8dn7w_d8f41323-f1d9-4fd6-9bcc-161c98f6cb07/discovery/0.log"
Sep 11 01:38:10.256273 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:10.256243    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-jmnn9_b280d862-8dd9-4ca3-a01f-44c4199fab20/payload-pre-processing/0.log"
Sep 11 01:38:10.278061 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:10.278039    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-wcfks_0804bf91-e319-401b-8eff-7964f1dc0d8c/payload-processing/0.log"
Sep 11 01:38:11.844459 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:11.844422    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-4fx44_68c1d6af-333a-45aa-9c5a-6c6362163748/istio-proxy/0.log"
Sep 11 01:38:12.118969 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:12.118885    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8dn7w_d8f41323-f1d9-4fd6-9bcc-161c98f6cb07/discovery/0.log"
Sep 11 01:38:12.193219 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:12.193188    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-jmnn9_b280d862-8dd9-4ca3-a01f-44c4199fab20/payload-pre-processing/0.log"
Sep 11 01:38:12.213525 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:12.213497    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-wcfks_0804bf91-e319-401b-8eff-7964f1dc0d8c/payload-processing/0.log"
Sep 11 01:38:16.079735 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:16.079703    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s6mbf_830feca5-59a2-4352-92ff-67852cf13bfd/kube-multus-additional-cni-plugins/0.log"
Sep 11 01:38:16.099761 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:16.099739    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s6mbf_830feca5-59a2-4352-92ff-67852cf13bfd/egress-router-binary-copy/0.log"
Sep 11 01:38:16.119459 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:16.119437    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s6mbf_830feca5-59a2-4352-92ff-67852cf13bfd/cni-plugins/0.log"
Sep 11 01:38:16.138125 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:16.138104    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s6mbf_830feca5-59a2-4352-92ff-67852cf13bfd/bond-cni-plugin/0.log"
Sep 11 01:38:16.157219 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:16.157198    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s6mbf_830feca5-59a2-4352-92ff-67852cf13bfd/routeoverride-cni/0.log"
Sep 11 01:38:16.175378 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:16.175354    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s6mbf_830feca5-59a2-4352-92ff-67852cf13bfd/whereabouts-cni-bincopy/0.log"
Sep 11 01:38:16.194094 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:16.194070    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s6mbf_830feca5-59a2-4352-92ff-67852cf13bfd/whereabouts-cni/0.log"
Sep 11 01:38:16.272690 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:16.272663    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fn26l_fdb7c32b-2205-4f0d-9ea2-58c45a059200/kube-multus/0.log"
Sep 11 01:38:16.381212 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:16.381136    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zcgvb_544fdaa4-afa7-48dc-9e47-79cdb2200200/network-metrics-daemon/0.log"
Sep 11 01:38:16.397364 ip-10-0-133-50 kubenswrapper[2565]: I0911 01:38:16.397345    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zcgvb_544fdaa4-afa7-48dc-9e47-79cdb2200200/kube-rbac-proxy/0.log"