Jul 26 15:48:07.574714 ip-10-0-142-224 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 26 15:48:07.574727 ip-10-0-142-224 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 26 15:48:07.574736 ip-10-0-142-224 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 26 15:48:07.575054 ip-10-0-142-224 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 26 15:48:18.879564 ip-10-0-142-224 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 26 15:48:18.879580 ip-10-0-142-224 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e49501c4afb94d8997bcf8163d11e20e --
Jul 26 15:50:03.690887 ip-10-0-142-224 systemd[1]: Starting Kubernetes Kubelet...
Jul 26 15:50:03.990861 ip-10-0-142-224 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 26 15:50:03.990861 ip-10-0-142-224 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 26 15:50:03.990861 ip-10-0-142-224 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 26 15:50:03.990861 ip-10-0-142-224 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 26 15:50:03.991452 ip-10-0-142-224 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 26 15:50:03.991735 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.991655    2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 26 15:50:03.995039 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995024    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:50:03.995039 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995039    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:50:03.995101 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995043    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:50:03.995101 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995047    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:50:03.995101 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995050    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:50:03.995101 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995053    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:50:03.995101 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995057    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:50:03.995101 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995059    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:50:03.995101 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995062    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:50:03.995101 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995065    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:50:03.995101 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995068    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:50:03.995101 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995070    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:50:03.995101 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995073    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:50:03.995101 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995076    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:50:03.995101 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995078    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:50:03.995101 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995086    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:50:03.995101 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995089    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:50:03.995101 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995092    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:50:03.995101 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995094    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:50:03.995101 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995096    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:50:03.995101 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995099    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:50:03.995101 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995102    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:50:03.995589 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995105    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:50:03.995589 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995108    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:50:03.995589 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995111    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:50:03.995589 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995114    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:50:03.995589 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995117    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:50:03.995589 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995119    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:50:03.995589 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995122    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:50:03.995589 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995124    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:50:03.995589 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995127    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:50:03.995589 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995129    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:50:03.995589 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995132    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:50:03.995589 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995134    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:50:03.995589 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995138    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:50:03.995589 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995142    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:50:03.995589 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995145    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:50:03.995589 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995147    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:50:03.995589 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995150    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:50:03.995589 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995153    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:50:03.995589 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995156    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:50:03.995589 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995159    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:50:03.996083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995162    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:50:03.996083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995164    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:50:03.996083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995166    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:50:03.996083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995169    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:50:03.996083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995171    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:50:03.996083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995174    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:50:03.996083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995176    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:50:03.996083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995180    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:50:03.996083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995184    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:50:03.996083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995187    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:50:03.996083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995190    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:50:03.996083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995193    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:50:03.996083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995196    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:50:03.996083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995199    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:50:03.996083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995201    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:50:03.996083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995204    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:50:03.996083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995207    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:50:03.996083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995210    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:50:03.996083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995213    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:50:03.996083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995215    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:50:03.996599 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995218    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:50:03.996599 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995221    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:50:03.996599 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995224    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:50:03.996599 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995226    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:50:03.996599 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995229    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:50:03.996599 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995232    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:50:03.996599 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995234    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:50:03.996599 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995237    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:50:03.996599 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995240    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:50:03.996599 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995243    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:50:03.996599 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995245    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:50:03.996599 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995248    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:50:03.996599 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995250    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:50:03.996599 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995253    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:50:03.996599 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995255    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:50:03.996599 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995258    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:50:03.996599 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995260    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:50:03.996599 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995263    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:50:03.996599 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995266    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:50:03.996599 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995268    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:50:03.997126 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995271    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:50:03.997126 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995273    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:50:03.997126 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995276    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:50:03.997126 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995278    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:50:03.997126 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995281    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:50:03.997126 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995285    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:50:03.997126 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995288    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:50:03.997126 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995290    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:50:03.997126 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995293    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:50:03.997126 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995295    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:50:03.997126 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995298    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:50:03.997126 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995300    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:50:03.997126 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995304    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:50:03.997126 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995307    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:50:03.997126 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995310    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:50:03.997126 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995313    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:50:03.997126 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.995315    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:50:03.997126 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996016    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:50:03.997126 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996023    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:50:03.997590 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996026    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:50:03.997590 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996029    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:50:03.997590 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996032    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:50:03.997590 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996034    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:50:03.997590 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996039    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:50:03.997590 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996043    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:50:03.997590 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996046    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:50:03.997590 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996049    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:50:03.997590 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996052    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:50:03.997590 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996055    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:50:03.997590 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996058    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:50:03.997590 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996061    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:50:03.997590 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996063    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:50:03.997590 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996067    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:50:03.997590 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996069    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:50:03.997590 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996072    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:50:03.997590 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996075    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:50:03.997590 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996078    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:50:03.997590 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996081    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:50:03.998083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996084    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:50:03.998083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996087    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:50:03.998083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996089    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:50:03.998083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996092    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:50:03.998083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996095    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:50:03.998083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996098    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:50:03.998083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996100    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:50:03.998083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996103    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:50:03.998083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996105    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:50:03.998083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996108    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:50:03.998083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996112    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:50:03.998083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996116    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:50:03.998083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996119    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:50:03.998083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996122    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:50:03.998083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996125    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:50:03.998083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996127    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:50:03.998083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996130    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:50:03.998083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996133    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:50:03.998083 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996136    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:50:03.998656 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996138    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:50:03.998656 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996141    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:50:03.998656 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996143    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:50:03.998656 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996146    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:50:03.998656 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996149    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:50:03.998656 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996152    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:50:03.998656 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996155    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:50:03.998656 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996157    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:50:03.998656 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996161    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:50:03.998656 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996164    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:50:03.998656 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996166    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:50:03.998656 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996169    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:50:03.998656 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996172    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:50:03.998656 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996175    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:50:03.998656 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996177    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:50:03.998656 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996180    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:50:03.998656 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996184    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:50:03.998656 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996188    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:50:03.998656 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996191    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:50:03.999135 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996194    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:50:03.999135 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996197    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:50:03.999135 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996199    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:50:03.999135 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996202    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:50:03.999135 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996205    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:50:03.999135 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996207    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:50:03.999135 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996210    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:50:03.999135 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996212    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:50:03.999135 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996215    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:50:03.999135 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996218    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:50:03.999135 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996220    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:50:03.999135 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996222    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:50:03.999135 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996226    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:50:03.999135 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996228    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:50:03.999135 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996231    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:50:03.999135 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996234    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:50:03.999135 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996237    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:50:03.999135 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996240    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:50:03.999135 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996242    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:50:03.999135 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996245    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:50:03.999623 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996248    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:50:03.999623 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996251    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:50:03.999623 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996253    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:50:03.999623 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996256    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:50:03.999623 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996258    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:50:03.999623 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996261    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:50:03.999623 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996263    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:50:03.999623 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996266    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:50:03.999623 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996269    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:50:03.999623 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996271    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:50:03.999623 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996274    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:50:03.999623 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996276    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:50:03.999623 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996279    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:50:03.999623 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996281    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:50:03.999623 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996284    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:50:03.999623 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996286    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:50:03.999623 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996289    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:50:03.999623 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996291    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:50:03.999623 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996294    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:50:03.999623 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996296    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:50:04.000128 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996678    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:50:04.000128 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996684    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:50:04.000128 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996688    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:50:04.000128 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996692    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:50:04.000128 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996702    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:50:04.000128 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996705    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:50:04.000128 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996709    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:50:04.000128 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996711    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:50:04.000128 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996714    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:50:04.000128 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996717    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:50:04.000128 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996720    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:50:04.000128 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996723    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:50:04.000128 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996725    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:50:04.000128 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996728    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:50:04.000128 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996731    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:50:04.000128 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996733    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:50:04.000128 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996736    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:50:04.000128 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996739    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:50:04.000128 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996742    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:50:04.000607 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996745    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:50:04.000607 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996747    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:50:04.000607 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996750    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:50:04.000607 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996753    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:50:04.000607 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996755    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:50:04.000607 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996758    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:50:04.000607 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996760    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:50:04.000607 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996763    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:50:04.000607 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996766    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:50:04.000607 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996769    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:50:04.000607 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996771    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:50:04.000607 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996774    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:50:04.000607 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996776    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:50:04.000607 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996779    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:50:04.000607 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996781    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:50:04.000607 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996784    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:50:04.000607 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996786    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:50:04.000607 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996789    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:50:04.000607 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996793    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:50:04.000607 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996796    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:50:04.001129 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996799    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:50:04.001129 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996801    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:50:04.001129 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996804    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:50:04.001129 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996806    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:50:04.001129 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996809    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:50:04.001129 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996811    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:50:04.001129 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996814    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:50:04.001129 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996816    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:50:04.001129 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996819    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:50:04.001129 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996821    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:50:04.001129 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996824    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:50:04.001129 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996826    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:50:04.001129 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996829    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:50:04.001129 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996831    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:50:04.001129 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996834    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:50:04.001129 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996836    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:50:04.001129 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996839    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:50:04.001129 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996841    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:50:04.001129 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996844    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:50:04.001129 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996847    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:50:04.001660 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996849    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:50:04.001660 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996852    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:50:04.001660 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996854    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:50:04.001660 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996857    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:50:04.001660 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996859    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:50:04.001660 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996864    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:50:04.001660 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996868    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:50:04.001660 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996870    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:50:04.001660 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996873    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:50:04.001660 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996876    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:50:04.001660 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996879    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:50:04.001660 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996882    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:50:04.001660 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996884    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:50:04.001660 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996887    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:50:04.001660 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996889    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:50:04.001660 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996893    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:50:04.001660 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996895    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:50:04.001660 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996900    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:50:04.001660 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996902    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:50:04.002131 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996905    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:50:04.002131 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996908    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:50:04.002131 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996910    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:50:04.002131 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996913    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:50:04.002131 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996915    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:50:04.002131 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996918    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:50:04.002131 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996920    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:50:04.002131 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996923    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:50:04.002131 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996926    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:50:04.002131 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996928    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:50:04.002131 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996931    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:50:04.002131 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996933    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:50:04.002131 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996936    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:50:04.002131 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996939    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:50:04.002131 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996941    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:50:04.002131 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996944    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:50:04.002131 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996946    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:50:04.002131 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996949    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:50:04.002131 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996951    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:50:04.002131 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996953    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.996956    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997020    2556 flags.go:64] FLAG: --address="0.0.0.0"
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997027    2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997037    2556 flags.go:64] FLAG: --anonymous-auth="true"
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997041    2556 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997045    2556 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997048    2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997052    2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997056    2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997059    2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997063    2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997067    2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997070    2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997073    2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997076    2556 flags.go:64] FLAG: --cgroup-root=""
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997079    2556 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997082    2556 flags.go:64] FLAG: --client-ca-file=""
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997085    2556 flags.go:64] FLAG: --cloud-provider="external"
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997088    2556 flags.go:64] FLAG: --cluster-dns="[]"
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997092    2556 flags.go:64] FLAG: --cluster-domain=""
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997095    2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997097    2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997100    2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 26 15:50:04.002686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997104    2556 flags.go:64] FLAG: --container-log-max-files="5"
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997112    2556 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997115    2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997119    2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997122    2556 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997125    2556 flags.go:64] FLAG: --contention-profiling="false"
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997128    2556 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997130    2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997134    2556 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997137    2556 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997141    2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997144    2556 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997148    2556 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997151    2556 flags.go:64] FLAG: --enable-load-reader="false"
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997154    2556 flags.go:64] FLAG: --enable-server="true"
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997157    2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997162    2556 flags.go:64] FLAG: --event-burst="100"
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997165    2556 flags.go:64] FLAG: --event-qps="50"
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997168    2556 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997172    2556 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997175    2556 flags.go:64] FLAG: --eviction-hard=""
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997179    2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997182    2556 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997184    2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997187    2556 flags.go:64] FLAG: --eviction-soft=""
Jul 26 15:50:04.003269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997190    2556 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997193    2556 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997196    2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997199    2556 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997202    2556 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997205    2556 flags.go:64] FLAG: --fail-swap-on="true"
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997207    2556 flags.go:64] FLAG: --feature-gates=""
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997211    2556 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997214    2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997217    2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997220    2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997223    2556 flags.go:64] FLAG: --healthz-port="10248"
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997226    2556 flags.go:64] FLAG: --help="false"
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997229    2556 flags.go:64] FLAG: --hostname-override="ip-10-0-142-224.ec2.internal"
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997232    2556 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997235    2556 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997238    2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997241    2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997245    2556 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997249    2556 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997252    2556 flags.go:64] FLAG: --image-service-endpoint=""
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997255    2556 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997258    2556 flags.go:64] FLAG: --kube-api-burst="100"
Jul 26 15:50:04.003925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997261    2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997264    2556 flags.go:64] FLAG: --kube-api-qps="50"
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997267    2556 flags.go:64] FLAG: --kube-reserved=""
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997272    2556 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997275    2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997278    2556 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997281    2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997284    2556 flags.go:64] FLAG: --lock-file=""
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997286    2556 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997289    2556 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997292    2556 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997298    2556 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997300    2556 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997303    2556 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997306    2556 flags.go:64] FLAG: --logging-format="text"
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997309    2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997312    2556 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997315    2556 flags.go:64] FLAG: --manifest-url=""
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997318    2556 flags.go:64] FLAG: --manifest-url-header=""
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997322    2556 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997325    2556 flags.go:64] FLAG: --max-open-files="1000000"
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997330    2556 flags.go:64] FLAG: --max-pods="110"
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997332    2556 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997335    2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997338    2556 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 26 15:50:04.004513 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997341    2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997344    2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997347    2556 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997351    2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997358    2556 flags.go:64] FLAG: --node-status-max-images="50"
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997361    2556 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997364    2556 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997367    2556 flags.go:64] FLAG: --pod-cidr=""
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997370    2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997375    2556 flags.go:64] FLAG: --pod-manifest-path=""
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997378    2556 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997383    2556 flags.go:64] FLAG: --pods-per-core="0"
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997386    2556 flags.go:64] FLAG: --port="10250"
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997389    2556 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997392    2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0386488c3ba7eb4e2"
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997395    2556 flags.go:64] FLAG: --qos-reserved=""
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997398    2556 flags.go:64] FLAG: --read-only-port="10255"
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997401    2556 flags.go:64] FLAG: --register-node="true"
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997404    2556 flags.go:64] FLAG: --register-with-taints=""
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997407    2556 flags.go:64] FLAG: --registry-burst="10"
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997411    2556 flags.go:64] FLAG: --registry-qps="5"
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997414    2556 flags.go:64] FLAG: --reserved-cpus=""
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997416    2556 flags.go:64] FLAG: --reserved-memory=""
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997420    2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997423    2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 26 15:50:04.005169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997426    2556 flags.go:64] FLAG: --rotate-certificates="false"
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997429    2556 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997432    2556 flags.go:64] FLAG: --runonce="false"
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997435    2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997438    2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997440    2556 flags.go:64] FLAG: --seccomp-default="false"
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997443    2556 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997446    2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997449    2556 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997452    2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997456    2556 flags.go:64] FLAG: --storage-driver-password="root"
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997459    2556 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997462    2556 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997465    2556 flags.go:64] FLAG: --storage-driver-user="root"
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997468    2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997471    2556 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997474    2556 flags.go:64] FLAG: --system-cgroups=""
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997477    2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997484    2556 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997487    2556 flags.go:64] FLAG: --tls-cert-file=""
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997490    2556 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997493    2556 flags.go:64] FLAG: --tls-min-version=""
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997496    2556 flags.go:64] FLAG: --tls-private-key-file=""
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997499    2556 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997502    2556 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 26 15:50:04.005793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997505    2556 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 26 15:50:04.006601 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997508    2556 flags.go:64] FLAG: --v="2"
Jul 26 15:50:04.006601 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997511    2556 flags.go:64] FLAG: --version="false"
Jul 26 15:50:04.006601 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997515    2556 flags.go:64] FLAG: --vmodule=""
Jul 26 15:50:04.006601 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997519    2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 26 15:50:04.006601 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997522    2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 26 15:50:04.006601 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997659    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:50:04.006601 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997664    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:50:04.006601 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997667    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:50:04.006601 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997670    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:50:04.006601 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997674    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:50:04.006601 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997678    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:50:04.006601 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997681    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:50:04.006601 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997684    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:50:04.006601 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997687    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:50:04.006601 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997690    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:50:04.006601 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997693    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:50:04.006601 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997696    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:50:04.006601 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997699    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:50:04.006601 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997701    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:50:04.006601 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997704    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:50:04.006601 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997707    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:50:04.007342 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997710    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:50:04.007342 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997712    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:50:04.007342 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997715    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:50:04.007342 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997719    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:50:04.007342 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997722    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:50:04.007342 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997725    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:50:04.007342 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997727    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:50:04.007342 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997730    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:50:04.007342 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997733    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:50:04.007342 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997735    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:50:04.007342 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997738    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:50:04.007342 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997740    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:50:04.007342 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997743    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:50:04.007342 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997745    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:50:04.007342 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997748    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:50:04.007342 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997752    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:50:04.007342 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997755    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:50:04.007342 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997758    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:50:04.007342 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997761    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:50:04.008015 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997763    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:50:04.008015 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997766    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:50:04.008015 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997769    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:50:04.008015 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997771    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:50:04.008015 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997774    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:50:04.008015 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997777    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:50:04.008015 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997779    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:50:04.008015 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997782    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:50:04.008015 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997785    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:50:04.008015 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997788    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:50:04.008015 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997790    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:50:04.008015 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997793    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:50:04.008015 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997795    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:50:04.008015 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997798    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:50:04.008015 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997801    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:50:04.008015 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997803    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:50:04.008015 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997808    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:50:04.008015 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997810    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:50:04.008015 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997813    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:50:04.008015 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997816    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:50:04.008501 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997818    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:50:04.008501 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997821    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:50:04.008501 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997823    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:50:04.008501 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997826    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:50:04.008501 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997829    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:50:04.008501 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997831    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:50:04.008501 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997834    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:50:04.008501 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997836    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:50:04.008501 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997839    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:50:04.008501 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997842    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:50:04.008501 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997844    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:50:04.008501 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997847    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:50:04.008501 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997850    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:50:04.008501 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997852    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:50:04.008501 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997855    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:50:04.008501 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997857    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:50:04.008501 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997860    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:50:04.008501 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997862    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:50:04.008501 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997865    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:50:04.008980 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997868    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:50:04.008980 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997870    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:50:04.008980 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997873    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:50:04.008980 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997875    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:50:04.008980 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997878    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:50:04.008980 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997881    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:50:04.008980 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997883    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:50:04.008980 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997886    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:50:04.008980 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997888    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:50:04.008980 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997892    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:50:04.008980 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997896    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:50:04.008980 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997898    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:50:04.008980 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997901    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:50:04.008980 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997904    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:50:04.008980 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997906    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:50:04.008980 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997909    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:50:04.008980 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997911    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:50:04.008980 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997914    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:50:04.008980 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997918    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:50:04.008980 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997921    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:50:04.009505 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997924    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:50:04.009505 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997927    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:50:04.009505 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997929    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:50:04.009505 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997932    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:50:04.009505 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:03.997935    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:50:04.009505 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:03.997940    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 26 15:50:04.009505 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.004098    2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 26 15:50:04.009505 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.004112    2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 26 15:50:04.009505 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.004132    2556 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 26 15:50:04.009505 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.004141    2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 26 15:50:04.009505 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004193    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:50:04.009505 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004198    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:50:04.009505 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004201    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:50:04.009505 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004204    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:50:04.009882 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004207    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:50:04.009882 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004210    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:50:04.009882 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004213    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:50:04.009882 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004216    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:50:04.009882 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004218    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:50:04.009882 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004221    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:50:04.009882 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004225    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:50:04.009882 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004229    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:50:04.009882 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004232    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:50:04.009882 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004235    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:50:04.009882 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004238    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:50:04.009882 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004241    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:50:04.009882 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004243    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:50:04.009882 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004247    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:50:04.009882 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004251    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:50:04.009882 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004254    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:50:04.009882 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004256    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:50:04.009882 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004259    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:50:04.009882 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004262    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:50:04.010434 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004264    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:50:04.010434 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004267    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:50:04.010434 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004269    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:50:04.010434 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004272    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:50:04.010434 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004274    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:50:04.010434 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004277    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:50:04.010434 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004281    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:50:04.010434 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004283    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:50:04.010434 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004286    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:50:04.010434 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004289    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:50:04.010434 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004291    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:50:04.010434 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004293    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:50:04.010434 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004296    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:50:04.010434 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004299    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:50:04.010434 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004301    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:50:04.010434 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004304    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:50:04.010434 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004306    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:50:04.010434 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004309    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:50:04.010434 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004311    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:50:04.010434 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004314    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:50:04.010932 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004316    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:50:04.010932 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004319    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:50:04.010932 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004322    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:50:04.010932 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004324    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:50:04.010932 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004327    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:50:04.010932 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004329    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:50:04.010932 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004333    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:50:04.010932 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004337    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:50:04.010932 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004340    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:50:04.010932 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004343    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:50:04.010932 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004346    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:50:04.010932 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004348    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:50:04.010932 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004351    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:50:04.010932 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004354    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:50:04.010932 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004357    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:50:04.010932 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004359    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:50:04.010932 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004362    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:50:04.010932 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004365    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:50:04.010932 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004369    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:50:04.011472 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004372    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:50:04.011472 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004375    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:50:04.011472 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004377    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:50:04.011472 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004380    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:50:04.011472 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004382    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:50:04.011472 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004385    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:50:04.011472 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004388    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:50:04.011472 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004390    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:50:04.011472 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004392    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:50:04.011472 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004395    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:50:04.011472 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004398    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:50:04.011472 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004400    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:50:04.011472 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004403    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:50:04.011472 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004405    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:50:04.011472 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004408    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:50:04.011472 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004410    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:50:04.011472 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004412    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:50:04.011472 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004415    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:50:04.011472 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004418    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:50:04.011472 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004420    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:50:04.012272 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004423    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:50:04.012272 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004425    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:50:04.012272 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004428    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:50:04.012272 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004430    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:50:04.012272 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004433    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:50:04.012272 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004435    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:50:04.012272 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004437    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:50:04.012272 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004440    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:50:04.012272 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004442    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:50:04.012272 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004445    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:50:04.012272 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004447    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:50:04.012272 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004450    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:50:04.012272 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004453    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:50:04.012272 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004456    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:50:04.012272 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004459    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:50:04.012272 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004462    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:50:04.012272 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004465    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:50:04.012991 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.004470    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 26 15:50:04.012991 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004573    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:50:04.012991 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004578    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:50:04.012991 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004581    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:50:04.012991 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004583    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:50:04.012991 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004586    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:50:04.012991 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004589    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:50:04.012991 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004592    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:50:04.012991 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004594    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:50:04.012991 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004597    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:50:04.012991 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004599    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:50:04.012991 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004602    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:50:04.012991 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004604    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:50:04.012991 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004607    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:50:04.012991 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004609    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:50:04.013649 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004612    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:50:04.013649 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004614    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:50:04.013649 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004617    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:50:04.013649 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004619    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:50:04.013649 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004622    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:50:04.013649 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004625    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:50:04.013649 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004627    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:50:04.013649 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004643    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:50:04.013649 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004646    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:50:04.013649 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004649    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:50:04.013649 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004652    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:50:04.013649 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004655    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:50:04.013649 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004657    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:50:04.013649 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004660    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:50:04.013649 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004663    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:50:04.013649 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004666    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:50:04.013649 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004668    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:50:04.013649 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004671    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:50:04.013649 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004673    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:50:04.013649 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004676    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:50:04.014376 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004679    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:50:04.014376 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004681    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:50:04.014376 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004683    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:50:04.014376 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004686    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:50:04.014376 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004688    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:50:04.014376 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004691    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:50:04.014376 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004693    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:50:04.014376 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004696    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:50:04.014376 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004698    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:50:04.014376 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004701    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:50:04.014376 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004703    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:50:04.014376 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004707    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:50:04.014376 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004711    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:50:04.014376 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004714    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:50:04.014376 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004717    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:50:04.014376 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004720    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:50:04.014376 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004724    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:50:04.014376 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004727    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:50:04.014376 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004730    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:50:04.014376 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004733    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:50:04.014908 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004736    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:50:04.014908 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004739    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:50:04.014908 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004741    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:50:04.014908 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004744    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:50:04.014908 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004746    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:50:04.014908 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004749    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:50:04.014908 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004752    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:50:04.014908 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004754    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:50:04.014908 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004757    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:50:04.014908 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004759    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:50:04.014908 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004762    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:50:04.014908 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004764    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:50:04.014908 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004767    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:50:04.014908 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004769    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:50:04.014908 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004771    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:50:04.014908 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004774    2556 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:50:04.014908 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004776    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:50:04.014908 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004779    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:50:04.014908 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004781    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:50:04.014908 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004784    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:50:04.015398 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004786    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:50:04.015398 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004789    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:50:04.015398 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004791    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:50:04.015398 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004794    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:50:04.015398 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004796    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:50:04.015398 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004799    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:50:04.015398 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004803    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:50:04.015398 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004807    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:50:04.015398 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004809    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:50:04.015398 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004812    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:50:04.015398 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004814    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:50:04.015398 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004817    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:50:04.015398 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004819    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:50:04.015398 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004822    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:50:04.015398 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004824    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:50:04.015398 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004827    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:50:04.015398 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004829    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:50:04.015398 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004832    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:50:04.015398 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004834    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:50:04.016059 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004837    2556 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:50:04.016059 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004840    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:50:04.016059 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004842    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:50:04.016059 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004845    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:50:04.016059 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004847    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:50:04.016059 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:04.004850    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:50:04.016059 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.004855    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 26 15:50:04.016059 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.004943    2556 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 26 15:50:04.016059 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.008940    2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 26 15:50:04.016059 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.010101    2556 server.go:1019] "Starting client certificate rotation"
Jul 26 15:50:04.016059 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.010208    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 26 15:50:04.016059 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.010251    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 26 15:50:04.016059 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.012465    2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 26 15:50:04.016408 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.014160    2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 26 15:50:04.023320 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.023305    2556 log.go:25] "Validated CRI v1 runtime API"
Jul 26 15:50:04.026884 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.026864    2556 log.go:25] "Validated CRI v1 image API"
Jul 26 15:50:04.027674 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.027657    2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 26 15:50:04.030227 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.030202    2556 fs.go:135] Filesystem UUIDs: map[6674740e-356c-443c-ba4c-2ebc186a59c0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 fb70d3b9-a4e0-4a06-b2ca-7d2ebd9a6689:/dev/nvme0n1p4]
Jul 26 15:50:04.030278 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.030227    2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 26 15:50:04.034920 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.034798    2556 manager.go:216] Machine: {Timestamp:2026-07-26 15:50:04.033750406 +0000 UTC m=+0.252377461 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3128392 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24e184bbff804ec87ea82c3a806ca7 SystemUUID:ec24e184-bbff-804e-c87e-a82c3a806ca7 BootID:e49501c4-afb9-4d89-97bc-f8163d11e20e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d2:ea:e3:b8:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d2:ea:e3:b8:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:78:3a:12:1c:20 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 26 15:50:04.034920 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.034918    2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 26 15:50:04.035033 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.035022    2556 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 26 15:50:04.037316 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.037287    2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 26 15:50:04.037486 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.037319    2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-224.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 26 15:50:04.038031 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.038020    2556 topology_manager.go:138] "Creating topology manager with none policy"
Jul 26 15:50:04.038062 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.038037    2556 container_manager_linux.go:309] "Creating device plugin manager"
Jul 26 15:50:04.038062 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.038048    2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 26 15:50:04.038582 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.038571    2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 26 15:50:04.039570 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.039557    2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 26 15:50:04.039658 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.039553    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 26 15:50:04.042248 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.042235    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 26 15:50:04.042402 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.042391    2556 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 26 15:50:04.042444 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.042426    2556 kubelet.go:486] "Attempting to sync node with API server"
Jul 26 15:50:04.042444 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.042439    2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 26 15:50:04.042514 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.042455    2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 26 15:50:04.042514 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.042468    2556 kubelet.go:398] "Adding apiserver pod source"
Jul 26 15:50:04.042514 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.042478    2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 26 15:50:04.042876 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.042865    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 26 15:50:04.042911 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.042886    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 26 15:50:04.046131 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.046113    2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 26 15:50:04.047922 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.047907    2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 26 15:50:04.047978 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.047947    2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 26 15:50:04.049421 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.049408    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 26 15:50:04.049471 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.049427    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 26 15:50:04.049471 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.049433    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 26 15:50:04.049471 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.049438    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 26 15:50:04.049471 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.049447    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 26 15:50:04.049471 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.049453    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 26 15:50:04.049471 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.049461    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 26 15:50:04.049471 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.049466    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 26 15:50:04.049471 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.049473    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 26 15:50:04.049731 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.049478    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 26 15:50:04.049731 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.049487    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 26 15:50:04.049731 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.049492    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 26 15:50:04.050036 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.050026    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 26 15:50:04.050036 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.050035    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 26 15:50:04.053086 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.053072    2556 server.go:1268] "Started kubelet"
Jul 26 15:50:04.053195 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.053169    2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 26 15:50:04.053247 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.053178    2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 26 15:50:04.053247 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.053244    2556 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 26 15:50:04.054222 ip-10-0-142-224 systemd[1]: Started Kubernetes Kubelet.
Jul 26 15:50:04.055105 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.055021    2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 26 15:50:04.055676 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.055662    2556 server.go:310] "Adding debug handlers to kubelet server"
Jul 26 15:50:04.056768 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.056747    2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-224.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 26 15:50:04.057100 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:04.057063    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-224.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 26 15:50:04.057184 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:04.057101    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 26 15:50:04.057983 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:04.057963    2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 26 15:50:04.058806 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.058786    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v86m8"
Jul 26 15:50:04.062742 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:04.061943    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-224.ec2.internal.18c5e1b725e12b08  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-224.ec2.internal,UID:ip-10-0-142-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-224.ec2.internal,},FirstTimestamp:2026-07-26 15:50:04.053048072 +0000 UTC m=+0.271675112,LastTimestamp:2026-07-26 15:50:04.053048072 +0000 UTC m=+0.271675112,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-224.ec2.internal,}"
Jul 26 15:50:04.064158 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.064142    2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 26 15:50:04.064158 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.064153    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 26 15:50:04.064261 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:04.064209    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-224.ec2.internal\" not found"
Jul 26 15:50:04.064690 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.064643    2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 26 15:50:04.064690 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.064655    2556 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 26 15:50:04.064690 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.064677    2556 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 26 15:50:04.064988 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.064971    2556 factory.go:55] Registering systemd factory
Jul 26 15:50:04.065057 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.064991    2556 factory.go:223] Registration of the systemd container factory successfully
Jul 26 15:50:04.065129 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.065115    2556 reconstruct.go:97] "Volume reconstruction finished"
Jul 26 15:50:04.065175 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.065129    2556 reconciler.go:29] "Reconciler: start to sync state"
Jul 26 15:50:04.065225 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.065172    2556 factory.go:153] Registering CRI-O factory
Jul 26 15:50:04.065225 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.065186    2556 factory.go:223] Registration of the crio container factory successfully
Jul 26 15:50:04.065318 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.065248    2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 26 15:50:04.065318 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.065271    2556 factory.go:103] Registering Raw factory
Jul 26 15:50:04.065318 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.065287    2556 manager.go:1196] Started watching for new ooms in manager
Jul 26 15:50:04.065854 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.065798    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v86m8"
Jul 26 15:50:04.066622 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.066609    2556 manager.go:349] Starting recovery of all containers
Jul 26 15:50:04.067484 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:04.067461    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 26 15:50:04.067702 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:04.067589    2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-224.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 26 15:50:04.080686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.080668    2556 manager.go:354] Recovery completed
Jul 26 15:50:04.084645 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.084622    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:50:04.087129 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.087115    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:50:04.087207 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.087140    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:50:04.087207 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.087150    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:50:04.087677 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.087660    2556 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 26 15:50:04.087768 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.087678    2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 26 15:50:04.087768 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.087705    2556 state_mem.go:36] "Initialized new in-memory state store"
Jul 26 15:50:04.087768 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.087663    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:50:04.088531 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.088513    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:50:04.088619 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.088542    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:50:04.088619 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.088557    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:50:04.090194 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.090182    2556 policy_none.go:49] "None policy: Start"
Jul 26 15:50:04.090194 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.090197    2556 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 26 15:50:04.090276 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.090207    2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 26 15:50:04.092180 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.092168    2556 policy_none.go:47] "Start"
Jul 26 15:50:04.133910 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.133776    2556 manager.go:337] "Starting Device Plugin manager"
Jul 26 15:50:04.133983 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:04.133932    2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 26 15:50:04.133983 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.133945    2556 server.go:87] "Starting device plugin registration server"
Jul 26 15:50:04.134181 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.134169    2556 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 26 15:50:04.134221 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.134184    2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 26 15:50:04.134281 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.134263    2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 26 15:50:04.134361 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.134347    2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 26 15:50:04.134586 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.134363    2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 26 15:50:04.134805 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:04.134791    2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 26 15:50:04.134887 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:04.134841    2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-224.ec2.internal\" not found"
Jul 26 15:50:04.207869 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.207846    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 26 15:50:04.209861 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.209021    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 26 15:50:04.209861 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.209067    2556 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 26 15:50:04.209861 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.209089    2556 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 26 15:50:04.209861 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:04.209128    2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 26 15:50:04.211343 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.211327    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:50:04.234539 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.234525    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:50:04.235303 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.235289    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:50:04.235376 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.235323    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:50:04.235376 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.235333    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:50:04.235376 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.235353    2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-224.ec2.internal"
Jul 26 15:50:04.243022 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.242978    2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-224.ec2.internal"
Jul 26 15:50:04.243022 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:04.243001    2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-224.ec2.internal\": node \"ip-10-0-142-224.ec2.internal\" not found"
Jul 26 15:50:04.266405 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:04.266385    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-224.ec2.internal\" not found"
Jul 26 15:50:04.310019 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.309988    2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-224.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-224.ec2.internal"]
Jul 26 15:50:04.310163 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.310067    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:50:04.311477 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.311459    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:50:04.311551 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.311496    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:50:04.311551 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.311511    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:50:04.313737 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.313724    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:50:04.313860 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.313845    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-224.ec2.internal"
Jul 26 15:50:04.313940 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.313881    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:50:04.314403 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.314390    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:50:04.314463 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.314413    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:50:04.314463 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.314436    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:50:04.314463 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.314445    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:50:04.314565 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.314465    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:50:04.314565 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.314475    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:50:04.316551 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.316534    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-224.ec2.internal"
Jul 26 15:50:04.316662 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.316556    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:50:04.317146 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.317128    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:50:04.317227 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.317167    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:50:04.317227 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.317178    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:50:04.347270 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:04.347251    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-224.ec2.internal\" not found" node="ip-10-0-142-224.ec2.internal"
Jul 26 15:50:04.351577 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:04.351562    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-224.ec2.internal\" not found" node="ip-10-0-142-224.ec2.internal"
Jul 26 15:50:04.366389 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.366372    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75b71d15a6bdf485e2a4be2e01686620-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-224.ec2.internal\" (UID: \"75b71d15a6bdf485e2a4be2e01686620\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-224.ec2.internal"
Jul 26 15:50:04.366474 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.366396    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d2eb1ec8e8cd2f3930f67ac8058bec51-config\") pod \"kube-apiserver-proxy-ip-10-0-142-224.ec2.internal\" (UID: \"d2eb1ec8e8cd2f3930f67ac8058bec51\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-224.ec2.internal"
Jul 26 15:50:04.366474 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.366412    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/75b71d15a6bdf485e2a4be2e01686620-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-224.ec2.internal\" (UID: \"75b71d15a6bdf485e2a4be2e01686620\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-224.ec2.internal"
Jul 26 15:50:04.366474 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:04.366430    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-224.ec2.internal\" not found"
Jul 26 15:50:04.467258 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:04.467233    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-224.ec2.internal\" not found"
Jul 26 15:50:04.467372 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.467278    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/75b71d15a6bdf485e2a4be2e01686620-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-224.ec2.internal\" (UID: \"75b71d15a6bdf485e2a4be2e01686620\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-224.ec2.internal"
Jul 26 15:50:04.467372 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.467299    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75b71d15a6bdf485e2a4be2e01686620-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-224.ec2.internal\" (UID: \"75b71d15a6bdf485e2a4be2e01686620\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-224.ec2.internal"
Jul 26 15:50:04.467372 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.467315    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d2eb1ec8e8cd2f3930f67ac8058bec51-config\") pod \"kube-apiserver-proxy-ip-10-0-142-224.ec2.internal\" (UID: \"d2eb1ec8e8cd2f3930f67ac8058bec51\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-224.ec2.internal"
Jul 26 15:50:04.467372 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.467348    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d2eb1ec8e8cd2f3930f67ac8058bec51-config\") pod \"kube-apiserver-proxy-ip-10-0-142-224.ec2.internal\" (UID: \"d2eb1ec8e8cd2f3930f67ac8058bec51\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-224.ec2.internal"
Jul 26 15:50:04.467372 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.467357    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/75b71d15a6bdf485e2a4be2e01686620-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-224.ec2.internal\" (UID: \"75b71d15a6bdf485e2a4be2e01686620\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-224.ec2.internal"
Jul 26 15:50:04.467521 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.467379    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75b71d15a6bdf485e2a4be2e01686620-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-224.ec2.internal\" (UID: \"75b71d15a6bdf485e2a4be2e01686620\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-224.ec2.internal"
Jul 26 15:50:04.567945 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:04.567869    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-224.ec2.internal\" not found"
Jul 26 15:50:04.650117 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.650075    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-224.ec2.internal"
Jul 26 15:50:04.655055 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.655034    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-224.ec2.internal"
Jul 26 15:50:04.668741 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:04.668722    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-224.ec2.internal\" not found"
Jul 26 15:50:04.771236 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:04.771199    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-224.ec2.internal\" not found"
Jul 26 15:50:04.871399 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:04.871303    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-224.ec2.internal\" not found"
Jul 26 15:50:04.901213 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.901191    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:50:04.908138 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.908111    2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:50:04.965311 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.965275    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-224.ec2.internal"
Jul 26 15:50:04.976463 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.976443    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 26 15:50:04.977269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.977256    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-224.ec2.internal"
Jul 26 15:50:04.993552 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:04.993534    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 26 15:50:05.009367 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.009341    2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 26 15:50:05.009506 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.009477    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 26 15:50:05.009616 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.009520    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 26 15:50:05.009616 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.009520    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 26 15:50:05.042924 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.042892    2556 apiserver.go:52] "Watching apiserver"
Jul 26 15:50:05.062320 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.062296    2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 26 15:50:05.062698 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.062652    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-psdlz","kube-system/konnectivity-agent-vqkl6","kube-system/kube-apiserver-proxy-ip-10-0-142-224.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42","openshift-dns/node-resolver-xcj2r","openshift-image-registry/node-ca-tp5k8","openshift-network-operator/iptables-alerter-x7r4w","openshift-ovn-kubernetes/ovnkube-node-dhwpz","kube-system/global-pull-secret-syncer-n7rxf","openshift-cluster-node-tuning-operator/tuned-8m8xz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-224.ec2.internal","openshift-multus/multus-additional-cni-plugins-xj7sr","openshift-multus/multus-nc45v","openshift-multus/network-metrics-daemon-wjzf7"]
Jul 26 15:50:05.064255 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.064239    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 26 15:50:05.065975 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.065953    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x7r4w"
Jul 26 15:50:05.068174 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.068153    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.069079 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.069051    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 26 15:50:05.069079 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.069064    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 26 15:50:05.069266 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.069155    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9j6f4\""
Jul 26 15:50:05.069266 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.069176    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 26 15:50:05.070483 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.070460    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:05.070586 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:05.070560    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjzf7" podUID="cc418ed5-59fd-4c09-9c91-8bd912a4bd73"
Jul 26 15:50:05.070745 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.070726    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 26 15:50:05.070819 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.070724    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-225vd\""
Jul 26 15:50:05.070874 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.070841    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 26 15:50:05.071061 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.071036    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 26 15:50:05.071144 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.071104    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 26 15:50:05.072118 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.072082    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-25 15:45:04 +0000 UTC" deadline="2028-01-30 23:16:44.277650047 +0000 UTC"
Jul 26 15:50:05.072118 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.072109    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a8b1f0e0-036d-4631-9bd8-0afd293b45ba-iptables-alerter-script\") pod \"iptables-alerter-x7r4w\" (UID: \"a8b1f0e0-036d-4631-9bd8-0afd293b45ba\") " pod="openshift-network-operator/iptables-alerter-x7r4w"
Jul 26 15:50:05.072240 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.072118    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13279h26m39.205536148s"
Jul 26 15:50:05.072240 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.072131    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8b1f0e0-036d-4631-9bd8-0afd293b45ba-host-slash\") pod \"iptables-alerter-x7r4w\" (UID: \"a8b1f0e0-036d-4631-9bd8-0afd293b45ba\") " pod="openshift-network-operator/iptables-alerter-x7r4w"
Jul 26 15:50:05.072240 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.072173    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8sgq\" (UniqueName: \"kubernetes.io/projected/a8b1f0e0-036d-4631-9bd8-0afd293b45ba-kube-api-access-v8sgq\") pod \"iptables-alerter-x7r4w\" (UID: \"a8b1f0e0-036d-4631-9bd8-0afd293b45ba\") " pod="openshift-network-operator/iptables-alerter-x7r4w"
Jul 26 15:50:05.072822 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.072806    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.075118 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.075101    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xcj2r"
Jul 26 15:50:05.075248 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.075208    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 26 15:50:05.075364 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.075260    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qpw4p\""
Jul 26 15:50:05.075364 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.075158    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 26 15:50:05.075364 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.075132    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 26 15:50:05.075364 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.075171    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 26 15:50:05.077319 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.077305    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 26 15:50:05.077698 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.077681    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 26 15:50:05.077813 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.077799    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4qcfn\""
Jul 26 15:50:05.078173 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.078158    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.080665 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.080632    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:05.080801 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:05.080715    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7rxf" podUID="d15f46dd-2ac8-4355-bb37-d19f8837deda"
Jul 26 15:50:05.080893 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.080868    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 26 15:50:05.080893 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.080878    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 26 15:50:05.081048 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.080893    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 26 15:50:05.081048 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.080959    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 26 15:50:05.081048 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.080987    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 26 15:50:05.081223 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.081203    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s75px\""
Jul 26 15:50:05.081285 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.081261    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 26 15:50:05.083321 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.083302    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:05.083415 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:05.083356    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psdlz" podUID="e7ce1458-87fd-4ce6-ab5a-19218c78cbb1"
Jul 26 15:50:05.085818 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.085795    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vqkl6"
Jul 26 15:50:05.088154 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.088135    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 26 15:50:05.088270 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.088202    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 26 15:50:05.088347 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.088279    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-npbfs\""
Jul 26 15:50:05.088347 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.088310    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.091008 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.090990    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dj7bg\""
Jul 26 15:50:05.091210 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.091187    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 26 15:50:05.091308 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.091195    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 26 15:50:05.091491 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.091457    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.093532 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.093513    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 26 15:50:05.093642 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.093587    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 26 15:50:05.093642 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.093610    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kvcwl\""
Jul 26 15:50:05.094544 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.094527    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tp5k8"
Jul 26 15:50:05.096820 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.096801    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 26 15:50:05.096898 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.096843    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k9rbg\""
Jul 26 15:50:05.096898 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.096881    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 26 15:50:05.097111 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.097097    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 26 15:50:05.100119 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.100100    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-47294"
Jul 26 15:50:05.108230 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.108206    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-47294"
Jul 26 15:50:05.166506 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.166483    2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 26 15:50:05.173030 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173002    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-host\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.173138 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173035    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4942130-b152-4353-ac91-262958a3e684-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.173138 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173055    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-496dp\" (UniqueName: \"kubernetes.io/projected/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-kube-api-access-496dp\") pod \"network-metrics-daemon-wjzf7\" (UID: \"cc418ed5-59fd-4c09-9c91-8bd912a4bd73\") " pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:05.173138 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173070    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-run-ovn\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.173138 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173108    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d15f46dd-2ac8-4355-bb37-d19f8837deda-dbus\") pod \"global-pull-secret-syncer-n7rxf\" (UID: \"d15f46dd-2ac8-4355-bb37-d19f8837deda\") " pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:05.173285 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173160    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-sys\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.173285 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173217    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-tmp\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.173285 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173253    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34d4d07d-3fa0-483d-a2ea-5f426e16a481-sys-fs\") pod \"aws-ebs-csi-driver-node-z5q42\" (UID: \"34d4d07d-3fa0-483d-a2ea-5f426e16a481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.173376 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173290    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phkzc\" (UniqueName: \"kubernetes.io/projected/8ff4109f-26ad-4a48-94d2-05f67fb8bbc2-kube-api-access-phkzc\") pod \"node-resolver-xcj2r\" (UID: \"8ff4109f-26ad-4a48-94d2-05f67fb8bbc2\") " pod="openshift-dns/node-resolver-xcj2r"
Jul 26 15:50:05.173376 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173309    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-multus-socket-dir-parent\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.173376 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173325    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-host-var-lib-cni-bin\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.173376 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173341    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34d4d07d-3fa0-483d-a2ea-5f426e16a481-registration-dir\") pod \"aws-ebs-csi-driver-node-z5q42\" (UID: \"34d4d07d-3fa0-483d-a2ea-5f426e16a481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.173516 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173380    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4942130-b152-4353-ac91-262958a3e684-os-release\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.173516 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173426    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8fdz\" (UniqueName: \"kubernetes.io/projected/a4942130-b152-4353-ac91-262958a3e684-kube-api-access-x8fdz\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.173516 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173451    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-run\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.173516 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173474    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-os-release\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.173516 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173498    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-env-overrides\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.173695 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173523    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8b1f0e0-036d-4631-9bd8-0afd293b45ba-host-slash\") pod \"iptables-alerter-x7r4w\" (UID: \"a8b1f0e0-036d-4631-9bd8-0afd293b45ba\") " pod="openshift-network-operator/iptables-alerter-x7r4w"
Jul 26 15:50:05.173695 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173563    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8b1f0e0-036d-4631-9bd8-0afd293b45ba-host-slash\") pod \"iptables-alerter-x7r4w\" (UID: \"a8b1f0e0-036d-4631-9bd8-0afd293b45ba\") " pod="openshift-network-operator/iptables-alerter-x7r4w"
Jul 26 15:50:05.173695 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173595    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-host-run-ovn-kubernetes\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.173695 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173619    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-etc-sysctl-conf\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.173695 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173636    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4942130-b152-4353-ac91-262958a3e684-system-cni-dir\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.173695 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173680    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-ovnkube-config\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.173974 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173703    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34d4d07d-3fa0-483d-a2ea-5f426e16a481-device-dir\") pod \"aws-ebs-csi-driver-node-z5q42\" (UID: \"34d4d07d-3fa0-483d-a2ea-5f426e16a481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.173974 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173725    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-host-kubelet\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.173974 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173753    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-etc-openvswitch\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.173974 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173807    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-ovnkube-script-lib\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.173974 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173851    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-lib-modules\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.173974 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173879    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-host-cni-netd\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.173974 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173909    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.173974 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.173952    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret\") pod \"global-pull-secret-syncer-n7rxf\" (UID: \"d15f46dd-2ac8-4355-bb37-d19f8837deda\") " pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:05.174412 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174002    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-var-lib-kubelet\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.174412 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174030    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-host-run-netns\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.174412 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174056    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d1155f7e-3fe4-4801-ac62-3a926a5821ce-multus-daemon-config\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.174412 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174093    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-run-openvswitch\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.174412 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174118    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-etc-sysconfig\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.174412 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174144    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-multus-cni-dir\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.174412 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174189    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-host-run-k8s-cni-cncf-io\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.174412 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174212    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-hostroot\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.174412 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174230    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-multus-conf-dir\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.174412 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174261    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a8b1f0e0-036d-4631-9bd8-0afd293b45ba-iptables-alerter-script\") pod \"iptables-alerter-x7r4w\" (UID: \"a8b1f0e0-036d-4631-9bd8-0afd293b45ba\") " pod="openshift-network-operator/iptables-alerter-x7r4w"
Jul 26 15:50:05.174412 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174282    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8710b2c4-8507-4879-aa1f-a677175fcd6e-agent-certs\") pod \"konnectivity-agent-vqkl6\" (UID: \"8710b2c4-8507-4879-aa1f-a677175fcd6e\") " pod="kube-system/konnectivity-agent-vqkl6"
Jul 26 15:50:05.174412 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174304    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34d4d07d-3fa0-483d-a2ea-5f426e16a481-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z5q42\" (UID: \"34d4d07d-3fa0-483d-a2ea-5f426e16a481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.174412 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174342    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-etc-modprobe-d\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.174412 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174366    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e2c0e7ad-45f1-4542-9a7e-272eb322c490-serviceca\") pod \"node-ca-tp5k8\" (UID: \"e2c0e7ad-45f1-4542-9a7e-272eb322c490\") " pod="openshift-image-registry/node-ca-tp5k8"
Jul 26 15:50:05.174412 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174405    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-systemd-units\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.175166 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174514    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-log-socket\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.175166 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174550    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-ovn-node-metrics-cert\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.175166 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174576    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d15f46dd-2ac8-4355-bb37-d19f8837deda-kubelet-config\") pod \"global-pull-secret-syncer-n7rxf\" (UID: \"d15f46dd-2ac8-4355-bb37-d19f8837deda\") " pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:05.175166 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174597    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-etc-tuned\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.175166 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174615    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-system-cni-dir\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.175166 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174677    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4942130-b152-4353-ac91-262958a3e684-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.175166 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174711    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1155f7e-3fe4-4801-ac62-3a926a5821ce-cni-binary-copy\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.175166 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174734    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-node-log\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.175166 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174748    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-host-cni-bin\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.175166 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174773    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-etc-sysctl-d\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.175166 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174808    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-etc-systemd\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.175166 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174832    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-host-run-multus-certs\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.175166 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174857    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34d4d07d-3fa0-483d-a2ea-5f426e16a481-socket-dir\") pod \"aws-ebs-csi-driver-node-z5q42\" (UID: \"34d4d07d-3fa0-483d-a2ea-5f426e16a481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.175166 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174894    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ff4109f-26ad-4a48-94d2-05f67fb8bbc2-tmp-dir\") pod \"node-resolver-xcj2r\" (UID: \"8ff4109f-26ad-4a48-94d2-05f67fb8bbc2\") " pod="openshift-dns/node-resolver-xcj2r"
Jul 26 15:50:05.175166 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174922    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs\") pod \"network-metrics-daemon-wjzf7\" (UID: \"cc418ed5-59fd-4c09-9c91-8bd912a4bd73\") " pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:05.175166 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174958    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-etc-kubernetes\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.176010 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174981    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbldb\" (UniqueName: \"kubernetes.io/projected/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-kube-api-access-rbldb\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.176010 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.174998    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-host-var-lib-kubelet\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.176010 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.175022    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4942130-b152-4353-ac91-262958a3e684-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.176010 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.175051    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8sgq\" (UniqueName: \"kubernetes.io/projected/a8b1f0e0-036d-4631-9bd8-0afd293b45ba-kube-api-access-v8sgq\") pod \"iptables-alerter-x7r4w\" (UID: \"a8b1f0e0-036d-4631-9bd8-0afd293b45ba\") " pod="openshift-network-operator/iptables-alerter-x7r4w"
Jul 26 15:50:05.176010 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.175075    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8710b2c4-8507-4879-aa1f-a677175fcd6e-konnectivity-ca\") pod \"konnectivity-agent-vqkl6\" (UID: \"8710b2c4-8507-4879-aa1f-a677175fcd6e\") " pod="kube-system/konnectivity-agent-vqkl6"
Jul 26 15:50:05.176010 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.175094    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-host-var-lib-cni-multus\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.176010 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.175117    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34d4d07d-3fa0-483d-a2ea-5f426e16a481-etc-selinux\") pod \"aws-ebs-csi-driver-node-z5q42\" (UID: \"34d4d07d-3fa0-483d-a2ea-5f426e16a481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.176010 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.175139    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8ff4109f-26ad-4a48-94d2-05f67fb8bbc2-hosts-file\") pod \"node-resolver-xcj2r\" (UID: \"8ff4109f-26ad-4a48-94d2-05f67fb8bbc2\") " pod="openshift-dns/node-resolver-xcj2r"
Jul 26 15:50:05.176010 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.175189    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4942130-b152-4353-ac91-262958a3e684-cnibin\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.176010 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.175237    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4942130-b152-4353-ac91-262958a3e684-cni-binary-copy\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.176010 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.175270    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2c0e7ad-45f1-4542-9a7e-272eb322c490-host\") pod \"node-ca-tp5k8\" (UID: \"e2c0e7ad-45f1-4542-9a7e-272eb322c490\") " pod="openshift-image-registry/node-ca-tp5k8"
Jul 26 15:50:05.176010 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.175301    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-host-slash\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.176010 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.175323    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x49x5\" (UniqueName: \"kubernetes.io/projected/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-kube-api-access-x49x5\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.176010 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.175343    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-cnibin\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.176010 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.175364    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhzpm\" (UniqueName: \"kubernetes.io/projected/d1155f7e-3fe4-4801-ac62-3a926a5821ce-kube-api-access-hhzpm\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.176010 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.175386    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqt24\" (UniqueName: \"kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24\") pod \"network-check-target-psdlz\" (UID: \"e7ce1458-87fd-4ce6-ab5a-19218c78cbb1\") " pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:05.176950 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.175411    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmw7c\" (UniqueName: \"kubernetes.io/projected/e2c0e7ad-45f1-4542-9a7e-272eb322c490-kube-api-access-tmw7c\") pod \"node-ca-tp5k8\" (UID: \"e2c0e7ad-45f1-4542-9a7e-272eb322c490\") " pod="openshift-image-registry/node-ca-tp5k8"
Jul 26 15:50:05.176950 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.175433    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-var-lib-openvswitch\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.176950 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.175456    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-host-run-netns\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.176950 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.175476    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-run-systemd\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.176950 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.175496    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-etc-kubernetes\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.176950 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.175519    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkg7s\" (UniqueName: \"kubernetes.io/projected/34d4d07d-3fa0-483d-a2ea-5f426e16a481-kube-api-access-mkg7s\") pod \"aws-ebs-csi-driver-node-z5q42\" (UID: \"34d4d07d-3fa0-483d-a2ea-5f426e16a481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.176950 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.175534    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a8b1f0e0-036d-4631-9bd8-0afd293b45ba-iptables-alerter-script\") pod \"iptables-alerter-x7r4w\" (UID: \"a8b1f0e0-036d-4631-9bd8-0afd293b45ba\") " pod="openshift-network-operator/iptables-alerter-x7r4w"
Jul 26 15:50:05.186026 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.186007    2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 26 15:50:05.189176 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.189160    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8sgq\" (UniqueName: \"kubernetes.io/projected/a8b1f0e0-036d-4631-9bd8-0afd293b45ba-kube-api-access-v8sgq\") pod \"iptables-alerter-x7r4w\" (UID: \"a8b1f0e0-036d-4631-9bd8-0afd293b45ba\") " pod="openshift-network-operator/iptables-alerter-x7r4w"
Jul 26 15:50:05.250484 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:05.250449    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75b71d15a6bdf485e2a4be2e01686620.slice/crio-4cb90a380c686e59f7bcd3d0ff4e328f699e70c976b1458452dc51a22f998069 WatchSource:0}: Error finding container 4cb90a380c686e59f7bcd3d0ff4e328f699e70c976b1458452dc51a22f998069: Status 404 returned error can't find the container with id 4cb90a380c686e59f7bcd3d0ff4e328f699e70c976b1458452dc51a22f998069
Jul 26 15:50:05.255012 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.254992    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 15:50:05.260582 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:05.260557    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2eb1ec8e8cd2f3930f67ac8058bec51.slice/crio-6ec9f1183923a31565f0c6dbdc19a767c05e635599c3300e4eb1484080ba63b5 WatchSource:0}: Error finding container 6ec9f1183923a31565f0c6dbdc19a767c05e635599c3300e4eb1484080ba63b5: Status 404 returned error can't find the container with id 6ec9f1183923a31565f0c6dbdc19a767c05e635599c3300e4eb1484080ba63b5
Jul 26 15:50:05.276159 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276135    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8710b2c4-8507-4879-aa1f-a677175fcd6e-konnectivity-ca\") pod \"konnectivity-agent-vqkl6\" (UID: \"8710b2c4-8507-4879-aa1f-a677175fcd6e\") " pod="kube-system/konnectivity-agent-vqkl6"
Jul 26 15:50:05.276259 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276173    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-host-var-lib-cni-multus\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.276259 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276198    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34d4d07d-3fa0-483d-a2ea-5f426e16a481-etc-selinux\") pod \"aws-ebs-csi-driver-node-z5q42\" (UID: \"34d4d07d-3fa0-483d-a2ea-5f426e16a481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.276377 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276258    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-host-var-lib-cni-multus\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.276377 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276320    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8ff4109f-26ad-4a48-94d2-05f67fb8bbc2-hosts-file\") pod \"node-resolver-xcj2r\" (UID: \"8ff4109f-26ad-4a48-94d2-05f67fb8bbc2\") " pod="openshift-dns/node-resolver-xcj2r"
Jul 26 15:50:05.276377 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276355    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4942130-b152-4353-ac91-262958a3e684-cnibin\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.276377 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276367    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34d4d07d-3fa0-483d-a2ea-5f426e16a481-etc-selinux\") pod \"aws-ebs-csi-driver-node-z5q42\" (UID: \"34d4d07d-3fa0-483d-a2ea-5f426e16a481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.276590 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276382    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4942130-b152-4353-ac91-262958a3e684-cni-binary-copy\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.276590 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276416    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8ff4109f-26ad-4a48-94d2-05f67fb8bbc2-hosts-file\") pod \"node-resolver-xcj2r\" (UID: \"8ff4109f-26ad-4a48-94d2-05f67fb8bbc2\") " pod="openshift-dns/node-resolver-xcj2r"
Jul 26 15:50:05.276590 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276436    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4942130-b152-4353-ac91-262958a3e684-cnibin\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.276590 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276480    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2c0e7ad-45f1-4542-9a7e-272eb322c490-host\") pod \"node-ca-tp5k8\" (UID: \"e2c0e7ad-45f1-4542-9a7e-272eb322c490\") " pod="openshift-image-registry/node-ca-tp5k8"
Jul 26 15:50:05.276590 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276502    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-host-slash\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.276590 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276524    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x49x5\" (UniqueName: \"kubernetes.io/projected/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-kube-api-access-x49x5\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.276590 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276557    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-cnibin\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.276590 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276559    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-host-slash\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.276590 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276568    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2c0e7ad-45f1-4542-9a7e-272eb322c490-host\") pod \"node-ca-tp5k8\" (UID: \"e2c0e7ad-45f1-4542-9a7e-272eb322c490\") " pod="openshift-image-registry/node-ca-tp5k8"
Jul 26 15:50:05.277029 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276606    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhzpm\" (UniqueName: \"kubernetes.io/projected/d1155f7e-3fe4-4801-ac62-3a926a5821ce-kube-api-access-hhzpm\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.277029 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276634    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-cnibin\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.277029 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276657    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqt24\" (UniqueName: \"kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24\") pod \"network-check-target-psdlz\" (UID: \"e7ce1458-87fd-4ce6-ab5a-19218c78cbb1\") " pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:05.277029 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276686    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmw7c\" (UniqueName: \"kubernetes.io/projected/e2c0e7ad-45f1-4542-9a7e-272eb322c490-kube-api-access-tmw7c\") pod \"node-ca-tp5k8\" (UID: \"e2c0e7ad-45f1-4542-9a7e-272eb322c490\") " pod="openshift-image-registry/node-ca-tp5k8"
Jul 26 15:50:05.277029 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276711    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-var-lib-openvswitch\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.277029 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276738    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-host-run-netns\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.277029 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276762    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-run-systemd\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.277029 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276807    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-run-systemd\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.277029 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276845    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8710b2c4-8507-4879-aa1f-a677175fcd6e-konnectivity-ca\") pod \"konnectivity-agent-vqkl6\" (UID: \"8710b2c4-8507-4879-aa1f-a677175fcd6e\") " pod="kube-system/konnectivity-agent-vqkl6"
Jul 26 15:50:05.277029 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276861    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-host-run-netns\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.277029 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276850    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-var-lib-openvswitch\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.277029 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276876    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-etc-kubernetes\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.277029 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276939    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkg7s\" (UniqueName: \"kubernetes.io/projected/34d4d07d-3fa0-483d-a2ea-5f426e16a481-kube-api-access-mkg7s\") pod \"aws-ebs-csi-driver-node-z5q42\" (UID: \"34d4d07d-3fa0-483d-a2ea-5f426e16a481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.277029 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276966    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-host\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.277029 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.276966    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-etc-kubernetes\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.277029 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277003    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4942130-b152-4353-ac91-262958a3e684-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.277029 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277023    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-host\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.277864 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277032    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-496dp\" (UniqueName: \"kubernetes.io/projected/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-kube-api-access-496dp\") pod \"network-metrics-daemon-wjzf7\" (UID: \"cc418ed5-59fd-4c09-9c91-8bd912a4bd73\") " pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:05.277864 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277057    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-run-ovn\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.277864 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277065    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4942130-b152-4353-ac91-262958a3e684-cni-binary-copy\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.277864 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277080    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d15f46dd-2ac8-4355-bb37-d19f8837deda-dbus\") pod \"global-pull-secret-syncer-n7rxf\" (UID: \"d15f46dd-2ac8-4355-bb37-d19f8837deda\") " pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:05.277864 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277136    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-run-ovn\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.277864 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277249    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-sys\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.277864 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277279    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d15f46dd-2ac8-4355-bb37-d19f8837deda-dbus\") pod \"global-pull-secret-syncer-n7rxf\" (UID: \"d15f46dd-2ac8-4355-bb37-d19f8837deda\") " pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:05.277864 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277285    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-tmp\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.277864 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277279    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-sys\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.277864 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277328    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34d4d07d-3fa0-483d-a2ea-5f426e16a481-sys-fs\") pod \"aws-ebs-csi-driver-node-z5q42\" (UID: \"34d4d07d-3fa0-483d-a2ea-5f426e16a481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.277864 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277372    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phkzc\" (UniqueName: \"kubernetes.io/projected/8ff4109f-26ad-4a48-94d2-05f67fb8bbc2-kube-api-access-phkzc\") pod \"node-resolver-xcj2r\" (UID: \"8ff4109f-26ad-4a48-94d2-05f67fb8bbc2\") " pod="openshift-dns/node-resolver-xcj2r"
Jul 26 15:50:05.277864 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277401    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-multus-socket-dir-parent\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.277864 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277409    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34d4d07d-3fa0-483d-a2ea-5f426e16a481-sys-fs\") pod \"aws-ebs-csi-driver-node-z5q42\" (UID: \"34d4d07d-3fa0-483d-a2ea-5f426e16a481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.277864 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277420    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-host-var-lib-cni-bin\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.277864 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277488    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-host-var-lib-cni-bin\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.277864 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277489    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-multus-socket-dir-parent\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.277864 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277520    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34d4d07d-3fa0-483d-a2ea-5f426e16a481-registration-dir\") pod \"aws-ebs-csi-driver-node-z5q42\" (UID: \"34d4d07d-3fa0-483d-a2ea-5f426e16a481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.278479 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277563    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4942130-b152-4353-ac91-262958a3e684-os-release\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.278479 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277610    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34d4d07d-3fa0-483d-a2ea-5f426e16a481-registration-dir\") pod \"aws-ebs-csi-driver-node-z5q42\" (UID: \"34d4d07d-3fa0-483d-a2ea-5f426e16a481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.278479 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277591    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8fdz\" (UniqueName: \"kubernetes.io/projected/a4942130-b152-4353-ac91-262958a3e684-kube-api-access-x8fdz\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.278479 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277612    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4942130-b152-4353-ac91-262958a3e684-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.278479 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277676    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-run\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.278479 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277699    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4942130-b152-4353-ac91-262958a3e684-os-release\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.278479 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277804    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-os-release\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.278479 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277838    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-env-overrides\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.278479 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277842    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-run\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.278479 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277867    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-host-run-ovn-kubernetes\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.278479 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277894    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-etc-sysctl-conf\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.278479 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277922    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4942130-b152-4353-ac91-262958a3e684-system-cni-dir\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.278479 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277928    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-host-run-ovn-kubernetes\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.278479 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277948    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-ovnkube-config\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.278479 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277985    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34d4d07d-3fa0-483d-a2ea-5f426e16a481-device-dir\") pod \"aws-ebs-csi-driver-node-z5q42\" (UID: \"34d4d07d-3fa0-483d-a2ea-5f426e16a481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.278479 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.277986    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-os-release\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.278479 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278013    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-host-kubelet\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.279016 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278041    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-etc-openvswitch\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.279016 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278066    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-ovnkube-script-lib\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.279016 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278075    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-host-kubelet\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.279016 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278080    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-etc-sysctl-conf\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.279016 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278042    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34d4d07d-3fa0-483d-a2ea-5f426e16a481-device-dir\") pod \"aws-ebs-csi-driver-node-z5q42\" (UID: \"34d4d07d-3fa0-483d-a2ea-5f426e16a481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.279016 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278093    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-lib-modules\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.279016 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278116    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-etc-openvswitch\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.279016 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278142    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-host-cni-netd\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.279016 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278154    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4942130-b152-4353-ac91-262958a3e684-system-cni-dir\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.279016 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278173    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.279016 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278201    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-lib-modules\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.279016 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278208    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret\") pod \"global-pull-secret-syncer-n7rxf\" (UID: \"d15f46dd-2ac8-4355-bb37-d19f8837deda\") " pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:05.279016 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278242    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-var-lib-kubelet\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.279016 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278270    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-host-run-netns\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.279016 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:05.278289    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:05.279016 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278316    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d1155f7e-3fe4-4801-ac62-3a926a5821ce-multus-daemon-config\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.279016 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278351    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-run-openvswitch\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.279831 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:05.278381    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret podName:d15f46dd-2ac8-4355-bb37-d19f8837deda nodeName:}" failed. No retries permitted until 2026-07-26 15:50:05.778355825 +0000 UTC m=+1.996982875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret") pod "global-pull-secret-syncer-n7rxf" (UID: "d15f46dd-2ac8-4355-bb37-d19f8837deda") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:05.279831 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278398    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-run-openvswitch\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.279831 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278416    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-etc-sysconfig\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.279831 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278444    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-multus-cni-dir\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.279831 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278448    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-var-lib-kubelet\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.279831 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278504    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-multus-cni-dir\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.279831 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278539    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-env-overrides\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.279831 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278550    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-host-run-netns\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.279831 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278595    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-ovnkube-script-lib\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.279831 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278627    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-host-run-k8s-cni-cncf-io\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.279831 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278639    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.279831 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278653    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-hostroot\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.279831 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278677    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-multus-conf-dir\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.279831 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278701    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-host-cni-netd\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.279831 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278729    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8710b2c4-8507-4879-aa1f-a677175fcd6e-agent-certs\") pod \"konnectivity-agent-vqkl6\" (UID: \"8710b2c4-8507-4879-aa1f-a677175fcd6e\") " pod="kube-system/konnectivity-agent-vqkl6"
Jul 26 15:50:05.279831 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278753    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-etc-sysconfig\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.279831 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278754    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34d4d07d-3fa0-483d-a2ea-5f426e16a481-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z5q42\" (UID: \"34d4d07d-3fa0-483d-a2ea-5f426e16a481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.280730 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278802    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34d4d07d-3fa0-483d-a2ea-5f426e16a481-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z5q42\" (UID: \"34d4d07d-3fa0-483d-a2ea-5f426e16a481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.280730 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278807    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-etc-modprobe-d\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.280730 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278858    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-hostroot\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.280730 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278903    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-host-run-k8s-cni-cncf-io\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.280730 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278933    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e2c0e7ad-45f1-4542-9a7e-272eb322c490-serviceca\") pod \"node-ca-tp5k8\" (UID: \"e2c0e7ad-45f1-4542-9a7e-272eb322c490\") " pod="openshift-image-registry/node-ca-tp5k8"
Jul 26 15:50:05.280730 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278956    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-ovnkube-config\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.280730 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278959    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-systemd-units\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.280730 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.278989    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-systemd-units\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.280730 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279014    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-log-socket\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.280730 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279040    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-ovn-node-metrics-cert\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.280730 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279051    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-etc-modprobe-d\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.280730 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279074    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d15f46dd-2ac8-4355-bb37-d19f8837deda-kubelet-config\") pod \"global-pull-secret-syncer-n7rxf\" (UID: \"d15f46dd-2ac8-4355-bb37-d19f8837deda\") " pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:05.280730 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279122    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-etc-tuned\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.280730 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279134    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d1155f7e-3fe4-4801-ac62-3a926a5821ce-multus-daemon-config\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.280730 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279148    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-system-cni-dir\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.280730 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279156    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-log-socket\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.280730 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279122    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d15f46dd-2ac8-4355-bb37-d19f8837deda-kubelet-config\") pod \"global-pull-secret-syncer-n7rxf\" (UID: \"d15f46dd-2ac8-4355-bb37-d19f8837deda\") " pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:05.280730 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279175    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4942130-b152-4353-ac91-262958a3e684-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.281644 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279216    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1155f7e-3fe4-4801-ac62-3a926a5821ce-cni-binary-copy\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.281644 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279243    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-node-log\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.281644 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279276    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-system-cni-dir\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.281644 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279277    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-host-cni-bin\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.281644 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279317    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-etc-sysctl-d\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.281644 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279329    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-multus-conf-dir\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.281644 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279347    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-etc-systemd\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.281644 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279374    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-host-run-multus-certs\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.281644 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279401    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34d4d07d-3fa0-483d-a2ea-5f426e16a481-socket-dir\") pod \"aws-ebs-csi-driver-node-z5q42\" (UID: \"34d4d07d-3fa0-483d-a2ea-5f426e16a481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.281644 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279427    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ff4109f-26ad-4a48-94d2-05f67fb8bbc2-tmp-dir\") pod \"node-resolver-xcj2r\" (UID: \"8ff4109f-26ad-4a48-94d2-05f67fb8bbc2\") " pod="openshift-dns/node-resolver-xcj2r"
Jul 26 15:50:05.281644 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279516    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs\") pod \"network-metrics-daemon-wjzf7\" (UID: \"cc418ed5-59fd-4c09-9c91-8bd912a4bd73\") " pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:05.281644 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279541    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-etc-kubernetes\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.281644 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279565    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbldb\" (UniqueName: \"kubernetes.io/projected/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-kube-api-access-rbldb\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.281644 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279606    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-host-var-lib-kubelet\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.281644 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279628    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-node-log\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.281644 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279631    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4942130-b152-4353-ac91-262958a3e684-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.281644 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279402    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e2c0e7ad-45f1-4542-9a7e-272eb322c490-serviceca\") pod \"node-ca-tp5k8\" (UID: \"e2c0e7ad-45f1-4542-9a7e-272eb322c490\") " pod="openshift-image-registry/node-ca-tp5k8"
Jul 26 15:50:05.281644 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279810    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-etc-sysctl-d\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.282285 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279823    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4942130-b152-4353-ac91-262958a3e684-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.282285 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279318    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-host-cni-bin\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.282285 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279823    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4942130-b152-4353-ac91-262958a3e684-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.282285 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279865    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-etc-systemd\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.282285 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279884    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-etc-kubernetes\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.282285 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279943    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-host-var-lib-kubelet\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.282285 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279883    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1155f7e-3fe4-4801-ac62-3a926a5821ce-cni-binary-copy\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.282285 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.279981    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34d4d07d-3fa0-483d-a2ea-5f426e16a481-socket-dir\") pod \"aws-ebs-csi-driver-node-z5q42\" (UID: \"34d4d07d-3fa0-483d-a2ea-5f426e16a481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.282285 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:05.279991    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:05.282285 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:05.280052    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs podName:cc418ed5-59fd-4c09-9c91-8bd912a4bd73 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:05.780033693 +0000 UTC m=+1.998660728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs") pod "network-metrics-daemon-wjzf7" (UID: "cc418ed5-59fd-4c09-9c91-8bd912a4bd73") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:05.282285 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.280112    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-tmp\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.282285 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.280189    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ff4109f-26ad-4a48-94d2-05f67fb8bbc2-tmp-dir\") pod \"node-resolver-xcj2r\" (UID: \"8ff4109f-26ad-4a48-94d2-05f67fb8bbc2\") " pod="openshift-dns/node-resolver-xcj2r"
Jul 26 15:50:05.282285 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.280202    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d1155f7e-3fe4-4801-ac62-3a926a5821ce-host-run-multus-certs\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.282285 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.281481    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-ovn-node-metrics-cert\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.282285 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.281588    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8710b2c4-8507-4879-aa1f-a677175fcd6e-agent-certs\") pod \"konnectivity-agent-vqkl6\" (UID: \"8710b2c4-8507-4879-aa1f-a677175fcd6e\") " pod="kube-system/konnectivity-agent-vqkl6"
Jul 26 15:50:05.282285 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.281853    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-etc-tuned\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.286084 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.286058    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x49x5\" (UniqueName: \"kubernetes.io/projected/906b2311-fcf7-4a5f-94ba-5f7f46d7854c-kube-api-access-x49x5\") pod \"ovnkube-node-dhwpz\" (UID: \"906b2311-fcf7-4a5f-94ba-5f7f46d7854c\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.286174 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:05.286149    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:50:05.286174 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:05.286171    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:50:05.286254 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:05.286184    2556 projected.go:196] Error preparing data for projected volume kube-api-access-xqt24 for pod openshift-network-diagnostics/network-check-target-psdlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:05.286254 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:05.286248    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24 podName:e7ce1458-87fd-4ce6-ab5a-19218c78cbb1 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:05.78622947 +0000 UTC m=+2.004856518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xqt24" (UniqueName: "kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24") pod "network-check-target-psdlz" (UID: "e7ce1458-87fd-4ce6-ab5a-19218c78cbb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:05.287376 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.287352    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmw7c\" (UniqueName: \"kubernetes.io/projected/e2c0e7ad-45f1-4542-9a7e-272eb322c490-kube-api-access-tmw7c\") pod \"node-ca-tp5k8\" (UID: \"e2c0e7ad-45f1-4542-9a7e-272eb322c490\") " pod="openshift-image-registry/node-ca-tp5k8"
Jul 26 15:50:05.288223 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.288191    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkg7s\" (UniqueName: \"kubernetes.io/projected/34d4d07d-3fa0-483d-a2ea-5f426e16a481-kube-api-access-mkg7s\") pod \"aws-ebs-csi-driver-node-z5q42\" (UID: \"34d4d07d-3fa0-483d-a2ea-5f426e16a481\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.288678 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.288643    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-496dp\" (UniqueName: \"kubernetes.io/projected/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-kube-api-access-496dp\") pod \"network-metrics-daemon-wjzf7\" (UID: \"cc418ed5-59fd-4c09-9c91-8bd912a4bd73\") " pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:05.288954 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.288937    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phkzc\" (UniqueName: \"kubernetes.io/projected/8ff4109f-26ad-4a48-94d2-05f67fb8bbc2-kube-api-access-phkzc\") pod \"node-resolver-xcj2r\" (UID: \"8ff4109f-26ad-4a48-94d2-05f67fb8bbc2\") " pod="openshift-dns/node-resolver-xcj2r"
Jul 26 15:50:05.289075 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.289054    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8fdz\" (UniqueName: \"kubernetes.io/projected/a4942130-b152-4353-ac91-262958a3e684-kube-api-access-x8fdz\") pod \"multus-additional-cni-plugins-xj7sr\" (UID: \"a4942130-b152-4353-ac91-262958a3e684\") " pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.290005 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.289988    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhzpm\" (UniqueName: \"kubernetes.io/projected/d1155f7e-3fe4-4801-ac62-3a926a5821ce-kube-api-access-hhzpm\") pod \"multus-nc45v\" (UID: \"d1155f7e-3fe4-4801-ac62-3a926a5821ce\") " pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.290417 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.290402    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbldb\" (UniqueName: \"kubernetes.io/projected/6a0561c2-eb94-4929-b5ae-6bf9b96e0f29-kube-api-access-rbldb\") pod \"tuned-8m8xz\" (UID: \"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29\") " pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.395718 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.395625    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x7r4w"
Jul 26 15:50:05.405941 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:05.405912    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8b1f0e0_036d_4631_9bd8_0afd293b45ba.slice/crio-942f1f28f059c5e65ee6b140cbce8e60492d67233127ff33e2c04ebdcfe9b08e WatchSource:0}: Error finding container 942f1f28f059c5e65ee6b140cbce8e60492d67233127ff33e2c04ebdcfe9b08e: Status 404 returned error can't find the container with id 942f1f28f059c5e65ee6b140cbce8e60492d67233127ff33e2c04ebdcfe9b08e
Jul 26 15:50:05.408028 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.408008    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nc45v"
Jul 26 15:50:05.416762 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:05.416741    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1155f7e_3fe4_4801_ac62_3a926a5821ce.slice/crio-1db3152b7a678158e551f76ef2094a8383e7a8751bde0f2e04f93c3592dfaee6 WatchSource:0}: Error finding container 1db3152b7a678158e551f76ef2094a8383e7a8751bde0f2e04f93c3592dfaee6: Status 404 returned error can't find the container with id 1db3152b7a678158e551f76ef2094a8383e7a8751bde0f2e04f93c3592dfaee6
Jul 26 15:50:05.425646 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.425609    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42"
Jul 26 15:50:05.433400 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:05.433381    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34d4d07d_3fa0_483d_a2ea_5f426e16a481.slice/crio-7278705ac47efcc637499aadf89e465af26f2fdd692cdb284822d02b6bb52ffb WatchSource:0}: Error finding container 7278705ac47efcc637499aadf89e465af26f2fdd692cdb284822d02b6bb52ffb: Status 404 returned error can't find the container with id 7278705ac47efcc637499aadf89e465af26f2fdd692cdb284822d02b6bb52ffb
Jul 26 15:50:05.436789 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.436773    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:50:05.446872 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.446849    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xcj2r"
Jul 26 15:50:05.455086 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:05.455065    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ff4109f_26ad_4a48_94d2_05f67fb8bbc2.slice/crio-9112cca2d74674bd17c456f4b20f12142a4afac8fc678e63d5359eb5da70dbb3 WatchSource:0}: Error finding container 9112cca2d74674bd17c456f4b20f12142a4afac8fc678e63d5359eb5da70dbb3: Status 404 returned error can't find the container with id 9112cca2d74674bd17c456f4b20f12142a4afac8fc678e63d5359eb5da70dbb3
Jul 26 15:50:05.460127 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.460112    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:05.467460 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.467423    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vqkl6"
Jul 26 15:50:05.467939 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:05.467919    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod906b2311_fcf7_4a5f_94ba_5f7f46d7854c.slice/crio-da9a39f52d71e16c05c584b482f3d15274594d6618b3473cd149b1d62f4ef364 WatchSource:0}: Error finding container da9a39f52d71e16c05c584b482f3d15274594d6618b3473cd149b1d62f4ef364: Status 404 returned error can't find the container with id da9a39f52d71e16c05c584b482f3d15274594d6618b3473cd149b1d62f4ef364
Jul 26 15:50:05.500835 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.500814    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8m8xz"
Jul 26 15:50:05.508490 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:05.508471    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a0561c2_eb94_4929_b5ae_6bf9b96e0f29.slice/crio-437ca82b2340144efcb4bac57da18931ef0433881c9baf708de9135c766c3784 WatchSource:0}: Error finding container 437ca82b2340144efcb4bac57da18931ef0433881c9baf708de9135c766c3784: Status 404 returned error can't find the container with id 437ca82b2340144efcb4bac57da18931ef0433881c9baf708de9135c766c3784
Jul 26 15:50:05.514791 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.514768    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xj7sr"
Jul 26 15:50:05.519828 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.519809    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tp5k8"
Jul 26 15:50:05.522757 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:05.522738    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4942130_b152_4353_ac91_262958a3e684.slice/crio-9b498e057e7de6ead27c4876eeb76e2685804f99b9bd524f3bf122d0bf5b0826 WatchSource:0}: Error finding container 9b498e057e7de6ead27c4876eeb76e2685804f99b9bd524f3bf122d0bf5b0826: Status 404 returned error can't find the container with id 9b498e057e7de6ead27c4876eeb76e2685804f99b9bd524f3bf122d0bf5b0826
Jul 26 15:50:05.528028 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:05.528008    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2c0e7ad_45f1_4542_9a7e_272eb322c490.slice/crio-99d08d1c90798c953e45529456cd6096d18b1c446fc3bdcea97eb4e64f48f64d WatchSource:0}: Error finding container 99d08d1c90798c953e45529456cd6096d18b1c446fc3bdcea97eb4e64f48f64d: Status 404 returned error can't find the container with id 99d08d1c90798c953e45529456cd6096d18b1c446fc3bdcea97eb4e64f48f64d
Jul 26 15:50:05.782480 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.782443    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret\") pod \"global-pull-secret-syncer-n7rxf\" (UID: \"d15f46dd-2ac8-4355-bb37-d19f8837deda\") " pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:05.782695 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.782512    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs\") pod \"network-metrics-daemon-wjzf7\" (UID: \"cc418ed5-59fd-4c09-9c91-8bd912a4bd73\") " pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:05.782695 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:05.782666    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:05.782827 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:05.782744    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs podName:cc418ed5-59fd-4c09-9c91-8bd912a4bd73 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:06.78272545 +0000 UTC m=+3.001352501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs") pod "network-metrics-daemon-wjzf7" (UID: "cc418ed5-59fd-4c09-9c91-8bd912a4bd73") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:05.783071 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:05.783047    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:05.783151 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:05.783117    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret podName:d15f46dd-2ac8-4355-bb37-d19f8837deda nodeName:}" failed. No retries permitted until 2026-07-26 15:50:06.783099892 +0000 UTC m=+3.001726925 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret") pod "global-pull-secret-syncer-n7rxf" (UID: "d15f46dd-2ac8-4355-bb37-d19f8837deda") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:05.883120 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:05.883078    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqt24\" (UniqueName: \"kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24\") pod \"network-check-target-psdlz\" (UID: \"e7ce1458-87fd-4ce6-ab5a-19218c78cbb1\") " pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:05.883306 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:05.883293    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:50:05.883369 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:05.883318    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:50:05.883369 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:05.883332    2556 projected.go:196] Error preparing data for projected volume kube-api-access-xqt24 for pod openshift-network-diagnostics/network-check-target-psdlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:05.883478 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:05.883398    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24 podName:e7ce1458-87fd-4ce6-ab5a-19218c78cbb1 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:06.883377203 +0000 UTC m=+3.102004234 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqt24" (UniqueName: "kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24") pod "network-check-target-psdlz" (UID: "e7ce1458-87fd-4ce6-ab5a-19218c78cbb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:06.111886 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:06.111800    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-25 15:45:05 +0000 UTC" deadline="2028-03-28 15:30:13.562188882 +0000 UTC"
Jul 26 15:50:06.111886 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:06.111838    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14663h40m7.450355141s"
Jul 26 15:50:06.213118 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:06.212459    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:06.213118 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:06.212610    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjzf7" podUID="cc418ed5-59fd-4c09-9c91-8bd912a4bd73"
Jul 26 15:50:06.242736 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:06.239271    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tp5k8" event={"ID":"e2c0e7ad-45f1-4542-9a7e-272eb322c490","Type":"ContainerStarted","Data":"99d08d1c90798c953e45529456cd6096d18b1c446fc3bdcea97eb4e64f48f64d"}
Jul 26 15:50:06.252923 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:06.252865    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xj7sr" event={"ID":"a4942130-b152-4353-ac91-262958a3e684","Type":"ContainerStarted","Data":"9b498e057e7de6ead27c4876eeb76e2685804f99b9bd524f3bf122d0bf5b0826"}
Jul 26 15:50:06.295006 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:06.294956    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vqkl6" event={"ID":"8710b2c4-8507-4879-aa1f-a677175fcd6e","Type":"ContainerStarted","Data":"e1e0030c35b9fd62d0e989ff76f41768c18bc2045dc2358851c9e97756446fc2"}
Jul 26 15:50:06.300111 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:06.300082    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz" event={"ID":"906b2311-fcf7-4a5f-94ba-5f7f46d7854c","Type":"ContainerStarted","Data":"da9a39f52d71e16c05c584b482f3d15274594d6618b3473cd149b1d62f4ef364"}
Jul 26 15:50:06.312148 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:06.312117    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xcj2r" event={"ID":"8ff4109f-26ad-4a48-94d2-05f67fb8bbc2","Type":"ContainerStarted","Data":"9112cca2d74674bd17c456f4b20f12142a4afac8fc678e63d5359eb5da70dbb3"}
Jul 26 15:50:06.323190 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:06.322986    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42" event={"ID":"34d4d07d-3fa0-483d-a2ea-5f426e16a481","Type":"ContainerStarted","Data":"7278705ac47efcc637499aadf89e465af26f2fdd692cdb284822d02b6bb52ffb"}
Jul 26 15:50:06.337560 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:06.337528    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nc45v" event={"ID":"d1155f7e-3fe4-4801-ac62-3a926a5821ce","Type":"ContainerStarted","Data":"1db3152b7a678158e551f76ef2094a8383e7a8751bde0f2e04f93c3592dfaee6"}
Jul 26 15:50:06.350796 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:06.350757    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x7r4w" event={"ID":"a8b1f0e0-036d-4631-9bd8-0afd293b45ba","Type":"ContainerStarted","Data":"942f1f28f059c5e65ee6b140cbce8e60492d67233127ff33e2c04ebdcfe9b08e"}
Jul 26 15:50:06.368409 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:06.368333    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8m8xz" event={"ID":"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29","Type":"ContainerStarted","Data":"437ca82b2340144efcb4bac57da18931ef0433881c9baf708de9135c766c3784"}
Jul 26 15:50:06.373354 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:06.373278    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-224.ec2.internal" event={"ID":"d2eb1ec8e8cd2f3930f67ac8058bec51","Type":"ContainerStarted","Data":"6ec9f1183923a31565f0c6dbdc19a767c05e635599c3300e4eb1484080ba63b5"}
Jul 26 15:50:06.390767 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:06.390735    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-224.ec2.internal" event={"ID":"75b71d15a6bdf485e2a4be2e01686620","Type":"ContainerStarted","Data":"4cb90a380c686e59f7bcd3d0ff4e328f699e70c976b1458452dc51a22f998069"}
Jul 26 15:50:06.534210 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:06.534174    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:50:06.712366 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:06.708934    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:50:06.794035 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:06.793987    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret\") pod \"global-pull-secret-syncer-n7rxf\" (UID: \"d15f46dd-2ac8-4355-bb37-d19f8837deda\") " pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:06.794200 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:06.794053    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs\") pod \"network-metrics-daemon-wjzf7\" (UID: \"cc418ed5-59fd-4c09-9c91-8bd912a4bd73\") " pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:06.794283 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:06.794203    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:06.794283 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:06.794273    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs podName:cc418ed5-59fd-4c09-9c91-8bd912a4bd73 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:08.794249801 +0000 UTC m=+5.012876844 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs") pod "network-metrics-daemon-wjzf7" (UID: "cc418ed5-59fd-4c09-9c91-8bd912a4bd73") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:06.794768 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:06.794746    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:06.794881 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:06.794803    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret podName:d15f46dd-2ac8-4355-bb37-d19f8837deda nodeName:}" failed. No retries permitted until 2026-07-26 15:50:08.794787902 +0000 UTC m=+5.013414934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret") pod "global-pull-secret-syncer-n7rxf" (UID: "d15f46dd-2ac8-4355-bb37-d19f8837deda") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:06.894728 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:06.894684    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqt24\" (UniqueName: \"kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24\") pod \"network-check-target-psdlz\" (UID: \"e7ce1458-87fd-4ce6-ab5a-19218c78cbb1\") " pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:06.894929 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:06.894846    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:50:06.894929 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:06.894868    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:50:06.894929 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:06.894880    2556 projected.go:196] Error preparing data for projected volume kube-api-access-xqt24 for pod openshift-network-diagnostics/network-check-target-psdlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:06.895098 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:06.894937    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24 podName:e7ce1458-87fd-4ce6-ab5a-19218c78cbb1 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:08.894917403 +0000 UTC m=+5.113544447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqt24" (UniqueName: "kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24") pod "network-check-target-psdlz" (UID: "e7ce1458-87fd-4ce6-ab5a-19218c78cbb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:07.112816 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:07.112682    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-25 15:45:05 +0000 UTC" deadline="2027-12-28 17:08:52.910790438 +0000 UTC"
Jul 26 15:50:07.112816 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:07.112744    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12481h18m45.798051168s"
Jul 26 15:50:07.209813 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:07.209730    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:07.209813 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:07.209776    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:07.210070 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:07.209862    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psdlz" podUID="e7ce1458-87fd-4ce6-ab5a-19218c78cbb1"
Jul 26 15:50:07.210340 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:07.210241    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7rxf" podUID="d15f46dd-2ac8-4355-bb37-d19f8837deda"
Jul 26 15:50:08.128820 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:08.128457    2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:50:08.210895 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:08.210868    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:08.211081 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:08.211017    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjzf7" podUID="cc418ed5-59fd-4c09-9c91-8bd912a4bd73"
Jul 26 15:50:08.810006 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:08.809921    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret\") pod \"global-pull-secret-syncer-n7rxf\" (UID: \"d15f46dd-2ac8-4355-bb37-d19f8837deda\") " pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:08.810006 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:08.809995    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs\") pod \"network-metrics-daemon-wjzf7\" (UID: \"cc418ed5-59fd-4c09-9c91-8bd912a4bd73\") " pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:08.810248 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:08.810164    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:08.810248 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:08.810226    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs podName:cc418ed5-59fd-4c09-9c91-8bd912a4bd73 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:12.810206104 +0000 UTC m=+9.028833135 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs") pod "network-metrics-daemon-wjzf7" (UID: "cc418ed5-59fd-4c09-9c91-8bd912a4bd73") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:08.810666 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:08.810646    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:08.810764 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:08.810722    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret podName:d15f46dd-2ac8-4355-bb37-d19f8837deda nodeName:}" failed. No retries permitted until 2026-07-26 15:50:12.810691682 +0000 UTC m=+9.029318717 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret") pod "global-pull-secret-syncer-n7rxf" (UID: "d15f46dd-2ac8-4355-bb37-d19f8837deda") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:08.911351 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:08.910742    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqt24\" (UniqueName: \"kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24\") pod \"network-check-target-psdlz\" (UID: \"e7ce1458-87fd-4ce6-ab5a-19218c78cbb1\") " pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:08.911351 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:08.910930    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:50:08.911351 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:08.910951    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:50:08.911351 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:08.910965    2556 projected.go:196] Error preparing data for projected volume kube-api-access-xqt24 for pod openshift-network-diagnostics/network-check-target-psdlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:08.911351 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:08.911020    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24 podName:e7ce1458-87fd-4ce6-ab5a-19218c78cbb1 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:12.911001681 +0000 UTC m=+9.129628713 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqt24" (UniqueName: "kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24") pod "network-check-target-psdlz" (UID: "e7ce1458-87fd-4ce6-ab5a-19218c78cbb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:09.209766 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:09.209734    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:09.210193 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:09.209876    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7rxf" podUID="d15f46dd-2ac8-4355-bb37-d19f8837deda"
Jul 26 15:50:09.210252 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:09.209696    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:09.210404 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:09.210362    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psdlz" podUID="e7ce1458-87fd-4ce6-ab5a-19218c78cbb1"
Jul 26 15:50:10.209729 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:10.209688    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:10.209920 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:10.209852    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjzf7" podUID="cc418ed5-59fd-4c09-9c91-8bd912a4bd73"
Jul 26 15:50:11.209512 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:11.209475    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:11.209731 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:11.209624    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7rxf" podUID="d15f46dd-2ac8-4355-bb37-d19f8837deda"
Jul 26 15:50:11.209833 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:11.209809    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:11.209974 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:11.209942    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psdlz" podUID="e7ce1458-87fd-4ce6-ab5a-19218c78cbb1"
Jul 26 15:50:12.210105 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:12.209930    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:12.210105 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:12.210068    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjzf7" podUID="cc418ed5-59fd-4c09-9c91-8bd912a4bd73"
Jul 26 15:50:12.842873 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:12.842838    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret\") pod \"global-pull-secret-syncer-n7rxf\" (UID: \"d15f46dd-2ac8-4355-bb37-d19f8837deda\") " pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:12.843044 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:12.842900    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs\") pod \"network-metrics-daemon-wjzf7\" (UID: \"cc418ed5-59fd-4c09-9c91-8bd912a4bd73\") " pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:12.843105 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:12.843052    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:12.843165 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:12.843113    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs podName:cc418ed5-59fd-4c09-9c91-8bd912a4bd73 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:20.843092374 +0000 UTC m=+17.061719415 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs") pod "network-metrics-daemon-wjzf7" (UID: "cc418ed5-59fd-4c09-9c91-8bd912a4bd73") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:12.843430 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:12.843328    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:12.843430 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:12.843383    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret podName:d15f46dd-2ac8-4355-bb37-d19f8837deda nodeName:}" failed. No retries permitted until 2026-07-26 15:50:20.843366868 +0000 UTC m=+17.061993904 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret") pod "global-pull-secret-syncer-n7rxf" (UID: "d15f46dd-2ac8-4355-bb37-d19f8837deda") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:12.943852 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:12.943785    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqt24\" (UniqueName: \"kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24\") pod \"network-check-target-psdlz\" (UID: \"e7ce1458-87fd-4ce6-ab5a-19218c78cbb1\") " pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:12.944016 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:12.943959    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:50:12.944016 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:12.943980    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:50:12.944016 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:12.943992    2556 projected.go:196] Error preparing data for projected volume kube-api-access-xqt24 for pod openshift-network-diagnostics/network-check-target-psdlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:12.944201 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:12.944042    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24 podName:e7ce1458-87fd-4ce6-ab5a-19218c78cbb1 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:20.944025993 +0000 UTC m=+17.162653025 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqt24" (UniqueName: "kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24") pod "network-check-target-psdlz" (UID: "e7ce1458-87fd-4ce6-ab5a-19218c78cbb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:13.209799 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:13.209768    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:13.209969 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:13.209768    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:13.209969 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:13.209892    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7rxf" podUID="d15f46dd-2ac8-4355-bb37-d19f8837deda"
Jul 26 15:50:13.210130 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:13.210005    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psdlz" podUID="e7ce1458-87fd-4ce6-ab5a-19218c78cbb1"
Jul 26 15:50:14.211754 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:14.211198    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:14.211754 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:14.211400    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjzf7" podUID="cc418ed5-59fd-4c09-9c91-8bd912a4bd73"
Jul 26 15:50:15.210625 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:15.210048    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:15.210625 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:15.210166    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psdlz" podUID="e7ce1458-87fd-4ce6-ab5a-19218c78cbb1"
Jul 26 15:50:15.210625 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:15.210225    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:15.210625 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:15.210292    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7rxf" podUID="d15f46dd-2ac8-4355-bb37-d19f8837deda"
Jul 26 15:50:16.209951 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:16.209910    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:16.210373 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:16.210048    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjzf7" podUID="cc418ed5-59fd-4c09-9c91-8bd912a4bd73"
Jul 26 15:50:17.210234 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:17.210215    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:17.210523 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:17.210215    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:17.210523 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:17.210302    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7rxf" podUID="d15f46dd-2ac8-4355-bb37-d19f8837deda"
Jul 26 15:50:17.210523 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:17.210392    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psdlz" podUID="e7ce1458-87fd-4ce6-ab5a-19218c78cbb1"
Jul 26 15:50:18.209740 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:18.209708    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:18.209894 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:18.209825    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjzf7" podUID="cc418ed5-59fd-4c09-9c91-8bd912a4bd73"
Jul 26 15:50:19.209906 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:19.209875    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:19.210300 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:19.209979    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psdlz" podUID="e7ce1458-87fd-4ce6-ab5a-19218c78cbb1"
Jul 26 15:50:19.210300 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:19.210065    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:19.210300 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:19.210158    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7rxf" podUID="d15f46dd-2ac8-4355-bb37-d19f8837deda"
Jul 26 15:50:20.209361 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:20.209324    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:20.209545 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:20.209470    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjzf7" podUID="cc418ed5-59fd-4c09-9c91-8bd912a4bd73"
Jul 26 15:50:20.902603 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:20.902566    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs\") pod \"network-metrics-daemon-wjzf7\" (UID: \"cc418ed5-59fd-4c09-9c91-8bd912a4bd73\") " pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:20.903083 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:20.902666    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret\") pod \"global-pull-secret-syncer-n7rxf\" (UID: \"d15f46dd-2ac8-4355-bb37-d19f8837deda\") " pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:20.903083 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:20.902701    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:20.903083 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:20.902778    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs podName:cc418ed5-59fd-4c09-9c91-8bd912a4bd73 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:36.902761623 +0000 UTC m=+33.121388651 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs") pod "network-metrics-daemon-wjzf7" (UID: "cc418ed5-59fd-4c09-9c91-8bd912a4bd73") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:20.903083 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:20.902778    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:20.903083 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:20.902805    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret podName:d15f46dd-2ac8-4355-bb37-d19f8837deda nodeName:}" failed. No retries permitted until 2026-07-26 15:50:36.902799195 +0000 UTC m=+33.121426221 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret") pod "global-pull-secret-syncer-n7rxf" (UID: "d15f46dd-2ac8-4355-bb37-d19f8837deda") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:21.003745 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:21.003709    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqt24\" (UniqueName: \"kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24\") pod \"network-check-target-psdlz\" (UID: \"e7ce1458-87fd-4ce6-ab5a-19218c78cbb1\") " pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:21.003919 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:21.003897    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:50:21.003919 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:21.003924    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:50:21.004096 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:21.003937    2556 projected.go:196] Error preparing data for projected volume kube-api-access-xqt24 for pod openshift-network-diagnostics/network-check-target-psdlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:21.004096 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:21.003996    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24 podName:e7ce1458-87fd-4ce6-ab5a-19218c78cbb1 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:37.003979662 +0000 UTC m=+33.222606693 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqt24" (UniqueName: "kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24") pod "network-check-target-psdlz" (UID: "e7ce1458-87fd-4ce6-ab5a-19218c78cbb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:21.209489 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:21.209461    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:21.209679 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:21.209458    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:21.209737 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:21.209698    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7rxf" podUID="d15f46dd-2ac8-4355-bb37-d19f8837deda"
Jul 26 15:50:21.209737 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:21.209560    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psdlz" podUID="e7ce1458-87fd-4ce6-ab5a-19218c78cbb1"
Jul 26 15:50:22.210320 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:22.210284    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:22.210793 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:22.210425    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjzf7" podUID="cc418ed5-59fd-4c09-9c91-8bd912a4bd73"
Jul 26 15:50:23.209296 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:23.209258    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:23.209462 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:23.209254    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:23.209462 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:23.209396    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psdlz" podUID="e7ce1458-87fd-4ce6-ab5a-19218c78cbb1"
Jul 26 15:50:23.209547 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:23.209485    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7rxf" podUID="d15f46dd-2ac8-4355-bb37-d19f8837deda"
Jul 26 15:50:24.210894 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:24.210650    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:24.211343 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:24.211000    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjzf7" podUID="cc418ed5-59fd-4c09-9c91-8bd912a4bd73"
Jul 26 15:50:25.209715 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:25.209684    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:25.209895 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:25.209683    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:25.209895 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:25.209838    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psdlz" podUID="e7ce1458-87fd-4ce6-ab5a-19218c78cbb1"
Jul 26 15:50:25.209895 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:25.209846    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7rxf" podUID="d15f46dd-2ac8-4355-bb37-d19f8837deda"
Jul 26 15:50:26.209647 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.209412    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:26.210165 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:26.209771    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjzf7" podUID="cc418ed5-59fd-4c09-9c91-8bd912a4bd73"
Jul 26 15:50:26.463990 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.463948    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tp5k8" event={"ID":"e2c0e7ad-45f1-4542-9a7e-272eb322c490","Type":"ContainerStarted","Data":"53772cdfcd7f268467dbd9ade175f59ed7299137efcd86462db5cab21575c1ae"}
Jul 26 15:50:26.465769 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.465740    2556 generic.go:356] "Generic (PLEG): container finished" podID="a4942130-b152-4353-ac91-262958a3e684" containerID="f7bfae7b2908446ac29b3461c226fcda6ffd8e14574c309675b91bbc22e826a1" exitCode=0
Jul 26 15:50:26.465943 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.465823    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xj7sr" event={"ID":"a4942130-b152-4353-ac91-262958a3e684","Type":"ContainerDied","Data":"f7bfae7b2908446ac29b3461c226fcda6ffd8e14574c309675b91bbc22e826a1"}
Jul 26 15:50:26.467966 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.467847    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vqkl6" event={"ID":"8710b2c4-8507-4879-aa1f-a677175fcd6e","Type":"ContainerStarted","Data":"33981f61aa3f682d974d205d693153cd38bdf5a730045f06d3cad155ad9d0050"}
Jul 26 15:50:26.472098 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.472074    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz" event={"ID":"906b2311-fcf7-4a5f-94ba-5f7f46d7854c","Type":"ContainerStarted","Data":"a4cba299568fe45296da5a7ea43d84f568b588b4f430cf1c2c48d69328c260d3"}
Jul 26 15:50:26.472201 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.472182    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz" event={"ID":"906b2311-fcf7-4a5f-94ba-5f7f46d7854c","Type":"ContainerStarted","Data":"04b2bebf872d235edb8faace40445ea9be59ff5a9414e128cd08bac5a459844d"}
Jul 26 15:50:26.472253 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.472235    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz" event={"ID":"906b2311-fcf7-4a5f-94ba-5f7f46d7854c","Type":"ContainerStarted","Data":"3bc4b6f59cb85a70e622f11fb5b5a395e95afefdb89ca56c8c025278d7144f5e"}
Jul 26 15:50:26.472345 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.472305    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz" event={"ID":"906b2311-fcf7-4a5f-94ba-5f7f46d7854c","Type":"ContainerStarted","Data":"1a1d3e9019328f8e9f72d362791f4e615a7e3b002f6964ca022ceb5984c946d5"}
Jul 26 15:50:26.472430 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.472357    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz" event={"ID":"906b2311-fcf7-4a5f-94ba-5f7f46d7854c","Type":"ContainerStarted","Data":"8f8187fb071230d88e4670f9861c9ca886b18875b16b3bcc0cb30a0770873900"}
Jul 26 15:50:26.472430 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.472412    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz" event={"ID":"906b2311-fcf7-4a5f-94ba-5f7f46d7854c","Type":"ContainerStarted","Data":"4d6370b1de909fb42b83ca738a6cdca18dfa01bd2c59fb83ba53c093604676e6"}
Jul 26 15:50:26.473737 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.473716    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xcj2r" event={"ID":"8ff4109f-26ad-4a48-94d2-05f67fb8bbc2","Type":"ContainerStarted","Data":"9f894cdd17a749f728be9c7adcd20dbedcc487937613b01f7c3577c82ea66b03"}
Jul 26 15:50:26.475258 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.475230    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42" event={"ID":"34d4d07d-3fa0-483d-a2ea-5f426e16a481","Type":"ContainerStarted","Data":"b331302f14b043cc53018f3e36a9d8336871ef0e1b7a2f25dd23c4c76f3fdcab"}
Jul 26 15:50:26.476745 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.476710    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nc45v" event={"ID":"d1155f7e-3fe4-4801-ac62-3a926a5821ce","Type":"ContainerStarted","Data":"b0a645121da0ae7a18a9940cf4ad9ab9a9a33c5964b8263dc4fb39d3b0ae248f"}
Jul 26 15:50:26.478184 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.478164    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8m8xz" event={"ID":"6a0561c2-eb94-4929-b5ae-6bf9b96e0f29","Type":"ContainerStarted","Data":"209ea6df00b8a8718b0080de4411bd3a6481874232b1cef204e20eeaf27403f2"}
Jul 26 15:50:26.478997 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.478935    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tp5k8" podStartSLOduration=1.5761098850000002 podStartE2EDuration="21.47891969s" totalImagesPullingTime="19.902809805s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:26.47839912 +0000 UTC m=+22.697026200" watchObservedRunningTime="2026-07-26 15:50:26.47891969 +0000 UTC m=+22.697546742"
Jul 26 15:50:26.479734 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.479675    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-224.ec2.internal" event={"ID":"d2eb1ec8e8cd2f3930f67ac8058bec51","Type":"ContainerStarted","Data":"8c0bfc22d8c475bc3a5c77138477b7b47aacec8f3cfa0ef62a64fc412e0f09db"}
Jul 26 15:50:26.481293 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.481268    2556 generic.go:356] "Generic (PLEG): container finished" podID="75b71d15a6bdf485e2a4be2e01686620" containerID="769c7d77b0b20018defebc65dc21d40e61473136fbdd9a94b420eb96b58287bb" exitCode=0
Jul 26 15:50:26.481400 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.481303    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-224.ec2.internal" event={"ID":"75b71d15a6bdf485e2a4be2e01686620","Type":"ContainerDied","Data":"769c7d77b0b20018defebc65dc21d40e61473136fbdd9a94b420eb96b58287bb"}
Jul 26 15:50:26.496145 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.496101    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nc45v" podStartSLOduration=2.448971217 podStartE2EDuration="22.49608364s" totalImagesPullingTime="20.047112423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:26.495337767 +0000 UTC m=+22.713964846" watchObservedRunningTime="2026-07-26 15:50:26.49608364 +0000 UTC m=+22.714710690"
Jul 26 15:50:26.527675 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.527375    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vqkl6" podStartSLOduration=1.573013425 podStartE2EDuration="21.527358525s" totalImagesPullingTime="19.9543451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:26.510165684 +0000 UTC m=+22.728792758" watchObservedRunningTime="2026-07-26 15:50:26.527358525 +0000 UTC m=+22.745985575"
Jul 26 15:50:26.527842 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.527806    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xcj2r" podStartSLOduration=2.5521730419999997 podStartE2EDuration="22.527792612s" totalImagesPullingTime="19.97561957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:26.5271216 +0000 UTC m=+22.745748649" watchObservedRunningTime="2026-07-26 15:50:26.527792612 +0000 UTC m=+22.746419663"
Jul 26 15:50:26.572106 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:26.572062    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8m8xz" podStartSLOduration=1.648566602 podStartE2EDuration="21.572045338s" totalImagesPullingTime="19.923478736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:26.546676335 +0000 UTC m=+22.765303407" watchObservedRunningTime="2026-07-26 15:50:26.572045338 +0000 UTC m=+22.790672389"
Jul 26 15:50:27.084397 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:27.084364    2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 26 15:50:27.146388 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:27.146290    2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-26T15:50:27.084392399Z","UUID":"8a123b04-8e21-44f8-a280-ddd38ed90880","Handler":null,"Name":"","Endpoint":""}
Jul 26 15:50:27.147642 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:27.147616    2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 26 15:50:27.147745 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:27.147673    2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 26 15:50:27.209425 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:27.209397    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:27.209606 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:27.209532    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7rxf" podUID="d15f46dd-2ac8-4355-bb37-d19f8837deda"
Jul 26 15:50:27.209606 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:27.209594    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:27.209935 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:27.209704    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psdlz" podUID="e7ce1458-87fd-4ce6-ab5a-19218c78cbb1"
Jul 26 15:50:27.486337 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:27.486252    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42" event={"ID":"34d4d07d-3fa0-483d-a2ea-5f426e16a481","Type":"ContainerStarted","Data":"6cb4f601051a03776890371a54c869b07328269a2c3c3173914db60fc9f5791c"}
Jul 26 15:50:27.488476 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:27.488082    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x7r4w" event={"ID":"a8b1f0e0-036d-4631-9bd8-0afd293b45ba","Type":"ContainerStarted","Data":"af9a0e3cbf7b8e484d4e25a7e6a047819f58023e969a855d37f61df079acbbcd"}
Jul 26 15:50:27.490591 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:27.490543    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-224.ec2.internal" event={"ID":"75b71d15a6bdf485e2a4be2e01686620","Type":"ContainerStarted","Data":"b3333f580a8d426f53bad6308783acdd54892373095d7fa12d74017dd7848f87"}
Jul 26 15:50:27.501947 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:27.501899    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-224.ec2.internal" podStartSLOduration=22.501884277 podStartE2EDuration="22.501884277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:26.607024328 +0000 UTC m=+22.825651378" watchObservedRunningTime="2026-07-26 15:50:27.501884277 +0000 UTC m=+23.720511326"
Jul 26 15:50:27.502225 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:27.502174    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x7r4w" podStartSLOduration=3.477664016 podStartE2EDuration="23.502164239s" totalImagesPullingTime="20.024500223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:27.501853395 +0000 UTC m=+23.720480444" watchObservedRunningTime="2026-07-26 15:50:27.502164239 +0000 UTC m=+23.720791288"
Jul 26 15:50:27.515747 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:27.515696    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-224.ec2.internal" podStartSLOduration=22.515685929 podStartE2EDuration="22.515685929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:27.515647447 +0000 UTC m=+23.734274515" watchObservedRunningTime="2026-07-26 15:50:27.515685929 +0000 UTC m=+23.734312978"
Jul 26 15:50:28.025768 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:28.025669    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vqkl6"
Jul 26 15:50:28.026325 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:28.026299    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vqkl6"
Jul 26 15:50:28.213370 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:28.213330    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:28.213752 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:28.213445    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjzf7" podUID="cc418ed5-59fd-4c09-9c91-8bd912a4bd73"
Jul 26 15:50:28.497220 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:28.497124    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz" event={"ID":"906b2311-fcf7-4a5f-94ba-5f7f46d7854c","Type":"ContainerStarted","Data":"79f1688bc83a4118de155e50fe0f60d443f85b9efa09a6ff422c999d461fbd73"}
Jul 26 15:50:28.499495 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:28.499464    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42" event={"ID":"34d4d07d-3fa0-483d-a2ea-5f426e16a481","Type":"ContainerStarted","Data":"12ea35e34af1b612b6e44a6d70c1866c8deb03e9e2e9a99ee7528d6ce1350dc9"}
Jul 26 15:50:28.500670 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:28.500648    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vqkl6"
Jul 26 15:50:28.501021 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:28.500999    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vqkl6"
Jul 26 15:50:28.516411 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:28.516365    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5q42" podStartSLOduration=2.576232687 podStartE2EDuration="24.516348611s" totalImagesPullingTime="21.940115924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:28.516014593 +0000 UTC m=+24.734641644" watchObservedRunningTime="2026-07-26 15:50:28.516348611 +0000 UTC m=+24.734975667"
Jul 26 15:50:29.210236 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:29.210207    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:29.210414 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:29.210204    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:29.210414 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:29.210306    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psdlz" podUID="e7ce1458-87fd-4ce6-ab5a-19218c78cbb1"
Jul 26 15:50:29.210414 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:29.210369    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7rxf" podUID="d15f46dd-2ac8-4355-bb37-d19f8837deda"
Jul 26 15:50:30.213802 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:30.213771    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:30.214284 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:30.213905    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjzf7" podUID="cc418ed5-59fd-4c09-9c91-8bd912a4bd73"
Jul 26 15:50:31.209404 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:31.209239    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:31.209520 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:31.209239    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:31.209520 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:31.209486    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psdlz" podUID="e7ce1458-87fd-4ce6-ab5a-19218c78cbb1"
Jul 26 15:50:31.209627 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:31.209554    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7rxf" podUID="d15f46dd-2ac8-4355-bb37-d19f8837deda"
Jul 26 15:50:31.507521 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:31.507484    2556 generic.go:356] "Generic (PLEG): container finished" podID="a4942130-b152-4353-ac91-262958a3e684" containerID="4dcd9b3c6e7a25b1b30eb4c869e935d7e41e2ab15184468a5719bed9bbcc1bc3" exitCode=0
Jul 26 15:50:31.508361 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:31.507575    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xj7sr" event={"ID":"a4942130-b152-4353-ac91-262958a3e684","Type":"ContainerDied","Data":"4dcd9b3c6e7a25b1b30eb4c869e935d7e41e2ab15184468a5719bed9bbcc1bc3"}
Jul 26 15:50:31.511517 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:31.511492    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz" event={"ID":"906b2311-fcf7-4a5f-94ba-5f7f46d7854c","Type":"ContainerStarted","Data":"0f70d7316fc4df00a951b8b7ff81254a01eb27f532afd63af909a2680ec17d14"}
Jul 26 15:50:31.511833 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:31.511812    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:31.511908 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:31.511886    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:31.527325 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:31.527305    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:31.551328 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:31.551282    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz" podStartSLOduration=7.37985612 podStartE2EDuration="27.55127046s" totalImagesPullingTime="20.17141434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:31.550337862 +0000 UTC m=+27.768964938" watchObservedRunningTime="2026-07-26 15:50:31.55127046 +0000 UTC m=+27.769897554"
Jul 26 15:50:32.210424 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:32.210389    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:32.210627 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:32.210532    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjzf7" podUID="cc418ed5-59fd-4c09-9c91-8bd912a4bd73"
Jul 26 15:50:32.514058 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:32.513997    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:32.528209 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:32.528069    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:50:33.209524 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:33.209498    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:33.209651 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:33.209525    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:33.209651 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:33.209611    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7rxf" podUID="d15f46dd-2ac8-4355-bb37-d19f8837deda"
Jul 26 15:50:33.209742 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:33.209721    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psdlz" podUID="e7ce1458-87fd-4ce6-ab5a-19218c78cbb1"
Jul 26 15:50:33.213061 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:33.213039    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-psdlz"]
Jul 26 15:50:33.213822 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:33.213799    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n7rxf"]
Jul 26 15:50:33.215255 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:33.215230    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wjzf7"]
Jul 26 15:50:33.215356 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:33.215301    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:33.215406 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:33.215381    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjzf7" podUID="cc418ed5-59fd-4c09-9c91-8bd912a4bd73"
Jul 26 15:50:33.518907 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:33.518879    2556 generic.go:356] "Generic (PLEG): container finished" podID="a4942130-b152-4353-ac91-262958a3e684" containerID="e7b6d5338d517f88d02dcc60ce7e969c5a1aaa8978e10851254ce8b151116b96" exitCode=0
Jul 26 15:50:33.519301 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:33.519007    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xj7sr" event={"ID":"a4942130-b152-4353-ac91-262958a3e684","Type":"ContainerDied","Data":"e7b6d5338d517f88d02dcc60ce7e969c5a1aaa8978e10851254ce8b151116b96"}
Jul 26 15:50:33.519301 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:33.519029    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:33.519301 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:33.519188    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7rxf" podUID="d15f46dd-2ac8-4355-bb37-d19f8837deda"
Jul 26 15:50:33.519443 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:33.519317    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:33.519443 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:33.519413    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psdlz" podUID="e7ce1458-87fd-4ce6-ab5a-19218c78cbb1"
Jul 26 15:50:35.209475 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:35.209448    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:35.209821 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:35.209448    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:35.209821 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:35.209542    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psdlz" podUID="e7ce1458-87fd-4ce6-ab5a-19218c78cbb1"
Jul 26 15:50:35.209821 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:35.209448    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:35.209821 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:35.209623    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7rxf" podUID="d15f46dd-2ac8-4355-bb37-d19f8837deda"
Jul 26 15:50:35.209821 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:35.209718    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjzf7" podUID="cc418ed5-59fd-4c09-9c91-8bd912a4bd73"
Jul 26 15:50:35.525478 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:35.525448    2556 generic.go:356] "Generic (PLEG): container finished" podID="a4942130-b152-4353-ac91-262958a3e684" containerID="f5412c8e54855a3f68c276a947b56a763cc43bcacf7b90c7cd25c7d25f0b94c6" exitCode=0
Jul 26 15:50:35.525648 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:35.525497    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xj7sr" event={"ID":"a4942130-b152-4353-ac91-262958a3e684","Type":"ContainerDied","Data":"f5412c8e54855a3f68c276a947b56a763cc43bcacf7b90c7cd25c7d25f0b94c6"}
Jul 26 15:50:36.929146 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:36.929083    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret\") pod \"global-pull-secret-syncer-n7rxf\" (UID: \"d15f46dd-2ac8-4355-bb37-d19f8837deda\") " pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:36.929547 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:36.929153    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs\") pod \"network-metrics-daemon-wjzf7\" (UID: \"cc418ed5-59fd-4c09-9c91-8bd912a4bd73\") " pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:36.929547 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:36.929254    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:36.929547 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:36.929259    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:36.929547 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:36.929312    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs podName:cc418ed5-59fd-4c09-9c91-8bd912a4bd73 nodeName:}" failed. No retries permitted until 2026-07-26 15:51:08.929292402 +0000 UTC m=+65.147919433 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs") pod "network-metrics-daemon-wjzf7" (UID: "cc418ed5-59fd-4c09-9c91-8bd912a4bd73") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:36.929547 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:36.929327    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret podName:d15f46dd-2ac8-4355-bb37-d19f8837deda nodeName:}" failed. No retries permitted until 2026-07-26 15:51:08.929320799 +0000 UTC m=+65.147947825 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret") pod "global-pull-secret-syncer-n7rxf" (UID: "d15f46dd-2ac8-4355-bb37-d19f8837deda") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:37.029849 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:37.029815    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqt24\" (UniqueName: \"kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24\") pod \"network-check-target-psdlz\" (UID: \"e7ce1458-87fd-4ce6-ab5a-19218c78cbb1\") " pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:37.030011 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:37.029963    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:50:37.030011 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:37.029981    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:50:37.030011 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:37.029992    2556 projected.go:196] Error preparing data for projected volume kube-api-access-xqt24 for pod openshift-network-diagnostics/network-check-target-psdlz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:37.030130 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:37.030048    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24 podName:e7ce1458-87fd-4ce6-ab5a-19218c78cbb1 nodeName:}" failed. No retries permitted until 2026-07-26 15:51:09.030033137 +0000 UTC m=+65.248660164 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqt24" (UniqueName: "kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24") pod "network-check-target-psdlz" (UID: "e7ce1458-87fd-4ce6-ab5a-19218c78cbb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:37.209806 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:37.209777    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:37.209987 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:37.209816    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:37.209987 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:37.209877    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:37.209987 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:37.209889    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n7rxf" podUID="d15f46dd-2ac8-4355-bb37-d19f8837deda"
Jul 26 15:50:37.209987 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:37.209969    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-psdlz" podUID="e7ce1458-87fd-4ce6-ab5a-19218c78cbb1"
Jul 26 15:50:37.210196 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:37.210054    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wjzf7" podUID="cc418ed5-59fd-4c09-9c91-8bd912a4bd73"
Jul 26 15:50:38.086083 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.085852    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-224.ec2.internal" event="NodeReady"
Jul 26 15:50:38.086500 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.086198    2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 26 15:50:38.119937 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.119914    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v6msr"]
Jul 26 15:50:38.124111 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.124089    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-l6wf6"]
Jul 26 15:50:38.124220 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.124199    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v6msr"
Jul 26 15:50:38.127236 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.127217    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-72d9v"]
Jul 26 15:50:38.127339 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.127327    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6"
Jul 26 15:50:38.128735 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.128715    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 26 15:50:38.129394 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.129368    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 26 15:50:38.129485 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.129476    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-h582c\""
Jul 26 15:50:38.130468 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.130446    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 26 15:50:38.130791 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.130758    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4gq77"]
Jul 26 15:50:38.131035 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.130978    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ndlld\""
Jul 26 15:50:38.131330 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.131278    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-72d9v"
Jul 26 15:50:38.131330 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.131325    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 26 15:50:38.131705 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.131523    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 26 15:50:38.131705 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.131285    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 26 15:50:38.134200 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.134171    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7df9d96595-mhclr"]
Jul 26 15:50:38.134348 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.134281    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4gq77"
Jul 26 15:50:38.135849 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.135051    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 26 15:50:38.135849 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.135417    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 26 15:50:38.135849 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.135601    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 26 15:50:38.140272 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.140247    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 26 15:50:38.140743 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.140521    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 26 15:50:38.140846 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.140761    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 26 15:50:38.141502 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.141369    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-h497q\""
Jul 26 15:50:38.141502 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.141375    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 26 15:50:38.141854 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.141830    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l"]
Jul 26 15:50:38.145415 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.144837    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7rnml\""
Jul 26 15:50:38.145415 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.144958    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.147881 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.147859    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-72d9v"]
Jul 26 15:50:38.147973 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.147897    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v6msr"]
Jul 26 15:50:38.148032 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.147976    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l"
Jul 26 15:50:38.148552 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.148525    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 26 15:50:38.148738 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.148647    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 26 15:50:38.149025 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.149009    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 26 15:50:38.149393 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.149234    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l"]
Jul 26 15:50:38.149393 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.149368    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 26 15:50:38.150041 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.149993    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 26 15:50:38.150489 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.150474    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 26 15:50:38.150890 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.150550    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4gq77"]
Jul 26 15:50:38.150987 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.150671    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 26 15:50:38.150987 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.150802    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-682xw\""
Jul 26 15:50:38.150987 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.150805    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 26 15:50:38.151449 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.151434    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-w7s6n"]
Jul 26 15:50:38.153288 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.151459    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rcvjj\""
Jul 26 15:50:38.156619 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.156602    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-v8n2s"]
Jul 26 15:50:38.156745 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.156721    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w7s6n"
Jul 26 15:50:38.158185 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.158162    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 26 15:50:38.159086 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.159068    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 26 15:50:38.159266 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.159072    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-pft4q\""
Jul 26 15:50:38.159411 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.159122    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 26 15:50:38.160316 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.160298    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df9d96595-mhclr"]
Jul 26 15:50:38.160398 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.160334    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-b9nfk"]
Jul 26 15:50:38.160443 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.160432    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-v8n2s"
Jul 26 15:50:38.163610 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.163590    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 26 15:50:38.163846 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.163831    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 26 15:50:38.164419 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.164189    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zjznk\""
Jul 26 15:50:38.164516 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.164426    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pp2wf"]
Jul 26 15:50:38.164668 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.164626    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b9nfk"
Jul 26 15:50:38.168395 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.168224    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 26 15:50:38.168395 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.168292    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 26 15:50:38.168395 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.168307    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 26 15:50:38.168395 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.168318    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-69pk7\""
Jul 26 15:50:38.168659 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.168427    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-w7s6n"]
Jul 26 15:50:38.168659 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.168456    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-v8n2s"]
Jul 26 15:50:38.168659 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.168476    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-l6wf6"]
Jul 26 15:50:38.168659 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.168493    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b9nfk"]
Jul 26 15:50:38.168659 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.168571    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:50:38.170569 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.170550    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 26 15:50:38.170675 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.170575    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cx8dk\""
Jul 26 15:50:38.170734 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.170550    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 26 15:50:38.174043 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.174022    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pp2wf"]
Jul 26 15:50:38.238866 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.238838    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-bound-sa-token\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.238967 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.238878    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2758w\" (UniqueName: \"kubernetes.io/projected/8967ec92-2236-4a7d-a752-9afc7761cbb1-kube-api-access-2758w\") pod \"network-check-source-7d88cb55d8-w7s6n\" (UID: \"8967ec92-2236-4a7d-a752-9afc7761cbb1\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w7s6n"
Jul 26 15:50:38.238967 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.238906    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/236dfe0e-0806-441e-8059-3ddde7696714-config\") pod \"console-operator-584dcb6b54-l6wf6\" (UID: \"236dfe0e-0806-441e-8059-3ddde7696714\") " pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6"
Jul 26 15:50:38.238967 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.238931    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-certificates\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.239106 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.238973    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8f82c6eb-6828-438d-88d9-2104fea4f62f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l\" (UID: \"8f82c6eb-6828-438d-88d9-2104fea4f62f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l"
Jul 26 15:50:38.239106 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.239031    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5de42ff-14ad-4780-aee7-80f431e2a706-config\") pod \"service-ca-operator-5d6c75f84f-72d9v\" (UID: \"e5de42ff-14ad-4780-aee7-80f431e2a706\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-72d9v"
Jul 26 15:50:38.239106 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.239088    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.239258 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.239122    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-installation-pull-secrets\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.239258 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.239157    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzvc5\" (UniqueName: \"kubernetes.io/projected/8f82c6eb-6828-438d-88d9-2104fea4f62f-kube-api-access-wzvc5\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l\" (UID: \"8f82c6eb-6828-438d-88d9-2104fea4f62f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l"
Jul 26 15:50:38.239258 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.239183    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5de42ff-14ad-4780-aee7-80f431e2a706-serving-cert\") pod \"service-ca-operator-5d6c75f84f-72d9v\" (UID: \"e5de42ff-14ad-4780-aee7-80f431e2a706\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-72d9v"
Jul 26 15:50:38.239258 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.239209    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/236dfe0e-0806-441e-8059-3ddde7696714-trusted-ca\") pod \"console-operator-584dcb6b54-l6wf6\" (UID: \"236dfe0e-0806-441e-8059-3ddde7696714\") " pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6"
Jul 26 15:50:38.239258 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.239235    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr7b6\" (UniqueName: \"kubernetes.io/projected/236dfe0e-0806-441e-8059-3ddde7696714-kube-api-access-mr7b6\") pod \"console-operator-584dcb6b54-l6wf6\" (UID: \"236dfe0e-0806-441e-8059-3ddde7696714\") " pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6"
Jul 26 15:50:38.239468 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.239263    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s99d\" (UniqueName: \"kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-kube-api-access-7s99d\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.239468 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.239287    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8f82c6eb-6828-438d-88d9-2104fea4f62f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l\" (UID: \"8f82c6eb-6828-438d-88d9-2104fea4f62f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l"
Jul 26 15:50:38.239468 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.239311    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkjc5\" (UniqueName: \"kubernetes.io/projected/5f18633e-f0a8-494c-8f26-6ba7f55ebf6c-kube-api-access-pkjc5\") pod \"volume-data-source-validator-549c6d54cf-v6msr\" (UID: \"5f18633e-f0a8-494c-8f26-6ba7f55ebf6c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v6msr"
Jul 26 15:50:38.239468 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.239338    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-image-registry-private-configuration\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.239468 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.239368    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/236dfe0e-0806-441e-8059-3ddde7696714-serving-cert\") pod \"console-operator-584dcb6b54-l6wf6\" (UID: \"236dfe0e-0806-441e-8059-3ddde7696714\") " pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6"
Jul 26 15:50:38.239468 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.239451    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-ca-trust-extracted\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.239736 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.239481    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a22e8189-a58c-45ac-ba41-90287a24e285-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-v8n2s\" (UID: \"a22e8189-a58c-45ac-ba41-90287a24e285\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v8n2s"
Jul 26 15:50:38.239736 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.239499    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a22e8189-a58c-45ac-ba41-90287a24e285-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-v8n2s\" (UID: \"a22e8189-a58c-45ac-ba41-90287a24e285\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v8n2s"
Jul 26 15:50:38.239736 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.239547    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-trusted-ca\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.239736 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.239575    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fllgn\" (UniqueName: \"kubernetes.io/projected/e5de42ff-14ad-4780-aee7-80f431e2a706-kube-api-access-fllgn\") pod \"service-ca-operator-5d6c75f84f-72d9v\" (UID: \"e5de42ff-14ad-4780-aee7-80f431e2a706\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-72d9v"
Jul 26 15:50:38.239736 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.239600    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb9pk\" (UniqueName: \"kubernetes.io/projected/456fcf29-3214-47fa-b012-dd304048b677-kube-api-access-cb9pk\") pod \"ingress-canary-b9nfk\" (UID: \"456fcf29-3214-47fa-b012-dd304048b677\") " pod="openshift-ingress-canary/ingress-canary-b9nfk"
Jul 26 15:50:38.239736 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.239647    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/066ffd1b-bf6b-4aa5-b28d-451261883283-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-4gq77\" (UID: \"066ffd1b-bf6b-4aa5-b28d-451261883283\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4gq77"
Jul 26 15:50:38.239736 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.239678    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk45s\" (UniqueName: \"kubernetes.io/projected/066ffd1b-bf6b-4aa5-b28d-451261883283-kube-api-access-kk45s\") pod \"cluster-samples-operator-6748489656-4gq77\" (UID: \"066ffd1b-bf6b-4aa5-b28d-451261883283\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4gq77"
Jul 26 15:50:38.239736 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.239700    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/456fcf29-3214-47fa-b012-dd304048b677-cert\") pod \"ingress-canary-b9nfk\" (UID: \"456fcf29-3214-47fa-b012-dd304048b677\") " pod="openshift-ingress-canary/ingress-canary-b9nfk"
Jul 26 15:50:38.340327 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.340260    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-trusted-ca\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.340327 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.340298    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-bound-sa-token\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.340327 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.340319    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2758w\" (UniqueName: \"kubernetes.io/projected/8967ec92-2236-4a7d-a752-9afc7761cbb1-kube-api-access-2758w\") pod \"network-check-source-7d88cb55d8-w7s6n\" (UID: \"8967ec92-2236-4a7d-a752-9afc7761cbb1\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w7s6n"
Jul 26 15:50:38.340583 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.340347    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-tmp-dir\") pod \"dns-default-pp2wf\" (UID: \"7dea8064-f342-461c-b4e9-ad71f3c7b9dc\") " pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:50:38.340583 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.340378    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-metrics-tls\") pod \"dns-default-pp2wf\" (UID: \"7dea8064-f342-461c-b4e9-ad71f3c7b9dc\") " pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:50:38.340583 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.340406    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8f82c6eb-6828-438d-88d9-2104fea4f62f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l\" (UID: \"8f82c6eb-6828-438d-88d9-2104fea4f62f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l"
Jul 26 15:50:38.340583 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.340430    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb9pk\" (UniqueName: \"kubernetes.io/projected/456fcf29-3214-47fa-b012-dd304048b677-kube-api-access-cb9pk\") pod \"ingress-canary-b9nfk\" (UID: \"456fcf29-3214-47fa-b012-dd304048b677\") " pod="openshift-ingress-canary/ingress-canary-b9nfk"
Jul 26 15:50:38.340583 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.340500    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr7b6\" (UniqueName: \"kubernetes.io/projected/236dfe0e-0806-441e-8059-3ddde7696714-kube-api-access-mr7b6\") pod \"console-operator-584dcb6b54-l6wf6\" (UID: \"236dfe0e-0806-441e-8059-3ddde7696714\") " pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6"
Jul 26 15:50:38.340858 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.340687    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8f82c6eb-6828-438d-88d9-2104fea4f62f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l\" (UID: \"8f82c6eb-6828-438d-88d9-2104fea4f62f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l"
Jul 26 15:50:38.340858 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.340720    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-image-registry-private-configuration\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.341030 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.340991    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/236dfe0e-0806-441e-8059-3ddde7696714-serving-cert\") pod \"console-operator-584dcb6b54-l6wf6\" (UID: \"236dfe0e-0806-441e-8059-3ddde7696714\") " pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6"
Jul 26 15:50:38.341158 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341030    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/066ffd1b-bf6b-4aa5-b28d-451261883283-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-4gq77\" (UID: \"066ffd1b-bf6b-4aa5-b28d-451261883283\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4gq77"
Jul 26 15:50:38.341158 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341060    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk45s\" (UniqueName: \"kubernetes.io/projected/066ffd1b-bf6b-4aa5-b28d-451261883283-kube-api-access-kk45s\") pod \"cluster-samples-operator-6748489656-4gq77\" (UID: \"066ffd1b-bf6b-4aa5-b28d-451261883283\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4gq77"
Jul 26 15:50:38.341158 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341061    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8f82c6eb-6828-438d-88d9-2104fea4f62f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l\" (UID: \"8f82c6eb-6828-438d-88d9-2104fea4f62f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l"
Jul 26 15:50:38.341158 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:38.341151    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 26 15:50:38.341419 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:38.341218    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066ffd1b-bf6b-4aa5-b28d-451261883283-samples-operator-tls podName:066ffd1b-bf6b-4aa5-b28d-451261883283 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:38.841199355 +0000 UTC m=+35.059826399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/066ffd1b-bf6b-4aa5-b28d-451261883283-samples-operator-tls") pod "cluster-samples-operator-6748489656-4gq77" (UID: "066ffd1b-bf6b-4aa5-b28d-451261883283") : secret "samples-operator-tls" not found
Jul 26 15:50:38.341419 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341287    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-trusted-ca\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.341419 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341316    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-ca-trust-extracted\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.341419 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341364    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a22e8189-a58c-45ac-ba41-90287a24e285-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-v8n2s\" (UID: \"a22e8189-a58c-45ac-ba41-90287a24e285\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v8n2s"
Jul 26 15:50:38.341652 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:38.341460    2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 26 15:50:38.341652 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:38.341519    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a22e8189-a58c-45ac-ba41-90287a24e285-networking-console-plugin-cert podName:a22e8189-a58c-45ac-ba41-90287a24e285 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:38.841503303 +0000 UTC m=+35.060130333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a22e8189-a58c-45ac-ba41-90287a24e285-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-v8n2s" (UID: "a22e8189-a58c-45ac-ba41-90287a24e285") : secret "networking-console-plugin-cert" not found
Jul 26 15:50:38.341652 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341515    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-config-volume\") pod \"dns-default-pp2wf\" (UID: \"7dea8064-f342-461c-b4e9-ad71f3c7b9dc\") " pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:50:38.341652 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341550    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/236dfe0e-0806-441e-8059-3ddde7696714-config\") pod \"console-operator-584dcb6b54-l6wf6\" (UID: \"236dfe0e-0806-441e-8059-3ddde7696714\") " pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6"
Jul 26 15:50:38.341652 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341579    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-certificates\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.341652 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341604    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5de42ff-14ad-4780-aee7-80f431e2a706-config\") pod \"service-ca-operator-5d6c75f84f-72d9v\" (UID: \"e5de42ff-14ad-4780-aee7-80f431e2a706\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-72d9v"
Jul 26 15:50:38.341652 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341628    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fllgn\" (UniqueName: \"kubernetes.io/projected/e5de42ff-14ad-4780-aee7-80f431e2a706-kube-api-access-fllgn\") pod \"service-ca-operator-5d6c75f84f-72d9v\" (UID: \"e5de42ff-14ad-4780-aee7-80f431e2a706\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-72d9v"
Jul 26 15:50:38.341944 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341673    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.341944 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341695    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-installation-pull-secrets\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.341944 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341698    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-ca-trust-extracted\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.341944 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341718    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5de42ff-14ad-4780-aee7-80f431e2a706-serving-cert\") pod \"service-ca-operator-5d6c75f84f-72d9v\" (UID: \"e5de42ff-14ad-4780-aee7-80f431e2a706\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-72d9v"
Jul 26 15:50:38.341944 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341747    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49bsz\" (UniqueName: \"kubernetes.io/projected/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-kube-api-access-49bsz\") pod \"dns-default-pp2wf\" (UID: \"7dea8064-f342-461c-b4e9-ad71f3c7b9dc\") " pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:50:38.341944 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341780    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzvc5\" (UniqueName: \"kubernetes.io/projected/8f82c6eb-6828-438d-88d9-2104fea4f62f-kube-api-access-wzvc5\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l\" (UID: \"8f82c6eb-6828-438d-88d9-2104fea4f62f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l"
Jul 26 15:50:38.341944 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341810    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/236dfe0e-0806-441e-8059-3ddde7696714-trusted-ca\") pod \"console-operator-584dcb6b54-l6wf6\" (UID: \"236dfe0e-0806-441e-8059-3ddde7696714\") " pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6"
Jul 26 15:50:38.341944 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341834    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s99d\" (UniqueName: \"kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-kube-api-access-7s99d\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.341944 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341859    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkjc5\" (UniqueName: \"kubernetes.io/projected/5f18633e-f0a8-494c-8f26-6ba7f55ebf6c-kube-api-access-pkjc5\") pod \"volume-data-source-validator-549c6d54cf-v6msr\" (UID: \"5f18633e-f0a8-494c-8f26-6ba7f55ebf6c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v6msr"
Jul 26 15:50:38.341944 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341888    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/456fcf29-3214-47fa-b012-dd304048b677-cert\") pod \"ingress-canary-b9nfk\" (UID: \"456fcf29-3214-47fa-b012-dd304048b677\") " pod="openshift-ingress-canary/ingress-canary-b9nfk"
Jul 26 15:50:38.341944 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.341918    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a22e8189-a58c-45ac-ba41-90287a24e285-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-v8n2s\" (UID: \"a22e8189-a58c-45ac-ba41-90287a24e285\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v8n2s"
Jul 26 15:50:38.342376 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.342194    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-certificates\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.342376 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.342238    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/236dfe0e-0806-441e-8059-3ddde7696714-config\") pod \"console-operator-584dcb6b54-l6wf6\" (UID: \"236dfe0e-0806-441e-8059-3ddde7696714\") " pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6"
Jul 26 15:50:38.342461 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.342412    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e5de42ff-14ad-4780-aee7-80f431e2a706-config\") pod \"service-ca-operator-5d6c75f84f-72d9v\" (UID: \"e5de42ff-14ad-4780-aee7-80f431e2a706\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-72d9v"
Jul 26 15:50:38.342956 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:38.342525    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:50:38.342956 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:38.342544    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df9d96595-mhclr: secret "image-registry-tls" not found
Jul 26 15:50:38.342956 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.342604    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a22e8189-a58c-45ac-ba41-90287a24e285-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-v8n2s\" (UID: \"a22e8189-a58c-45ac-ba41-90287a24e285\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v8n2s"
Jul 26 15:50:38.342956 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:38.342674    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls podName:f4fe2369-8cf2-40ef-903f-40a375cdb5d9 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:38.842621004 +0000 UTC m=+35.061248033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls") pod "image-registry-7df9d96595-mhclr" (UID: "f4fe2369-8cf2-40ef-903f-40a375cdb5d9") : secret "image-registry-tls" not found
Jul 26 15:50:38.343240 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.343174    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/236dfe0e-0806-441e-8059-3ddde7696714-trusted-ca\") pod \"console-operator-584dcb6b54-l6wf6\" (UID: \"236dfe0e-0806-441e-8059-3ddde7696714\") " pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6"
Jul 26 15:50:38.345564 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.345539    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-image-registry-private-configuration\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.345697 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.345679    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e5de42ff-14ad-4780-aee7-80f431e2a706-serving-cert\") pod \"service-ca-operator-5d6c75f84f-72d9v\" (UID: \"e5de42ff-14ad-4780-aee7-80f431e2a706\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-72d9v"
Jul 26 15:50:38.345797 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.345768    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/236dfe0e-0806-441e-8059-3ddde7696714-serving-cert\") pod \"console-operator-584dcb6b54-l6wf6\" (UID: \"236dfe0e-0806-441e-8059-3ddde7696714\") " pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6"
Jul 26 15:50:38.345797 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.345789    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8f82c6eb-6828-438d-88d9-2104fea4f62f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l\" (UID: \"8f82c6eb-6828-438d-88d9-2104fea4f62f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l"
Jul 26 15:50:38.345920 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.345816    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-installation-pull-secrets\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.346112 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.346094    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/456fcf29-3214-47fa-b012-dd304048b677-cert\") pod \"ingress-canary-b9nfk\" (UID: \"456fcf29-3214-47fa-b012-dd304048b677\") " pod="openshift-ingress-canary/ingress-canary-b9nfk"
Jul 26 15:50:38.350266 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.349884    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-bound-sa-token\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.350266 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.350225    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk45s\" (UniqueName: \"kubernetes.io/projected/066ffd1b-bf6b-4aa5-b28d-451261883283-kube-api-access-kk45s\") pod \"cluster-samples-operator-6748489656-4gq77\" (UID: \"066ffd1b-bf6b-4aa5-b28d-451261883283\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4gq77"
Jul 26 15:50:38.350432 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.350411    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2758w\" (UniqueName: \"kubernetes.io/projected/8967ec92-2236-4a7d-a752-9afc7761cbb1-kube-api-access-2758w\") pod \"network-check-source-7d88cb55d8-w7s6n\" (UID: \"8967ec92-2236-4a7d-a752-9afc7761cbb1\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w7s6n"
Jul 26 15:50:38.350845 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.350619    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb9pk\" (UniqueName: \"kubernetes.io/projected/456fcf29-3214-47fa-b012-dd304048b677-kube-api-access-cb9pk\") pod \"ingress-canary-b9nfk\" (UID: \"456fcf29-3214-47fa-b012-dd304048b677\") " pod="openshift-ingress-canary/ingress-canary-b9nfk"
Jul 26 15:50:38.351662 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.351605    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzvc5\" (UniqueName: \"kubernetes.io/projected/8f82c6eb-6828-438d-88d9-2104fea4f62f-kube-api-access-wzvc5\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l\" (UID: \"8f82c6eb-6828-438d-88d9-2104fea4f62f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l"
Jul 26 15:50:38.351832 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.351796    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr7b6\" (UniqueName: \"kubernetes.io/projected/236dfe0e-0806-441e-8059-3ddde7696714-kube-api-access-mr7b6\") pod \"console-operator-584dcb6b54-l6wf6\" (UID: \"236dfe0e-0806-441e-8059-3ddde7696714\") " pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6"
Jul 26 15:50:38.352009 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.351989    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkjc5\" (UniqueName: \"kubernetes.io/projected/5f18633e-f0a8-494c-8f26-6ba7f55ebf6c-kube-api-access-pkjc5\") pod \"volume-data-source-validator-549c6d54cf-v6msr\" (UID: \"5f18633e-f0a8-494c-8f26-6ba7f55ebf6c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v6msr"
Jul 26 15:50:38.352144 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.352125    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s99d\" (UniqueName: \"kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-kube-api-access-7s99d\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.353205 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.353180    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fllgn\" (UniqueName: \"kubernetes.io/projected/e5de42ff-14ad-4780-aee7-80f431e2a706-kube-api-access-fllgn\") pod \"service-ca-operator-5d6c75f84f-72d9v\" (UID: \"e5de42ff-14ad-4780-aee7-80f431e2a706\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-72d9v"
Jul 26 15:50:38.437193 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.437163    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v6msr"
Jul 26 15:50:38.442822 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.442802    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-tmp-dir\") pod \"dns-default-pp2wf\" (UID: \"7dea8064-f342-461c-b4e9-ad71f3c7b9dc\") " pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:50:38.442925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.442834    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-metrics-tls\") pod \"dns-default-pp2wf\" (UID: \"7dea8064-f342-461c-b4e9-ad71f3c7b9dc\") " pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:50:38.442975 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:38.442955    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:50:38.443027 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:38.443006    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-metrics-tls podName:7dea8064-f342-461c-b4e9-ad71f3c7b9dc nodeName:}" failed. No retries permitted until 2026-07-26 15:50:38.942990355 +0000 UTC m=+35.161617389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-metrics-tls") pod "dns-default-pp2wf" (UID: "7dea8064-f342-461c-b4e9-ad71f3c7b9dc") : secret "dns-default-metrics-tls" not found
Jul 26 15:50:38.443091 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.443035    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-config-volume\") pod \"dns-default-pp2wf\" (UID: \"7dea8064-f342-461c-b4e9-ad71f3c7b9dc\") " pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:50:38.443091 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.443073    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49bsz\" (UniqueName: \"kubernetes.io/projected/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-kube-api-access-49bsz\") pod \"dns-default-pp2wf\" (UID: \"7dea8064-f342-461c-b4e9-ad71f3c7b9dc\") " pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:50:38.443187 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.443146    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-tmp-dir\") pod \"dns-default-pp2wf\" (UID: \"7dea8064-f342-461c-b4e9-ad71f3c7b9dc\") " pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:50:38.443562 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.443544    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-config-volume\") pod \"dns-default-pp2wf\" (UID: \"7dea8064-f342-461c-b4e9-ad71f3c7b9dc\") " pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:50:38.448448 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.448423    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6"
Jul 26 15:50:38.450726 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.450705    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49bsz\" (UniqueName: \"kubernetes.io/projected/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-kube-api-access-49bsz\") pod \"dns-default-pp2wf\" (UID: \"7dea8064-f342-461c-b4e9-ad71f3c7b9dc\") " pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:50:38.460343 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.460325    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-72d9v"
Jul 26 15:50:38.483316 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.483290    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l"
Jul 26 15:50:38.490053 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.490033    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w7s6n"
Jul 26 15:50:38.505867 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.505850    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b9nfk"
Jul 26 15:50:38.846475 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.846445    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/066ffd1b-bf6b-4aa5-b28d-451261883283-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-4gq77\" (UID: \"066ffd1b-bf6b-4aa5-b28d-451261883283\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4gq77"
Jul 26 15:50:38.846670 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.846498    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a22e8189-a58c-45ac-ba41-90287a24e285-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-v8n2s\" (UID: \"a22e8189-a58c-45ac-ba41-90287a24e285\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v8n2s"
Jul 26 15:50:38.846670 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.846539    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:38.846670 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:38.846614    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 26 15:50:38.846670 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:38.846666    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:50:38.846881 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:38.846681    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df9d96595-mhclr: secret "image-registry-tls" not found
Jul 26 15:50:38.846881 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:38.846700    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066ffd1b-bf6b-4aa5-b28d-451261883283-samples-operator-tls podName:066ffd1b-bf6b-4aa5-b28d-451261883283 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:39.846683523 +0000 UTC m=+36.065310550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/066ffd1b-bf6b-4aa5-b28d-451261883283-samples-operator-tls") pod "cluster-samples-operator-6748489656-4gq77" (UID: "066ffd1b-bf6b-4aa5-b28d-451261883283") : secret "samples-operator-tls" not found
Jul 26 15:50:38.846881 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:38.846727    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls podName:f4fe2369-8cf2-40ef-903f-40a375cdb5d9 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:39.84671159 +0000 UTC m=+36.065338619 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls") pod "image-registry-7df9d96595-mhclr" (UID: "f4fe2369-8cf2-40ef-903f-40a375cdb5d9") : secret "image-registry-tls" not found
Jul 26 15:50:38.846881 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:38.846666    2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 26 15:50:38.846881 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:38.846764    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a22e8189-a58c-45ac-ba41-90287a24e285-networking-console-plugin-cert podName:a22e8189-a58c-45ac-ba41-90287a24e285 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:39.846754696 +0000 UTC m=+36.065381726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a22e8189-a58c-45ac-ba41-90287a24e285-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-v8n2s" (UID: "a22e8189-a58c-45ac-ba41-90287a24e285") : secret "networking-console-plugin-cert" not found
Jul 26 15:50:38.947101 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:38.947074    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-metrics-tls\") pod \"dns-default-pp2wf\" (UID: \"7dea8064-f342-461c-b4e9-ad71f3c7b9dc\") " pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:50:38.947255 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:38.947236    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:50:38.947312 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:38.947305    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-metrics-tls podName:7dea8064-f342-461c-b4e9-ad71f3c7b9dc nodeName:}" failed. No retries permitted until 2026-07-26 15:50:39.947286578 +0000 UTC m=+36.165913619 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-metrics-tls") pod "dns-default-pp2wf" (UID: "7dea8064-f342-461c-b4e9-ad71f3c7b9dc") : secret "dns-default-metrics-tls" not found
Jul 26 15:50:39.210332 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:39.210302    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:50:39.210889 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:39.210439    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:50:39.210889 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:39.210470    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:50:39.214715 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:39.214167    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 26 15:50:39.214715 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:39.214428    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 26 15:50:39.214715 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:39.214603    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r7gjf\""
Jul 26 15:50:39.214715 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:39.214627    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c5h9x\""
Jul 26 15:50:39.860496 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:39.859537    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/066ffd1b-bf6b-4aa5-b28d-451261883283-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-4gq77\" (UID: \"066ffd1b-bf6b-4aa5-b28d-451261883283\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4gq77"
Jul 26 15:50:39.860496 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:39.859596    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a22e8189-a58c-45ac-ba41-90287a24e285-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-v8n2s\" (UID: \"a22e8189-a58c-45ac-ba41-90287a24e285\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v8n2s"
Jul 26 15:50:39.860496 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:39.859668    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:39.860496 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:39.859838    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:50:39.860496 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:39.859854    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df9d96595-mhclr: secret "image-registry-tls" not found
Jul 26 15:50:39.860496 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:39.859912    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls podName:f4fe2369-8cf2-40ef-903f-40a375cdb5d9 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:41.859892279 +0000 UTC m=+38.078519305 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls") pod "image-registry-7df9d96595-mhclr" (UID: "f4fe2369-8cf2-40ef-903f-40a375cdb5d9") : secret "image-registry-tls" not found
Jul 26 15:50:39.860496 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:39.859988    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 26 15:50:39.860496 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:39.860025    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066ffd1b-bf6b-4aa5-b28d-451261883283-samples-operator-tls podName:066ffd1b-bf6b-4aa5-b28d-451261883283 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:41.860012538 +0000 UTC m=+38.078639578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/066ffd1b-bf6b-4aa5-b28d-451261883283-samples-operator-tls") pod "cluster-samples-operator-6748489656-4gq77" (UID: "066ffd1b-bf6b-4aa5-b28d-451261883283") : secret "samples-operator-tls" not found
Jul 26 15:50:39.860496 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:39.860081    2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 26 15:50:39.860496 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:39.860113    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a22e8189-a58c-45ac-ba41-90287a24e285-networking-console-plugin-cert podName:a22e8189-a58c-45ac-ba41-90287a24e285 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:41.860103008 +0000 UTC m=+38.078730037 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a22e8189-a58c-45ac-ba41-90287a24e285-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-v8n2s" (UID: "a22e8189-a58c-45ac-ba41-90287a24e285") : secret "networking-console-plugin-cert" not found
Jul 26 15:50:39.865839 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:39.865739    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b9nfk"]
Jul 26 15:50:39.870879 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:39.870838    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod456fcf29_3214_47fa_b012_dd304048b677.slice/crio-ece43b94a278877ed01223ecba6fc33eadeeb2780d57baeff5898df58ab7f14c WatchSource:0}: Error finding container ece43b94a278877ed01223ecba6fc33eadeeb2780d57baeff5898df58ab7f14c: Status 404 returned error can't find the container with id ece43b94a278877ed01223ecba6fc33eadeeb2780d57baeff5898df58ab7f14c
Jul 26 15:50:39.875143 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:39.874793    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l"]
Jul 26 15:50:39.878109 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:39.878017    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v6msr"]
Jul 26 15:50:39.878856 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:39.878386    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f82c6eb_6828_438d_88d9_2104fea4f62f.slice/crio-def601a7f1d47318c78555f9de0e787bc79d31642c1dddec5f84ba167c5fe41d WatchSource:0}: Error finding container def601a7f1d47318c78555f9de0e787bc79d31642c1dddec5f84ba167c5fe41d: Status 404 returned error can't find the container with id def601a7f1d47318c78555f9de0e787bc79d31642c1dddec5f84ba167c5fe41d
Jul 26 15:50:39.881087 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:39.881059    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f18633e_f0a8_494c_8f26_6ba7f55ebf6c.slice/crio-0b97e1d15700aea466449ca2a62419c09f6db646ebe9de56f17ca1e04f1bfc88 WatchSource:0}: Error finding container 0b97e1d15700aea466449ca2a62419c09f6db646ebe9de56f17ca1e04f1bfc88: Status 404 returned error can't find the container with id 0b97e1d15700aea466449ca2a62419c09f6db646ebe9de56f17ca1e04f1bfc88
Jul 26 15:50:39.891220 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:39.891154    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-w7s6n"]
Jul 26 15:50:39.895068 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:39.895037    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8967ec92_2236_4a7d_a752_9afc7761cbb1.slice/crio-275b5c6007d24bfd939d3907af6aebb5dc2ea2fc7ccdb7afe1a30fbc7f87be31 WatchSource:0}: Error finding container 275b5c6007d24bfd939d3907af6aebb5dc2ea2fc7ccdb7afe1a30fbc7f87be31: Status 404 returned error can't find the container with id 275b5c6007d24bfd939d3907af6aebb5dc2ea2fc7ccdb7afe1a30fbc7f87be31
Jul 26 15:50:39.905203 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:39.905180    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-l6wf6"]
Jul 26 15:50:39.915256 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:39.915231    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-72d9v"]
Jul 26 15:50:39.917877 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:39.917851    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5de42ff_14ad_4780_aee7_80f431e2a706.slice/crio-8a519c31add4e17872c9f69ee384b2700a149bd3c79ae5b0cc967165fb69acb7 WatchSource:0}: Error finding container 8a519c31add4e17872c9f69ee384b2700a149bd3c79ae5b0cc967165fb69acb7: Status 404 returned error can't find the container with id 8a519c31add4e17872c9f69ee384b2700a149bd3c79ae5b0cc967165fb69acb7
Jul 26 15:50:39.918519 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:50:39.918492    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod236dfe0e_0806_441e_8059_3ddde7696714.slice/crio-61fcd7e40fd5eb4bb942f832fefbb2780f8ec67c6e95a6efed26e43d885af35c WatchSource:0}: Error finding container 61fcd7e40fd5eb4bb942f832fefbb2780f8ec67c6e95a6efed26e43d885af35c: Status 404 returned error can't find the container with id 61fcd7e40fd5eb4bb942f832fefbb2780f8ec67c6e95a6efed26e43d885af35c
Jul 26 15:50:39.960502 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:39.960470    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-metrics-tls\") pod \"dns-default-pp2wf\" (UID: \"7dea8064-f342-461c-b4e9-ad71f3c7b9dc\") " pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:50:39.960623 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:39.960607    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:50:39.960720 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:39.960680    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-metrics-tls podName:7dea8064-f342-461c-b4e9-ad71f3c7b9dc nodeName:}" failed. No retries permitted until 2026-07-26 15:50:41.960666335 +0000 UTC m=+38.179293362 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-metrics-tls") pod "dns-default-pp2wf" (UID: "7dea8064-f342-461c-b4e9-ad71f3c7b9dc") : secret "dns-default-metrics-tls" not found
Jul 26 15:50:40.542825 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:40.542741    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6" event={"ID":"236dfe0e-0806-441e-8059-3ddde7696714","Type":"ContainerStarted","Data":"61fcd7e40fd5eb4bb942f832fefbb2780f8ec67c6e95a6efed26e43d885af35c"}
Jul 26 15:50:40.552385 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:40.552347    2556 generic.go:356] "Generic (PLEG): container finished" podID="a4942130-b152-4353-ac91-262958a3e684" containerID="e6f006b6a4a9af92b81b0a1717a8eaecc41eba3a9d7d51a0d6150871080414ee" exitCode=0
Jul 26 15:50:40.552507 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:40.552448    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xj7sr" event={"ID":"a4942130-b152-4353-ac91-262958a3e684","Type":"ContainerDied","Data":"e6f006b6a4a9af92b81b0a1717a8eaecc41eba3a9d7d51a0d6150871080414ee"}
Jul 26 15:50:40.556902 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:40.556776    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w7s6n" event={"ID":"8967ec92-2236-4a7d-a752-9afc7761cbb1","Type":"ContainerStarted","Data":"275b5c6007d24bfd939d3907af6aebb5dc2ea2fc7ccdb7afe1a30fbc7f87be31"}
Jul 26 15:50:40.560271 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:40.559576    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l" event={"ID":"8f82c6eb-6828-438d-88d9-2104fea4f62f","Type":"ContainerStarted","Data":"def601a7f1d47318c78555f9de0e787bc79d31642c1dddec5f84ba167c5fe41d"}
Jul 26 15:50:40.564890 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:40.564866    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-72d9v" event={"ID":"e5de42ff-14ad-4780-aee7-80f431e2a706","Type":"ContainerStarted","Data":"8a519c31add4e17872c9f69ee384b2700a149bd3c79ae5b0cc967165fb69acb7"}
Jul 26 15:50:40.568400 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:40.568328    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v6msr" event={"ID":"5f18633e-f0a8-494c-8f26-6ba7f55ebf6c","Type":"ContainerStarted","Data":"0b97e1d15700aea466449ca2a62419c09f6db646ebe9de56f17ca1e04f1bfc88"}
Jul 26 15:50:40.570659 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:40.570591    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b9nfk" event={"ID":"456fcf29-3214-47fa-b012-dd304048b677","Type":"ContainerStarted","Data":"ece43b94a278877ed01223ecba6fc33eadeeb2780d57baeff5898df58ab7f14c"}
Jul 26 15:50:41.579927 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:41.579887    2556 generic.go:356] "Generic (PLEG): container finished" podID="a4942130-b152-4353-ac91-262958a3e684" containerID="8cf8762d244bde71ae7d725f7f10997021c1a3ea949497a5a330d143d4f6f5b4" exitCode=0
Jul 26 15:50:41.580455 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:41.579959    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xj7sr" event={"ID":"a4942130-b152-4353-ac91-262958a3e684","Type":"ContainerDied","Data":"8cf8762d244bde71ae7d725f7f10997021c1a3ea949497a5a330d143d4f6f5b4"}
Jul 26 15:50:41.878134 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:41.878049    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a22e8189-a58c-45ac-ba41-90287a24e285-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-v8n2s\" (UID: \"a22e8189-a58c-45ac-ba41-90287a24e285\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v8n2s"
Jul 26 15:50:41.878134 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:41.878118    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:41.878310 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:41.878219    2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 26 15:50:41.878310 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:41.878224    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/066ffd1b-bf6b-4aa5-b28d-451261883283-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-4gq77\" (UID: \"066ffd1b-bf6b-4aa5-b28d-451261883283\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4gq77"
Jul 26 15:50:41.878310 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:41.878282    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a22e8189-a58c-45ac-ba41-90287a24e285-networking-console-plugin-cert podName:a22e8189-a58c-45ac-ba41-90287a24e285 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:45.878262239 +0000 UTC m=+42.096889283 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a22e8189-a58c-45ac-ba41-90287a24e285-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-v8n2s" (UID: "a22e8189-a58c-45ac-ba41-90287a24e285") : secret "networking-console-plugin-cert" not found
Jul 26 15:50:41.878310 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:41.878308    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 26 15:50:41.878464 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:41.878342    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066ffd1b-bf6b-4aa5-b28d-451261883283-samples-operator-tls podName:066ffd1b-bf6b-4aa5-b28d-451261883283 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:45.87833187 +0000 UTC m=+42.096958897 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/066ffd1b-bf6b-4aa5-b28d-451261883283-samples-operator-tls") pod "cluster-samples-operator-6748489656-4gq77" (UID: "066ffd1b-bf6b-4aa5-b28d-451261883283") : secret "samples-operator-tls" not found
Jul 26 15:50:41.878464 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:41.878400    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:50:41.878464 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:41.878410    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df9d96595-mhclr: secret "image-registry-tls" not found
Jul 26 15:50:41.878464 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:41.878439    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls podName:f4fe2369-8cf2-40ef-903f-40a375cdb5d9 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:45.878428764 +0000 UTC m=+42.097055799 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls") pod "image-registry-7df9d96595-mhclr" (UID: "f4fe2369-8cf2-40ef-903f-40a375cdb5d9") : secret "image-registry-tls" not found
Jul 26 15:50:41.979378 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:41.979286    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-metrics-tls\") pod \"dns-default-pp2wf\" (UID: \"7dea8064-f342-461c-b4e9-ad71f3c7b9dc\") " pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:50:41.979543 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:41.979462    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:50:41.979543 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:41.979532    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-metrics-tls podName:7dea8064-f342-461c-b4e9-ad71f3c7b9dc nodeName:}" failed. No retries permitted until 2026-07-26 15:50:45.979511487 +0000 UTC m=+42.198138535 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-metrics-tls") pod "dns-default-pp2wf" (UID: "7dea8064-f342-461c-b4e9-ad71f3c7b9dc") : secret "dns-default-metrics-tls" not found
Jul 26 15:50:42.587599 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:42.587564    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xj7sr" event={"ID":"a4942130-b152-4353-ac91-262958a3e684","Type":"ContainerStarted","Data":"42b1ff7d487094a6a17d0670cc6350d9059b845153f00dd817ad5792fe4b1652"}
Jul 26 15:50:42.609247 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:42.609158    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xj7sr" podStartSLOduration=7.060796683 podStartE2EDuration="37.609081928s" totalImagesPullingTime="30.548285245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:42.608011831 +0000 UTC m=+38.826638905" watchObservedRunningTime="2026-07-26 15:50:42.609081928 +0000 UTC m=+38.827708977"
Jul 26 15:50:45.913560 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:45.913337    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a22e8189-a58c-45ac-ba41-90287a24e285-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-v8n2s\" (UID: \"a22e8189-a58c-45ac-ba41-90287a24e285\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v8n2s"
Jul 26 15:50:45.914079 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:45.913599    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:45.914079 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:45.913515    2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 26 15:50:45.914079 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:45.913720    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a22e8189-a58c-45ac-ba41-90287a24e285-networking-console-plugin-cert podName:a22e8189-a58c-45ac-ba41-90287a24e285 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:53.913695831 +0000 UTC m=+50.132322860 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a22e8189-a58c-45ac-ba41-90287a24e285-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-v8n2s" (UID: "a22e8189-a58c-45ac-ba41-90287a24e285") : secret "networking-console-plugin-cert" not found
Jul 26 15:50:45.914079 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:45.913763    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/066ffd1b-bf6b-4aa5-b28d-451261883283-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-4gq77\" (UID: \"066ffd1b-bf6b-4aa5-b28d-451261883283\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4gq77"
Jul 26 15:50:45.914079 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:45.913802    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:50:45.914079 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:45.913821    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df9d96595-mhclr: secret "image-registry-tls" not found
Jul 26 15:50:45.914079 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:45.913867    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls podName:f4fe2369-8cf2-40ef-903f-40a375cdb5d9 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:53.913852175 +0000 UTC m=+50.132479224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls") pod "image-registry-7df9d96595-mhclr" (UID: "f4fe2369-8cf2-40ef-903f-40a375cdb5d9") : secret "image-registry-tls" not found
Jul 26 15:50:45.914079 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:45.913866    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 26 15:50:45.914079 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:45.913899    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066ffd1b-bf6b-4aa5-b28d-451261883283-samples-operator-tls podName:066ffd1b-bf6b-4aa5-b28d-451261883283 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:53.913891259 +0000 UTC m=+50.132518292 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/066ffd1b-bf6b-4aa5-b28d-451261883283-samples-operator-tls") pod "cluster-samples-operator-6748489656-4gq77" (UID: "066ffd1b-bf6b-4aa5-b28d-451261883283") : secret "samples-operator-tls" not found
Jul 26 15:50:46.014217 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:46.014182    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-metrics-tls\") pod \"dns-default-pp2wf\" (UID: \"7dea8064-f342-461c-b4e9-ad71f3c7b9dc\") " pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:50:46.014363 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:46.014331    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:50:46.014408 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:46.014394    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-metrics-tls podName:7dea8064-f342-461c-b4e9-ad71f3c7b9dc nodeName:}" failed. No retries permitted until 2026-07-26 15:50:54.014379856 +0000 UTC m=+50.233006883 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-metrics-tls") pod "dns-default-pp2wf" (UID: "7dea8064-f342-461c-b4e9-ad71f3c7b9dc") : secret "dns-default-metrics-tls" not found
Jul 26 15:50:46.601804 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:46.601771    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/0.log"
Jul 26 15:50:46.602004 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:46.601826    2556 generic.go:356] "Generic (PLEG): container finished" podID="236dfe0e-0806-441e-8059-3ddde7696714" containerID="5bd63f21f081e89aed20fd86a5bf865c9d9c0efcd1372241f6ae9153c9fbb32f" exitCode=255
Jul 26 15:50:46.602141 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:46.602127    2556 scope.go:117] "RemoveContainer" containerID="5bd63f21f081e89aed20fd86a5bf865c9d9c0efcd1372241f6ae9153c9fbb32f"
Jul 26 15:50:46.602398 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:46.602378    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6" event={"ID":"236dfe0e-0806-441e-8059-3ddde7696714","Type":"ContainerDied","Data":"5bd63f21f081e89aed20fd86a5bf865c9d9c0efcd1372241f6ae9153c9fbb32f"}
Jul 26 15:50:46.604137 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:46.604110    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w7s6n" event={"ID":"8967ec92-2236-4a7d-a752-9afc7761cbb1","Type":"ContainerStarted","Data":"f40babe7fb0903bd4eab6668f4c4e01b0c806c43179250a8adcaf21cd05202d4"}
Jul 26 15:50:46.606109 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:46.606085    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l" event={"ID":"8f82c6eb-6828-438d-88d9-2104fea4f62f","Type":"ContainerStarted","Data":"923b3acd05dfa7feae80b71b9f9e113674823e522a8c3c2460e9da809a7b2670"}
Jul 26 15:50:46.607782 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:46.607743    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-72d9v" event={"ID":"e5de42ff-14ad-4780-aee7-80f431e2a706","Type":"ContainerStarted","Data":"4eba2ebe4044853abef87efc57a37fa39f75dcd68705b0887ef022146a201cb7"}
Jul 26 15:50:46.609854 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:46.609559    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v6msr" event={"ID":"5f18633e-f0a8-494c-8f26-6ba7f55ebf6c","Type":"ContainerStarted","Data":"17f957b712b2e2d9173de9e35a67330e15008e746bcd7bf75e4b166f0fac1c6d"}
Jul 26 15:50:46.611553 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:46.611532    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b9nfk" event={"ID":"456fcf29-3214-47fa-b012-dd304048b677","Type":"ContainerStarted","Data":"d693095bb8f03a80f6a47de4cc12738b515059ceaf05cb1acffb101d25040c86"}
Jul 26 15:50:46.632613 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:46.632566    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-w7s6n" podStartSLOduration=26.058528622 podStartE2EDuration="32.632547511s" totalImagesPullingTime="6.574018889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:46.631243698 +0000 UTC m=+42.849870747" watchObservedRunningTime="2026-07-26 15:50:46.632547511 +0000 UTC m=+42.851174560"
Jul 26 15:50:46.646414 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:46.646357    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-72d9v" podStartSLOduration=21.409023938 podStartE2EDuration="27.64633868s" totalImagesPullingTime="6.237314742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:46.645349482 +0000 UTC m=+42.863976533" watchObservedRunningTime="2026-07-26 15:50:46.64633868 +0000 UTC m=+42.864965713"
Jul 26 15:50:46.666316 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:46.666273    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-b9nfk" podStartSLOduration=2.377322576 podStartE2EDuration="8.666243475s" totalImagesPullingTime="6.288920899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:50:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:46.664688099 +0000 UTC m=+42.883315148" watchObservedRunningTime="2026-07-26 15:50:46.666243475 +0000 UTC m=+42.884870522"
Jul 26 15:50:46.679973 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:46.679930    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-v6msr" podStartSLOduration=29.428176723 podStartE2EDuration="35.679917566s" totalImagesPullingTime="6.251740843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:46.679048007 +0000 UTC m=+42.897675099" watchObservedRunningTime="2026-07-26 15:50:46.679917566 +0000 UTC m=+42.898544593"
Jul 26 15:50:46.696515 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:46.696450    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l" podStartSLOduration=26.420286059 podStartE2EDuration="32.696433176s" totalImagesPullingTime="6.276147117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:46.695922722 +0000 UTC m=+42.914549771" watchObservedRunningTime="2026-07-26 15:50:46.696433176 +0000 UTC m=+42.915060227"
Jul 26 15:50:47.616232 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:47.616203    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 15:50:47.616774 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:47.616671    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/0.log"
Jul 26 15:50:47.616774 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:47.616719    2556 generic.go:356] "Generic (PLEG): container finished" podID="236dfe0e-0806-441e-8059-3ddde7696714" containerID="c896ee924bcb683e18eb0b38a1d61bcd37685fed64d9159c2234b92c970fc252" exitCode=255
Jul 26 15:50:47.616893 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:47.616819    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6" event={"ID":"236dfe0e-0806-441e-8059-3ddde7696714","Type":"ContainerDied","Data":"c896ee924bcb683e18eb0b38a1d61bcd37685fed64d9159c2234b92c970fc252"}
Jul 26 15:50:47.616893 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:47.616886    2556 scope.go:117] "RemoveContainer" containerID="5bd63f21f081e89aed20fd86a5bf865c9d9c0efcd1372241f6ae9153c9fbb32f"
Jul 26 15:50:47.617077 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:47.617019    2556 scope.go:117] "RemoveContainer" containerID="c896ee924bcb683e18eb0b38a1d61bcd37685fed64d9159c2234b92c970fc252"
Jul 26 15:50:47.617234 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:47.617195    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-l6wf6_openshift-console-operator(236dfe0e-0806-441e-8059-3ddde7696714)\"" pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6" podUID="236dfe0e-0806-441e-8059-3ddde7696714"
Jul 26 15:50:48.448980 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:48.448938    2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6"
Jul 26 15:50:48.449154 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:48.448999    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6"
Jul 26 15:50:48.627728 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:48.627696    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 15:50:48.628093 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:48.628021    2556 scope.go:117] "RemoveContainer" containerID="c896ee924bcb683e18eb0b38a1d61bcd37685fed64d9159c2234b92c970fc252"
Jul 26 15:50:48.628212 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:48.628190    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-l6wf6_openshift-console-operator(236dfe0e-0806-441e-8059-3ddde7696714)\"" pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6" podUID="236dfe0e-0806-441e-8059-3ddde7696714"
Jul 26 15:50:49.631143 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:49.631110    2556 scope.go:117] "RemoveContainer" containerID="c896ee924bcb683e18eb0b38a1d61bcd37685fed64d9159c2234b92c970fc252"
Jul 26 15:50:49.631512 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:49.631250    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-l6wf6_openshift-console-operator(236dfe0e-0806-441e-8059-3ddde7696714)\"" pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6" podUID="236dfe0e-0806-441e-8059-3ddde7696714"
Jul 26 15:50:53.971217 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:53.971180    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/066ffd1b-bf6b-4aa5-b28d-451261883283-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-4gq77\" (UID: \"066ffd1b-bf6b-4aa5-b28d-451261883283\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4gq77"
Jul 26 15:50:53.971217 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:53.971231    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a22e8189-a58c-45ac-ba41-90287a24e285-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-v8n2s\" (UID: \"a22e8189-a58c-45ac-ba41-90287a24e285\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v8n2s"
Jul 26 15:50:53.971762 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:53.971326    2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 26 15:50:53.971762 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:53.971330    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 26 15:50:53.971762 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:53.971383    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:50:53.971762 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:53.971404    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/066ffd1b-bf6b-4aa5-b28d-451261883283-samples-operator-tls podName:066ffd1b-bf6b-4aa5-b28d-451261883283 nodeName:}" failed. No retries permitted until 2026-07-26 15:51:09.971381794 +0000 UTC m=+66.190008824 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/066ffd1b-bf6b-4aa5-b28d-451261883283-samples-operator-tls") pod "cluster-samples-operator-6748489656-4gq77" (UID: "066ffd1b-bf6b-4aa5-b28d-451261883283") : secret "samples-operator-tls" not found
Jul 26 15:50:53.971762 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:53.971457    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a22e8189-a58c-45ac-ba41-90287a24e285-networking-console-plugin-cert podName:a22e8189-a58c-45ac-ba41-90287a24e285 nodeName:}" failed. No retries permitted until 2026-07-26 15:51:09.971434309 +0000 UTC m=+66.190061344 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a22e8189-a58c-45ac-ba41-90287a24e285-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-v8n2s" (UID: "a22e8189-a58c-45ac-ba41-90287a24e285") : secret "networking-console-plugin-cert" not found
Jul 26 15:50:53.971762 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:53.971488    2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:50:53.971762 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:53.971507    2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df9d96595-mhclr: secret "image-registry-tls" not found
Jul 26 15:50:53.971762 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:53.971565    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls podName:f4fe2369-8cf2-40ef-903f-40a375cdb5d9 nodeName:}" failed. No retries permitted until 2026-07-26 15:51:09.971551972 +0000 UTC m=+66.190178999 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls") pod "image-registry-7df9d96595-mhclr" (UID: "f4fe2369-8cf2-40ef-903f-40a375cdb5d9") : secret "image-registry-tls" not found
Jul 26 15:50:54.072580 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:50:54.072553    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-metrics-tls\") pod \"dns-default-pp2wf\" (UID: \"7dea8064-f342-461c-b4e9-ad71f3c7b9dc\") " pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:50:54.072728 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:54.072709    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:50:54.072772 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:50:54.072755    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-metrics-tls podName:7dea8064-f342-461c-b4e9-ad71f3c7b9dc nodeName:}" failed. No retries permitted until 2026-07-26 15:51:10.072741321 +0000 UTC m=+66.291368379 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-metrics-tls") pod "dns-default-pp2wf" (UID: "7dea8064-f342-461c-b4e9-ad71f3c7b9dc") : secret "dns-default-metrics-tls" not found
Jul 26 15:51:03.210354 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:03.210323    2556 scope.go:117] "RemoveContainer" containerID="c896ee924bcb683e18eb0b38a1d61bcd37685fed64d9159c2234b92c970fc252"
Jul 26 15:51:03.674011 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:03.673985    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 15:51:03.674185 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:03.674054    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6" event={"ID":"236dfe0e-0806-441e-8059-3ddde7696714","Type":"ContainerStarted","Data":"0301f5c1cde1afe4cfc8ad6eeba04aa872c9aa49d6be2d8fe5cdf71a12c407a0"}
Jul 26 15:51:03.674401 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:03.674369    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6"
Jul 26 15:51:03.690788 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:03.690744    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6" podStartSLOduration=45.454418365 podStartE2EDuration="51.69073126s" totalImagesPullingTime="6.236312895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:50:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:03.690509228 +0000 UTC m=+59.909136304" watchObservedRunningTime="2026-07-26 15:51:03.69073126 +0000 UTC m=+59.909358309"
Jul 26 15:51:04.108776 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:04.108674    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-l6wf6"
Jul 26 15:51:04.553190 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:04.553165    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhwpz"
Jul 26 15:51:08.959799 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:08.959760    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64487c6554-xdb4v"]
Jul 26 15:51:08.964342 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:08.964315    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64487c6554-xdb4v"
Jul 26 15:51:08.967789 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:08.967766    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 26 15:51:08.967903 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:08.967875    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 26 15:51:08.968613 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:08.968590    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-p4pwl\""
Jul 26 15:51:08.969015 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:08.968999    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 26 15:51:08.969112 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:08.969036    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 26 15:51:08.981796 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:08.981772    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64487c6554-xdb4v"]
Jul 26 15:51:08.983885 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:08.983861    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret\") pod \"global-pull-secret-syncer-n7rxf\" (UID: \"d15f46dd-2ac8-4355-bb37-d19f8837deda\") " pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:51:08.983992 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:08.983919    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs\") pod \"network-metrics-daemon-wjzf7\" (UID: \"cc418ed5-59fd-4c09-9c91-8bd912a4bd73\") " pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:51:08.986589 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:08.986568    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 26 15:51:08.986701 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:08.986598    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 26 15:51:08.999873 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:08.999846    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d15f46dd-2ac8-4355-bb37-d19f8837deda-original-pull-secret\") pod \"global-pull-secret-syncer-n7rxf\" (UID: \"d15f46dd-2ac8-4355-bb37-d19f8837deda\") " pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:51:08.999978 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:08.999896    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc418ed5-59fd-4c09-9c91-8bd912a4bd73-metrics-certs\") pod \"network-metrics-daemon-wjzf7\" (UID: \"cc418ed5-59fd-4c09-9c91-8bd912a4bd73\") " pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:51:09.084332 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.084307    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d00180a-3baf-4b8c-9a18-c1e35da20af0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64487c6554-xdb4v\" (UID: \"4d00180a-3baf-4b8c-9a18-c1e35da20af0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64487c6554-xdb4v"
Jul 26 15:51:09.084429 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.084336    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqv75\" (UniqueName: \"kubernetes.io/projected/4d00180a-3baf-4b8c-9a18-c1e35da20af0-kube-api-access-wqv75\") pod \"managed-serviceaccount-addon-agent-64487c6554-xdb4v\" (UID: \"4d00180a-3baf-4b8c-9a18-c1e35da20af0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64487c6554-xdb4v"
Jul 26 15:51:09.084429 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.084382    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqt24\" (UniqueName: \"kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24\") pod \"network-check-target-psdlz\" (UID: \"e7ce1458-87fd-4ce6-ab5a-19218c78cbb1\") " pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:51:09.086556 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.086532    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqt24\" (UniqueName: \"kubernetes.io/projected/e7ce1458-87fd-4ce6-ab5a-19218c78cbb1-kube-api-access-xqt24\") pod \"network-check-target-psdlz\" (UID: \"e7ce1458-87fd-4ce6-ab5a-19218c78cbb1\") " pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:51:09.185229 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.185205    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqv75\" (UniqueName: \"kubernetes.io/projected/4d00180a-3baf-4b8c-9a18-c1e35da20af0-kube-api-access-wqv75\") pod \"managed-serviceaccount-addon-agent-64487c6554-xdb4v\" (UID: \"4d00180a-3baf-4b8c-9a18-c1e35da20af0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64487c6554-xdb4v"
Jul 26 15:51:09.185337 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.185298    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d00180a-3baf-4b8c-9a18-c1e35da20af0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64487c6554-xdb4v\" (UID: \"4d00180a-3baf-4b8c-9a18-c1e35da20af0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64487c6554-xdb4v"
Jul 26 15:51:09.187718 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.187687    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d00180a-3baf-4b8c-9a18-c1e35da20af0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64487c6554-xdb4v\" (UID: \"4d00180a-3baf-4b8c-9a18-c1e35da20af0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64487c6554-xdb4v"
Jul 26 15:51:09.201450 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.201426    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqv75\" (UniqueName: \"kubernetes.io/projected/4d00180a-3baf-4b8c-9a18-c1e35da20af0-kube-api-access-wqv75\") pod \"managed-serviceaccount-addon-agent-64487c6554-xdb4v\" (UID: \"4d00180a-3baf-4b8c-9a18-c1e35da20af0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64487c6554-xdb4v"
Jul 26 15:51:09.225410 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.225358    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r7gjf\""
Jul 26 15:51:09.232016 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.232002    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c5h9x\""
Jul 26 15:51:09.233801 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.233787    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wjzf7"
Jul 26 15:51:09.236020 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.236004    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n7rxf"
Jul 26 15:51:09.241002 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.240970    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:51:09.288539 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.287999    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64487c6554-xdb4v"
Jul 26 15:51:09.376814 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.376737    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-psdlz"]
Jul 26 15:51:09.384554 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:51:09.384017    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ce1458_87fd_4ce6_ab5a_19218c78cbb1.slice/crio-de0b938526048e9075dbd3dccb2632ebfeaa5d97edcb40bec4abf0102147620f WatchSource:0}: Error finding container de0b938526048e9075dbd3dccb2632ebfeaa5d97edcb40bec4abf0102147620f: Status 404 returned error can't find the container with id de0b938526048e9075dbd3dccb2632ebfeaa5d97edcb40bec4abf0102147620f
Jul 26 15:51:09.449768 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.449747    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64487c6554-xdb4v"]
Jul 26 15:51:09.452428 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:51:09.452400    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d00180a_3baf_4b8c_9a18_c1e35da20af0.slice/crio-98e5d67a8ab56276538a445adcad88dc49a20f10c2807b0092b77287c641d2c9 WatchSource:0}: Error finding container 98e5d67a8ab56276538a445adcad88dc49a20f10c2807b0092b77287c641d2c9: Status 404 returned error can't find the container with id 98e5d67a8ab56276538a445adcad88dc49a20f10c2807b0092b77287c641d2c9
Jul 26 15:51:09.606946 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.606875    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n7rxf"]
Jul 26 15:51:09.607775 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.607757    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wjzf7"]
Jul 26 15:51:09.609137 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:51:09.609114    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc418ed5_59fd_4c09_9c91_8bd912a4bd73.slice/crio-b7a40f0852d293b07db71f3e0be365cfdd303a31beb855b2b7e95dbc044d0226 WatchSource:0}: Error finding container b7a40f0852d293b07db71f3e0be365cfdd303a31beb855b2b7e95dbc044d0226: Status 404 returned error can't find the container with id b7a40f0852d293b07db71f3e0be365cfdd303a31beb855b2b7e95dbc044d0226
Jul 26 15:51:09.609825 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:51:09.609807    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd15f46dd_2ac8_4355_bb37_d19f8837deda.slice/crio-54ca01bfdace553d24d8b13d97a51c0822bc942ee515d3dc2a668ffde65e70d6 WatchSource:0}: Error finding container 54ca01bfdace553d24d8b13d97a51c0822bc942ee515d3dc2a668ffde65e70d6: Status 404 returned error can't find the container with id 54ca01bfdace553d24d8b13d97a51c0822bc942ee515d3dc2a668ffde65e70d6
Jul 26 15:51:09.693741 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.693707    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wjzf7" event={"ID":"cc418ed5-59fd-4c09-9c91-8bd912a4bd73","Type":"ContainerStarted","Data":"b7a40f0852d293b07db71f3e0be365cfdd303a31beb855b2b7e95dbc044d0226"}
Jul 26 15:51:09.694722 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.694701    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64487c6554-xdb4v" event={"ID":"4d00180a-3baf-4b8c-9a18-c1e35da20af0","Type":"ContainerStarted","Data":"98e5d67a8ab56276538a445adcad88dc49a20f10c2807b0092b77287c641d2c9"}
Jul 26 15:51:09.696022 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.696002    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-psdlz" event={"ID":"e7ce1458-87fd-4ce6-ab5a-19218c78cbb1","Type":"ContainerStarted","Data":"6c1a17a139275b6db6785d1c3a7764c046b497c5976f40fceb8e0f1acd375d18"}
Jul 26 15:51:09.696113 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.696035    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-psdlz" event={"ID":"e7ce1458-87fd-4ce6-ab5a-19218c78cbb1","Type":"ContainerStarted","Data":"de0b938526048e9075dbd3dccb2632ebfeaa5d97edcb40bec4abf0102147620f"}
Jul 26 15:51:09.696113 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.696079    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:51:09.697096 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.697079    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n7rxf" event={"ID":"d15f46dd-2ac8-4355-bb37-d19f8837deda","Type":"ContainerStarted","Data":"54ca01bfdace553d24d8b13d97a51c0822bc942ee515d3dc2a668ffde65e70d6"}
Jul 26 15:51:09.710196 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.710157    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-psdlz" podStartSLOduration=64.710144998 podStartE2EDuration="1m4.710144998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:50:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:09.709391196 +0000 UTC m=+65.928018265" watchObservedRunningTime="2026-07-26 15:51:09.710144998 +0000 UTC m=+65.928772095"
Jul 26 15:51:09.992591 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.992571    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/066ffd1b-bf6b-4aa5-b28d-451261883283-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-4gq77\" (UID: \"066ffd1b-bf6b-4aa5-b28d-451261883283\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4gq77"
Jul 26 15:51:09.992981 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.992601    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a22e8189-a58c-45ac-ba41-90287a24e285-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-v8n2s\" (UID: \"a22e8189-a58c-45ac-ba41-90287a24e285\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v8n2s"
Jul 26 15:51:09.992981 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.992628    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:51:09.995295 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.995272    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls\") pod \"image-registry-7df9d96595-mhclr\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") " pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:51:09.995379 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.995295    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a22e8189-a58c-45ac-ba41-90287a24e285-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-v8n2s\" (UID: \"a22e8189-a58c-45ac-ba41-90287a24e285\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-v8n2s"
Jul 26 15:51:09.995379 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.995314    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/066ffd1b-bf6b-4aa5-b28d-451261883283-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-4gq77\" (UID: \"066ffd1b-bf6b-4aa5-b28d-451261883283\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4gq77"
Jul 26 15:51:09.999273 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:09.999257    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zjznk\""
Jul 26 15:51:10.008164 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:10.008144    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-v8n2s"
Jul 26 15:51:10.093624 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:10.093556    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-metrics-tls\") pod \"dns-default-pp2wf\" (UID: \"7dea8064-f342-461c-b4e9-ad71f3c7b9dc\") " pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:51:10.097985 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:10.097893    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7dea8064-f342-461c-b4e9-ad71f3c7b9dc-metrics-tls\") pod \"dns-default-pp2wf\" (UID: \"7dea8064-f342-461c-b4e9-ad71f3c7b9dc\") " pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:51:10.173957 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:10.173877    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-v8n2s"]
Jul 26 15:51:10.179266 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:51:10.179231    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda22e8189_a58c_45ac_ba41_90287a24e285.slice/crio-835b7f8eba5d05ad00dc3f848dee74dfd29c30556ee499d5be413db5a16186cc WatchSource:0}: Error finding container 835b7f8eba5d05ad00dc3f848dee74dfd29c30556ee499d5be413db5a16186cc: Status 404 returned error can't find the container with id 835b7f8eba5d05ad00dc3f848dee74dfd29c30556ee499d5be413db5a16186cc
Jul 26 15:51:10.269695 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:10.269415    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7rnml\""
Jul 26 15:51:10.277584 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:10.277522    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4gq77"
Jul 26 15:51:10.278709 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:10.278679    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rcvjj\""
Jul 26 15:51:10.286878 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:10.286848    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:51:10.314567 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:10.314345    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cx8dk\""
Jul 26 15:51:10.322709 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:10.322417    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:51:10.493665 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:10.493106    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df9d96595-mhclr"]
Jul 26 15:51:10.518554 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:10.518485    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pp2wf"]
Jul 26 15:51:10.690564 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:10.690475    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4gq77"]
Jul 26 15:51:10.704551 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:10.704440    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-v8n2s" event={"ID":"a22e8189-a58c-45ac-ba41-90287a24e285","Type":"ContainerStarted","Data":"835b7f8eba5d05ad00dc3f848dee74dfd29c30556ee499d5be413db5a16186cc"}
Jul 26 15:51:10.918104 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:51:10.918005    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4fe2369_8cf2_40ef_903f_40a375cdb5d9.slice/crio-300886a5b0ecd52927e7d2497979a0358df175ba883b6677302380fa9ea86119 WatchSource:0}: Error finding container 300886a5b0ecd52927e7d2497979a0358df175ba883b6677302380fa9ea86119: Status 404 returned error can't find the container with id 300886a5b0ecd52927e7d2497979a0358df175ba883b6677302380fa9ea86119
Jul 26 15:51:11.711107 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:11.711074    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pp2wf" event={"ID":"7dea8064-f342-461c-b4e9-ad71f3c7b9dc","Type":"ContainerStarted","Data":"ce8283c4f2cfe5871bc589bf9a9df971237ad701fa9ebdc73900cf7aaf8db4eb"}
Jul 26 15:51:11.712847 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:11.712818    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df9d96595-mhclr" event={"ID":"f4fe2369-8cf2-40ef-903f-40a375cdb5d9","Type":"ContainerStarted","Data":"119984c17d8dc98f4a48c6a6bafef7038ff367dc9ab577474345eb4b7ed2216a"}
Jul 26 15:51:11.712966 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:11.712866    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df9d96595-mhclr" event={"ID":"f4fe2369-8cf2-40ef-903f-40a375cdb5d9","Type":"ContainerStarted","Data":"300886a5b0ecd52927e7d2497979a0358df175ba883b6677302380fa9ea86119"}
Jul 26 15:51:11.713346 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:11.713324    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:51:11.715090 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:11.715064    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4gq77" event={"ID":"066ffd1b-bf6b-4aa5-b28d-451261883283","Type":"ContainerStarted","Data":"26bb6e5bfc211717d50d44db7de86365e4a50e0c7f9b51f80ca2cf46443ec163"}
Jul 26 15:51:11.734411 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:11.734362    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7df9d96595-mhclr" podStartSLOduration=67.73434644 podStartE2EDuration="1m7.73434644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:50:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:11.73318195 +0000 UTC m=+67.951809020" watchObservedRunningTime="2026-07-26 15:51:11.73434644 +0000 UTC m=+67.952973493"
Jul 26 15:51:13.724120 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:13.724050    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wjzf7" event={"ID":"cc418ed5-59fd-4c09-9c91-8bd912a4bd73","Type":"ContainerStarted","Data":"71192cd253ca09989252c4abb7419e239a5fd70fe6d7f5b15616ffb737c50f18"}
Jul 26 15:51:14.480712 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:14.480683    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xrhpg"]
Jul 26 15:51:14.491647 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:14.491615    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:14.494197 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:14.494054    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 26 15:51:14.494197 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:14.494164    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 26 15:51:14.494197 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:14.494171    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 26 15:51:14.495250 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:14.495043    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 26 15:51:14.495250 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:14.495144    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lf682\""
Jul 26 15:51:14.496391 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:14.496362    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xrhpg"]
Jul 26 15:51:14.528004 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:14.527982    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:14.528101 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:14.528017    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v48b7\" (UniqueName: \"kubernetes.io/projected/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-kube-api-access-v48b7\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:14.528101 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:14.528046    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-data-volume\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:14.528214 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:14.528135    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:14.528214 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:14.528177    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-crio-socket\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:14.629464 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:14.629434    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-crio-socket\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:14.629682 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:14.629493    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:14.629682 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:14.629522    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v48b7\" (UniqueName: \"kubernetes.io/projected/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-kube-api-access-v48b7\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:14.629682 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:14.629567    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-data-volume\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:14.629682 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:14.629565    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-crio-socket\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:14.629682 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:14.629605    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:14.629682 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:51:14.629669    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 15:51:14.629974 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:51:14.629741    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:51:14.629974 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:51:14.629747    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-kube-rbac-proxy-cm podName:2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd nodeName:}" failed. No retries permitted until 2026-07-26 15:51:15.129725097 +0000 UTC m=+71.348352131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xrhpg" (UID: "2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd") : configmap "kube-rbac-proxy" not found
Jul 26 15:51:14.630355 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:51:14.630329    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-insights-runtime-extractor-tls podName:2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd nodeName:}" failed. No retries permitted until 2026-07-26 15:51:15.13009952 +0000 UTC m=+71.348726550 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xrhpg" (UID: "2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:51:14.630482 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:14.630451    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-data-volume\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:14.640538 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:14.640488    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v48b7\" (UniqueName: \"kubernetes.io/projected/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-kube-api-access-v48b7\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:15.133656 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.133607    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:15.134078 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.133683    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:15.134078 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:51:15.133762    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:51:15.134078 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:51:15.133826    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-insights-runtime-extractor-tls podName:2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd nodeName:}" failed. No retries permitted until 2026-07-26 15:51:16.133809294 +0000 UTC m=+72.352436321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xrhpg" (UID: "2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:51:15.134078 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:51:15.133768    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 15:51:15.134078 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:51:15.133860    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-kube-rbac-proxy-cm podName:2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd nodeName:}" failed. No retries permitted until 2026-07-26 15:51:16.13385381 +0000 UTC m=+72.352480836 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xrhpg" (UID: "2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd") : configmap "kube-rbac-proxy" not found
Jul 26 15:51:15.201627 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.201602    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fb65bc75f-p6l24"]
Jul 26 15:51:15.221766 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.221717    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fb65bc75f-p6l24"]
Jul 26 15:51:15.221865 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.221802    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.224332 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.224311    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 26 15:51:15.224451 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.224313    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 26 15:51:15.224451 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.224405    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-59gbz\""
Jul 26 15:51:15.225559 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.225541    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 26 15:51:15.225691 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.225572    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 26 15:51:15.225691 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.225684    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 26 15:51:15.225787 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.225698    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 26 15:51:15.225828 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.225788    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 26 15:51:15.229130 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.229102    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 26 15:51:15.335967 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.335943    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-oauth-serving-cert\") pod \"console-fb65bc75f-p6l24\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") " pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.336064 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.335971    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-service-ca\") pod \"console-fb65bc75f-p6l24\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") " pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.336064 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.335989    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-console-oauth-config\") pod \"console-fb65bc75f-p6l24\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") " pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.336064 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.336014    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-console-config\") pod \"console-fb65bc75f-p6l24\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") " pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.336162 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.336070    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-console-serving-cert\") pod \"console-fb65bc75f-p6l24\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") " pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.336162 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.336103    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-trusted-ca-bundle\") pod \"console-fb65bc75f-p6l24\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") " pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.336162 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.336133    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkq5b\" (UniqueName: \"kubernetes.io/projected/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-kube-api-access-qkq5b\") pod \"console-fb65bc75f-p6l24\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") " pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.437418 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.437385    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkq5b\" (UniqueName: \"kubernetes.io/projected/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-kube-api-access-qkq5b\") pod \"console-fb65bc75f-p6l24\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") " pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.437522 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.437424    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-oauth-serving-cert\") pod \"console-fb65bc75f-p6l24\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") " pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.437522 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.437443    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-service-ca\") pod \"console-fb65bc75f-p6l24\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") " pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.437522 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.437484    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-console-oauth-config\") pod \"console-fb65bc75f-p6l24\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") " pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.437522 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.437516    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-console-config\") pod \"console-fb65bc75f-p6l24\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") " pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.437741 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.437556    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-console-serving-cert\") pod \"console-fb65bc75f-p6l24\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") " pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.437741 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.437592    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-trusted-ca-bundle\") pod \"console-fb65bc75f-p6l24\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") " pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.438314 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.438282    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-oauth-serving-cert\") pod \"console-fb65bc75f-p6l24\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") " pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.438412 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.438310    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-console-config\") pod \"console-fb65bc75f-p6l24\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") " pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.438412 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.438291    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-service-ca\") pod \"console-fb65bc75f-p6l24\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") " pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.438621 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.438596    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-trusted-ca-bundle\") pod \"console-fb65bc75f-p6l24\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") " pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.440021 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.439996    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-console-oauth-config\") pod \"console-fb65bc75f-p6l24\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") " pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.440219 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.440199    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-console-serving-cert\") pod \"console-fb65bc75f-p6l24\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") " pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.448084 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.448063    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkq5b\" (UniqueName: \"kubernetes.io/projected/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-kube-api-access-qkq5b\") pod \"console-fb65bc75f-p6l24\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") " pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:15.531243 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:15.531188    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:16.141805 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:16.141769    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:16.142236 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:16.141845    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:16.142236 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:51:16.141933    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 15:51:16.142236 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:51:16.141944    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:51:16.142236 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:51:16.142002    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-kube-rbac-proxy-cm podName:2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd nodeName:}" failed. No retries permitted until 2026-07-26 15:51:18.141983195 +0000 UTC m=+74.360610225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xrhpg" (UID: "2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd") : configmap "kube-rbac-proxy" not found
Jul 26 15:51:16.142236 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:51:16.142020    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-insights-runtime-extractor-tls podName:2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd nodeName:}" failed. No retries permitted until 2026-07-26 15:51:18.142011349 +0000 UTC m=+74.360638378 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xrhpg" (UID: "2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:51:16.692564 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:16.692542    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xcj2r_8ff4109f-26ad-4a48-94d2-05f67fb8bbc2/dns-node-resolver/0.log"
Jul 26 15:51:16.892443 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:16.892426    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7df9d96595-mhclr_f4fe2369-8cf2-40ef-903f-40a375cdb5d9/registry/0.log"
Jul 26 15:51:17.034693 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:17.034666    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fb65bc75f-p6l24"]
Jul 26 15:51:17.039899 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:51:17.039869    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c0e3cf1_72ed_4f1b_9fe4_bf539bc6ca1b.slice/crio-d74410311308076cdc3e41c7cd459d34d62e66ce7fcb624224d21f52482b62b8 WatchSource:0}: Error finding container d74410311308076cdc3e41c7cd459d34d62e66ce7fcb624224d21f52482b62b8: Status 404 returned error can't find the container with id d74410311308076cdc3e41c7cd459d34d62e66ce7fcb624224d21f52482b62b8
Jul 26 15:51:17.692250 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:17.692213    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tp5k8_e2c0e7ad-45f1-4542-9a7e-272eb322c490/node-ca/0.log"
Jul 26 15:51:17.741566 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:17.741523    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64487c6554-xdb4v" event={"ID":"4d00180a-3baf-4b8c-9a18-c1e35da20af0","Type":"ContainerStarted","Data":"d1132cc38dd45541cf7f415bfcd1d58f35cc81dc3e48dc49a05e5dbf3584bc31"}
Jul 26 15:51:17.744305 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:17.744274    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n7rxf" event={"ID":"d15f46dd-2ac8-4355-bb37-d19f8837deda","Type":"ContainerStarted","Data":"349e1583af807cf375c72006677b83fd30bb94168be393296ea101be29bd95c5"}
Jul 26 15:51:17.748453 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:17.748422    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4gq77" event={"ID":"066ffd1b-bf6b-4aa5-b28d-451261883283","Type":"ContainerStarted","Data":"123daa58a3af2f6b04361febdaa6e218926835b301c5d9f601254b836d9788c5"}
Jul 26 15:51:17.748560 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:17.748485    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4gq77" event={"ID":"066ffd1b-bf6b-4aa5-b28d-451261883283","Type":"ContainerStarted","Data":"46d98241143dec7e0debfbba5b1bbd98a69645497fdb8fc4777fd0953b38b431"}
Jul 26 15:51:17.750800 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:17.750655    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pp2wf" event={"ID":"7dea8064-f342-461c-b4e9-ad71f3c7b9dc","Type":"ContainerStarted","Data":"0ce8274ff2b7d0c3ad79e81bb12e9ba98ee9c9086e9a919e331429b9b386dc6c"}
Jul 26 15:51:17.750800 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:17.750715    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:51:17.750800 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:17.750742    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pp2wf" event={"ID":"7dea8064-f342-461c-b4e9-ad71f3c7b9dc","Type":"ContainerStarted","Data":"0a7e15c32f5d4919364e39bc0ec7dbe38b5759e9a6c9eaf437fd2b925919c167"}
Jul 26 15:51:17.752680 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:17.752651    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wjzf7" event={"ID":"cc418ed5-59fd-4c09-9c91-8bd912a4bd73","Type":"ContainerStarted","Data":"cbdca3ebcc040c8092336e30eea1ab8ae0e135081e12697c437d1c704d710993"}
Jul 26 15:51:17.754763 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:17.754731    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-v8n2s" event={"ID":"a22e8189-a58c-45ac-ba41-90287a24e285","Type":"ContainerStarted","Data":"307efddbbe5fbb91951f0fd00700fc5f919efebd66a9a5db875dbf9f7a56b7e6"}
Jul 26 15:51:17.757346 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:17.757222    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64487c6554-xdb4v" podStartSLOduration=2.766151853 podStartE2EDuration="9.757204113s" totalImagesPullingTime="6.99105226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:17.756463485 +0000 UTC m=+73.975090534" watchObservedRunningTime="2026-07-26 15:51:17.757204113 +0000 UTC m=+73.975831163"
Jul 26 15:51:17.757454 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:17.757430    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb65bc75f-p6l24" event={"ID":"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b","Type":"ContainerStarted","Data":"d74410311308076cdc3e41c7cd459d34d62e66ce7fcb624224d21f52482b62b8"}
Jul 26 15:51:17.774214 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:17.774165    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pp2wf" podStartSLOduration=33.787799466 podStartE2EDuration="39.774152278s" totalImagesPullingTime="5.986352812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:50:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:17.772806632 +0000 UTC m=+73.991433707" watchObservedRunningTime="2026-07-26 15:51:17.774152278 +0000 UTC m=+73.992779328"
Jul 26 15:51:17.788354 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:17.788309    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-v8n2s" podStartSLOduration=34.524914389 podStartE2EDuration="40.788293399s" totalImagesPullingTime="6.26337901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:17.78779447 +0000 UTC m=+74.006421520" watchObservedRunningTime="2026-07-26 15:51:17.788293399 +0000 UTC m=+74.006920447"
Jul 26 15:51:17.805720 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:17.805554    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-4gq77" podStartSLOduration=60.89389868 podStartE2EDuration="1m6.805536042s" totalImagesPullingTime="5.911637362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:17.803566016 +0000 UTC m=+74.022193070" watchObservedRunningTime="2026-07-26 15:51:17.805536042 +0000 UTC m=+74.024163093"
Jul 26 15:51:17.818608 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:17.818563    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wjzf7" podStartSLOduration=72.184135031 podStartE2EDuration="1m13.818555087s" totalImagesPullingTime="1.634420056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:17.818051591 +0000 UTC m=+74.036678666" watchObservedRunningTime="2026-07-26 15:51:17.818555087 +0000 UTC m=+74.037182139"
Jul 26 15:51:17.832930 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:17.832842    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n7rxf" podStartSLOduration=65.999161905 podStartE2EDuration="1m12.832826411s" totalImagesPullingTime="6.833664506s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:17.831358692 +0000 UTC m=+74.049985743" watchObservedRunningTime="2026-07-26 15:51:17.832826411 +0000 UTC m=+74.051453462"
Jul 26 15:51:18.165047 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:18.164908    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:18.165047 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:18.164997    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:18.165270 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:51:18.165081    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 15:51:18.165270 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:51:18.165084    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:51:18.165270 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:51:18.165149    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-kube-rbac-proxy-cm podName:2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd nodeName:}" failed. No retries permitted until 2026-07-26 15:51:22.165129511 +0000 UTC m=+78.383756539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xrhpg" (UID: "2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd") : configmap "kube-rbac-proxy" not found
Jul 26 15:51:18.165270 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:51:18.165165    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-insights-runtime-extractor-tls podName:2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd nodeName:}" failed. No retries permitted until 2026-07-26 15:51:22.165157858 +0000 UTC m=+78.383784889 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xrhpg" (UID: "2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:51:18.492480 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:18.492448    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b9nfk_456fcf29-3214-47fa-b012-dd304048b677/serve-healthcheck-canary/0.log"
Jul 26 15:51:19.040377 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:19.040343    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l5kkx"]
Jul 26 15:51:19.043522 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:19.043503    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l5kkx"
Jul 26 15:51:19.045748 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:19.045720    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 26 15:51:19.045842 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:19.045767    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-bzkv5\""
Jul 26 15:51:19.052620 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:19.052592    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l5kkx"]
Jul 26 15:51:19.172844 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:19.172814    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9cb4b24e-83a8-4911-91e5-7ebcf5c6e74f-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-l5kkx\" (UID: \"9cb4b24e-83a8-4911-91e5-7ebcf5c6e74f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l5kkx"
Jul 26 15:51:19.273915 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:19.273883    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9cb4b24e-83a8-4911-91e5-7ebcf5c6e74f-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-l5kkx\" (UID: \"9cb4b24e-83a8-4911-91e5-7ebcf5c6e74f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l5kkx"
Jul 26 15:51:19.276525 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:19.276502    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9cb4b24e-83a8-4911-91e5-7ebcf5c6e74f-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-l5kkx\" (UID: \"9cb4b24e-83a8-4911-91e5-7ebcf5c6e74f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l5kkx"
Jul 26 15:51:19.353715 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:19.353625    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l5kkx"
Jul 26 15:51:20.050045 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:20.050022    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l5kkx"]
Jul 26 15:51:20.052369 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:51:20.052347    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cb4b24e_83a8_4911_91e5_7ebcf5c6e74f.slice/crio-47356497d1391362017589195336bfe75e39aa8215abe3b0ef0251c0283da8b6 WatchSource:0}: Error finding container 47356497d1391362017589195336bfe75e39aa8215abe3b0ef0251c0283da8b6: Status 404 returned error can't find the container with id 47356497d1391362017589195336bfe75e39aa8215abe3b0ef0251c0283da8b6
Jul 26 15:51:20.770648 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:20.770609    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l5kkx" event={"ID":"9cb4b24e-83a8-4911-91e5-7ebcf5c6e74f","Type":"ContainerStarted","Data":"47356497d1391362017589195336bfe75e39aa8215abe3b0ef0251c0283da8b6"}
Jul 26 15:51:20.772012 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:20.771990    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb65bc75f-p6l24" event={"ID":"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b","Type":"ContainerStarted","Data":"aac238eeb5207249d1e927afb3e45d2f315b80db261a1eb0303751f967bd9a58"}
Jul 26 15:51:20.788013 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:20.787961    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fb65bc75f-p6l24" podStartSLOduration=2.844329821 podStartE2EDuration="5.787914374s" totalImagesPullingTime="2.943584553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:51:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:20.787528746 +0000 UTC m=+77.006155839" watchObservedRunningTime="2026-07-26 15:51:20.787914374 +0000 UTC m=+77.006541425"
Jul 26 15:51:21.777150 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:21.777109    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l5kkx" event={"ID":"9cb4b24e-83a8-4911-91e5-7ebcf5c6e74f","Type":"ContainerStarted","Data":"8dffb44bd832b0ca038355c7dd2b3913a9e6cfa08fc8342cba16574e43c0b947"}
Jul 26 15:51:21.777522 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:21.777312    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l5kkx"
Jul 26 15:51:21.781575 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:21.781547    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l5kkx"
Jul 26 15:51:21.793670 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:21.793605    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-l5kkx" podStartSLOduration=1.676847049 podStartE2EDuration="2.793566775s" totalImagesPullingTime="1.116719726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:51:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:21.792410423 +0000 UTC m=+78.011037468" watchObservedRunningTime="2026-07-26 15:51:21.793566775 +0000 UTC m=+78.012193824"
Jul 26 15:51:22.199832 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:22.199782    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:22.200004 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:22.199878    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:22.200004 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:51:22.199891    2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 15:51:22.200004 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:51:22.199971    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-kube-rbac-proxy-cm podName:2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd nodeName:}" failed. No retries permitted until 2026-07-26 15:51:30.199954366 +0000 UTC m=+86.418581399 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xrhpg" (UID: "2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd") : configmap "kube-rbac-proxy" not found
Jul 26 15:51:22.200171 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:51:22.200006    2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:51:22.200171 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:51:22.200072    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-insights-runtime-extractor-tls podName:2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd nodeName:}" failed. No retries permitted until 2026-07-26 15:51:30.200053822 +0000 UTC m=+86.418680850 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xrhpg" (UID: "2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:51:25.531333 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:25.531296    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:25.531757 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:25.531354    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:25.535844 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:25.535818    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:25.795459 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:25.795395    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:51:27.764490 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:27.764459    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pp2wf"
Jul 26 15:51:30.260912 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:30.260876    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:30.261347 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:30.260936    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:30.261388 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:30.261368    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:30.263209 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:30.263188    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xrhpg\" (UID: \"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd\") " pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:30.400552 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:30.400528    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xrhpg"
Jul 26 15:51:30.523756 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:30.523541    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xrhpg"]
Jul 26 15:51:30.526606 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:51:30.526581    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e4d7be9_efb0_4a11_bf8b_5e59dfb920bd.slice/crio-ff99e9c4421eb565862ce6737aaa0e704473e658f549e8fa8b5034f39d3c8ec2 WatchSource:0}: Error finding container ff99e9c4421eb565862ce6737aaa0e704473e658f549e8fa8b5034f39d3c8ec2: Status 404 returned error can't find the container with id ff99e9c4421eb565862ce6737aaa0e704473e658f549e8fa8b5034f39d3c8ec2
Jul 26 15:51:30.811839 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:30.811780    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xrhpg" event={"ID":"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd","Type":"ContainerStarted","Data":"ff99e9c4421eb565862ce6737aaa0e704473e658f549e8fa8b5034f39d3c8ec2"}
Jul 26 15:51:30.866453 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:30.866426    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7df9d96595-mhclr"]
Jul 26 15:51:30.871209 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:30.871165    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:51:33.458029 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.457996    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r"]
Jul 26 15:51:33.473162 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.473134    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r"
Jul 26 15:51:33.476744 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.476692    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 26 15:51:33.476744 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.476702    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 26 15:51:33.477118 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.477096    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 26 15:51:33.477240 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.477155    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r"]
Jul 26 15:51:33.477240 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.477195    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 26 15:51:33.477367 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.477313    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wr8dt\""
Jul 26 15:51:33.477421 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.477385    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 26 15:51:33.521298 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.521275    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wgbxw"]
Jul 26 15:51:33.525276 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.525250    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.527805 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.527787    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 26 15:51:33.527805 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.527795    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 26 15:51:33.527961 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.527809    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qqbbn\""
Jul 26 15:51:33.528063 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.528046    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 26 15:51:33.590070 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.590044    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6xk9\" (UniqueName: \"kubernetes.io/projected/2e6da54f-9956-44d1-aaf9-17d2b3862808-kube-api-access-x6xk9\") pod \"openshift-state-metrics-b8f49f5c6-knb9r\" (UID: \"2e6da54f-9956-44d1-aaf9-17d2b3862808\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r"
Jul 26 15:51:33.590181 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.590117    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e6da54f-9956-44d1-aaf9-17d2b3862808-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-knb9r\" (UID: \"2e6da54f-9956-44d1-aaf9-17d2b3862808\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r"
Jul 26 15:51:33.590181 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.590144    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e6da54f-9956-44d1-aaf9-17d2b3862808-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-knb9r\" (UID: \"2e6da54f-9956-44d1-aaf9-17d2b3862808\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r"
Jul 26 15:51:33.590181 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.590170    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e6da54f-9956-44d1-aaf9-17d2b3862808-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-knb9r\" (UID: \"2e6da54f-9956-44d1-aaf9-17d2b3862808\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r"
Jul 26 15:51:33.690763 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.690732    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e6da54f-9956-44d1-aaf9-17d2b3862808-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-knb9r\" (UID: \"2e6da54f-9956-44d1-aaf9-17d2b3862808\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r"
Jul 26 15:51:33.690938 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.690784    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e6da54f-9956-44d1-aaf9-17d2b3862808-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-knb9r\" (UID: \"2e6da54f-9956-44d1-aaf9-17d2b3862808\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r"
Jul 26 15:51:33.690938 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.690844    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd481fc9-48ca-4d26-8c45-7b13791b10c5-node-exporter-wtmp\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.690938 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.690880    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd481fc9-48ca-4d26-8c45-7b13791b10c5-sys\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.690938 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.690917    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd481fc9-48ca-4d26-8c45-7b13791b10c5-metrics-client-ca\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.691524 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.690988    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e6da54f-9956-44d1-aaf9-17d2b3862808-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-knb9r\" (UID: \"2e6da54f-9956-44d1-aaf9-17d2b3862808\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r"
Jul 26 15:51:33.691524 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.691066    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flgnf\" (UniqueName: \"kubernetes.io/projected/fd481fc9-48ca-4d26-8c45-7b13791b10c5-kube-api-access-flgnf\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.691524 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.691097    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd481fc9-48ca-4d26-8c45-7b13791b10c5-root\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.691524 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.691145    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6xk9\" (UniqueName: \"kubernetes.io/projected/2e6da54f-9956-44d1-aaf9-17d2b3862808-kube-api-access-x6xk9\") pod \"openshift-state-metrics-b8f49f5c6-knb9r\" (UID: \"2e6da54f-9956-44d1-aaf9-17d2b3862808\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r"
Jul 26 15:51:33.691524 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.691188    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd481fc9-48ca-4d26-8c45-7b13791b10c5-node-exporter-textfile\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.691524 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.691225    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd481fc9-48ca-4d26-8c45-7b13791b10c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.691949 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.691924    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd481fc9-48ca-4d26-8c45-7b13791b10c5-node-exporter-tls\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.692019 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.691965    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd481fc9-48ca-4d26-8c45-7b13791b10c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.692183 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.692153    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e6da54f-9956-44d1-aaf9-17d2b3862808-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-knb9r\" (UID: \"2e6da54f-9956-44d1-aaf9-17d2b3862808\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r"
Jul 26 15:51:33.694526 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.694501    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e6da54f-9956-44d1-aaf9-17d2b3862808-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-knb9r\" (UID: \"2e6da54f-9956-44d1-aaf9-17d2b3862808\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r"
Jul 26 15:51:33.694909 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.694891    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e6da54f-9956-44d1-aaf9-17d2b3862808-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-knb9r\" (UID: \"2e6da54f-9956-44d1-aaf9-17d2b3862808\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r"
Jul 26 15:51:33.699362 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.699340    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6xk9\" (UniqueName: \"kubernetes.io/projected/2e6da54f-9956-44d1-aaf9-17d2b3862808-kube-api-access-x6xk9\") pod \"openshift-state-metrics-b8f49f5c6-knb9r\" (UID: \"2e6da54f-9956-44d1-aaf9-17d2b3862808\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r"
Jul 26 15:51:33.785382 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.785307    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r"
Jul 26 15:51:33.792699 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.792656    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd481fc9-48ca-4d26-8c45-7b13791b10c5-node-exporter-tls\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.792808 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.792713    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd481fc9-48ca-4d26-8c45-7b13791b10c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.792808 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.792764    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd481fc9-48ca-4d26-8c45-7b13791b10c5-node-exporter-wtmp\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.792808 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.792786    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd481fc9-48ca-4d26-8c45-7b13791b10c5-sys\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.792962 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.792811    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd481fc9-48ca-4d26-8c45-7b13791b10c5-metrics-client-ca\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.792962 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.792845    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flgnf\" (UniqueName: \"kubernetes.io/projected/fd481fc9-48ca-4d26-8c45-7b13791b10c5-kube-api-access-flgnf\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.792962 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.792868    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd481fc9-48ca-4d26-8c45-7b13791b10c5-root\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.792962 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.792875    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd481fc9-48ca-4d26-8c45-7b13791b10c5-sys\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.792962 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.792936    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd481fc9-48ca-4d26-8c45-7b13791b10c5-root\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.792962 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.792935    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd481fc9-48ca-4d26-8c45-7b13791b10c5-node-exporter-wtmp\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.793275 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.792962    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd481fc9-48ca-4d26-8c45-7b13791b10c5-node-exporter-textfile\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.793275 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.793010    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd481fc9-48ca-4d26-8c45-7b13791b10c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.793390 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.793309    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd481fc9-48ca-4d26-8c45-7b13791b10c5-node-exporter-textfile\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.793441 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.793417    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd481fc9-48ca-4d26-8c45-7b13791b10c5-node-exporter-accelerators-collector-config\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.793815 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.793788    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd481fc9-48ca-4d26-8c45-7b13791b10c5-metrics-client-ca\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.795244 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.795221    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd481fc9-48ca-4d26-8c45-7b13791b10c5-node-exporter-tls\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.795336 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.795273    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd481fc9-48ca-4d26-8c45-7b13791b10c5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.804342 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.804317    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flgnf\" (UniqueName: \"kubernetes.io/projected/fd481fc9-48ca-4d26-8c45-7b13791b10c5-kube-api-access-flgnf\") pod \"node-exporter-wgbxw\" (UID: \"fd481fc9-48ca-4d26-8c45-7b13791b10c5\") " pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:33.835916 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:33.835889    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wgbxw"
Jul 26 15:51:35.378626 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:51:35.378578    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd481fc9_48ca_4d26_8c45_7b13791b10c5.slice/crio-bde0a2bcbab973add958cb38c35ff192ceec26ae9c12c97d86286532b9ee291b WatchSource:0}: Error finding container bde0a2bcbab973add958cb38c35ff192ceec26ae9c12c97d86286532b9ee291b: Status 404 returned error can't find the container with id bde0a2bcbab973add958cb38c35ff192ceec26ae9c12c97d86286532b9ee291b
Jul 26 15:51:35.498337 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:35.498312    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r"]
Jul 26 15:51:35.500567 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:51:35.500545    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e6da54f_9956_44d1_aaf9_17d2b3862808.slice/crio-9b4a62d29f8b1c4e6f2bd6dc70f919c85b826445cb69a7bfe45bd4e96c6e593f WatchSource:0}: Error finding container 9b4a62d29f8b1c4e6f2bd6dc70f919c85b826445cb69a7bfe45bd4e96c6e593f: Status 404 returned error can't find the container with id 9b4a62d29f8b1c4e6f2bd6dc70f919c85b826445cb69a7bfe45bd4e96c6e593f
Jul 26 15:51:35.834008 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:35.833969    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wgbxw" event={"ID":"fd481fc9-48ca-4d26-8c45-7b13791b10c5","Type":"ContainerStarted","Data":"bde0a2bcbab973add958cb38c35ff192ceec26ae9c12c97d86286532b9ee291b"}
Jul 26 15:51:35.836108 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:35.836082    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r" event={"ID":"2e6da54f-9956-44d1-aaf9-17d2b3862808","Type":"ContainerStarted","Data":"939c382ec8b4ab5e9f20772403a64a6079e9e391c701b23e3a071ecf995a63fc"}
Jul 26 15:51:35.836241 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:35.836137    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r" event={"ID":"2e6da54f-9956-44d1-aaf9-17d2b3862808","Type":"ContainerStarted","Data":"b6514dc19bfc17151e7424e177e527b529f24b112ba6101923b99cfd3cbe370f"}
Jul 26 15:51:35.836241 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:35.836162    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r" event={"ID":"2e6da54f-9956-44d1-aaf9-17d2b3862808","Type":"ContainerStarted","Data":"9b4a62d29f8b1c4e6f2bd6dc70f919c85b826445cb69a7bfe45bd4e96c6e593f"}
Jul 26 15:51:35.837763 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:35.837727    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xrhpg" event={"ID":"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd","Type":"ContainerStarted","Data":"32283ed0875709e99fa6f24343a03de2fc592145fb6db243ef24224d4e1fc3ee"}
Jul 26 15:51:37.767549 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:37.767511    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5df65dc5f6-2b48q"]
Jul 26 15:51:37.780139 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:37.780110    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5df65dc5f6-2b48q"]
Jul 26 15:51:37.780288 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:37.780173    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:37.782738 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:37.782703    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 26 15:51:37.782952 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:37.782934    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-cdwn7\""
Jul 26 15:51:37.783720 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:37.783696    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 26 15:51:37.783831 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:37.783796    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-515u3ou92ilg2\""
Jul 26 15:51:37.783901 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:37.783888    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 26 15:51:37.783964 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:37.783904    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 26 15:51:37.849626 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:37.849597    2556 generic.go:356] "Generic (PLEG): container finished" podID="fd481fc9-48ca-4d26-8c45-7b13791b10c5" containerID="712386bc523a9db8b7e609abc4b2a83c1dbe1629cff1faa8aa2c62a740965ee5" exitCode=0
Jul 26 15:51:37.849779 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:37.849671    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wgbxw" event={"ID":"fd481fc9-48ca-4d26-8c45-7b13791b10c5","Type":"ContainerDied","Data":"712386bc523a9db8b7e609abc4b2a83c1dbe1629cff1faa8aa2c62a740965ee5"}
Jul 26 15:51:37.852370 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:37.852342    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r" event={"ID":"2e6da54f-9956-44d1-aaf9-17d2b3862808","Type":"ContainerStarted","Data":"2a48a1dfd3e5a2b21c27b22208311b583b98e2ec081471669f4846807d1667b9"}
Jul 26 15:51:37.884002 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:37.883956    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-knb9r" podStartSLOduration=3.7232894119999997 podStartE2EDuration="4.883940962s" totalImagesPullingTime="1.16065155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:51:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:37.882984605 +0000 UTC m=+94.101611655" watchObservedRunningTime="2026-07-26 15:51:37.883940962 +0000 UTC m=+94.102568014"
Jul 26 15:51:37.927358 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:37.927332    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/70ad4440-0d0f-4f94-beef-b9228ec387b1-audit-log\") pod \"metrics-server-5df65dc5f6-2b48q\" (UID: \"70ad4440-0d0f-4f94-beef-b9228ec387b1\") " pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:37.927473 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:37.927375    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70ad4440-0d0f-4f94-beef-b9228ec387b1-client-ca-bundle\") pod \"metrics-server-5df65dc5f6-2b48q\" (UID: \"70ad4440-0d0f-4f94-beef-b9228ec387b1\") " pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:37.927473 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:37.927401    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/70ad4440-0d0f-4f94-beef-b9228ec387b1-metrics-server-audit-profiles\") pod \"metrics-server-5df65dc5f6-2b48q\" (UID: \"70ad4440-0d0f-4f94-beef-b9228ec387b1\") " pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:37.927602 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:37.927497    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/70ad4440-0d0f-4f94-beef-b9228ec387b1-secret-metrics-server-tls\") pod \"metrics-server-5df65dc5f6-2b48q\" (UID: \"70ad4440-0d0f-4f94-beef-b9228ec387b1\") " pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:37.927602 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:37.927538    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/70ad4440-0d0f-4f94-beef-b9228ec387b1-secret-metrics-server-client-certs\") pod \"metrics-server-5df65dc5f6-2b48q\" (UID: \"70ad4440-0d0f-4f94-beef-b9228ec387b1\") " pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:37.927602 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:37.927566    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70ad4440-0d0f-4f94-beef-b9228ec387b1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5df65dc5f6-2b48q\" (UID: \"70ad4440-0d0f-4f94-beef-b9228ec387b1\") " pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:37.927758 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:37.927623    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gddmh\" (UniqueName: \"kubernetes.io/projected/70ad4440-0d0f-4f94-beef-b9228ec387b1-kube-api-access-gddmh\") pod \"metrics-server-5df65dc5f6-2b48q\" (UID: \"70ad4440-0d0f-4f94-beef-b9228ec387b1\") " pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:38.028980 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.028908    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gddmh\" (UniqueName: \"kubernetes.io/projected/70ad4440-0d0f-4f94-beef-b9228ec387b1-kube-api-access-gddmh\") pod \"metrics-server-5df65dc5f6-2b48q\" (UID: \"70ad4440-0d0f-4f94-beef-b9228ec387b1\") " pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:38.029127 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.029087    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/70ad4440-0d0f-4f94-beef-b9228ec387b1-audit-log\") pod \"metrics-server-5df65dc5f6-2b48q\" (UID: \"70ad4440-0d0f-4f94-beef-b9228ec387b1\") " pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:38.029197 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.029178    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70ad4440-0d0f-4f94-beef-b9228ec387b1-client-ca-bundle\") pod \"metrics-server-5df65dc5f6-2b48q\" (UID: \"70ad4440-0d0f-4f94-beef-b9228ec387b1\") " pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:38.029264 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.029216    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/70ad4440-0d0f-4f94-beef-b9228ec387b1-metrics-server-audit-profiles\") pod \"metrics-server-5df65dc5f6-2b48q\" (UID: \"70ad4440-0d0f-4f94-beef-b9228ec387b1\") " pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:38.029329 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.029278    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/70ad4440-0d0f-4f94-beef-b9228ec387b1-secret-metrics-server-tls\") pod \"metrics-server-5df65dc5f6-2b48q\" (UID: \"70ad4440-0d0f-4f94-beef-b9228ec387b1\") " pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:38.029329 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.029311    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/70ad4440-0d0f-4f94-beef-b9228ec387b1-secret-metrics-server-client-certs\") pod \"metrics-server-5df65dc5f6-2b48q\" (UID: \"70ad4440-0d0f-4f94-beef-b9228ec387b1\") " pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:38.029436 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.029328    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70ad4440-0d0f-4f94-beef-b9228ec387b1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5df65dc5f6-2b48q\" (UID: \"70ad4440-0d0f-4f94-beef-b9228ec387b1\") " pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:38.029670 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.029603    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/70ad4440-0d0f-4f94-beef-b9228ec387b1-audit-log\") pod \"metrics-server-5df65dc5f6-2b48q\" (UID: \"70ad4440-0d0f-4f94-beef-b9228ec387b1\") " pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:38.030364 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.030340    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70ad4440-0d0f-4f94-beef-b9228ec387b1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5df65dc5f6-2b48q\" (UID: \"70ad4440-0d0f-4f94-beef-b9228ec387b1\") " pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:38.030499 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.030476    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/70ad4440-0d0f-4f94-beef-b9228ec387b1-metrics-server-audit-profiles\") pod \"metrics-server-5df65dc5f6-2b48q\" (UID: \"70ad4440-0d0f-4f94-beef-b9228ec387b1\") " pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:38.032268 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.032243    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/70ad4440-0d0f-4f94-beef-b9228ec387b1-secret-metrics-server-tls\") pod \"metrics-server-5df65dc5f6-2b48q\" (UID: \"70ad4440-0d0f-4f94-beef-b9228ec387b1\") " pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:38.032368 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.032246    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70ad4440-0d0f-4f94-beef-b9228ec387b1-client-ca-bundle\") pod \"metrics-server-5df65dc5f6-2b48q\" (UID: \"70ad4440-0d0f-4f94-beef-b9228ec387b1\") " pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:38.032429 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.032407    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/70ad4440-0d0f-4f94-beef-b9228ec387b1-secret-metrics-server-client-certs\") pod \"metrics-server-5df65dc5f6-2b48q\" (UID: \"70ad4440-0d0f-4f94-beef-b9228ec387b1\") " pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:38.036849 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.036828    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gddmh\" (UniqueName: \"kubernetes.io/projected/70ad4440-0d0f-4f94-beef-b9228ec387b1-kube-api-access-gddmh\") pod \"metrics-server-5df65dc5f6-2b48q\" (UID: \"70ad4440-0d0f-4f94-beef-b9228ec387b1\") " pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:38.092402 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.092378    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:38.240679 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.240647    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-687dc9fbb4-n42kr"]
Jul 26 15:51:38.248952 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.248926    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.257648 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.257332    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-687dc9fbb4-n42kr"]
Jul 26 15:51:38.432595 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.432569    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-trusted-ca-bundle\") pod \"console-687dc9fbb4-n42kr\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") " pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.432763 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.432605    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm4vb\" (UniqueName: \"kubernetes.io/projected/774d36ed-eb1a-4e3c-9470-70facf7f73b4-kube-api-access-dm4vb\") pod \"console-687dc9fbb4-n42kr\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") " pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.432763 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.432657    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-oauth-serving-cert\") pod \"console-687dc9fbb4-n42kr\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") " pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.432763 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.432745    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/774d36ed-eb1a-4e3c-9470-70facf7f73b4-console-oauth-config\") pod \"console-687dc9fbb4-n42kr\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") " pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.432880 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.432781    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-service-ca\") pod \"console-687dc9fbb4-n42kr\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") " pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.432880 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.432800    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/774d36ed-eb1a-4e3c-9470-70facf7f73b4-console-serving-cert\") pod \"console-687dc9fbb4-n42kr\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") " pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.432880 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.432831    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-console-config\") pod \"console-687dc9fbb4-n42kr\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") " pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.534193 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.534163    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/774d36ed-eb1a-4e3c-9470-70facf7f73b4-console-oauth-config\") pod \"console-687dc9fbb4-n42kr\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") " pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.534362 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.534203    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-service-ca\") pod \"console-687dc9fbb4-n42kr\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") " pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.534362 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.534221    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/774d36ed-eb1a-4e3c-9470-70facf7f73b4-console-serving-cert\") pod \"console-687dc9fbb4-n42kr\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") " pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.534476 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.534356    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-console-config\") pod \"console-687dc9fbb4-n42kr\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") " pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.534476 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.534407    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-trusted-ca-bundle\") pod \"console-687dc9fbb4-n42kr\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") " pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.534476 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.534446    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm4vb\" (UniqueName: \"kubernetes.io/projected/774d36ed-eb1a-4e3c-9470-70facf7f73b4-kube-api-access-dm4vb\") pod \"console-687dc9fbb4-n42kr\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") " pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.534627 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.534603    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-oauth-serving-cert\") pod \"console-687dc9fbb4-n42kr\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") " pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.534971 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.534942    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-service-ca\") pod \"console-687dc9fbb4-n42kr\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") " pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.535113 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.535073    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-console-config\") pod \"console-687dc9fbb4-n42kr\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") " pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.535460 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.535437    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-trusted-ca-bundle\") pod \"console-687dc9fbb4-n42kr\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") " pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.535519 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.535490    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-oauth-serving-cert\") pod \"console-687dc9fbb4-n42kr\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") " pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.537134 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.537116    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/774d36ed-eb1a-4e3c-9470-70facf7f73b4-console-serving-cert\") pod \"console-687dc9fbb4-n42kr\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") " pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.537350 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.537330    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/774d36ed-eb1a-4e3c-9470-70facf7f73b4-console-oauth-config\") pod \"console-687dc9fbb4-n42kr\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") " pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.541725 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.541702    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm4vb\" (UniqueName: \"kubernetes.io/projected/774d36ed-eb1a-4e3c-9470-70facf7f73b4-kube-api-access-dm4vb\") pod \"console-687dc9fbb4-n42kr\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") " pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:38.560728 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:38.560708    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:39.221886 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:39.221575    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5df65dc5f6-2b48q"]
Jul 26 15:51:39.224077 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:51:39.224045    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70ad4440_0d0f_4f94_beef_b9228ec387b1.slice/crio-8dab63f8d40ae03618bad6dba993f0023d87a4aabd99636ee1a38e2389c54649 WatchSource:0}: Error finding container 8dab63f8d40ae03618bad6dba993f0023d87a4aabd99636ee1a38e2389c54649: Status 404 returned error can't find the container with id 8dab63f8d40ae03618bad6dba993f0023d87a4aabd99636ee1a38e2389c54649
Jul 26 15:51:39.241261 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:39.241235    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-687dc9fbb4-n42kr"]
Jul 26 15:51:39.244080 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:51:39.244059    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod774d36ed_eb1a_4e3c_9470_70facf7f73b4.slice/crio-8c0a931a30d3fc11abc19a0321ae8119b38a0526666ea08769fa022bc132695e WatchSource:0}: Error finding container 8c0a931a30d3fc11abc19a0321ae8119b38a0526666ea08769fa022bc132695e: Status 404 returned error can't find the container with id 8c0a931a30d3fc11abc19a0321ae8119b38a0526666ea08769fa022bc132695e
Jul 26 15:51:39.864806 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:39.864764    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q" event={"ID":"70ad4440-0d0f-4f94-beef-b9228ec387b1","Type":"ContainerStarted","Data":"8dab63f8d40ae03618bad6dba993f0023d87a4aabd99636ee1a38e2389c54649"}
Jul 26 15:51:39.868436 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:39.868326    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wgbxw" event={"ID":"fd481fc9-48ca-4d26-8c45-7b13791b10c5","Type":"ContainerStarted","Data":"cefce56f1e1bfd8644f7cdfda21218c8bbaa87481eb7ec8400acb02fd0eb7231"}
Jul 26 15:51:39.868436 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:39.868387    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wgbxw" event={"ID":"fd481fc9-48ca-4d26-8c45-7b13791b10c5","Type":"ContainerStarted","Data":"5059c61e420a23bb0f1c2de7f3c44880021de7d8a57eb6450b375d0d18c54982"}
Jul 26 15:51:39.870951 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:39.870918    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xrhpg" event={"ID":"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd","Type":"ContainerStarted","Data":"815b19ac81d488fb1644ba5199984efeb2fa6e206d08340cc5b8ab9e64898a46"}
Jul 26 15:51:39.872850 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:39.872819    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687dc9fbb4-n42kr" event={"ID":"774d36ed-eb1a-4e3c-9470-70facf7f73b4","Type":"ContainerStarted","Data":"b1568c37f3ef281e14f8fae162b8531fbb6e168d57d6c09ea9b57930733e5238"}
Jul 26 15:51:39.872937 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:39.872868    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687dc9fbb4-n42kr" event={"ID":"774d36ed-eb1a-4e3c-9470-70facf7f73b4","Type":"ContainerStarted","Data":"8c0a931a30d3fc11abc19a0321ae8119b38a0526666ea08769fa022bc132695e"}
Jul 26 15:51:39.902065 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:39.902014    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wgbxw" podStartSLOduration=5.434430785 podStartE2EDuration="6.901996604s" totalImagesPullingTime="1.395895146s" totalInitContainerRuntime="71.670673ms" isStatefulPod=true podCreationTimestamp="2026-07-26 15:51:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:39.900836661 +0000 UTC m=+96.119463722" watchObservedRunningTime="2026-07-26 15:51:39.901996604 +0000 UTC m=+96.120623660"
Jul 26 15:51:39.917013 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:39.916950    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-687dc9fbb4-n42kr" podStartSLOduration=1.916938767 podStartE2EDuration="1.916938767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:51:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:39.916832023 +0000 UTC m=+96.135459097" watchObservedRunningTime="2026-07-26 15:51:39.916938767 +0000 UTC m=+96.135565816"
Jul 26 15:51:40.707490 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:40.707465    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-psdlz"
Jul 26 15:51:40.880142 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:40.880104    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q" event={"ID":"70ad4440-0d0f-4f94-beef-b9228ec387b1","Type":"ContainerStarted","Data":"b1bb318ba81684f8c17cc8d0cdcfdec5dfcf655cecbffbbc1f7775e205d3b6bb"}
Jul 26 15:51:40.897593 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:40.897542    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q" podStartSLOduration=2.421151144 podStartE2EDuration="3.89752763s" totalImagesPullingTime="1.476376486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:40.896320619 +0000 UTC m=+97.114947690" watchObservedRunningTime="2026-07-26 15:51:40.89752763 +0000 UTC m=+97.116154679"
Jul 26 15:51:42.889482 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:42.889452    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xrhpg" event={"ID":"2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd","Type":"ContainerStarted","Data":"78fe947d5f26cbab3cdc2ae82c145d9633e71c1fdd857e0213d7194870be0023"}
Jul 26 15:51:42.915785 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:42.915746    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xrhpg" podStartSLOduration=16.822220301 podStartE2EDuration="28.915730636s" totalImagesPullingTime="12.093510335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:51:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:42.91544135 +0000 UTC m=+99.134068399" watchObservedRunningTime="2026-07-26 15:51:42.915730636 +0000 UTC m=+99.134357684"
Jul 26 15:51:48.561214 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:48.561178    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:48.561786 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:48.561243    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:48.566171 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:48.566145    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:48.916849 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:48.916819    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:51:48.963157 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:48.963130    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fb65bc75f-p6l24"]
Jul 26 15:51:50.159569 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.159536    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-854c56cc76-wzsh6"]
Jul 26 15:51:50.225509 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.225481    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.230341 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.230318    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-854c56cc76-wzsh6"]
Jul 26 15:51:50.323545 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.323521    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-console-oauth-config\") pod \"console-854c56cc76-wzsh6\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") " pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.323697 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.323553    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-console-serving-cert\") pod \"console-854c56cc76-wzsh6\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") " pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.323697 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.323574    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-trusted-ca-bundle\") pod \"console-854c56cc76-wzsh6\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") " pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.323697 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.323604    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-console-config\") pod \"console-854c56cc76-wzsh6\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") " pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.323877 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.323707    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-oauth-serving-cert\") pod \"console-854c56cc76-wzsh6\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") " pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.323877 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.323766    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-service-ca\") pod \"console-854c56cc76-wzsh6\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") " pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.323877 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.323805    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwkd2\" (UniqueName: \"kubernetes.io/projected/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-kube-api-access-pwkd2\") pod \"console-854c56cc76-wzsh6\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") " pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.424780 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.424755    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwkd2\" (UniqueName: \"kubernetes.io/projected/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-kube-api-access-pwkd2\") pod \"console-854c56cc76-wzsh6\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") " pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.424926 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.424798    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-console-oauth-config\") pod \"console-854c56cc76-wzsh6\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") " pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.424926 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.424827    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-console-serving-cert\") pod \"console-854c56cc76-wzsh6\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") " pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.424926 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.424860    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-trusted-ca-bundle\") pod \"console-854c56cc76-wzsh6\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") " pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.424926 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.424892    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-console-config\") pod \"console-854c56cc76-wzsh6\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") " pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.425150 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.424927    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-oauth-serving-cert\") pod \"console-854c56cc76-wzsh6\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") " pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.425150 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.424968    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-service-ca\") pod \"console-854c56cc76-wzsh6\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") " pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.425734 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.425707    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-service-ca\") pod \"console-854c56cc76-wzsh6\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") " pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.425952 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.425914    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-trusted-ca-bundle\") pod \"console-854c56cc76-wzsh6\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") " pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.426075 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.426053    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-oauth-serving-cert\") pod \"console-854c56cc76-wzsh6\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") " pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.426172 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.426150    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-console-config\") pod \"console-854c56cc76-wzsh6\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") " pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.427476 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.427456    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-console-oauth-config\") pod \"console-854c56cc76-wzsh6\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") " pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.427551 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.427484    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-console-serving-cert\") pod \"console-854c56cc76-wzsh6\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") " pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.432072 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.432055    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwkd2\" (UniqueName: \"kubernetes.io/projected/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-kube-api-access-pwkd2\") pod \"console-854c56cc76-wzsh6\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") " pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.534327 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.534305    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:51:50.695563 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.695546    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-854c56cc76-wzsh6"]
Jul 26 15:51:50.697852 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:51:50.697825    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod396ddbe0_6cb3_413f_a4a1_53d2f843bc74.slice/crio-ac65ac0135bb2c4193953f7819fea4ca03a695b7d75d9f38801f545b57ed0212 WatchSource:0}: Error finding container ac65ac0135bb2c4193953f7819fea4ca03a695b7d75d9f38801f545b57ed0212: Status 404 returned error can't find the container with id ac65ac0135bb2c4193953f7819fea4ca03a695b7d75d9f38801f545b57ed0212
Jul 26 15:51:50.922043 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.922006    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-854c56cc76-wzsh6" event={"ID":"396ddbe0-6cb3-413f-a4a1-53d2f843bc74","Type":"ContainerStarted","Data":"35b443f492469752652d12b24ce012f6a5cbce856064b4491dfb0cba33ca42a7"}
Jul 26 15:51:50.922193 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.922070    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-854c56cc76-wzsh6" event={"ID":"396ddbe0-6cb3-413f-a4a1-53d2f843bc74","Type":"ContainerStarted","Data":"ac65ac0135bb2c4193953f7819fea4ca03a695b7d75d9f38801f545b57ed0212"}
Jul 26 15:51:50.938111 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:50.938022    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-854c56cc76-wzsh6" podStartSLOduration=0.938005481 podStartE2EDuration="938.005481ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:51:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:50.937717268 +0000 UTC m=+107.156344345" watchObservedRunningTime="2026-07-26 15:51:50.938005481 +0000 UTC m=+107.156632530"
Jul 26 15:51:55.888253 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:55.888212    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7df9d96595-mhclr" podUID="f4fe2369-8cf2-40ef-903f-40a375cdb5d9" containerName="registry" containerID="cri-o://119984c17d8dc98f4a48c6a6bafef7038ff367dc9ab577474345eb4b7ed2216a" gracePeriod=30
Jul 26 15:51:56.135939 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.135917    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:51:56.168975 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.168952    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-bound-sa-token\") pod \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") "
Jul 26 15:51:56.169105 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.168995    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-trusted-ca\") pod \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") "
Jul 26 15:51:56.169105 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.169028    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-image-registry-private-configuration\") pod \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") "
Jul 26 15:51:56.169105 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.169069    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-certificates\") pod \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") "
Jul 26 15:51:56.169105 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.169085    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls\") pod \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") "
Jul 26 15:51:56.169305 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.169109    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7s99d\" (UniqueName: \"kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-kube-api-access-7s99d\") pod \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") "
Jul 26 15:51:56.169305 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.169167    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-ca-trust-extracted\") pod \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") "
Jul 26 15:51:56.169305 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.169229    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-installation-pull-secrets\") pod \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\" (UID: \"f4fe2369-8cf2-40ef-903f-40a375cdb5d9\") "
Jul 26 15:51:56.171214 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.169498    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f4fe2369-8cf2-40ef-903f-40a375cdb5d9" (UID: "f4fe2369-8cf2-40ef-903f-40a375cdb5d9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:51:56.171214 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.170000    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f4fe2369-8cf2-40ef-903f-40a375cdb5d9" (UID: "f4fe2369-8cf2-40ef-903f-40a375cdb5d9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:51:56.171574 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.171548    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f4fe2369-8cf2-40ef-903f-40a375cdb5d9" (UID: "f4fe2369-8cf2-40ef-903f-40a375cdb5d9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:51:56.171727 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.171687    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f4fe2369-8cf2-40ef-903f-40a375cdb5d9" (UID: "f4fe2369-8cf2-40ef-903f-40a375cdb5d9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:51:56.171888 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.171866    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-kube-api-access-7s99d" (OuterVolumeSpecName: "kube-api-access-7s99d") pod "f4fe2369-8cf2-40ef-903f-40a375cdb5d9" (UID: "f4fe2369-8cf2-40ef-903f-40a375cdb5d9"). InnerVolumeSpecName "kube-api-access-7s99d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:51:56.171954 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.171910    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f4fe2369-8cf2-40ef-903f-40a375cdb5d9" (UID: "f4fe2369-8cf2-40ef-903f-40a375cdb5d9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:51:56.172010 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.171990    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f4fe2369-8cf2-40ef-903f-40a375cdb5d9" (UID: "f4fe2369-8cf2-40ef-903f-40a375cdb5d9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:51:56.178234 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.178212    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f4fe2369-8cf2-40ef-903f-40a375cdb5d9" (UID: "f4fe2369-8cf2-40ef-903f-40a375cdb5d9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:51:56.270125 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.270099    2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-bound-sa-token\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:51:56.270125 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.270120    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-trusted-ca\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:51:56.270252 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.270148    2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-image-registry-private-configuration\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:51:56.270252 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.270158    2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-certificates\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:51:56.270252 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.270167    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-registry-tls\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:51:56.270252 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.270175    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7s99d\" (UniqueName: \"kubernetes.io/projected/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-kube-api-access-7s99d\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:51:56.270252 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.270182    2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-ca-trust-extracted\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:51:56.270252 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.270190    2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f4fe2369-8cf2-40ef-903f-40a375cdb5d9-installation-pull-secrets\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:51:56.950444 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.950411    2556 generic.go:356] "Generic (PLEG): container finished" podID="8f82c6eb-6828-438d-88d9-2104fea4f62f" containerID="923b3acd05dfa7feae80b71b9f9e113674823e522a8c3c2460e9da809a7b2670" exitCode=0
Jul 26 15:51:56.950785 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.950489    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l" event={"ID":"8f82c6eb-6828-438d-88d9-2104fea4f62f","Type":"ContainerDied","Data":"923b3acd05dfa7feae80b71b9f9e113674823e522a8c3c2460e9da809a7b2670"}
Jul 26 15:51:56.950888 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.950868    2556 scope.go:117] "RemoveContainer" containerID="923b3acd05dfa7feae80b71b9f9e113674823e522a8c3c2460e9da809a7b2670"
Jul 26 15:51:56.951984 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.951955    2556 generic.go:356] "Generic (PLEG): container finished" podID="f4fe2369-8cf2-40ef-903f-40a375cdb5d9" containerID="119984c17d8dc98f4a48c6a6bafef7038ff367dc9ab577474345eb4b7ed2216a" exitCode=0
Jul 26 15:51:56.952080 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.952011    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df9d96595-mhclr" event={"ID":"f4fe2369-8cf2-40ef-903f-40a375cdb5d9","Type":"ContainerDied","Data":"119984c17d8dc98f4a48c6a6bafef7038ff367dc9ab577474345eb4b7ed2216a"}
Jul 26 15:51:56.952080 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.952015    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df9d96595-mhclr"
Jul 26 15:51:56.952080 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.952053    2556 scope.go:117] "RemoveContainer" containerID="119984c17d8dc98f4a48c6a6bafef7038ff367dc9ab577474345eb4b7ed2216a"
Jul 26 15:51:56.952240 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.952044    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df9d96595-mhclr" event={"ID":"f4fe2369-8cf2-40ef-903f-40a375cdb5d9","Type":"ContainerDied","Data":"300886a5b0ecd52927e7d2497979a0358df175ba883b6677302380fa9ea86119"}
Jul 26 15:51:56.960829 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.960812    2556 scope.go:117] "RemoveContainer" containerID="119984c17d8dc98f4a48c6a6bafef7038ff367dc9ab577474345eb4b7ed2216a"
Jul 26 15:51:56.961091 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:51:56.961070    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"119984c17d8dc98f4a48c6a6bafef7038ff367dc9ab577474345eb4b7ed2216a\": container with ID starting with 119984c17d8dc98f4a48c6a6bafef7038ff367dc9ab577474345eb4b7ed2216a not found: ID does not exist" containerID="119984c17d8dc98f4a48c6a6bafef7038ff367dc9ab577474345eb4b7ed2216a"
Jul 26 15:51:56.961150 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.961099    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"119984c17d8dc98f4a48c6a6bafef7038ff367dc9ab577474345eb4b7ed2216a"} err="failed to get container status \"119984c17d8dc98f4a48c6a6bafef7038ff367dc9ab577474345eb4b7ed2216a\": rpc error: code = NotFound desc = could not find container \"119984c17d8dc98f4a48c6a6bafef7038ff367dc9ab577474345eb4b7ed2216a\": container with ID starting with 119984c17d8dc98f4a48c6a6bafef7038ff367dc9ab577474345eb4b7ed2216a not found: ID does not exist"
Jul 26 15:51:56.981470 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.981448    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7df9d96595-mhclr"]
Jul 26 15:51:56.987087 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:56.987060    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7df9d96595-mhclr"]
Jul 26 15:51:57.958380 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:57.958346    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l" event={"ID":"8f82c6eb-6828-438d-88d9-2104fea4f62f","Type":"ContainerStarted","Data":"92691d6a022075be661a14d8acb1f18018f91ac4a57723f0f75dda01a7e8322c"}
Jul 26 15:51:58.093413 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:58.093370    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:58.093556 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:58.093439    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:51:58.214387 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:51:58.214319    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4fe2369-8cf2-40ef-903f-40a375cdb5d9" path="/var/lib/kubelet/pods/f4fe2369-8cf2-40ef-903f-40a375cdb5d9/volumes"
Jul 26 15:52:00.534703 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:00.534673    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:52:00.535076 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:00.534728    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:52:00.539375 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:00.539355    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:52:00.973981 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:00.973948    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:52:01.018431 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:01.018406    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-687dc9fbb4-n42kr"]
Jul 26 15:52:12.013056 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:12.012998    2556 generic.go:356] "Generic (PLEG): container finished" podID="e5de42ff-14ad-4780-aee7-80f431e2a706" containerID="4eba2ebe4044853abef87efc57a37fa39f75dcd68705b0887ef022146a201cb7" exitCode=0
Jul 26 15:52:12.013380 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:12.013065    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-72d9v" event={"ID":"e5de42ff-14ad-4780-aee7-80f431e2a706","Type":"ContainerDied","Data":"4eba2ebe4044853abef87efc57a37fa39f75dcd68705b0887ef022146a201cb7"}
Jul 26 15:52:12.013380 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:12.013335    2556 scope.go:117] "RemoveContainer" containerID="4eba2ebe4044853abef87efc57a37fa39f75dcd68705b0887ef022146a201cb7"
Jul 26 15:52:13.019985 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:13.019946    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-72d9v" event={"ID":"e5de42ff-14ad-4780-aee7-80f431e2a706","Type":"ContainerStarted","Data":"707b48fe85537e6f60f04b1dc902a5da6dea4204891823e73642c92222b518ac"}
Jul 26 15:52:13.982398 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:13.982335    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fb65bc75f-p6l24" podUID="4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b" containerName="console" containerID="cri-o://aac238eeb5207249d1e927afb3e45d2f315b80db261a1eb0303751f967bd9a58" gracePeriod=15
Jul 26 15:52:14.257736 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.257683    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:52:14.300518 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.300494    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-oauth-serving-cert\") pod \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") "
Jul 26 15:52:14.300628 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.300526    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-console-oauth-config\") pod \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") "
Jul 26 15:52:14.300628 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.300569    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-console-config\") pod \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") "
Jul 26 15:52:14.300628 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.300587    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-service-ca\") pod \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") "
Jul 26 15:52:14.300785 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.300627    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkq5b\" (UniqueName: \"kubernetes.io/projected/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-kube-api-access-qkq5b\") pod \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") "
Jul 26 15:52:14.300785 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.300674    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-console-serving-cert\") pod \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") "
Jul 26 15:52:14.300785 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.300707    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-trusted-ca-bundle\") pod \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\" (UID: \"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b\") "
Jul 26 15:52:14.301000 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.300975    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b" (UID: "4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:52:14.301233 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.301010    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-console-config" (OuterVolumeSpecName: "console-config") pod "4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b" (UID: "4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:52:14.301233 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.301019    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-service-ca" (OuterVolumeSpecName: "service-ca") pod "4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b" (UID: "4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:52:14.301379 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.301263    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b" (UID: "4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:52:14.302921 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.302898    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b" (UID: "4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:52:14.303015 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.302952    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-kube-api-access-qkq5b" (OuterVolumeSpecName: "kube-api-access-qkq5b") pod "4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b" (UID: "4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b"). InnerVolumeSpecName "kube-api-access-qkq5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:52:14.303015 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.302966    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b" (UID: "4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:52:14.401206 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.401187    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-oauth-serving-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:52:14.401206 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.401207    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-console-oauth-config\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:52:14.401313 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.401218    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-console-config\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:52:14.401313 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.401227    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-service-ca\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:52:14.401313 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.401235    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkq5b\" (UniqueName: \"kubernetes.io/projected/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-kube-api-access-qkq5b\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:52:14.401313 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.401244    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-console-serving-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:52:14.401313 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:14.401252    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b-trusted-ca-bundle\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:52:15.028905 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:15.028866    2556 generic.go:356] "Generic (PLEG): container finished" podID="4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b" containerID="aac238eeb5207249d1e927afb3e45d2f315b80db261a1eb0303751f967bd9a58" exitCode=0
Jul 26 15:52:15.029111 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:15.028916    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb65bc75f-p6l24"
Jul 26 15:52:15.029111 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:15.028921    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb65bc75f-p6l24" event={"ID":"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b","Type":"ContainerDied","Data":"aac238eeb5207249d1e927afb3e45d2f315b80db261a1eb0303751f967bd9a58"}
Jul 26 15:52:15.029111 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:15.029036    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb65bc75f-p6l24" event={"ID":"4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b","Type":"ContainerDied","Data":"d74410311308076cdc3e41c7cd459d34d62e66ce7fcb624224d21f52482b62b8"}
Jul 26 15:52:15.029111 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:15.029058    2556 scope.go:117] "RemoveContainer" containerID="aac238eeb5207249d1e927afb3e45d2f315b80db261a1eb0303751f967bd9a58"
Jul 26 15:52:15.038403 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:15.038386    2556 scope.go:117] "RemoveContainer" containerID="aac238eeb5207249d1e927afb3e45d2f315b80db261a1eb0303751f967bd9a58"
Jul 26 15:52:15.038673 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:52:15.038649    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aac238eeb5207249d1e927afb3e45d2f315b80db261a1eb0303751f967bd9a58\": container with ID starting with aac238eeb5207249d1e927afb3e45d2f315b80db261a1eb0303751f967bd9a58 not found: ID does not exist" containerID="aac238eeb5207249d1e927afb3e45d2f315b80db261a1eb0303751f967bd9a58"
Jul 26 15:52:15.038748 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:15.038680    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aac238eeb5207249d1e927afb3e45d2f315b80db261a1eb0303751f967bd9a58"} err="failed to get container status \"aac238eeb5207249d1e927afb3e45d2f315b80db261a1eb0303751f967bd9a58\": rpc error: code = NotFound desc = could not find container \"aac238eeb5207249d1e927afb3e45d2f315b80db261a1eb0303751f967bd9a58\": container with ID starting with aac238eeb5207249d1e927afb3e45d2f315b80db261a1eb0303751f967bd9a58 not found: ID does not exist"
Jul 26 15:52:15.050292 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:15.050267    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fb65bc75f-p6l24"]
Jul 26 15:52:15.053252 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:15.053232    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fb65bc75f-p6l24"]
Jul 26 15:52:16.214163 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:16.214133    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b" path="/var/lib/kubelet/pods/4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b/volumes"
Jul 26 15:52:18.098156 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:18.098129    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:52:18.103161 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:18.103135    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5df65dc5f6-2b48q"
Jul 26 15:52:26.037555 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.037488    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-687dc9fbb4-n42kr" podUID="774d36ed-eb1a-4e3c-9470-70facf7f73b4" containerName="console" containerID="cri-o://b1568c37f3ef281e14f8fae162b8531fbb6e168d57d6c09ea9b57930733e5238" gracePeriod=15
Jul 26 15:52:26.273368 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.273344    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:52:26.390716 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.390655    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-trusted-ca-bundle\") pod \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") "
Jul 26 15:52:26.390716 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.390687    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/774d36ed-eb1a-4e3c-9470-70facf7f73b4-console-serving-cert\") pod \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") "
Jul 26 15:52:26.390716 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.390712    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dm4vb\" (UniqueName: \"kubernetes.io/projected/774d36ed-eb1a-4e3c-9470-70facf7f73b4-kube-api-access-dm4vb\") pod \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") "
Jul 26 15:52:26.390933 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.390827    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/774d36ed-eb1a-4e3c-9470-70facf7f73b4-console-oauth-config\") pod \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") "
Jul 26 15:52:26.390933 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.390866    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-oauth-serving-cert\") pod \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") "
Jul 26 15:52:26.390933 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.390894    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-service-ca\") pod \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") "
Jul 26 15:52:26.390933 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.390916    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-console-config\") pod \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\" (UID: \"774d36ed-eb1a-4e3c-9470-70facf7f73b4\") "
Jul 26 15:52:26.391123 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.391064    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "774d36ed-eb1a-4e3c-9470-70facf7f73b4" (UID: "774d36ed-eb1a-4e3c-9470-70facf7f73b4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:52:26.391271 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.391250    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-trusted-ca-bundle\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:52:26.391345 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.391277    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "774d36ed-eb1a-4e3c-9470-70facf7f73b4" (UID: "774d36ed-eb1a-4e3c-9470-70facf7f73b4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:52:26.391345 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.391291    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-service-ca" (OuterVolumeSpecName: "service-ca") pod "774d36ed-eb1a-4e3c-9470-70facf7f73b4" (UID: "774d36ed-eb1a-4e3c-9470-70facf7f73b4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:52:26.391431 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.391393    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-console-config" (OuterVolumeSpecName: "console-config") pod "774d36ed-eb1a-4e3c-9470-70facf7f73b4" (UID: "774d36ed-eb1a-4e3c-9470-70facf7f73b4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:52:26.392868 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.392845    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/774d36ed-eb1a-4e3c-9470-70facf7f73b4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "774d36ed-eb1a-4e3c-9470-70facf7f73b4" (UID: "774d36ed-eb1a-4e3c-9470-70facf7f73b4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:52:26.393263 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.393240    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/774d36ed-eb1a-4e3c-9470-70facf7f73b4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "774d36ed-eb1a-4e3c-9470-70facf7f73b4" (UID: "774d36ed-eb1a-4e3c-9470-70facf7f73b4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:52:26.393323 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.393256    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/774d36ed-eb1a-4e3c-9470-70facf7f73b4-kube-api-access-dm4vb" (OuterVolumeSpecName: "kube-api-access-dm4vb") pod "774d36ed-eb1a-4e3c-9470-70facf7f73b4" (UID: "774d36ed-eb1a-4e3c-9470-70facf7f73b4"). InnerVolumeSpecName "kube-api-access-dm4vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:52:26.491946 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.491926    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-service-ca\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:52:26.491946 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.491945    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-console-config\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:52:26.492058 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.491953    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/774d36ed-eb1a-4e3c-9470-70facf7f73b4-console-serving-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:52:26.492058 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.491963    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm4vb\" (UniqueName: \"kubernetes.io/projected/774d36ed-eb1a-4e3c-9470-70facf7f73b4-kube-api-access-dm4vb\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:52:26.492058 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.491972    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/774d36ed-eb1a-4e3c-9470-70facf7f73b4-console-oauth-config\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:52:26.492058 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:26.491980    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/774d36ed-eb1a-4e3c-9470-70facf7f73b4-oauth-serving-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:52:27.078321 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:27.078286    2556 generic.go:356] "Generic (PLEG): container finished" podID="774d36ed-eb1a-4e3c-9470-70facf7f73b4" containerID="b1568c37f3ef281e14f8fae162b8531fbb6e168d57d6c09ea9b57930733e5238" exitCode=0
Jul 26 15:52:27.078767 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:27.078339    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687dc9fbb4-n42kr" event={"ID":"774d36ed-eb1a-4e3c-9470-70facf7f73b4","Type":"ContainerDied","Data":"b1568c37f3ef281e14f8fae162b8531fbb6e168d57d6c09ea9b57930733e5238"}
Jul 26 15:52:27.078767 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:27.078353    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687dc9fbb4-n42kr"
Jul 26 15:52:27.078767 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:27.078388    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687dc9fbb4-n42kr" event={"ID":"774d36ed-eb1a-4e3c-9470-70facf7f73b4","Type":"ContainerDied","Data":"8c0a931a30d3fc11abc19a0321ae8119b38a0526666ea08769fa022bc132695e"}
Jul 26 15:52:27.078767 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:27.078412    2556 scope.go:117] "RemoveContainer" containerID="b1568c37f3ef281e14f8fae162b8531fbb6e168d57d6c09ea9b57930733e5238"
Jul 26 15:52:27.087796 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:27.087776    2556 scope.go:117] "RemoveContainer" containerID="b1568c37f3ef281e14f8fae162b8531fbb6e168d57d6c09ea9b57930733e5238"
Jul 26 15:52:27.088101 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:52:27.088076    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1568c37f3ef281e14f8fae162b8531fbb6e168d57d6c09ea9b57930733e5238\": container with ID starting with b1568c37f3ef281e14f8fae162b8531fbb6e168d57d6c09ea9b57930733e5238 not found: ID does not exist" containerID="b1568c37f3ef281e14f8fae162b8531fbb6e168d57d6c09ea9b57930733e5238"
Jul 26 15:52:27.088152 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:27.088110    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1568c37f3ef281e14f8fae162b8531fbb6e168d57d6c09ea9b57930733e5238"} err="failed to get container status \"b1568c37f3ef281e14f8fae162b8531fbb6e168d57d6c09ea9b57930733e5238\": rpc error: code = NotFound desc = could not find container \"b1568c37f3ef281e14f8fae162b8531fbb6e168d57d6c09ea9b57930733e5238\": container with ID starting with b1568c37f3ef281e14f8fae162b8531fbb6e168d57d6c09ea9b57930733e5238 not found: ID does not exist"
Jul 26 15:52:27.099129 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:27.099104    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-687dc9fbb4-n42kr"]
Jul 26 15:52:27.102263 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:27.102240    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-687dc9fbb4-n42kr"]
Jul 26 15:52:28.214690 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:52:28.214659    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="774d36ed-eb1a-4e3c-9470-70facf7f73b4" path="/var/lib/kubelet/pods/774d36ed-eb1a-4e3c-9470-70facf7f73b4/volumes"
Jul 26 15:53:04.493059 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.493007    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d89fb465c-pzl29"]
Jul 26 15:53:04.493804 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.493438    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="774d36ed-eb1a-4e3c-9470-70facf7f73b4" containerName="console"
Jul 26 15:53:04.493804 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.493481    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="774d36ed-eb1a-4e3c-9470-70facf7f73b4" containerName="console"
Jul 26 15:53:04.493804 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.493500    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4fe2369-8cf2-40ef-903f-40a375cdb5d9" containerName="registry"
Jul 26 15:53:04.493804 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.493512    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4fe2369-8cf2-40ef-903f-40a375cdb5d9" containerName="registry"
Jul 26 15:53:04.493804 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.493532    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b" containerName="console"
Jul 26 15:53:04.493804 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.493541    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b" containerName="console"
Jul 26 15:53:04.493804 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.493650    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c0e3cf1-72ed-4f1b-9fe4-bf539bc6ca1b" containerName="console"
Jul 26 15:53:04.493804 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.493665    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4fe2369-8cf2-40ef-903f-40a375cdb5d9" containerName="registry"
Jul 26 15:53:04.493804 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.493674    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="774d36ed-eb1a-4e3c-9470-70facf7f73b4" containerName="console"
Jul 26 15:53:04.498097 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.498079    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.506750 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.506727    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d89fb465c-pzl29"]
Jul 26 15:53:04.649770 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.649740    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-oauth-serving-cert\") pod \"console-d89fb465c-pzl29\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") " pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.649915 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.649779    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-console-serving-cert\") pod \"console-d89fb465c-pzl29\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") " pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.649915 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.649798    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-trusted-ca-bundle\") pod \"console-d89fb465c-pzl29\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") " pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.649915 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.649816    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-console-oauth-config\") pod \"console-d89fb465c-pzl29\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") " pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.650074 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.649907    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-console-config\") pod \"console-d89fb465c-pzl29\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") " pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.650074 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.649941    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-service-ca\") pod \"console-d89fb465c-pzl29\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") " pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.650074 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.650007    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vnd2\" (UniqueName: \"kubernetes.io/projected/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-kube-api-access-4vnd2\") pod \"console-d89fb465c-pzl29\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") " pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.750975 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.750915    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-console-oauth-config\") pod \"console-d89fb465c-pzl29\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") " pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.750975 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.750949    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-console-config\") pod \"console-d89fb465c-pzl29\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") " pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.750975 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.750964    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-service-ca\") pod \"console-d89fb465c-pzl29\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") " pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.751191 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.750987    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vnd2\" (UniqueName: \"kubernetes.io/projected/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-kube-api-access-4vnd2\") pod \"console-d89fb465c-pzl29\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") " pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.751191 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.751031    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-oauth-serving-cert\") pod \"console-d89fb465c-pzl29\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") " pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.751191 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.751068    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-console-serving-cert\") pod \"console-d89fb465c-pzl29\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") " pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.751191 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.751090    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-trusted-ca-bundle\") pod \"console-d89fb465c-pzl29\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") " pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.751819 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.751795    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-oauth-serving-cert\") pod \"console-d89fb465c-pzl29\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") " pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.751934 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.751794    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-service-ca\") pod \"console-d89fb465c-pzl29\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") " pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.751934 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.751882    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-console-config\") pod \"console-d89fb465c-pzl29\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") " pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.752042 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.751972    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-trusted-ca-bundle\") pod \"console-d89fb465c-pzl29\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") " pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.753497 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.753468    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-console-oauth-config\") pod \"console-d89fb465c-pzl29\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") " pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.753598 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.753554    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-console-serving-cert\") pod \"console-d89fb465c-pzl29\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") " pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.758231 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.758209    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vnd2\" (UniqueName: \"kubernetes.io/projected/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-kube-api-access-4vnd2\") pod \"console-d89fb465c-pzl29\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") " pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.809207 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.809183    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:04.934343 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:04.934318    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d89fb465c-pzl29"]
Jul 26 15:53:04.938326 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:53:04.938302    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode92343ce_ca2f_49bb_80b3_2d2037fbcea9.slice/crio-a755c0fbf2c503d430849a9a1399bd520233c6aadf2371a1b648eec86bb6b257 WatchSource:0}: Error finding container a755c0fbf2c503d430849a9a1399bd520233c6aadf2371a1b648eec86bb6b257: Status 404 returned error can't find the container with id a755c0fbf2c503d430849a9a1399bd520233c6aadf2371a1b648eec86bb6b257
Jul 26 15:53:05.221642 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:05.221602    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d89fb465c-pzl29" event={"ID":"e92343ce-ca2f-49bb-80b3-2d2037fbcea9","Type":"ContainerStarted","Data":"3cbc25a69367fab160bd32c2b6df7c213689ef2b5aee1c1c2edbe97db4cd8978"}
Jul 26 15:53:05.221796 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:05.221680    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d89fb465c-pzl29" event={"ID":"e92343ce-ca2f-49bb-80b3-2d2037fbcea9","Type":"ContainerStarted","Data":"a755c0fbf2c503d430849a9a1399bd520233c6aadf2371a1b648eec86bb6b257"}
Jul 26 15:53:05.238923 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:05.238881    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d89fb465c-pzl29" podStartSLOduration=1.23886554 podStartE2EDuration="1.23886554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:53:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:53:05.237576538 +0000 UTC m=+181.456203601" watchObservedRunningTime="2026-07-26 15:53:05.23886554 +0000 UTC m=+181.457492589"
Jul 26 15:53:14.810240 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:14.810207    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:14.810738 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:14.810277    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:14.815309 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:14.815284    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:15.262138 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:15.262114    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:53:15.304478 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:15.304452    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-854c56cc76-wzsh6"]
Jul 26 15:53:40.323130 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.323081    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-854c56cc76-wzsh6" podUID="396ddbe0-6cb3-413f-a4a1-53d2f843bc74" containerName="console" containerID="cri-o://35b443f492469752652d12b24ce012f6a5cbce856064b4491dfb0cba33ca42a7" gracePeriod=15
Jul 26 15:53:40.556664 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.556625    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:53:40.597255 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.597193    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-service-ca\") pod \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") "
Jul 26 15:53:40.597255 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.597229    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-trusted-ca-bundle\") pod \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") "
Jul 26 15:53:40.597398 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.597338    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-console-oauth-config\") pod \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") "
Jul 26 15:53:40.597398 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.597365    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwkd2\" (UniqueName: \"kubernetes.io/projected/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-kube-api-access-pwkd2\") pod \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") "
Jul 26 15:53:40.597398 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.597392    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-console-config\") pod \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") "
Jul 26 15:53:40.597508 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.597451    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-oauth-serving-cert\") pod \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") "
Jul 26 15:53:40.597508 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.597492    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-console-serving-cert\") pod \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\" (UID: \"396ddbe0-6cb3-413f-a4a1-53d2f843bc74\") "
Jul 26 15:53:40.597608 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.597594    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "396ddbe0-6cb3-413f-a4a1-53d2f843bc74" (UID: "396ddbe0-6cb3-413f-a4a1-53d2f843bc74"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:53:40.597690 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.597666    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-service-ca" (OuterVolumeSpecName: "service-ca") pod "396ddbe0-6cb3-413f-a4a1-53d2f843bc74" (UID: "396ddbe0-6cb3-413f-a4a1-53d2f843bc74"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:53:40.597917 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.597890    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-service-ca\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:53:40.597917 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.597917    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-trusted-ca-bundle\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:53:40.598086 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.597956    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-console-config" (OuterVolumeSpecName: "console-config") pod "396ddbe0-6cb3-413f-a4a1-53d2f843bc74" (UID: "396ddbe0-6cb3-413f-a4a1-53d2f843bc74"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:53:40.598086 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.598023    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "396ddbe0-6cb3-413f-a4a1-53d2f843bc74" (UID: "396ddbe0-6cb3-413f-a4a1-53d2f843bc74"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:53:40.599799 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.599776    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "396ddbe0-6cb3-413f-a4a1-53d2f843bc74" (UID: "396ddbe0-6cb3-413f-a4a1-53d2f843bc74"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:53:40.599878 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.599795    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "396ddbe0-6cb3-413f-a4a1-53d2f843bc74" (UID: "396ddbe0-6cb3-413f-a4a1-53d2f843bc74"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:53:40.599878 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.599816    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-kube-api-access-pwkd2" (OuterVolumeSpecName: "kube-api-access-pwkd2") pod "396ddbe0-6cb3-413f-a4a1-53d2f843bc74" (UID: "396ddbe0-6cb3-413f-a4a1-53d2f843bc74"). InnerVolumeSpecName "kube-api-access-pwkd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:53:40.698882 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.698859    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-console-config\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:53:40.698882 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.698878    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-oauth-serving-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:53:40.699004 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.698888    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-console-serving-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:53:40.699004 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.698898    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-console-oauth-config\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:53:40.699004 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:40.698907    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwkd2\" (UniqueName: \"kubernetes.io/projected/396ddbe0-6cb3-413f-a4a1-53d2f843bc74-kube-api-access-pwkd2\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:53:41.358568 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:41.358534    2556 generic.go:356] "Generic (PLEG): container finished" podID="396ddbe0-6cb3-413f-a4a1-53d2f843bc74" containerID="35b443f492469752652d12b24ce012f6a5cbce856064b4491dfb0cba33ca42a7" exitCode=0
Jul 26 15:53:41.358989 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:41.358574    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-854c56cc76-wzsh6"
Jul 26 15:53:41.358989 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:41.358620    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-854c56cc76-wzsh6" event={"ID":"396ddbe0-6cb3-413f-a4a1-53d2f843bc74","Type":"ContainerDied","Data":"35b443f492469752652d12b24ce012f6a5cbce856064b4491dfb0cba33ca42a7"}
Jul 26 15:53:41.358989 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:41.358689    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-854c56cc76-wzsh6" event={"ID":"396ddbe0-6cb3-413f-a4a1-53d2f843bc74","Type":"ContainerDied","Data":"ac65ac0135bb2c4193953f7819fea4ca03a695b7d75d9f38801f545b57ed0212"}
Jul 26 15:53:41.358989 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:41.358711    2556 scope.go:117] "RemoveContainer" containerID="35b443f492469752652d12b24ce012f6a5cbce856064b4491dfb0cba33ca42a7"
Jul 26 15:53:41.367360 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:41.367344    2556 scope.go:117] "RemoveContainer" containerID="35b443f492469752652d12b24ce012f6a5cbce856064b4491dfb0cba33ca42a7"
Jul 26 15:53:41.367595 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:53:41.367577    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35b443f492469752652d12b24ce012f6a5cbce856064b4491dfb0cba33ca42a7\": container with ID starting with 35b443f492469752652d12b24ce012f6a5cbce856064b4491dfb0cba33ca42a7 not found: ID does not exist" containerID="35b443f492469752652d12b24ce012f6a5cbce856064b4491dfb0cba33ca42a7"
Jul 26 15:53:41.367657 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:41.367603    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35b443f492469752652d12b24ce012f6a5cbce856064b4491dfb0cba33ca42a7"} err="failed to get container status \"35b443f492469752652d12b24ce012f6a5cbce856064b4491dfb0cba33ca42a7\": rpc error: code = NotFound desc = could not find container \"35b443f492469752652d12b24ce012f6a5cbce856064b4491dfb0cba33ca42a7\": container with ID starting with 35b443f492469752652d12b24ce012f6a5cbce856064b4491dfb0cba33ca42a7 not found: ID does not exist"
Jul 26 15:53:41.378475 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:41.378451    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-854c56cc76-wzsh6"]
Jul 26 15:53:41.380446 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:41.380426    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-854c56cc76-wzsh6"]
Jul 26 15:53:42.214840 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:42.214810    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="396ddbe0-6cb3-413f-a4a1-53d2f843bc74" path="/var/lib/kubelet/pods/396ddbe0-6cb3-413f-a4a1-53d2f843bc74/volumes"
Jul 26 15:53:53.780010 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:53.779976    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx"]
Jul 26 15:53:53.780429 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:53.780285    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="396ddbe0-6cb3-413f-a4a1-53d2f843bc74" containerName="console"
Jul 26 15:53:53.780429 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:53.780297    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="396ddbe0-6cb3-413f-a4a1-53d2f843bc74" containerName="console"
Jul 26 15:53:53.780429 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:53.780349    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="396ddbe0-6cb3-413f-a4a1-53d2f843bc74" containerName="console"
Jul 26 15:53:53.784910 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:53.784892    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx"
Jul 26 15:53:53.787495 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:53.787465    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bqbnw\""
Jul 26 15:53:53.787798 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:53.787779    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 26 15:53:53.788308 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:53.788291    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 26 15:53:53.793020 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:53.792999    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx"]
Jul 26 15:53:53.888781 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:53.888755    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b709fe66-ec4c-45cf-a7b7-29119b5c7253-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx\" (UID: \"b709fe66-ec4c-45cf-a7b7-29119b5c7253\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx"
Jul 26 15:53:53.888892 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:53.888793    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67l65\" (UniqueName: \"kubernetes.io/projected/b709fe66-ec4c-45cf-a7b7-29119b5c7253-kube-api-access-67l65\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx\" (UID: \"b709fe66-ec4c-45cf-a7b7-29119b5c7253\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx"
Jul 26 15:53:53.888892 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:53.888823    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b709fe66-ec4c-45cf-a7b7-29119b5c7253-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx\" (UID: \"b709fe66-ec4c-45cf-a7b7-29119b5c7253\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx"
Jul 26 15:53:53.989559 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:53.989523    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b709fe66-ec4c-45cf-a7b7-29119b5c7253-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx\" (UID: \"b709fe66-ec4c-45cf-a7b7-29119b5c7253\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx"
Jul 26 15:53:53.989690 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:53.989570    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67l65\" (UniqueName: \"kubernetes.io/projected/b709fe66-ec4c-45cf-a7b7-29119b5c7253-kube-api-access-67l65\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx\" (UID: \"b709fe66-ec4c-45cf-a7b7-29119b5c7253\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx"
Jul 26 15:53:53.989690 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:53.989599    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b709fe66-ec4c-45cf-a7b7-29119b5c7253-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx\" (UID: \"b709fe66-ec4c-45cf-a7b7-29119b5c7253\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx"
Jul 26 15:53:53.989895 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:53.989875    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b709fe66-ec4c-45cf-a7b7-29119b5c7253-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx\" (UID: \"b709fe66-ec4c-45cf-a7b7-29119b5c7253\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx"
Jul 26 15:53:53.989933 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:53.989903    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b709fe66-ec4c-45cf-a7b7-29119b5c7253-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx\" (UID: \"b709fe66-ec4c-45cf-a7b7-29119b5c7253\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx"
Jul 26 15:53:53.998052 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:53.998027    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67l65\" (UniqueName: \"kubernetes.io/projected/b709fe66-ec4c-45cf-a7b7-29119b5c7253-kube-api-access-67l65\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx\" (UID: \"b709fe66-ec4c-45cf-a7b7-29119b5c7253\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx"
Jul 26 15:53:54.095220 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:54.095169    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx"
Jul 26 15:53:54.218524 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:54.218503    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx"]
Jul 26 15:53:54.220488 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:53:54.220464    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb709fe66_ec4c_45cf_a7b7_29119b5c7253.slice/crio-2daa78aab693078e7370d310dd9d78d3b290af1282cd9e271f596d0e8132d020 WatchSource:0}: Error finding container 2daa78aab693078e7370d310dd9d78d3b290af1282cd9e271f596d0e8132d020: Status 404 returned error can't find the container with id 2daa78aab693078e7370d310dd9d78d3b290af1282cd9e271f596d0e8132d020
Jul 26 15:53:54.414229 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:53:54.414168    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx" event={"ID":"b709fe66-ec4c-45cf-a7b7-29119b5c7253","Type":"ContainerStarted","Data":"2daa78aab693078e7370d310dd9d78d3b290af1282cd9e271f596d0e8132d020"}
Jul 26 15:54:00.440023 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:00.439991    2556 generic.go:356] "Generic (PLEG): container finished" podID="b709fe66-ec4c-45cf-a7b7-29119b5c7253" containerID="34cb999ff7313a303ac7355e95b76f0a3043ed72e991a87c595c067142b0ed31" exitCode=0
Jul 26 15:54:00.440348 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:00.440069    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx" event={"ID":"b709fe66-ec4c-45cf-a7b7-29119b5c7253","Type":"ContainerDied","Data":"34cb999ff7313a303ac7355e95b76f0a3043ed72e991a87c595c067142b0ed31"}
Jul 26 15:54:06.462137 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:06.462105    2556 generic.go:356] "Generic (PLEG): container finished" podID="b709fe66-ec4c-45cf-a7b7-29119b5c7253" containerID="b4484b85fbf322b3ea564dbded33c5c2f47c54922f5c64349045447cce9b99f6" exitCode=0
Jul 26 15:54:06.462488 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:06.462175    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx" event={"ID":"b709fe66-ec4c-45cf-a7b7-29119b5c7253","Type":"ContainerDied","Data":"b4484b85fbf322b3ea564dbded33c5c2f47c54922f5c64349045447cce9b99f6"}
Jul 26 15:54:13.495374 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:13.495341    2556 generic.go:356] "Generic (PLEG): container finished" podID="b709fe66-ec4c-45cf-a7b7-29119b5c7253" containerID="9fa94aa38965f5f009d06e25d614c4c2c5c0380f815284b253639f024cd5c40f" exitCode=0
Jul 26 15:54:13.495730 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:13.495424    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx" event={"ID":"b709fe66-ec4c-45cf-a7b7-29119b5c7253","Type":"ContainerDied","Data":"9fa94aa38965f5f009d06e25d614c4c2c5c0380f815284b253639f024cd5c40f"}
Jul 26 15:54:14.640507 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:14.640483    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx"
Jul 26 15:54:14.750582 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:14.750526    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67l65\" (UniqueName: \"kubernetes.io/projected/b709fe66-ec4c-45cf-a7b7-29119b5c7253-kube-api-access-67l65\") pod \"b709fe66-ec4c-45cf-a7b7-29119b5c7253\" (UID: \"b709fe66-ec4c-45cf-a7b7-29119b5c7253\") "
Jul 26 15:54:14.750582 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:14.750575    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b709fe66-ec4c-45cf-a7b7-29119b5c7253-bundle\") pod \"b709fe66-ec4c-45cf-a7b7-29119b5c7253\" (UID: \"b709fe66-ec4c-45cf-a7b7-29119b5c7253\") "
Jul 26 15:54:14.750779 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:14.750626    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b709fe66-ec4c-45cf-a7b7-29119b5c7253-util\") pod \"b709fe66-ec4c-45cf-a7b7-29119b5c7253\" (UID: \"b709fe66-ec4c-45cf-a7b7-29119b5c7253\") "
Jul 26 15:54:14.751266 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:14.751235    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b709fe66-ec4c-45cf-a7b7-29119b5c7253-bundle" (OuterVolumeSpecName: "bundle") pod "b709fe66-ec4c-45cf-a7b7-29119b5c7253" (UID: "b709fe66-ec4c-45cf-a7b7-29119b5c7253"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:54:14.752660 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:14.752622    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b709fe66-ec4c-45cf-a7b7-29119b5c7253-kube-api-access-67l65" (OuterVolumeSpecName: "kube-api-access-67l65") pod "b709fe66-ec4c-45cf-a7b7-29119b5c7253" (UID: "b709fe66-ec4c-45cf-a7b7-29119b5c7253"). InnerVolumeSpecName "kube-api-access-67l65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:54:14.754966 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:14.754943    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b709fe66-ec4c-45cf-a7b7-29119b5c7253-util" (OuterVolumeSpecName: "util") pod "b709fe66-ec4c-45cf-a7b7-29119b5c7253" (UID: "b709fe66-ec4c-45cf-a7b7-29119b5c7253"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:54:14.851805 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:14.851783    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b709fe66-ec4c-45cf-a7b7-29119b5c7253-bundle\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:54:14.851805 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:14.851802    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b709fe66-ec4c-45cf-a7b7-29119b5c7253-util\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:54:14.851936 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:14.851812    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67l65\" (UniqueName: \"kubernetes.io/projected/b709fe66-ec4c-45cf-a7b7-29119b5c7253-kube-api-access-67l65\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:54:15.504937 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:15.504900    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx" event={"ID":"b709fe66-ec4c-45cf-a7b7-29119b5c7253","Type":"ContainerDied","Data":"2daa78aab693078e7370d310dd9d78d3b290af1282cd9e271f596d0e8132d020"}
Jul 26 15:54:15.504937 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:15.504946    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2daa78aab693078e7370d310dd9d78d3b290af1282cd9e271f596d0e8132d020"
Jul 26 15:54:15.505169 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:15.504949    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540v87nx"
Jul 26 15:54:26.181228 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.181148    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg"]
Jul 26 15:54:26.181582 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.181426    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b709fe66-ec4c-45cf-a7b7-29119b5c7253" containerName="pull"
Jul 26 15:54:26.181582 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.181437    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b709fe66-ec4c-45cf-a7b7-29119b5c7253" containerName="pull"
Jul 26 15:54:26.181582 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.181452    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b709fe66-ec4c-45cf-a7b7-29119b5c7253" containerName="extract"
Jul 26 15:54:26.181582 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.181458    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b709fe66-ec4c-45cf-a7b7-29119b5c7253" containerName="extract"
Jul 26 15:54:26.181582 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.181474    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b709fe66-ec4c-45cf-a7b7-29119b5c7253" containerName="util"
Jul 26 15:54:26.181582 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.181480    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b709fe66-ec4c-45cf-a7b7-29119b5c7253" containerName="util"
Jul 26 15:54:26.181582 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.181527    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b709fe66-ec4c-45cf-a7b7-29119b5c7253" containerName="extract"
Jul 26 15:54:26.184456 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.184433    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg"
Jul 26 15:54:26.187165 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.187145    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bqbnw\""
Jul 26 15:54:26.187360 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.187336    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 26 15:54:26.188026 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.188008    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 26 15:54:26.199591 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.199567    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg"]
Jul 26 15:54:26.329598 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.329569    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b20e84b4-f6f4-4f86-837a-e818338e31c5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg\" (UID: \"b20e84b4-f6f4-4f86-837a-e818338e31c5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg"
Jul 26 15:54:26.329748 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.329611    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc5xv\" (UniqueName: \"kubernetes.io/projected/b20e84b4-f6f4-4f86-837a-e818338e31c5-kube-api-access-rc5xv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg\" (UID: \"b20e84b4-f6f4-4f86-837a-e818338e31c5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg"
Jul 26 15:54:26.329748 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.329696    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b20e84b4-f6f4-4f86-837a-e818338e31c5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg\" (UID: \"b20e84b4-f6f4-4f86-837a-e818338e31c5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg"
Jul 26 15:54:26.430866 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.430832    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b20e84b4-f6f4-4f86-837a-e818338e31c5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg\" (UID: \"b20e84b4-f6f4-4f86-837a-e818338e31c5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg"
Jul 26 15:54:26.430964 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.430879    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc5xv\" (UniqueName: \"kubernetes.io/projected/b20e84b4-f6f4-4f86-837a-e818338e31c5-kube-api-access-rc5xv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg\" (UID: \"b20e84b4-f6f4-4f86-837a-e818338e31c5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg"
Jul 26 15:54:26.430964 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.430916    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b20e84b4-f6f4-4f86-837a-e818338e31c5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg\" (UID: \"b20e84b4-f6f4-4f86-837a-e818338e31c5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg"
Jul 26 15:54:26.431272 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.431233    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b20e84b4-f6f4-4f86-837a-e818338e31c5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg\" (UID: \"b20e84b4-f6f4-4f86-837a-e818338e31c5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg"
Jul 26 15:54:26.431313 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.431267    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b20e84b4-f6f4-4f86-837a-e818338e31c5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg\" (UID: \"b20e84b4-f6f4-4f86-837a-e818338e31c5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg"
Jul 26 15:54:26.441498 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.441467    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc5xv\" (UniqueName: \"kubernetes.io/projected/b20e84b4-f6f4-4f86-837a-e818338e31c5-kube-api-access-rc5xv\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg\" (UID: \"b20e84b4-f6f4-4f86-837a-e818338e31c5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg"
Jul 26 15:54:26.494032 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.494008    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg"
Jul 26 15:54:26.621018 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:26.620989    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg"]
Jul 26 15:54:26.624794 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:54:26.624769    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb20e84b4_f6f4_4f86_837a_e818338e31c5.slice/crio-1ef869962897f9ea1453a2783972dbb5844551458ad63b1801acd0584f4bc67b WatchSource:0}: Error finding container 1ef869962897f9ea1453a2783972dbb5844551458ad63b1801acd0584f4bc67b: Status 404 returned error can't find the container with id 1ef869962897f9ea1453a2783972dbb5844551458ad63b1801acd0584f4bc67b
Jul 26 15:54:27.553751 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:27.553719    2556 generic.go:356] "Generic (PLEG): container finished" podID="b20e84b4-f6f4-4f86-837a-e818338e31c5" containerID="6ad5f43c10ac6966181dbc99dd6183c899669873c23773d9893dc98d315340aa" exitCode=0
Jul 26 15:54:27.554062 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:27.553759    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg" event={"ID":"b20e84b4-f6f4-4f86-837a-e818338e31c5","Type":"ContainerDied","Data":"6ad5f43c10ac6966181dbc99dd6183c899669873c23773d9893dc98d315340aa"}
Jul 26 15:54:27.554062 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:27.553813    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg" event={"ID":"b20e84b4-f6f4-4f86-837a-e818338e31c5","Type":"ContainerStarted","Data":"1ef869962897f9ea1453a2783972dbb5844551458ad63b1801acd0584f4bc67b"}
Jul 26 15:54:28.389114 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:28.389082    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zqm8l"]
Jul 26 15:54:28.392182 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:28.392154    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zqm8l"
Jul 26 15:54:28.394338 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:28.394317    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 26 15:54:28.395195 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:28.395155    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-kqjpk\""
Jul 26 15:54:28.395195 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:28.395168    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 26 15:54:28.402020 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:28.401997    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zqm8l"]
Jul 26 15:54:28.547096 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:28.547073    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94ff44c4-669f-44eb-80a6-5b206bc96538-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zqm8l\" (UID: \"94ff44c4-669f-44eb-80a6-5b206bc96538\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zqm8l"
Jul 26 15:54:28.547223 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:28.547105    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px6xn\" (UniqueName: \"kubernetes.io/projected/94ff44c4-669f-44eb-80a6-5b206bc96538-kube-api-access-px6xn\") pod \"cert-manager-cainjector-559cdd8c87-zqm8l\" (UID: \"94ff44c4-669f-44eb-80a6-5b206bc96538\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zqm8l"
Jul 26 15:54:28.648247 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:28.648175    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94ff44c4-669f-44eb-80a6-5b206bc96538-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zqm8l\" (UID: \"94ff44c4-669f-44eb-80a6-5b206bc96538\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zqm8l"
Jul 26 15:54:28.648671 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:28.648291    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px6xn\" (UniqueName: \"kubernetes.io/projected/94ff44c4-669f-44eb-80a6-5b206bc96538-kube-api-access-px6xn\") pod \"cert-manager-cainjector-559cdd8c87-zqm8l\" (UID: \"94ff44c4-669f-44eb-80a6-5b206bc96538\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zqm8l"
Jul 26 15:54:28.656364 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:28.656343    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94ff44c4-669f-44eb-80a6-5b206bc96538-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zqm8l\" (UID: \"94ff44c4-669f-44eb-80a6-5b206bc96538\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zqm8l"
Jul 26 15:54:28.656590 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:28.656572    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px6xn\" (UniqueName: \"kubernetes.io/projected/94ff44c4-669f-44eb-80a6-5b206bc96538-kube-api-access-px6xn\") pod \"cert-manager-cainjector-559cdd8c87-zqm8l\" (UID: \"94ff44c4-669f-44eb-80a6-5b206bc96538\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zqm8l"
Jul 26 15:54:28.701935 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:28.701913    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zqm8l"
Jul 26 15:54:28.842424 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:28.842399    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zqm8l"]
Jul 26 15:54:28.844915 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:54:28.844887    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94ff44c4_669f_44eb_80a6_5b206bc96538.slice/crio-c0ef435c6ee97af005a35a25d5fe86998b27b37778fd0bd5a181f66ded96678d WatchSource:0}: Error finding container c0ef435c6ee97af005a35a25d5fe86998b27b37778fd0bd5a181f66ded96678d: Status 404 returned error can't find the container with id c0ef435c6ee97af005a35a25d5fe86998b27b37778fd0bd5a181f66ded96678d
Jul 26 15:54:29.563287 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:29.563250    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zqm8l" event={"ID":"94ff44c4-669f-44eb-80a6-5b206bc96538","Type":"ContainerStarted","Data":"c0ef435c6ee97af005a35a25d5fe86998b27b37778fd0bd5a181f66ded96678d"}
Jul 26 15:54:30.569702 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:30.569665    2556 generic.go:356] "Generic (PLEG): container finished" podID="b20e84b4-f6f4-4f86-837a-e818338e31c5" containerID="ea02363810bd718f5fff358cfedefef27a8e376609240e6003f2902c9a8e0998" exitCode=0
Jul 26 15:54:30.570143 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:30.569748    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg" event={"ID":"b20e84b4-f6f4-4f86-837a-e818338e31c5","Type":"ContainerDied","Data":"ea02363810bd718f5fff358cfedefef27a8e376609240e6003f2902c9a8e0998"}
Jul 26 15:54:31.576778 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:31.576745    2556 generic.go:356] "Generic (PLEG): container finished" podID="b20e84b4-f6f4-4f86-837a-e818338e31c5" containerID="dc42a8df20a2d3bae3232aa0e922a0a8156f2d7e80597025fbb2d36db99bf3ae" exitCode=0
Jul 26 15:54:31.577147 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:31.576828    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg" event={"ID":"b20e84b4-f6f4-4f86-837a-e818338e31c5","Type":"ContainerDied","Data":"dc42a8df20a2d3bae3232aa0e922a0a8156f2d7e80597025fbb2d36db99bf3ae"}
Jul 26 15:54:32.582383 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:32.582352    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zqm8l" event={"ID":"94ff44c4-669f-44eb-80a6-5b206bc96538","Type":"ContainerStarted","Data":"0e41280aade98298a12b18ad4a77681dacde25e7fd85cba9368cc2714648d3e2"}
Jul 26 15:54:32.597554 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:32.597509    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zqm8l" podStartSLOduration=1.425127579 podStartE2EDuration="4.597495003s" totalImagesPullingTime="3.172367424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:54:32.596451371 +0000 UTC m=+268.815078420" watchObservedRunningTime="2026-07-26 15:54:32.597495003 +0000 UTC m=+268.816122051"
Jul 26 15:54:32.720092 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:32.720068    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg"
Jul 26 15:54:32.882497 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:32.882425    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b20e84b4-f6f4-4f86-837a-e818338e31c5-util\") pod \"b20e84b4-f6f4-4f86-837a-e818338e31c5\" (UID: \"b20e84b4-f6f4-4f86-837a-e818338e31c5\") "
Jul 26 15:54:32.882497 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:32.882474    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rc5xv\" (UniqueName: \"kubernetes.io/projected/b20e84b4-f6f4-4f86-837a-e818338e31c5-kube-api-access-rc5xv\") pod \"b20e84b4-f6f4-4f86-837a-e818338e31c5\" (UID: \"b20e84b4-f6f4-4f86-837a-e818338e31c5\") "
Jul 26 15:54:32.882723 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:32.882523    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b20e84b4-f6f4-4f86-837a-e818338e31c5-bundle\") pod \"b20e84b4-f6f4-4f86-837a-e818338e31c5\" (UID: \"b20e84b4-f6f4-4f86-837a-e818338e31c5\") "
Jul 26 15:54:32.882993 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:32.882958    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b20e84b4-f6f4-4f86-837a-e818338e31c5-bundle" (OuterVolumeSpecName: "bundle") pod "b20e84b4-f6f4-4f86-837a-e818338e31c5" (UID: "b20e84b4-f6f4-4f86-837a-e818338e31c5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:54:32.884664 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:32.884629    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b20e84b4-f6f4-4f86-837a-e818338e31c5-kube-api-access-rc5xv" (OuterVolumeSpecName: "kube-api-access-rc5xv") pod "b20e84b4-f6f4-4f86-837a-e818338e31c5" (UID: "b20e84b4-f6f4-4f86-837a-e818338e31c5"). InnerVolumeSpecName "kube-api-access-rc5xv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:54:32.887346 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:32.887324    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b20e84b4-f6f4-4f86-837a-e818338e31c5-util" (OuterVolumeSpecName: "util") pod "b20e84b4-f6f4-4f86-837a-e818338e31c5" (UID: "b20e84b4-f6f4-4f86-837a-e818338e31c5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:54:32.982971 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:32.982948    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b20e84b4-f6f4-4f86-837a-e818338e31c5-bundle\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:54:32.982971 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:32.982969    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b20e84b4-f6f4-4f86-837a-e818338e31c5-util\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:54:32.983086 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:32.982979    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rc5xv\" (UniqueName: \"kubernetes.io/projected/b20e84b4-f6f4-4f86-837a-e818338e31c5-kube-api-access-rc5xv\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:54:33.553708 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.553678    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-swgsm"]
Jul 26 15:54:33.553972 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.553959    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b20e84b4-f6f4-4f86-837a-e818338e31c5" containerName="pull"
Jul 26 15:54:33.554061 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.553973    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b20e84b4-f6f4-4f86-837a-e818338e31c5" containerName="pull"
Jul 26 15:54:33.554061 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.553985    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b20e84b4-f6f4-4f86-837a-e818338e31c5" containerName="util"
Jul 26 15:54:33.554061 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.553991    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b20e84b4-f6f4-4f86-837a-e818338e31c5" containerName="util"
Jul 26 15:54:33.554061 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.554001    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b20e84b4-f6f4-4f86-837a-e818338e31c5" containerName="extract"
Jul 26 15:54:33.554061 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.554006    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b20e84b4-f6f4-4f86-837a-e818338e31c5" containerName="extract"
Jul 26 15:54:33.554061 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.554057    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b20e84b4-f6f4-4f86-837a-e818338e31c5" containerName="extract"
Jul 26 15:54:33.557132 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.557113    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-swgsm"
Jul 26 15:54:33.559307 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.559286    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-9c4nt\""
Jul 26 15:54:33.564500 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.564476    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-swgsm"]
Jul 26 15:54:33.588154 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.588131    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg"
Jul 26 15:54:33.588448 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.588159    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnvjwg" event={"ID":"b20e84b4-f6f4-4f86-837a-e818338e31c5","Type":"ContainerDied","Data":"1ef869962897f9ea1453a2783972dbb5844551458ad63b1801acd0584f4bc67b"}
Jul 26 15:54:33.588448 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.588202    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ef869962897f9ea1453a2783972dbb5844551458ad63b1801acd0584f4bc67b"
Jul 26 15:54:33.686874 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.686853    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7ts5\" (UniqueName: \"kubernetes.io/projected/7d3154cf-a941-43c9-a7f0-c57012d0ca6e-kube-api-access-k7ts5\") pod \"cert-manager-webhook-6486ffd997-swgsm\" (UID: \"7d3154cf-a941-43c9-a7f0-c57012d0ca6e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-swgsm"
Jul 26 15:54:33.687027 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.687007    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d3154cf-a941-43c9-a7f0-c57012d0ca6e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-swgsm\" (UID: \"7d3154cf-a941-43c9-a7f0-c57012d0ca6e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-swgsm"
Jul 26 15:54:33.788052 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.788029    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7ts5\" (UniqueName: \"kubernetes.io/projected/7d3154cf-a941-43c9-a7f0-c57012d0ca6e-kube-api-access-k7ts5\") pod \"cert-manager-webhook-6486ffd997-swgsm\" (UID: \"7d3154cf-a941-43c9-a7f0-c57012d0ca6e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-swgsm"
Jul 26 15:54:33.788155 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.788094    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d3154cf-a941-43c9-a7f0-c57012d0ca6e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-swgsm\" (UID: \"7d3154cf-a941-43c9-a7f0-c57012d0ca6e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-swgsm"
Jul 26 15:54:33.797246 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.797214    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d3154cf-a941-43c9-a7f0-c57012d0ca6e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-swgsm\" (UID: \"7d3154cf-a941-43c9-a7f0-c57012d0ca6e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-swgsm"
Jul 26 15:54:33.797338 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.797289    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7ts5\" (UniqueName: \"kubernetes.io/projected/7d3154cf-a941-43c9-a7f0-c57012d0ca6e-kube-api-access-k7ts5\") pod \"cert-manager-webhook-6486ffd997-swgsm\" (UID: \"7d3154cf-a941-43c9-a7f0-c57012d0ca6e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-swgsm"
Jul 26 15:54:33.866823 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.866770    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-swgsm"
Jul 26 15:54:33.988385 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:33.988259    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-swgsm"]
Jul 26 15:54:33.990988 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:54:33.990959    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d3154cf_a941_43c9_a7f0_c57012d0ca6e.slice/crio-03e80b023dc252532e842de3d49ea5e0aec63ff90d0b2e3f7f184f3a17ec0fab WatchSource:0}: Error finding container 03e80b023dc252532e842de3d49ea5e0aec63ff90d0b2e3f7f184f3a17ec0fab: Status 404 returned error can't find the container with id 03e80b023dc252532e842de3d49ea5e0aec63ff90d0b2e3f7f184f3a17ec0fab
Jul 26 15:54:34.593329 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:34.593296    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-swgsm" event={"ID":"7d3154cf-a941-43c9-a7f0-c57012d0ca6e","Type":"ContainerStarted","Data":"6e7a5b1bfdf33fe0783ee8254d90e553dd3109139a0b9751be0db357d63e5190"}
Jul 26 15:54:34.593697 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:34.593338    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-swgsm" event={"ID":"7d3154cf-a941-43c9-a7f0-c57012d0ca6e","Type":"ContainerStarted","Data":"03e80b023dc252532e842de3d49ea5e0aec63ff90d0b2e3f7f184f3a17ec0fab"}
Jul 26 15:54:34.593697 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:34.593476    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-swgsm"
Jul 26 15:54:34.611694 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:34.611653    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-swgsm" podStartSLOduration=1.611627177 podStartE2EDuration="1.611627177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:54:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:54:34.609487401 +0000 UTC m=+270.828114451" watchObservedRunningTime="2026-07-26 15:54:34.611627177 +0000 UTC m=+270.830254226"
Jul 26 15:54:36.485059 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:36.485027    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-g4w4p"]
Jul 26 15:54:36.488855 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:36.488838    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-g4w4p"
Jul 26 15:54:36.491276 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:36.491262    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9qkg5\""
Jul 26 15:54:36.499652 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:36.498507    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-g4w4p"]
Jul 26 15:54:36.609274 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:36.609246    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rjmq\" (UniqueName: \"kubernetes.io/projected/0392239c-524b-4a3a-b0e6-5ca4231d6b6a-kube-api-access-7rjmq\") pod \"cert-manager-55b4d954d5-g4w4p\" (UID: \"0392239c-524b-4a3a-b0e6-5ca4231d6b6a\") " pod="cert-manager/cert-manager-55b4d954d5-g4w4p"
Jul 26 15:54:36.609407 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:36.609310    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0392239c-524b-4a3a-b0e6-5ca4231d6b6a-bound-sa-token\") pod \"cert-manager-55b4d954d5-g4w4p\" (UID: \"0392239c-524b-4a3a-b0e6-5ca4231d6b6a\") " pod="cert-manager/cert-manager-55b4d954d5-g4w4p"
Jul 26 15:54:36.709940 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:36.709910    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0392239c-524b-4a3a-b0e6-5ca4231d6b6a-bound-sa-token\") pod \"cert-manager-55b4d954d5-g4w4p\" (UID: \"0392239c-524b-4a3a-b0e6-5ca4231d6b6a\") " pod="cert-manager/cert-manager-55b4d954d5-g4w4p"
Jul 26 15:54:36.710025 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:36.709954    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rjmq\" (UniqueName: \"kubernetes.io/projected/0392239c-524b-4a3a-b0e6-5ca4231d6b6a-kube-api-access-7rjmq\") pod \"cert-manager-55b4d954d5-g4w4p\" (UID: \"0392239c-524b-4a3a-b0e6-5ca4231d6b6a\") " pod="cert-manager/cert-manager-55b4d954d5-g4w4p"
Jul 26 15:54:36.717394 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:36.717367    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0392239c-524b-4a3a-b0e6-5ca4231d6b6a-bound-sa-token\") pod \"cert-manager-55b4d954d5-g4w4p\" (UID: \"0392239c-524b-4a3a-b0e6-5ca4231d6b6a\") " pod="cert-manager/cert-manager-55b4d954d5-g4w4p"
Jul 26 15:54:36.717549 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:36.717529    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rjmq\" (UniqueName: \"kubernetes.io/projected/0392239c-524b-4a3a-b0e6-5ca4231d6b6a-kube-api-access-7rjmq\") pod \"cert-manager-55b4d954d5-g4w4p\" (UID: \"0392239c-524b-4a3a-b0e6-5ca4231d6b6a\") " pod="cert-manager/cert-manager-55b4d954d5-g4w4p"
Jul 26 15:54:36.799735 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:36.799686    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-g4w4p"
Jul 26 15:54:36.922722 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:36.922661    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-g4w4p"]
Jul 26 15:54:36.925328 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:54:36.925303    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0392239c_524b_4a3a_b0e6_5ca4231d6b6a.slice/crio-b4949541411518b1c7989ba8dc52738c9e5081213d655c3a9f4e384ad3bf05e3 WatchSource:0}: Error finding container b4949541411518b1c7989ba8dc52738c9e5081213d655c3a9f4e384ad3bf05e3: Status 404 returned error can't find the container with id b4949541411518b1c7989ba8dc52738c9e5081213d655c3a9f4e384ad3bf05e3
Jul 26 15:54:37.606800 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:37.606761    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-g4w4p" event={"ID":"0392239c-524b-4a3a-b0e6-5ca4231d6b6a","Type":"ContainerStarted","Data":"8c3d7c880b1bd55f6055d3b2537eddd342ad3b5c87d824a712a055614f3f36d4"}
Jul 26 15:54:37.606800 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:37.606807    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-g4w4p" event={"ID":"0392239c-524b-4a3a-b0e6-5ca4231d6b6a","Type":"ContainerStarted","Data":"b4949541411518b1c7989ba8dc52738c9e5081213d655c3a9f4e384ad3bf05e3"}
Jul 26 15:54:37.622703 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:37.622607    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-g4w4p" podStartSLOduration=1.622589915 podStartE2EDuration="1.622589915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:54:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:54:37.621465163 +0000 UTC m=+273.840092212" watchObservedRunningTime="2026-07-26 15:54:37.622589915 +0000 UTC m=+273.841216966"
Jul 26 15:54:40.600112 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:40.600085    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-swgsm"
Jul 26 15:54:46.945407 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:46.945363    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl"]
Jul 26 15:54:46.951188 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:46.951162    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl"
Jul 26 15:54:46.953560 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:46.953530    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 26 15:54:46.953667 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:46.953571    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 26 15:54:46.953735 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:46.953711    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bqbnw\""
Jul 26 15:54:46.956845 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:46.956816    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl"]
Jul 26 15:54:47.079419 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:47.079379    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24537722-4a96-4302-b307-19ee9597c95f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl\" (UID: \"24537722-4a96-4302-b307-19ee9597c95f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl"
Jul 26 15:54:47.079560 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:47.079434    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gct4b\" (UniqueName: \"kubernetes.io/projected/24537722-4a96-4302-b307-19ee9597c95f-kube-api-access-gct4b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl\" (UID: \"24537722-4a96-4302-b307-19ee9597c95f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl"
Jul 26 15:54:47.079560 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:47.079533    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24537722-4a96-4302-b307-19ee9597c95f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl\" (UID: \"24537722-4a96-4302-b307-19ee9597c95f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl"
Jul 26 15:54:47.180758 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:47.180726    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24537722-4a96-4302-b307-19ee9597c95f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl\" (UID: \"24537722-4a96-4302-b307-19ee9597c95f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl"
Jul 26 15:54:47.180864 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:47.180768    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24537722-4a96-4302-b307-19ee9597c95f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl\" (UID: \"24537722-4a96-4302-b307-19ee9597c95f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl"
Jul 26 15:54:47.180864 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:47.180804    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gct4b\" (UniqueName: \"kubernetes.io/projected/24537722-4a96-4302-b307-19ee9597c95f-kube-api-access-gct4b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl\" (UID: \"24537722-4a96-4302-b307-19ee9597c95f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl"
Jul 26 15:54:47.181096 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:47.181077    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24537722-4a96-4302-b307-19ee9597c95f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl\" (UID: \"24537722-4a96-4302-b307-19ee9597c95f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl"
Jul 26 15:54:47.181181 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:47.181163    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24537722-4a96-4302-b307-19ee9597c95f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl\" (UID: \"24537722-4a96-4302-b307-19ee9597c95f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl"
Jul 26 15:54:47.189158 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:47.189132    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gct4b\" (UniqueName: \"kubernetes.io/projected/24537722-4a96-4302-b307-19ee9597c95f-kube-api-access-gct4b\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl\" (UID: \"24537722-4a96-4302-b307-19ee9597c95f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl"
Jul 26 15:54:47.263381 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:47.263317    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl"
Jul 26 15:54:47.382944 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:47.382919    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl"]
Jul 26 15:54:47.385374 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:54:47.385346    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24537722_4a96_4302_b307_19ee9597c95f.slice/crio-417b89a9eda20651067d048e36eead5bc43900a1bfeffe3c1ab1cc3d86fa705c WatchSource:0}: Error finding container 417b89a9eda20651067d048e36eead5bc43900a1bfeffe3c1ab1cc3d86fa705c: Status 404 returned error can't find the container with id 417b89a9eda20651067d048e36eead5bc43900a1bfeffe3c1ab1cc3d86fa705c
Jul 26 15:54:47.648203 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:47.648135    2556 generic.go:356] "Generic (PLEG): container finished" podID="24537722-4a96-4302-b307-19ee9597c95f" containerID="5df17557d4efb5c0e343729fc36890107aa84f8dc86b57f8a6c5931bf1e5ba5b" exitCode=0
Jul 26 15:54:47.648203 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:47.648184    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl" event={"ID":"24537722-4a96-4302-b307-19ee9597c95f","Type":"ContainerDied","Data":"5df17557d4efb5c0e343729fc36890107aa84f8dc86b57f8a6c5931bf1e5ba5b"}
Jul 26 15:54:47.648348 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:47.648221    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl" event={"ID":"24537722-4a96-4302-b307-19ee9597c95f","Type":"ContainerStarted","Data":"417b89a9eda20651067d048e36eead5bc43900a1bfeffe3c1ab1cc3d86fa705c"}
Jul 26 15:54:48.660450 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:48.660376    2556 generic.go:356] "Generic (PLEG): container finished" podID="24537722-4a96-4302-b307-19ee9597c95f" containerID="1580a04e652c5d966253685a8c4b0d5e2d073dea6a0c7a00cc7ba239175adba0" exitCode=0
Jul 26 15:54:48.660450 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:48.660443    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl" event={"ID":"24537722-4a96-4302-b307-19ee9597c95f","Type":"ContainerDied","Data":"1580a04e652c5d966253685a8c4b0d5e2d073dea6a0c7a00cc7ba239175adba0"}
Jul 26 15:54:49.667531 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:49.667488    2556 generic.go:356] "Generic (PLEG): container finished" podID="24537722-4a96-4302-b307-19ee9597c95f" containerID="1291dcf9b8e05c95cd8f19b963028e6f94b776fddf19709fee0e4d105fc44383" exitCode=0
Jul 26 15:54:49.667942 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:49.667553    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl" event={"ID":"24537722-4a96-4302-b307-19ee9597c95f","Type":"ContainerDied","Data":"1291dcf9b8e05c95cd8f19b963028e6f94b776fddf19709fee0e4d105fc44383"}
Jul 26 15:54:50.789078 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:50.789053    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl"
Jul 26 15:54:50.805651 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:50.805592    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gct4b\" (UniqueName: \"kubernetes.io/projected/24537722-4a96-4302-b307-19ee9597c95f-kube-api-access-gct4b\") pod \"24537722-4a96-4302-b307-19ee9597c95f\" (UID: \"24537722-4a96-4302-b307-19ee9597c95f\") "
Jul 26 15:54:50.805772 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:50.805688    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24537722-4a96-4302-b307-19ee9597c95f-bundle\") pod \"24537722-4a96-4302-b307-19ee9597c95f\" (UID: \"24537722-4a96-4302-b307-19ee9597c95f\") "
Jul 26 15:54:50.805772 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:50.805722    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24537722-4a96-4302-b307-19ee9597c95f-util\") pod \"24537722-4a96-4302-b307-19ee9597c95f\" (UID: \"24537722-4a96-4302-b307-19ee9597c95f\") "
Jul 26 15:54:50.806476 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:50.806447    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24537722-4a96-4302-b307-19ee9597c95f-bundle" (OuterVolumeSpecName: "bundle") pod "24537722-4a96-4302-b307-19ee9597c95f" (UID: "24537722-4a96-4302-b307-19ee9597c95f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:54:50.807868 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:50.807840    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24537722-4a96-4302-b307-19ee9597c95f-kube-api-access-gct4b" (OuterVolumeSpecName: "kube-api-access-gct4b") pod "24537722-4a96-4302-b307-19ee9597c95f" (UID: "24537722-4a96-4302-b307-19ee9597c95f"). InnerVolumeSpecName "kube-api-access-gct4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:54:50.814070 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:50.814044    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24537722-4a96-4302-b307-19ee9597c95f-util" (OuterVolumeSpecName: "util") pod "24537722-4a96-4302-b307-19ee9597c95f" (UID: "24537722-4a96-4302-b307-19ee9597c95f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:54:50.906682 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:50.906657    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gct4b\" (UniqueName: \"kubernetes.io/projected/24537722-4a96-4302-b307-19ee9597c95f-kube-api-access-gct4b\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:54:50.906682 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:50.906681    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24537722-4a96-4302-b307-19ee9597c95f-bundle\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:54:50.906814 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:50.906695    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24537722-4a96-4302-b307-19ee9597c95f-util\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:54:51.678279 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:51.678251    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl"
Jul 26 15:54:51.678279 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:51.678267    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2jzrl" event={"ID":"24537722-4a96-4302-b307-19ee9597c95f","Type":"ContainerDied","Data":"417b89a9eda20651067d048e36eead5bc43900a1bfeffe3c1ab1cc3d86fa705c"}
Jul 26 15:54:51.678481 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:54:51.678317    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="417b89a9eda20651067d048e36eead5bc43900a1bfeffe3c1ab1cc3d86fa705c"
Jul 26 15:55:01.103385 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.103348    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"]
Jul 26 15:55:01.103784 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.103623    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24537722-4a96-4302-b307-19ee9597c95f" containerName="pull"
Jul 26 15:55:01.103784 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.103648    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="24537722-4a96-4302-b307-19ee9597c95f" containerName="pull"
Jul 26 15:55:01.103784 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.103665    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24537722-4a96-4302-b307-19ee9597c95f" containerName="util"
Jul 26 15:55:01.103784 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.103671    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="24537722-4a96-4302-b307-19ee9597c95f" containerName="util"
Jul 26 15:55:01.103784 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.103685    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24537722-4a96-4302-b307-19ee9597c95f" containerName="extract"
Jul 26 15:55:01.103784 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.103690    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="24537722-4a96-4302-b307-19ee9597c95f" containerName="extract"
Jul 26 15:55:01.103784 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.103740    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="24537722-4a96-4302-b307-19ee9597c95f" containerName="extract"
Jul 26 15:55:01.106671 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.106654    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"
Jul 26 15:55:01.109162 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.109126    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 26 15:55:01.109313 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.109226    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 26 15:55:01.109313 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.109263    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 26 15:55:01.109313 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.109302    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 26 15:55:01.109466 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.109233    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n4l27\""
Jul 26 15:55:01.119917 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.119892    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"]
Jul 26 15:55:01.170283 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.170257    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8211f09-b05e-415a-9831-90a2a00dbb28-webhook-cert\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-frtvb\" (UID: \"a8211f09-b05e-415a-9831-90a2a00dbb28\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"
Jul 26 15:55:01.170427 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.170289    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8211f09-b05e-415a-9831-90a2a00dbb28-manifests\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-frtvb\" (UID: \"a8211f09-b05e-415a-9831-90a2a00dbb28\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"
Jul 26 15:55:01.170427 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.170306    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9lms\" (UniqueName: \"kubernetes.io/projected/a8211f09-b05e-415a-9831-90a2a00dbb28-kube-api-access-t9lms\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-frtvb\" (UID: \"a8211f09-b05e-415a-9831-90a2a00dbb28\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"
Jul 26 15:55:01.170427 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.170410    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a8211f09-b05e-415a-9831-90a2a00dbb28-apiservice-cert\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-frtvb\" (UID: \"a8211f09-b05e-415a-9831-90a2a00dbb28\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"
Jul 26 15:55:01.170534 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.170447    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8211f09-b05e-415a-9831-90a2a00dbb28-tmp\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-frtvb\" (UID: \"a8211f09-b05e-415a-9831-90a2a00dbb28\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"
Jul 26 15:55:01.271057 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.271031    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8211f09-b05e-415a-9831-90a2a00dbb28-webhook-cert\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-frtvb\" (UID: \"a8211f09-b05e-415a-9831-90a2a00dbb28\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"
Jul 26 15:55:01.271182 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.271069    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8211f09-b05e-415a-9831-90a2a00dbb28-manifests\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-frtvb\" (UID: \"a8211f09-b05e-415a-9831-90a2a00dbb28\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"
Jul 26 15:55:01.271182 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.271084    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9lms\" (UniqueName: \"kubernetes.io/projected/a8211f09-b05e-415a-9831-90a2a00dbb28-kube-api-access-t9lms\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-frtvb\" (UID: \"a8211f09-b05e-415a-9831-90a2a00dbb28\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"
Jul 26 15:55:01.271182 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.271176    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a8211f09-b05e-415a-9831-90a2a00dbb28-apiservice-cert\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-frtvb\" (UID: \"a8211f09-b05e-415a-9831-90a2a00dbb28\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"
Jul 26 15:55:01.271325 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.271214    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8211f09-b05e-415a-9831-90a2a00dbb28-tmp\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-frtvb\" (UID: \"a8211f09-b05e-415a-9831-90a2a00dbb28\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"
Jul 26 15:55:01.271420 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.271400    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a8211f09-b05e-415a-9831-90a2a00dbb28-manifests\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-frtvb\" (UID: \"a8211f09-b05e-415a-9831-90a2a00dbb28\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"
Jul 26 15:55:01.273349 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.273322    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8211f09-b05e-415a-9831-90a2a00dbb28-tmp\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-frtvb\" (UID: \"a8211f09-b05e-415a-9831-90a2a00dbb28\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"
Jul 26 15:55:01.273570 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.273552    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a8211f09-b05e-415a-9831-90a2a00dbb28-apiservice-cert\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-frtvb\" (UID: \"a8211f09-b05e-415a-9831-90a2a00dbb28\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"
Jul 26 15:55:01.273674 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.273659    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a8211f09-b05e-415a-9831-90a2a00dbb28-webhook-cert\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-frtvb\" (UID: \"a8211f09-b05e-415a-9831-90a2a00dbb28\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"
Jul 26 15:55:01.279208 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.279186    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9lms\" (UniqueName: \"kubernetes.io/projected/a8211f09-b05e-415a-9831-90a2a00dbb28-kube-api-access-t9lms\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-frtvb\" (UID: \"a8211f09-b05e-415a-9831-90a2a00dbb28\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"
Jul 26 15:55:01.417018 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.416995    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"
Jul 26 15:55:01.552749 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.552724    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"]
Jul 26 15:55:01.554739 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:55:01.554713    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8211f09_b05e_415a_9831_90a2a00dbb28.slice/crio-a73617d22e41105e4bc0f56b6bccbe8675faf9377ae24015c39eeb6f2f8176ad WatchSource:0}: Error finding container a73617d22e41105e4bc0f56b6bccbe8675faf9377ae24015c39eeb6f2f8176ad: Status 404 returned error can't find the container with id a73617d22e41105e4bc0f56b6bccbe8675faf9377ae24015c39eeb6f2f8176ad
Jul 26 15:55:01.724692 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:01.724591    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb" event={"ID":"a8211f09-b05e-415a-9831-90a2a00dbb28","Type":"ContainerStarted","Data":"a73617d22e41105e4bc0f56b6bccbe8675faf9377ae24015c39eeb6f2f8176ad"}
Jul 26 15:55:04.508054 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:04.508028    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 15:55:04.510354 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:04.508073    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 15:55:04.524793 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:04.524773    2556 kubelet.go:1648] "Image garbage collection succeeded"
Jul 26 15:55:04.741627 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:04.741595    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb" event={"ID":"a8211f09-b05e-415a-9831-90a2a00dbb28","Type":"ContainerStarted","Data":"a0e1860f08a53f8e43a4b090d9304332bbc03c8953abad6dd603211e172b094b"}
Jul 26 15:55:05.747194 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:05.747157    2556 generic.go:356] "Generic (PLEG): container finished" podID="a8211f09-b05e-415a-9831-90a2a00dbb28" containerID="a0e1860f08a53f8e43a4b090d9304332bbc03c8953abad6dd603211e172b094b" exitCode=0
Jul 26 15:55:05.747580 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:05.747240    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb" event={"ID":"a8211f09-b05e-415a-9831-90a2a00dbb28","Type":"ContainerDied","Data":"a0e1860f08a53f8e43a4b090d9304332bbc03c8953abad6dd603211e172b094b"}
Jul 26 15:55:05.747738 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:05.747721    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 15:55:06.753332 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:06.753291    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb" event={"ID":"a8211f09-b05e-415a-9831-90a2a00dbb28","Type":"ContainerStarted","Data":"6cb2d7efb09bba6cf786479d3e5ac49f22cdf59f05d75c420029052781f21527"}
Jul 26 15:55:06.753735 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:06.753430    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"
Jul 26 15:55:06.777986 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:06.777941    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb" podStartSLOduration=1.355518556 podStartE2EDuration="5.777926573s" totalImagesPullingTime="3.38825383s" totalInitContainerRuntime="1.034154187s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:55:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:55:06.776902537 +0000 UTC m=+302.995529597" watchObservedRunningTime="2026-07-26 15:55:06.777926573 +0000 UTC m=+302.996553622"
Jul 26 15:55:17.760769 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:17.760734    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-frtvb"
Jul 26 15:55:19.840518 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:19.840483    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf"]
Jul 26 15:55:19.854612 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:19.854591    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf"
Jul 26 15:55:19.857891 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:19.857836    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 26 15:55:19.857891 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:19.857860    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 26 15:55:19.857891 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:19.857888    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 26 15:55:19.858103 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:19.857864    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-2czlr\""
Jul 26 15:55:19.858103 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:19.857860    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 26 15:55:19.858103 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:19.857950    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 26 15:55:19.863126 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:19.863104    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf"]
Jul 26 15:55:19.910179 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:19.910156    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ecced7e1-e9ce-4521-a921-cc97ef311f63-metrics-cert\") pod \"lws-controller-manager-868c8c7ff4-qv5kf\" (UID: \"ecced7e1-e9ce-4521-a921-cc97ef311f63\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf"
Jul 26 15:55:19.910291 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:19.910200    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ecced7e1-e9ce-4521-a921-cc97ef311f63-manager-config\") pod \"lws-controller-manager-868c8c7ff4-qv5kf\" (UID: \"ecced7e1-e9ce-4521-a921-cc97ef311f63\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf"
Jul 26 15:55:19.910291 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:19.910265    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecced7e1-e9ce-4521-a921-cc97ef311f63-cert\") pod \"lws-controller-manager-868c8c7ff4-qv5kf\" (UID: \"ecced7e1-e9ce-4521-a921-cc97ef311f63\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf"
Jul 26 15:55:19.910381 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:19.910365    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhqhr\" (UniqueName: \"kubernetes.io/projected/ecced7e1-e9ce-4521-a921-cc97ef311f63-kube-api-access-lhqhr\") pod \"lws-controller-manager-868c8c7ff4-qv5kf\" (UID: \"ecced7e1-e9ce-4521-a921-cc97ef311f63\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf"
Jul 26 15:55:20.011505 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:20.011479    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhqhr\" (UniqueName: \"kubernetes.io/projected/ecced7e1-e9ce-4521-a921-cc97ef311f63-kube-api-access-lhqhr\") pod \"lws-controller-manager-868c8c7ff4-qv5kf\" (UID: \"ecced7e1-e9ce-4521-a921-cc97ef311f63\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf"
Jul 26 15:55:20.011616 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:20.011514    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ecced7e1-e9ce-4521-a921-cc97ef311f63-metrics-cert\") pod \"lws-controller-manager-868c8c7ff4-qv5kf\" (UID: \"ecced7e1-e9ce-4521-a921-cc97ef311f63\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf"
Jul 26 15:55:20.011616 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:20.011539    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ecced7e1-e9ce-4521-a921-cc97ef311f63-manager-config\") pod \"lws-controller-manager-868c8c7ff4-qv5kf\" (UID: \"ecced7e1-e9ce-4521-a921-cc97ef311f63\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf"
Jul 26 15:55:20.011616 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:20.011563    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecced7e1-e9ce-4521-a921-cc97ef311f63-cert\") pod \"lws-controller-manager-868c8c7ff4-qv5kf\" (UID: \"ecced7e1-e9ce-4521-a921-cc97ef311f63\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf"
Jul 26 15:55:20.012264 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:20.012247    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ecced7e1-e9ce-4521-a921-cc97ef311f63-manager-config\") pod \"lws-controller-manager-868c8c7ff4-qv5kf\" (UID: \"ecced7e1-e9ce-4521-a921-cc97ef311f63\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf"
Jul 26 15:55:20.013969 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:20.013950    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ecced7e1-e9ce-4521-a921-cc97ef311f63-metrics-cert\") pod \"lws-controller-manager-868c8c7ff4-qv5kf\" (UID: \"ecced7e1-e9ce-4521-a921-cc97ef311f63\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf"
Jul 26 15:55:20.014053 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:20.013966    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecced7e1-e9ce-4521-a921-cc97ef311f63-cert\") pod \"lws-controller-manager-868c8c7ff4-qv5kf\" (UID: \"ecced7e1-e9ce-4521-a921-cc97ef311f63\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf"
Jul 26 15:55:20.030739 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:20.030713    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhqhr\" (UniqueName: \"kubernetes.io/projected/ecced7e1-e9ce-4521-a921-cc97ef311f63-kube-api-access-lhqhr\") pod \"lws-controller-manager-868c8c7ff4-qv5kf\" (UID: \"ecced7e1-e9ce-4521-a921-cc97ef311f63\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf"
Jul 26 15:55:20.164647 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:20.164564    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf"
Jul 26 15:55:20.307954 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:20.307924    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf"]
Jul 26 15:55:20.310318 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:55:20.310287    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecced7e1_e9ce_4521_a921_cc97ef311f63.slice/crio-1580752ea65e26db9948e031393076c6284fb37166c7b26b71ec1fe64f86f914 WatchSource:0}: Error finding container 1580752ea65e26db9948e031393076c6284fb37166c7b26b71ec1fe64f86f914: Status 404 returned error can't find the container with id 1580752ea65e26db9948e031393076c6284fb37166c7b26b71ec1fe64f86f914
Jul 26 15:55:20.819710 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:20.819678    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf" event={"ID":"ecced7e1-e9ce-4521-a921-cc97ef311f63","Type":"ContainerStarted","Data":"1580752ea65e26db9948e031393076c6284fb37166c7b26b71ec1fe64f86f914"}
Jul 26 15:55:22.831066 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:22.831015    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf" event={"ID":"ecced7e1-e9ce-4521-a921-cc97ef311f63","Type":"ContainerStarted","Data":"b0ec14fe88a244fcb3085e85706530191d2a19151666e5ffe9985f515a74e114"}
Jul 26 15:55:22.831487 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:22.831131    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf"
Jul 26 15:55:22.848665 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:22.848600    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf" podStartSLOduration=1.865804567 podStartE2EDuration="3.848580264s" totalImagesPullingTime="1.982775697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:55:22.846784029 +0000 UTC m=+319.065411119" watchObservedRunningTime="2026-07-26 15:55:22.848580264 +0000 UTC m=+319.067207313"
Jul 26 15:55:33.838917 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:33.838877    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-qv5kf"
Jul 26 15:55:39.513360 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.513311    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"]
Jul 26 15:55:39.516925 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.516898    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.519479 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.519449    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 26 15:55:39.519479 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.519473    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 26 15:55:39.519702 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.519541    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 26 15:55:39.519702 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.519580    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5m5n8\""
Jul 26 15:55:39.528123 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.528098    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"]
Jul 26 15:55:39.657704 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.657674    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4e8dc36-8451-4433-a256-6f456b658e80-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.657812 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.657715    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4e8dc36-8451-4433-a256-6f456b658e80-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.657812 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.657769    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4e8dc36-8451-4433-a256-6f456b658e80-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.657812 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.657789    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4e8dc36-8451-4433-a256-6f456b658e80-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.657812 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.657808    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4e8dc36-8451-4433-a256-6f456b658e80-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.658025 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.657864    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4e8dc36-8451-4433-a256-6f456b658e80-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.658025 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.657887    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4e8dc36-8451-4433-a256-6f456b658e80-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.658025 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.657951    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkrcv\" (UniqueName: \"kubernetes.io/projected/e4e8dc36-8451-4433-a256-6f456b658e80-kube-api-access-rkrcv\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.658025 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.658000    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4e8dc36-8451-4433-a256-6f456b658e80-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.759130 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.759094    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4e8dc36-8451-4433-a256-6f456b658e80-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.759130 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.759130    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4e8dc36-8451-4433-a256-6f456b658e80-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.759316 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.759152    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4e8dc36-8451-4433-a256-6f456b658e80-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.759316 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.759182    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4e8dc36-8451-4433-a256-6f456b658e80-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.759316 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.759208    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4e8dc36-8451-4433-a256-6f456b658e80-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.759316 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.759243    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkrcv\" (UniqueName: \"kubernetes.io/projected/e4e8dc36-8451-4433-a256-6f456b658e80-kube-api-access-rkrcv\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.759316 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.759268    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4e8dc36-8451-4433-a256-6f456b658e80-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.759316 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.759310    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4e8dc36-8451-4433-a256-6f456b658e80-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.759562 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.759353    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4e8dc36-8451-4433-a256-6f456b658e80-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.759748 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.759703    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4e8dc36-8451-4433-a256-6f456b658e80-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.759748 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.759716    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4e8dc36-8451-4433-a256-6f456b658e80-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.759983 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.759953    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4e8dc36-8451-4433-a256-6f456b658e80-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.760040 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.759965    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4e8dc36-8451-4433-a256-6f456b658e80-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.760188 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.760162    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4e8dc36-8451-4433-a256-6f456b658e80-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.761889 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.761870    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4e8dc36-8451-4433-a256-6f456b658e80-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.761988 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.761943    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4e8dc36-8451-4433-a256-6f456b658e80-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.767321 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.767264    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4e8dc36-8451-4433-a256-6f456b658e80-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.767488 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.767465    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkrcv\" (UniqueName: \"kubernetes.io/projected/e4e8dc36-8451-4433-a256-6f456b658e80-kube-api-access-rkrcv\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ckltgv\" (UID: \"e4e8dc36-8451-4433-a256-6f456b658e80\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.828173 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.828151    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:39.964700 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:39.964675    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"]
Jul 26 15:55:39.966818 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:55:39.966788    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4e8dc36_8451_4433_a256_6f456b658e80.slice/crio-7533c29f51f5108cf485b0f7877e9511ae6be9bb2c086f7b76ac8d19c74a386f WatchSource:0}: Error finding container 7533c29f51f5108cf485b0f7877e9511ae6be9bb2c086f7b76ac8d19c74a386f: Status 404 returned error can't find the container with id 7533c29f51f5108cf485b0f7877e9511ae6be9bb2c086f7b76ac8d19c74a386f
Jul 26 15:55:40.929080 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:40.929042    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv" event={"ID":"e4e8dc36-8451-4433-a256-6f456b658e80","Type":"ContainerStarted","Data":"7533c29f51f5108cf485b0f7877e9511ae6be9bb2c086f7b76ac8d19c74a386f"}
Jul 26 15:55:42.923873 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:42.923820    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 15:55:42.924099 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:42.923912    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 15:55:42.924099 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:42.923947    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 15:55:43.945281 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:43.945240    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv" event={"ID":"e4e8dc36-8451-4433-a256-6f456b658e80","Type":"ContainerStarted","Data":"a6ee8505060e76f63b0de907c30b780b9898e5a6410aee32eaebadd1afa6de58"}
Jul 26 15:55:43.966522 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:43.966469    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv" podStartSLOduration=2.012142356 podStartE2EDuration="4.966454576s" totalImagesPullingTime="2.95431222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:55:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:55:43.96428618 +0000 UTC m=+340.182913224" watchObservedRunningTime="2026-07-26 15:55:43.966454576 +0000 UTC m=+340.185081625"
Jul 26 15:55:44.828735 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:44.828695    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:44.834380 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:44.834349    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:44.949809 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:44.949783    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:55:44.950594 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:55:44.950577    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ckltgv"
Jul 26 15:56:21.864454 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:21.864380    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8r9hl"]
Jul 26 15:56:21.874967 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:21.874939    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8r9hl"
Jul 26 15:56:21.875368 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:21.875324    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8r9hl"]
Jul 26 15:56:21.878001 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:21.877913    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 26 15:56:21.878001 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:21.877972    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-sncbs\""
Jul 26 15:56:21.878001 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:21.877978    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 26 15:56:21.971540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:21.971515    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l87db\" (UniqueName: \"kubernetes.io/projected/4e010080-3363-45a1-951f-476ecead4888-kube-api-access-l87db\") pod \"kuadrant-operator-catalog-8r9hl\" (UID: \"4e010080-3363-45a1-951f-476ecead4888\") " pod="kuadrant-system/kuadrant-operator-catalog-8r9hl"
Jul 26 15:56:22.071923 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:22.071893    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l87db\" (UniqueName: \"kubernetes.io/projected/4e010080-3363-45a1-951f-476ecead4888-kube-api-access-l87db\") pod \"kuadrant-operator-catalog-8r9hl\" (UID: \"4e010080-3363-45a1-951f-476ecead4888\") " pod="kuadrant-system/kuadrant-operator-catalog-8r9hl"
Jul 26 15:56:22.080128 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:22.080100    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l87db\" (UniqueName: \"kubernetes.io/projected/4e010080-3363-45a1-951f-476ecead4888-kube-api-access-l87db\") pod \"kuadrant-operator-catalog-8r9hl\" (UID: \"4e010080-3363-45a1-951f-476ecead4888\") " pod="kuadrant-system/kuadrant-operator-catalog-8r9hl"
Jul 26 15:56:22.187884 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:22.187866    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8r9hl"
Jul 26 15:56:22.229613 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:22.229586    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8r9hl"]
Jul 26 15:56:22.317719 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:22.317697    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8r9hl"]
Jul 26 15:56:22.319562 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:56:22.319531    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e010080_3363_45a1_951f_476ecead4888.slice/crio-5f9ac2a187263a90ad531ce9927dd7db82764bc6ea8d3c34c7323d42b57bbf09 WatchSource:0}: Error finding container 5f9ac2a187263a90ad531ce9927dd7db82764bc6ea8d3c34c7323d42b57bbf09: Status 404 returned error can't find the container with id 5f9ac2a187263a90ad531ce9927dd7db82764bc6ea8d3c34c7323d42b57bbf09
Jul 26 15:56:22.439811 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:22.439744    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r75wj"]
Jul 26 15:56:22.444562 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:22.444547    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r75wj"
Jul 26 15:56:22.451315 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:22.451291    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r75wj"]
Jul 26 15:56:22.476580 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:22.476558    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh7gt\" (UniqueName: \"kubernetes.io/projected/e1e789d4-33c2-41d5-9089-5cac9a911246-kube-api-access-kh7gt\") pod \"kuadrant-operator-catalog-r75wj\" (UID: \"e1e789d4-33c2-41d5-9089-5cac9a911246\") " pod="kuadrant-system/kuadrant-operator-catalog-r75wj"
Jul 26 15:56:22.577475 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:22.577452    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh7gt\" (UniqueName: \"kubernetes.io/projected/e1e789d4-33c2-41d5-9089-5cac9a911246-kube-api-access-kh7gt\") pod \"kuadrant-operator-catalog-r75wj\" (UID: \"e1e789d4-33c2-41d5-9089-5cac9a911246\") " pod="kuadrant-system/kuadrant-operator-catalog-r75wj"
Jul 26 15:56:22.587606 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:22.587580    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh7gt\" (UniqueName: \"kubernetes.io/projected/e1e789d4-33c2-41d5-9089-5cac9a911246-kube-api-access-kh7gt\") pod \"kuadrant-operator-catalog-r75wj\" (UID: \"e1e789d4-33c2-41d5-9089-5cac9a911246\") " pod="kuadrant-system/kuadrant-operator-catalog-r75wj"
Jul 26 15:56:22.754738 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:22.754680    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r75wj"
Jul 26 15:56:22.881252 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:22.881225    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r75wj"]
Jul 26 15:56:22.883458 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:56:22.883432    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1e789d4_33c2_41d5_9089_5cac9a911246.slice/crio-6d84c7f3099f70c02c9501dfd51bd1bc80172217b1088079fd79943e4da6a1fa WatchSource:0}: Error finding container 6d84c7f3099f70c02c9501dfd51bd1bc80172217b1088079fd79943e4da6a1fa: Status 404 returned error can't find the container with id 6d84c7f3099f70c02c9501dfd51bd1bc80172217b1088079fd79943e4da6a1fa
Jul 26 15:56:23.136872 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:23.136793    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8r9hl" event={"ID":"4e010080-3363-45a1-951f-476ecead4888","Type":"ContainerStarted","Data":"5f9ac2a187263a90ad531ce9927dd7db82764bc6ea8d3c34c7323d42b57bbf09"}
Jul 26 15:56:23.137976 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:23.137945    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r75wj" event={"ID":"e1e789d4-33c2-41d5-9089-5cac9a911246","Type":"ContainerStarted","Data":"6d84c7f3099f70c02c9501dfd51bd1bc80172217b1088079fd79943e4da6a1fa"}
Jul 26 15:56:25.149449 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:25.149411    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8r9hl" event={"ID":"4e010080-3363-45a1-951f-476ecead4888","Type":"ContainerStarted","Data":"d2ff7021b468f9879b0a6a2a01a52d04e26906f783dc6817e9dcf96a4e02ee83"}
Jul 26 15:56:25.149964 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:25.149460    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-8r9hl" podUID="4e010080-3363-45a1-951f-476ecead4888" containerName="registry-server" containerID="cri-o://d2ff7021b468f9879b0a6a2a01a52d04e26906f783dc6817e9dcf96a4e02ee83" gracePeriod=2
Jul 26 15:56:25.154515 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:25.154480    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r75wj" event={"ID":"e1e789d4-33c2-41d5-9089-5cac9a911246","Type":"ContainerStarted","Data":"730dff5d24ef9dfdde4c4750b6a66f09244a1770ed8bbed2f639f09192a745fa"}
Jul 26 15:56:25.165425 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:25.165383    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8r9hl" podStartSLOduration=2.237136307 podStartE2EDuration="4.165369368s" totalImagesPullingTime="1.928233061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:56:25.163505381 +0000 UTC m=+381.382132457" watchObservedRunningTime="2026-07-26 15:56:25.165369368 +0000 UTC m=+381.383996416"
Jul 26 15:56:25.178803 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:25.178743    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-r75wj" podStartSLOduration=1.813995848 podStartE2EDuration="3.178724633s" totalImagesPullingTime="1.364728785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:56:25.177371896 +0000 UTC m=+381.395998965" watchObservedRunningTime="2026-07-26 15:56:25.178724633 +0000 UTC m=+381.397351682"
Jul 26 15:56:25.408086 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:25.408023    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8r9hl"
Jul 26 15:56:25.503796 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:25.503760    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l87db\" (UniqueName: \"kubernetes.io/projected/4e010080-3363-45a1-951f-476ecead4888-kube-api-access-l87db\") pod \"4e010080-3363-45a1-951f-476ecead4888\" (UID: \"4e010080-3363-45a1-951f-476ecead4888\") "
Jul 26 15:56:25.505952 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:25.505920    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e010080-3363-45a1-951f-476ecead4888-kube-api-access-l87db" (OuterVolumeSpecName: "kube-api-access-l87db") pod "4e010080-3363-45a1-951f-476ecead4888" (UID: "4e010080-3363-45a1-951f-476ecead4888"). InnerVolumeSpecName "kube-api-access-l87db". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:56:25.604772 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:25.604741    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l87db\" (UniqueName: \"kubernetes.io/projected/4e010080-3363-45a1-951f-476ecead4888-kube-api-access-l87db\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:56:26.160853 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:26.160813    2556 generic.go:356] "Generic (PLEG): container finished" podID="4e010080-3363-45a1-951f-476ecead4888" containerID="d2ff7021b468f9879b0a6a2a01a52d04e26906f783dc6817e9dcf96a4e02ee83" exitCode=0
Jul 26 15:56:26.161241 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:26.160864    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8r9hl"
Jul 26 15:56:26.161241 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:26.160898    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8r9hl" event={"ID":"4e010080-3363-45a1-951f-476ecead4888","Type":"ContainerDied","Data":"d2ff7021b468f9879b0a6a2a01a52d04e26906f783dc6817e9dcf96a4e02ee83"}
Jul 26 15:56:26.161241 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:26.160954    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8r9hl" event={"ID":"4e010080-3363-45a1-951f-476ecead4888","Type":"ContainerDied","Data":"5f9ac2a187263a90ad531ce9927dd7db82764bc6ea8d3c34c7323d42b57bbf09"}
Jul 26 15:56:26.161241 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:26.160976    2556 scope.go:117] "RemoveContainer" containerID="d2ff7021b468f9879b0a6a2a01a52d04e26906f783dc6817e9dcf96a4e02ee83"
Jul 26 15:56:26.169724 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:26.169705    2556 scope.go:117] "RemoveContainer" containerID="d2ff7021b468f9879b0a6a2a01a52d04e26906f783dc6817e9dcf96a4e02ee83"
Jul 26 15:56:26.169982 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:56:26.169964    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2ff7021b468f9879b0a6a2a01a52d04e26906f783dc6817e9dcf96a4e02ee83\": container with ID starting with d2ff7021b468f9879b0a6a2a01a52d04e26906f783dc6817e9dcf96a4e02ee83 not found: ID does not exist" containerID="d2ff7021b468f9879b0a6a2a01a52d04e26906f783dc6817e9dcf96a4e02ee83"
Jul 26 15:56:26.170046 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:26.169992    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2ff7021b468f9879b0a6a2a01a52d04e26906f783dc6817e9dcf96a4e02ee83"} err="failed to get container status \"d2ff7021b468f9879b0a6a2a01a52d04e26906f783dc6817e9dcf96a4e02ee83\": rpc error: code = NotFound desc = could not find container \"d2ff7021b468f9879b0a6a2a01a52d04e26906f783dc6817e9dcf96a4e02ee83\": container with ID starting with d2ff7021b468f9879b0a6a2a01a52d04e26906f783dc6817e9dcf96a4e02ee83 not found: ID does not exist"
Jul 26 15:56:26.181668 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:26.181643    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8r9hl"]
Jul 26 15:56:26.185201 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:26.185173    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8r9hl"]
Jul 26 15:56:26.214699 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:26.214678    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e010080-3363-45a1-951f-476ecead4888" path="/var/lib/kubelet/pods/4e010080-3363-45a1-951f-476ecead4888/volumes"
Jul 26 15:56:32.754827 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:32.754792    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-r75wj"
Jul 26 15:56:32.755309 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:32.754868    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-r75wj"
Jul 26 15:56:32.777335 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:32.777300    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-r75wj"
Jul 26 15:56:33.214978 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:33.214954    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-r75wj"
Jul 26 15:56:41.272814 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.272781    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k"]
Jul 26 15:56:41.273164 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.273096    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e010080-3363-45a1-951f-476ecead4888" containerName="registry-server"
Jul 26 15:56:41.273164 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.273107    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e010080-3363-45a1-951f-476ecead4888" containerName="registry-server"
Jul 26 15:56:41.273238 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.273170    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e010080-3363-45a1-951f-476ecead4888" containerName="registry-server"
Jul 26 15:56:41.276273 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.276257    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k"
Jul 26 15:56:41.278823 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.278802    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bfkp9\""
Jul 26 15:56:41.284445 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.284422    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k"]
Jul 26 15:56:41.328142 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.328120    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04ab4d29-0afa-40dc-8357-036fa7546c3d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k\" (UID: \"04ab4d29-0afa-40dc-8357-036fa7546c3d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k"
Jul 26 15:56:41.328247 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.328160    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04ab4d29-0afa-40dc-8357-036fa7546c3d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k\" (UID: \"04ab4d29-0afa-40dc-8357-036fa7546c3d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k"
Jul 26 15:56:41.328247 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.328202    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6b5w\" (UniqueName: \"kubernetes.io/projected/04ab4d29-0afa-40dc-8357-036fa7546c3d-kube-api-access-j6b5w\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k\" (UID: \"04ab4d29-0afa-40dc-8357-036fa7546c3d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k"
Jul 26 15:56:41.377959 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.377934    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq"]
Jul 26 15:56:41.381263 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.381248    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq"
Jul 26 15:56:41.390427 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.390406    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq"]
Jul 26 15:56:41.429452 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.429431    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6b5w\" (UniqueName: \"kubernetes.io/projected/04ab4d29-0afa-40dc-8357-036fa7546c3d-kube-api-access-j6b5w\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k\" (UID: \"04ab4d29-0afa-40dc-8357-036fa7546c3d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k"
Jul 26 15:56:41.429550 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.429490    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04ab4d29-0afa-40dc-8357-036fa7546c3d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k\" (UID: \"04ab4d29-0afa-40dc-8357-036fa7546c3d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k"
Jul 26 15:56:41.429550 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.429543    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04ab4d29-0afa-40dc-8357-036fa7546c3d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k\" (UID: \"04ab4d29-0afa-40dc-8357-036fa7546c3d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k"
Jul 26 15:56:41.429697 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.429573    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjpc8\" (UniqueName: \"kubernetes.io/projected/b59633d3-22cc-40b2-8c32-fc65e98b3117-kube-api-access-qjpc8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq\" (UID: \"b59633d3-22cc-40b2-8c32-fc65e98b3117\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq"
Jul 26 15:56:41.429697 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.429613    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b59633d3-22cc-40b2-8c32-fc65e98b3117-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq\" (UID: \"b59633d3-22cc-40b2-8c32-fc65e98b3117\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq"
Jul 26 15:56:41.429697 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.429659    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b59633d3-22cc-40b2-8c32-fc65e98b3117-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq\" (UID: \"b59633d3-22cc-40b2-8c32-fc65e98b3117\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq"
Jul 26 15:56:41.429813 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.429793    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04ab4d29-0afa-40dc-8357-036fa7546c3d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k\" (UID: \"04ab4d29-0afa-40dc-8357-036fa7546c3d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k"
Jul 26 15:56:41.429878 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.429862    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04ab4d29-0afa-40dc-8357-036fa7546c3d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k\" (UID: \"04ab4d29-0afa-40dc-8357-036fa7546c3d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k"
Jul 26 15:56:41.437228 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.437196    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6b5w\" (UniqueName: \"kubernetes.io/projected/04ab4d29-0afa-40dc-8357-036fa7546c3d-kube-api-access-j6b5w\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k\" (UID: \"04ab4d29-0afa-40dc-8357-036fa7546c3d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k"
Jul 26 15:56:41.530150 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.530091    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjpc8\" (UniqueName: \"kubernetes.io/projected/b59633d3-22cc-40b2-8c32-fc65e98b3117-kube-api-access-qjpc8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq\" (UID: \"b59633d3-22cc-40b2-8c32-fc65e98b3117\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq"
Jul 26 15:56:41.530150 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.530123    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b59633d3-22cc-40b2-8c32-fc65e98b3117-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq\" (UID: \"b59633d3-22cc-40b2-8c32-fc65e98b3117\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq"
Jul 26 15:56:41.530293 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.530141    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b59633d3-22cc-40b2-8c32-fc65e98b3117-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq\" (UID: \"b59633d3-22cc-40b2-8c32-fc65e98b3117\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq"
Jul 26 15:56:41.530517 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.530497    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b59633d3-22cc-40b2-8c32-fc65e98b3117-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq\" (UID: \"b59633d3-22cc-40b2-8c32-fc65e98b3117\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq"
Jul 26 15:56:41.530555 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.530516    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b59633d3-22cc-40b2-8c32-fc65e98b3117-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq\" (UID: \"b59633d3-22cc-40b2-8c32-fc65e98b3117\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq"
Jul 26 15:56:41.537811 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.537790    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjpc8\" (UniqueName: \"kubernetes.io/projected/b59633d3-22cc-40b2-8c32-fc65e98b3117-kube-api-access-qjpc8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq\" (UID: \"b59633d3-22cc-40b2-8c32-fc65e98b3117\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq"
Jul 26 15:56:41.586297 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.586277    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k"
Jul 26 15:56:41.677247 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.677216    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx"]
Jul 26 15:56:41.682764 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.682738    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx"
Jul 26 15:56:41.688805 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.688689    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx"]
Jul 26 15:56:41.689968 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.689943    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq"
Jul 26 15:56:41.717009 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.716984    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k"]
Jul 26 15:56:41.719804 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:56:41.719778    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04ab4d29_0afa_40dc_8357_036fa7546c3d.slice/crio-555d659be32fc0c99b6ab2f26404062acd8f1b4213366ab9cf0d94cae7a7cc1f WatchSource:0}: Error finding container 555d659be32fc0c99b6ab2f26404062acd8f1b4213366ab9cf0d94cae7a7cc1f: Status 404 returned error can't find the container with id 555d659be32fc0c99b6ab2f26404062acd8f1b4213366ab9cf0d94cae7a7cc1f
Jul 26 15:56:41.731331 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.731306    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6872661b-0123-4227-be44-9d2ed01a38e1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx\" (UID: \"6872661b-0123-4227-be44-9d2ed01a38e1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx"
Jul 26 15:56:41.731397 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.731349    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6872661b-0123-4227-be44-9d2ed01a38e1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx\" (UID: \"6872661b-0123-4227-be44-9d2ed01a38e1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx"
Jul 26 15:56:41.731457 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.731432    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df2b8\" (UniqueName: \"kubernetes.io/projected/6872661b-0123-4227-be44-9d2ed01a38e1-kube-api-access-df2b8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx\" (UID: \"6872661b-0123-4227-be44-9d2ed01a38e1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx"
Jul 26 15:56:41.832366 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.832336    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6872661b-0123-4227-be44-9d2ed01a38e1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx\" (UID: \"6872661b-0123-4227-be44-9d2ed01a38e1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx"
Jul 26 15:56:41.832536 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.832381    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6872661b-0123-4227-be44-9d2ed01a38e1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx\" (UID: \"6872661b-0123-4227-be44-9d2ed01a38e1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx"
Jul 26 15:56:41.832536 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.832444    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df2b8\" (UniqueName: \"kubernetes.io/projected/6872661b-0123-4227-be44-9d2ed01a38e1-kube-api-access-df2b8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx\" (UID: \"6872661b-0123-4227-be44-9d2ed01a38e1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx"
Jul 26 15:56:41.832764 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.832738    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6872661b-0123-4227-be44-9d2ed01a38e1-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx\" (UID: \"6872661b-0123-4227-be44-9d2ed01a38e1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx"
Jul 26 15:56:41.832811 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.832782    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6872661b-0123-4227-be44-9d2ed01a38e1-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx\" (UID: \"6872661b-0123-4227-be44-9d2ed01a38e1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx"
Jul 26 15:56:41.843159 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.843137    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq"]
Jul 26 15:56:41.843536 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.843519    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df2b8\" (UniqueName: \"kubernetes.io/projected/6872661b-0123-4227-be44-9d2ed01a38e1-kube-api-access-df2b8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx\" (UID: \"6872661b-0123-4227-be44-9d2ed01a38e1\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx"
Jul 26 15:56:41.845278 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:56:41.845250    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb59633d3_22cc_40b2_8c32_fc65e98b3117.slice/crio-cc8cc0f40061c4c3f33196c18246588a4276761632287e5e41853ef4f0bee00a WatchSource:0}: Error finding container cc8cc0f40061c4c3f33196c18246588a4276761632287e5e41853ef4f0bee00a: Status 404 returned error can't find the container with id cc8cc0f40061c4c3f33196c18246588a4276761632287e5e41853ef4f0bee00a
Jul 26 15:56:41.995400 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:41.995366    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx"
Jul 26 15:56:42.073985 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.073958    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2"]
Jul 26 15:56:42.079178 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.079149    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2"
Jul 26 15:56:42.085622 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.085580    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2"]
Jul 26 15:56:42.126686 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.126663    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx"]
Jul 26 15:56:42.128304 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:56:42.128278    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6872661b_0123_4227_be44_9d2ed01a38e1.slice/crio-a4fd14c02517fe98b941f34f082e271488825900769b93ecf10eeead62dd8071 WatchSource:0}: Error finding container a4fd14c02517fe98b941f34f082e271488825900769b93ecf10eeead62dd8071: Status 404 returned error can't find the container with id a4fd14c02517fe98b941f34f082e271488825900769b93ecf10eeead62dd8071
Jul 26 15:56:42.135202 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.135179    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c098811-9347-4ed3-a358-71c4d0a897aa-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2\" (UID: \"4c098811-9347-4ed3-a358-71c4d0a897aa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2"
Jul 26 15:56:42.135295 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.135217    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h4hr\" (UniqueName: \"kubernetes.io/projected/4c098811-9347-4ed3-a358-71c4d0a897aa-kube-api-access-6h4hr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2\" (UID: \"4c098811-9347-4ed3-a358-71c4d0a897aa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2"
Jul 26 15:56:42.135295 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.135242    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c098811-9347-4ed3-a358-71c4d0a897aa-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2\" (UID: \"4c098811-9347-4ed3-a358-71c4d0a897aa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2"
Jul 26 15:56:42.235755 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.235725    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c098811-9347-4ed3-a358-71c4d0a897aa-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2\" (UID: \"4c098811-9347-4ed3-a358-71c4d0a897aa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2"
Jul 26 15:56:42.235854 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.235824    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c098811-9347-4ed3-a358-71c4d0a897aa-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2\" (UID: \"4c098811-9347-4ed3-a358-71c4d0a897aa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2"
Jul 26 15:56:42.235895 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.235868    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h4hr\" (UniqueName: \"kubernetes.io/projected/4c098811-9347-4ed3-a358-71c4d0a897aa-kube-api-access-6h4hr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2\" (UID: \"4c098811-9347-4ed3-a358-71c4d0a897aa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2"
Jul 26 15:56:42.236161 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.236137    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c098811-9347-4ed3-a358-71c4d0a897aa-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2\" (UID: \"4c098811-9347-4ed3-a358-71c4d0a897aa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2"
Jul 26 15:56:42.236226 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.236168    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c098811-9347-4ed3-a358-71c4d0a897aa-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2\" (UID: \"4c098811-9347-4ed3-a358-71c4d0a897aa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2"
Jul 26 15:56:42.236955 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.236929    2556 generic.go:356] "Generic (PLEG): container finished" podID="b59633d3-22cc-40b2-8c32-fc65e98b3117" containerID="36c729aa9f8176b2bdac4128dc9fc9819885dcc232b3766c1caed5173eb00c8e" exitCode=0
Jul 26 15:56:42.237025 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.237006    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq" event={"ID":"b59633d3-22cc-40b2-8c32-fc65e98b3117","Type":"ContainerDied","Data":"36c729aa9f8176b2bdac4128dc9fc9819885dcc232b3766c1caed5173eb00c8e"}
Jul 26 15:56:42.237075 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.237060    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq" event={"ID":"b59633d3-22cc-40b2-8c32-fc65e98b3117","Type":"ContainerStarted","Data":"cc8cc0f40061c4c3f33196c18246588a4276761632287e5e41853ef4f0bee00a"}
Jul 26 15:56:42.238541 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.238518    2556 generic.go:356] "Generic (PLEG): container finished" podID="04ab4d29-0afa-40dc-8357-036fa7546c3d" containerID="c14355d965819bd8d406118e63d3364035fc34639b771f0f0deb5ae4c87bb4d6" exitCode=0
Jul 26 15:56:42.238625 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.238604    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k" event={"ID":"04ab4d29-0afa-40dc-8357-036fa7546c3d","Type":"ContainerDied","Data":"c14355d965819bd8d406118e63d3364035fc34639b771f0f0deb5ae4c87bb4d6"}
Jul 26 15:56:42.238720 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.238666    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k" event={"ID":"04ab4d29-0afa-40dc-8357-036fa7546c3d","Type":"ContainerStarted","Data":"555d659be32fc0c99b6ab2f26404062acd8f1b4213366ab9cf0d94cae7a7cc1f"}
Jul 26 15:56:42.240146 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.240031    2556 generic.go:356] "Generic (PLEG): container finished" podID="6872661b-0123-4227-be44-9d2ed01a38e1" containerID="d395b0d7b40267f228ea8fb7b6fee8fc6e980da41a95dd18bb938780fb93cdad" exitCode=0
Jul 26 15:56:42.240146 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.240082    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx" event={"ID":"6872661b-0123-4227-be44-9d2ed01a38e1","Type":"ContainerDied","Data":"d395b0d7b40267f228ea8fb7b6fee8fc6e980da41a95dd18bb938780fb93cdad"}
Jul 26 15:56:42.240146 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.240137    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx" event={"ID":"6872661b-0123-4227-be44-9d2ed01a38e1","Type":"ContainerStarted","Data":"a4fd14c02517fe98b941f34f082e271488825900769b93ecf10eeead62dd8071"}
Jul 26 15:56:42.246997 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.246979    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h4hr\" (UniqueName: \"kubernetes.io/projected/4c098811-9347-4ed3-a358-71c4d0a897aa-kube-api-access-6h4hr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2\" (UID: \"4c098811-9347-4ed3-a358-71c4d0a897aa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2"
Jul 26 15:56:42.391923 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.391868    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2"
Jul 26 15:56:42.515387 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:42.515361    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2"]
Jul 26 15:56:42.516299 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:56:42.516272    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c098811_9347_4ed3_a358_71c4d0a897aa.slice/crio-c88113c601ddc1924875eab23c6a52c6666308ea103f166c5bbc969b2039f2e7 WatchSource:0}: Error finding container c88113c601ddc1924875eab23c6a52c6666308ea103f166c5bbc969b2039f2e7: Status 404 returned error can't find the container with id c88113c601ddc1924875eab23c6a52c6666308ea103f166c5bbc969b2039f2e7
Jul 26 15:56:43.249269 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:43.249240    2556 generic.go:356] "Generic (PLEG): container finished" podID="4c098811-9347-4ed3-a358-71c4d0a897aa" containerID="0eb2410f9d884fb616a0cb723167d365d020f2c852fe7b95be91ac46268e12a9" exitCode=0
Jul 26 15:56:43.249377 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:43.249318    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2" event={"ID":"4c098811-9347-4ed3-a358-71c4d0a897aa","Type":"ContainerDied","Data":"0eb2410f9d884fb616a0cb723167d365d020f2c852fe7b95be91ac46268e12a9"}
Jul 26 15:56:43.249439 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:43.249376    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2" event={"ID":"4c098811-9347-4ed3-a358-71c4d0a897aa","Type":"ContainerStarted","Data":"c88113c601ddc1924875eab23c6a52c6666308ea103f166c5bbc969b2039f2e7"}
Jul 26 15:56:44.255061 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:44.254978    2556 generic.go:356] "Generic (PLEG): container finished" podID="4c098811-9347-4ed3-a358-71c4d0a897aa" containerID="eddeba020a5445599f1f332b15a0b4edf1aac6317198336687e8cdd1c4baf688" exitCode=0
Jul 26 15:56:44.255486 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:44.255052    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2" event={"ID":"4c098811-9347-4ed3-a358-71c4d0a897aa","Type":"ContainerDied","Data":"eddeba020a5445599f1f332b15a0b4edf1aac6317198336687e8cdd1c4baf688"}
Jul 26 15:56:44.256882 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:44.256862    2556 generic.go:356] "Generic (PLEG): container finished" podID="b59633d3-22cc-40b2-8c32-fc65e98b3117" containerID="45d937a2d9f1041e47952392c8e066fae76c3eeee0be067687aafb1aa8bf8057" exitCode=0
Jul 26 15:56:44.256965 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:44.256941    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq" event={"ID":"b59633d3-22cc-40b2-8c32-fc65e98b3117","Type":"ContainerDied","Data":"45d937a2d9f1041e47952392c8e066fae76c3eeee0be067687aafb1aa8bf8057"}
Jul 26 15:56:44.258695 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:44.258673    2556 generic.go:356] "Generic (PLEG): container finished" podID="04ab4d29-0afa-40dc-8357-036fa7546c3d" containerID="329395dcc0a23c7588b3878c29e103242d3da366cf810dd8cd21eb93ed8827d9" exitCode=0
Jul 26 15:56:44.258785 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:44.258693    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k" event={"ID":"04ab4d29-0afa-40dc-8357-036fa7546c3d","Type":"ContainerDied","Data":"329395dcc0a23c7588b3878c29e103242d3da366cf810dd8cd21eb93ed8827d9"}
Jul 26 15:56:44.260675 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:44.260651    2556 generic.go:356] "Generic (PLEG): container finished" podID="6872661b-0123-4227-be44-9d2ed01a38e1" containerID="67389b626e92bd2483dd482bec309436ffd4760ba976f7ca7f6f59e2b38541ac" exitCode=0
Jul 26 15:56:44.260775 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:44.260678    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx" event={"ID":"6872661b-0123-4227-be44-9d2ed01a38e1","Type":"ContainerDied","Data":"67389b626e92bd2483dd482bec309436ffd4760ba976f7ca7f6f59e2b38541ac"}
Jul 26 15:56:45.267667 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:45.267602    2556 generic.go:356] "Generic (PLEG): container finished" podID="b59633d3-22cc-40b2-8c32-fc65e98b3117" containerID="c548571f31960bb97ae35c825db4d6d5da7f3e52774f912e095cb63234037ba1" exitCode=0
Jul 26 15:56:45.268109 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:45.267666    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq" event={"ID":"b59633d3-22cc-40b2-8c32-fc65e98b3117","Type":"ContainerDied","Data":"c548571f31960bb97ae35c825db4d6d5da7f3e52774f912e095cb63234037ba1"}
Jul 26 15:56:45.269765 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:45.269746    2556 generic.go:356] "Generic (PLEG): container finished" podID="04ab4d29-0afa-40dc-8357-036fa7546c3d" containerID="70d1c0d44ee1d224ff1afbd0d7c45e5f3c5bccab239cc9dfb05e9bbd49ac3722" exitCode=0
Jul 26 15:56:45.269894 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:45.269794    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k" event={"ID":"04ab4d29-0afa-40dc-8357-036fa7546c3d","Type":"ContainerDied","Data":"70d1c0d44ee1d224ff1afbd0d7c45e5f3c5bccab239cc9dfb05e9bbd49ac3722"}
Jul 26 15:56:45.271845 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:45.271827    2556 generic.go:356] "Generic (PLEG): container finished" podID="6872661b-0123-4227-be44-9d2ed01a38e1" containerID="038c2ce7b48f7b9d7d74313c083ba570f9432489a3d82458dc848fb6fa06bca8" exitCode=0
Jul 26 15:56:45.271932 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:45.271899    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx" event={"ID":"6872661b-0123-4227-be44-9d2ed01a38e1","Type":"ContainerDied","Data":"038c2ce7b48f7b9d7d74313c083ba570f9432489a3d82458dc848fb6fa06bca8"}
Jul 26 15:56:45.273791 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:45.273769    2556 generic.go:356] "Generic (PLEG): container finished" podID="4c098811-9347-4ed3-a358-71c4d0a897aa" containerID="d6862ae90e6abba707a14ac8bc0ed404ec77c6ab483d2d1a343a550c0532ccf2" exitCode=0
Jul 26 15:56:45.273880 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:45.273807    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2" event={"ID":"4c098811-9347-4ed3-a358-71c4d0a897aa","Type":"ContainerDied","Data":"d6862ae90e6abba707a14ac8bc0ed404ec77c6ab483d2d1a343a550c0532ccf2"}
Jul 26 15:56:46.418978 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.418951    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k"
Jul 26 15:56:46.462553 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.462528    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2"
Jul 26 15:56:46.465476 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.465455    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx"
Jul 26 15:56:46.472075 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.472054    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04ab4d29-0afa-40dc-8357-036fa7546c3d-util\") pod \"04ab4d29-0afa-40dc-8357-036fa7546c3d\" (UID: \"04ab4d29-0afa-40dc-8357-036fa7546c3d\") "
Jul 26 15:56:46.472187 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.472096    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04ab4d29-0afa-40dc-8357-036fa7546c3d-bundle\") pod \"04ab4d29-0afa-40dc-8357-036fa7546c3d\" (UID: \"04ab4d29-0afa-40dc-8357-036fa7546c3d\") "
Jul 26 15:56:46.472241 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.472188    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6b5w\" (UniqueName: \"kubernetes.io/projected/04ab4d29-0afa-40dc-8357-036fa7546c3d-kube-api-access-j6b5w\") pod \"04ab4d29-0afa-40dc-8357-036fa7546c3d\" (UID: \"04ab4d29-0afa-40dc-8357-036fa7546c3d\") "
Jul 26 15:56:46.472718 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.472698    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04ab4d29-0afa-40dc-8357-036fa7546c3d-bundle" (OuterVolumeSpecName: "bundle") pod "04ab4d29-0afa-40dc-8357-036fa7546c3d" (UID: "04ab4d29-0afa-40dc-8357-036fa7546c3d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:56:46.474258 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.474228    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04ab4d29-0afa-40dc-8357-036fa7546c3d-kube-api-access-j6b5w" (OuterVolumeSpecName: "kube-api-access-j6b5w") pod "04ab4d29-0afa-40dc-8357-036fa7546c3d" (UID: "04ab4d29-0afa-40dc-8357-036fa7546c3d"). InnerVolumeSpecName "kube-api-access-j6b5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:56:46.478020 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.477994    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04ab4d29-0afa-40dc-8357-036fa7546c3d-util" (OuterVolumeSpecName: "util") pod "04ab4d29-0afa-40dc-8357-036fa7546c3d" (UID: "04ab4d29-0afa-40dc-8357-036fa7546c3d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:56:46.488536 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.488513    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq"
Jul 26 15:56:46.573325 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.573240    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c098811-9347-4ed3-a358-71c4d0a897aa-util\") pod \"4c098811-9347-4ed3-a358-71c4d0a897aa\" (UID: \"4c098811-9347-4ed3-a358-71c4d0a897aa\") "
Jul 26 15:56:46.573325 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.573305    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjpc8\" (UniqueName: \"kubernetes.io/projected/b59633d3-22cc-40b2-8c32-fc65e98b3117-kube-api-access-qjpc8\") pod \"b59633d3-22cc-40b2-8c32-fc65e98b3117\" (UID: \"b59633d3-22cc-40b2-8c32-fc65e98b3117\") "
Jul 26 15:56:46.573325 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.573324    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6h4hr\" (UniqueName: \"kubernetes.io/projected/4c098811-9347-4ed3-a358-71c4d0a897aa-kube-api-access-6h4hr\") pod \"4c098811-9347-4ed3-a358-71c4d0a897aa\" (UID: \"4c098811-9347-4ed3-a358-71c4d0a897aa\") "
Jul 26 15:56:46.573586 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.573354    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6872661b-0123-4227-be44-9d2ed01a38e1-util\") pod \"6872661b-0123-4227-be44-9d2ed01a38e1\" (UID: \"6872661b-0123-4227-be44-9d2ed01a38e1\") "
Jul 26 15:56:46.573586 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.573373    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b59633d3-22cc-40b2-8c32-fc65e98b3117-bundle\") pod \"b59633d3-22cc-40b2-8c32-fc65e98b3117\" (UID: \"b59633d3-22cc-40b2-8c32-fc65e98b3117\") "
Jul 26 15:56:46.573586 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.573392    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c098811-9347-4ed3-a358-71c4d0a897aa-bundle\") pod \"4c098811-9347-4ed3-a358-71c4d0a897aa\" (UID: \"4c098811-9347-4ed3-a358-71c4d0a897aa\") "
Jul 26 15:56:46.573586 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.573430    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b59633d3-22cc-40b2-8c32-fc65e98b3117-util\") pod \"b59633d3-22cc-40b2-8c32-fc65e98b3117\" (UID: \"b59633d3-22cc-40b2-8c32-fc65e98b3117\") "
Jul 26 15:56:46.573586 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.573453    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6872661b-0123-4227-be44-9d2ed01a38e1-bundle\") pod \"6872661b-0123-4227-be44-9d2ed01a38e1\" (UID: \"6872661b-0123-4227-be44-9d2ed01a38e1\") "
Jul 26 15:56:46.573586 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.573558    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df2b8\" (UniqueName: \"kubernetes.io/projected/6872661b-0123-4227-be44-9d2ed01a38e1-kube-api-access-df2b8\") pod \"6872661b-0123-4227-be44-9d2ed01a38e1\" (UID: \"6872661b-0123-4227-be44-9d2ed01a38e1\") "
Jul 26 15:56:46.573906 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.573844    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6b5w\" (UniqueName: \"kubernetes.io/projected/04ab4d29-0afa-40dc-8357-036fa7546c3d-kube-api-access-j6b5w\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:56:46.573906 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.573870    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/04ab4d29-0afa-40dc-8357-036fa7546c3d-util\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:56:46.573906 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.573885    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/04ab4d29-0afa-40dc-8357-036fa7546c3d-bundle\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:56:46.574047 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.574002    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c098811-9347-4ed3-a358-71c4d0a897aa-bundle" (OuterVolumeSpecName: "bundle") pod "4c098811-9347-4ed3-a358-71c4d0a897aa" (UID: "4c098811-9347-4ed3-a358-71c4d0a897aa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:56:46.574329 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.574297    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b59633d3-22cc-40b2-8c32-fc65e98b3117-bundle" (OuterVolumeSpecName: "bundle") pod "b59633d3-22cc-40b2-8c32-fc65e98b3117" (UID: "b59633d3-22cc-40b2-8c32-fc65e98b3117"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:56:46.574726 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.574688    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6872661b-0123-4227-be44-9d2ed01a38e1-bundle" (OuterVolumeSpecName: "bundle") pod "6872661b-0123-4227-be44-9d2ed01a38e1" (UID: "6872661b-0123-4227-be44-9d2ed01a38e1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:56:46.575856 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.575829    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b59633d3-22cc-40b2-8c32-fc65e98b3117-kube-api-access-qjpc8" (OuterVolumeSpecName: "kube-api-access-qjpc8") pod "b59633d3-22cc-40b2-8c32-fc65e98b3117" (UID: "b59633d3-22cc-40b2-8c32-fc65e98b3117"). InnerVolumeSpecName "kube-api-access-qjpc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:56:46.575856 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.575834    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c098811-9347-4ed3-a358-71c4d0a897aa-kube-api-access-6h4hr" (OuterVolumeSpecName: "kube-api-access-6h4hr") pod "4c098811-9347-4ed3-a358-71c4d0a897aa" (UID: "4c098811-9347-4ed3-a358-71c4d0a897aa"). InnerVolumeSpecName "kube-api-access-6h4hr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:56:46.576126 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.576100    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6872661b-0123-4227-be44-9d2ed01a38e1-kube-api-access-df2b8" (OuterVolumeSpecName: "kube-api-access-df2b8") pod "6872661b-0123-4227-be44-9d2ed01a38e1" (UID: "6872661b-0123-4227-be44-9d2ed01a38e1"). InnerVolumeSpecName "kube-api-access-df2b8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:56:46.579747 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.579722    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c098811-9347-4ed3-a358-71c4d0a897aa-util" (OuterVolumeSpecName: "util") pod "4c098811-9347-4ed3-a358-71c4d0a897aa" (UID: "4c098811-9347-4ed3-a358-71c4d0a897aa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:56:46.581838 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.581810    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b59633d3-22cc-40b2-8c32-fc65e98b3117-util" (OuterVolumeSpecName: "util") pod "b59633d3-22cc-40b2-8c32-fc65e98b3117" (UID: "b59633d3-22cc-40b2-8c32-fc65e98b3117"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:56:46.582341 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.582325    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6872661b-0123-4227-be44-9d2ed01a38e1-util" (OuterVolumeSpecName: "util") pod "6872661b-0123-4227-be44-9d2ed01a38e1" (UID: "6872661b-0123-4227-be44-9d2ed01a38e1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:56:46.675191 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.675149    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjpc8\" (UniqueName: \"kubernetes.io/projected/b59633d3-22cc-40b2-8c32-fc65e98b3117-kube-api-access-qjpc8\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:56:46.675191 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.675185    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h4hr\" (UniqueName: \"kubernetes.io/projected/4c098811-9347-4ed3-a358-71c4d0a897aa-kube-api-access-6h4hr\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:56:46.675191 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.675195    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6872661b-0123-4227-be44-9d2ed01a38e1-util\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:56:46.675191 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.675203    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b59633d3-22cc-40b2-8c32-fc65e98b3117-bundle\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:56:46.675445 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.675212    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c098811-9347-4ed3-a358-71c4d0a897aa-bundle\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:56:46.675445 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.675219    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b59633d3-22cc-40b2-8c32-fc65e98b3117-util\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:56:46.675445 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.675226    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6872661b-0123-4227-be44-9d2ed01a38e1-bundle\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:56:46.675445 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.675233    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df2b8\" (UniqueName: \"kubernetes.io/projected/6872661b-0123-4227-be44-9d2ed01a38e1-kube-api-access-df2b8\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:56:46.675445 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:46.675241    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c098811-9347-4ed3-a358-71c4d0a897aa-util\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:56:47.286087 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:47.286057    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx"
Jul 26 15:56:47.286243 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:47.286093    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx" event={"ID":"6872661b-0123-4227-be44-9d2ed01a38e1","Type":"ContainerDied","Data":"a4fd14c02517fe98b941f34f082e271488825900769b93ecf10eeead62dd8071"}
Jul 26 15:56:47.286243 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:47.286151    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4fd14c02517fe98b941f34f082e271488825900769b93ecf10eeead62dd8071"
Jul 26 15:56:47.287929 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:47.287913    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2"
Jul 26 15:56:47.288055 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:47.287938    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2" event={"ID":"4c098811-9347-4ed3-a358-71c4d0a897aa","Type":"ContainerDied","Data":"c88113c601ddc1924875eab23c6a52c6666308ea103f166c5bbc969b2039f2e7"}
Jul 26 15:56:47.288055 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:47.287972    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c88113c601ddc1924875eab23c6a52c6666308ea103f166c5bbc969b2039f2e7"
Jul 26 15:56:47.289673 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:47.289658    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq"
Jul 26 15:56:47.289673 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:47.289661    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq" event={"ID":"b59633d3-22cc-40b2-8c32-fc65e98b3117","Type":"ContainerDied","Data":"cc8cc0f40061c4c3f33196c18246588a4276761632287e5e41853ef4f0bee00a"}
Jul 26 15:56:47.289830 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:47.289697    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc8cc0f40061c4c3f33196c18246588a4276761632287e5e41853ef4f0bee00a"
Jul 26 15:56:47.291696 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:47.291669    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k" event={"ID":"04ab4d29-0afa-40dc-8357-036fa7546c3d","Type":"ContainerDied","Data":"555d659be32fc0c99b6ab2f26404062acd8f1b4213366ab9cf0d94cae7a7cc1f"}
Jul 26 15:56:47.291805 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:47.291706    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="555d659be32fc0c99b6ab2f26404062acd8f1b4213366ab9cf0d94cae7a7cc1f"
Jul 26 15:56:47.291805 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:47.291712    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k"
Jul 26 15:56:51.481141 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481102    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2xm5"]
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481407    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6872661b-0123-4227-be44-9d2ed01a38e1" containerName="extract"
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481418    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6872661b-0123-4227-be44-9d2ed01a38e1" containerName="extract"
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481430    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6872661b-0123-4227-be44-9d2ed01a38e1" containerName="util"
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481436    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6872661b-0123-4227-be44-9d2ed01a38e1" containerName="util"
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481446    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c098811-9347-4ed3-a358-71c4d0a897aa" containerName="pull"
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481451    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c098811-9347-4ed3-a358-71c4d0a897aa" containerName="pull"
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481460    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04ab4d29-0afa-40dc-8357-036fa7546c3d" containerName="pull"
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481466    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="04ab4d29-0afa-40dc-8357-036fa7546c3d" containerName="pull"
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481471    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c098811-9347-4ed3-a358-71c4d0a897aa" containerName="extract"
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481476    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c098811-9347-4ed3-a358-71c4d0a897aa" containerName="extract"
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481486    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04ab4d29-0afa-40dc-8357-036fa7546c3d" containerName="util"
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481491    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="04ab4d29-0afa-40dc-8357-036fa7546c3d" containerName="util"
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481496    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04ab4d29-0afa-40dc-8357-036fa7546c3d" containerName="extract"
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481500    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="04ab4d29-0afa-40dc-8357-036fa7546c3d" containerName="extract"
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481506    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b59633d3-22cc-40b2-8c32-fc65e98b3117" containerName="util"
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481513    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b59633d3-22cc-40b2-8c32-fc65e98b3117" containerName="util"
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481520    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c098811-9347-4ed3-a358-71c4d0a897aa" containerName="util"
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481524    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c098811-9347-4ed3-a358-71c4d0a897aa" containerName="util"
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481529    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6872661b-0123-4227-be44-9d2ed01a38e1" containerName="pull"
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481534    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6872661b-0123-4227-be44-9d2ed01a38e1" containerName="pull"
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481541    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b59633d3-22cc-40b2-8c32-fc65e98b3117" containerName="pull"
Jul 26 15:56:51.481540 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481546    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b59633d3-22cc-40b2-8c32-fc65e98b3117" containerName="pull"
Jul 26 15:56:51.482282 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481555    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b59633d3-22cc-40b2-8c32-fc65e98b3117" containerName="extract"
Jul 26 15:56:51.482282 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481560    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b59633d3-22cc-40b2-8c32-fc65e98b3117" containerName="extract"
Jul 26 15:56:51.482282 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481607    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6872661b-0123-4227-be44-9d2ed01a38e1" containerName="extract"
Jul 26 15:56:51.482282 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481615    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c098811-9347-4ed3-a358-71c4d0a897aa" containerName="extract"
Jul 26 15:56:51.482282 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481621    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b59633d3-22cc-40b2-8c32-fc65e98b3117" containerName="extract"
Jul 26 15:56:51.482282 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.481629    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="04ab4d29-0afa-40dc-8357-036fa7546c3d" containerName="extract"
Jul 26 15:56:51.485775 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.485758    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2xm5"
Jul 26 15:56:51.490404 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.490374    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7xp92\""
Jul 26 15:56:51.490519 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.490502    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 26 15:56:51.498331 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.498307    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2xm5"]
Jul 26 15:56:51.617990 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.617948    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhjht\" (UniqueName: \"kubernetes.io/projected/2e3a6ac6-d894-41b9-a207-0c4a4db65e2c-kube-api-access-dhjht\") pod \"dns-operator-controller-manager-864dd78c4c-t2xm5\" (UID: \"2e3a6ac6-d894-41b9-a207-0c4a4db65e2c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2xm5"
Jul 26 15:56:51.719175 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.719142    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhjht\" (UniqueName: \"kubernetes.io/projected/2e3a6ac6-d894-41b9-a207-0c4a4db65e2c-kube-api-access-dhjht\") pod \"dns-operator-controller-manager-864dd78c4c-t2xm5\" (UID: \"2e3a6ac6-d894-41b9-a207-0c4a4db65e2c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2xm5"
Jul 26 15:56:51.733847 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.733784    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhjht\" (UniqueName: \"kubernetes.io/projected/2e3a6ac6-d894-41b9-a207-0c4a4db65e2c-kube-api-access-dhjht\") pod \"dns-operator-controller-manager-864dd78c4c-t2xm5\" (UID: \"2e3a6ac6-d894-41b9-a207-0c4a4db65e2c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2xm5"
Jul 26 15:56:51.795930 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.795903    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2xm5"
Jul 26 15:56:51.922557 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:51.922530    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2xm5"]
Jul 26 15:56:51.924184 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:56:51.924152    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e3a6ac6_d894_41b9_a207_0c4a4db65e2c.slice/crio-cc79b58e8ffc7d45b9b7d133e7458f4c84e2610ddeccda2980dc50f7af82a0ce WatchSource:0}: Error finding container cc79b58e8ffc7d45b9b7d133e7458f4c84e2610ddeccda2980dc50f7af82a0ce: Status 404 returned error can't find the container with id cc79b58e8ffc7d45b9b7d133e7458f4c84e2610ddeccda2980dc50f7af82a0ce
Jul 26 15:56:52.315800 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:52.315766    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2xm5" event={"ID":"2e3a6ac6-d894-41b9-a207-0c4a4db65e2c","Type":"ContainerStarted","Data":"cc79b58e8ffc7d45b9b7d133e7458f4c84e2610ddeccda2980dc50f7af82a0ce"}
Jul 26 15:56:52.937472 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:52.937370    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65b99cfb6c-2dj4m"]
Jul 26 15:56:52.942313 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:52.942288    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:52.955645 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:52.955606    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65b99cfb6c-2dj4m"]
Jul 26 15:56:53.031750 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.031720    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad9b0273-d6ff-4a7c-9e4a-e058318994b5-console-oauth-config\") pod \"console-65b99cfb6c-2dj4m\" (UID: \"ad9b0273-d6ff-4a7c-9e4a-e058318994b5\") " pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.031750 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.031757    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad9b0273-d6ff-4a7c-9e4a-e058318994b5-trusted-ca-bundle\") pod \"console-65b99cfb6c-2dj4m\" (UID: \"ad9b0273-d6ff-4a7c-9e4a-e058318994b5\") " pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.031972 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.031793    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad9b0273-d6ff-4a7c-9e4a-e058318994b5-console-config\") pod \"console-65b99cfb6c-2dj4m\" (UID: \"ad9b0273-d6ff-4a7c-9e4a-e058318994b5\") " pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.031972 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.031828    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad9b0273-d6ff-4a7c-9e4a-e058318994b5-service-ca\") pod \"console-65b99cfb6c-2dj4m\" (UID: \"ad9b0273-d6ff-4a7c-9e4a-e058318994b5\") " pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.031972 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.031860    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad9b0273-d6ff-4a7c-9e4a-e058318994b5-oauth-serving-cert\") pod \"console-65b99cfb6c-2dj4m\" (UID: \"ad9b0273-d6ff-4a7c-9e4a-e058318994b5\") " pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.031972 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.031929    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz82n\" (UniqueName: \"kubernetes.io/projected/ad9b0273-d6ff-4a7c-9e4a-e058318994b5-kube-api-access-cz82n\") pod \"console-65b99cfb6c-2dj4m\" (UID: \"ad9b0273-d6ff-4a7c-9e4a-e058318994b5\") " pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.032111 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.031973    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad9b0273-d6ff-4a7c-9e4a-e058318994b5-console-serving-cert\") pod \"console-65b99cfb6c-2dj4m\" (UID: \"ad9b0273-d6ff-4a7c-9e4a-e058318994b5\") " pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.132499 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.132459    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz82n\" (UniqueName: \"kubernetes.io/projected/ad9b0273-d6ff-4a7c-9e4a-e058318994b5-kube-api-access-cz82n\") pod \"console-65b99cfb6c-2dj4m\" (UID: \"ad9b0273-d6ff-4a7c-9e4a-e058318994b5\") " pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.132676 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.132514    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad9b0273-d6ff-4a7c-9e4a-e058318994b5-console-serving-cert\") pod \"console-65b99cfb6c-2dj4m\" (UID: \"ad9b0273-d6ff-4a7c-9e4a-e058318994b5\") " pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.132676 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.132544    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad9b0273-d6ff-4a7c-9e4a-e058318994b5-console-oauth-config\") pod \"console-65b99cfb6c-2dj4m\" (UID: \"ad9b0273-d6ff-4a7c-9e4a-e058318994b5\") " pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.132676 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.132564    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad9b0273-d6ff-4a7c-9e4a-e058318994b5-trusted-ca-bundle\") pod \"console-65b99cfb6c-2dj4m\" (UID: \"ad9b0273-d6ff-4a7c-9e4a-e058318994b5\") " pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.132676 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.132601    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad9b0273-d6ff-4a7c-9e4a-e058318994b5-console-config\") pod \"console-65b99cfb6c-2dj4m\" (UID: \"ad9b0273-d6ff-4a7c-9e4a-e058318994b5\") " pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.133113 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.133032    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad9b0273-d6ff-4a7c-9e4a-e058318994b5-service-ca\") pod \"console-65b99cfb6c-2dj4m\" (UID: \"ad9b0273-d6ff-4a7c-9e4a-e058318994b5\") " pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.133113 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.133088    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad9b0273-d6ff-4a7c-9e4a-e058318994b5-oauth-serving-cert\") pod \"console-65b99cfb6c-2dj4m\" (UID: \"ad9b0273-d6ff-4a7c-9e4a-e058318994b5\") " pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.133399 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.133378    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad9b0273-d6ff-4a7c-9e4a-e058318994b5-console-config\") pod \"console-65b99cfb6c-2dj4m\" (UID: \"ad9b0273-d6ff-4a7c-9e4a-e058318994b5\") " pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.133828 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.133802    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad9b0273-d6ff-4a7c-9e4a-e058318994b5-oauth-serving-cert\") pod \"console-65b99cfb6c-2dj4m\" (UID: \"ad9b0273-d6ff-4a7c-9e4a-e058318994b5\") " pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.133935 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.133801    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad9b0273-d6ff-4a7c-9e4a-e058318994b5-trusted-ca-bundle\") pod \"console-65b99cfb6c-2dj4m\" (UID: \"ad9b0273-d6ff-4a7c-9e4a-e058318994b5\") " pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.133998 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.133947    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad9b0273-d6ff-4a7c-9e4a-e058318994b5-service-ca\") pod \"console-65b99cfb6c-2dj4m\" (UID: \"ad9b0273-d6ff-4a7c-9e4a-e058318994b5\") " pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.135518 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.135496    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad9b0273-d6ff-4a7c-9e4a-e058318994b5-console-oauth-config\") pod \"console-65b99cfb6c-2dj4m\" (UID: \"ad9b0273-d6ff-4a7c-9e4a-e058318994b5\") " pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.136186 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.136161    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad9b0273-d6ff-4a7c-9e4a-e058318994b5-console-serving-cert\") pod \"console-65b99cfb6c-2dj4m\" (UID: \"ad9b0273-d6ff-4a7c-9e4a-e058318994b5\") " pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.142867 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.142844    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz82n\" (UniqueName: \"kubernetes.io/projected/ad9b0273-d6ff-4a7c-9e4a-e058318994b5-kube-api-access-cz82n\") pod \"console-65b99cfb6c-2dj4m\" (UID: \"ad9b0273-d6ff-4a7c-9e4a-e058318994b5\") " pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.257074 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.256679    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:56:53.421466 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:53.421431    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65b99cfb6c-2dj4m"]
Jul 26 15:56:53.425003 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:56:53.424974    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad9b0273_d6ff_4a7c_9e4a_e058318994b5.slice/crio-3064fad617202a288a6992bdd0cf010b3da3c7e40aa9a2bc16995db82335358f WatchSource:0}: Error finding container 3064fad617202a288a6992bdd0cf010b3da3c7e40aa9a2bc16995db82335358f: Status 404 returned error can't find the container with id 3064fad617202a288a6992bdd0cf010b3da3c7e40aa9a2bc16995db82335358f
Jul 26 15:56:54.329178 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:54.329139    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2xm5" event={"ID":"2e3a6ac6-d894-41b9-a207-0c4a4db65e2c","Type":"ContainerStarted","Data":"dfa17f498dc289d4274f9d337f2cc026948eccdf9ca19f9045cbd01907225752"}
Jul 26 15:56:54.329610 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:54.329281    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2xm5"
Jul 26 15:56:54.330680 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:54.330658    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65b99cfb6c-2dj4m" event={"ID":"ad9b0273-d6ff-4a7c-9e4a-e058318994b5","Type":"ContainerStarted","Data":"ed8f9936f980750aa2eee198d20d4f23edc607e19e8f7713ec9427f2fc94b4bc"}
Jul 26 15:56:54.330746 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:54.330697    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65b99cfb6c-2dj4m" event={"ID":"ad9b0273-d6ff-4a7c-9e4a-e058318994b5","Type":"ContainerStarted","Data":"3064fad617202a288a6992bdd0cf010b3da3c7e40aa9a2bc16995db82335358f"}
Jul 26 15:56:54.347861 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:54.347820    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2xm5" podStartSLOduration=1.435534092 podStartE2EDuration="3.347805414s" totalImagesPullingTime="1.912271322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:56:54.346686165 +0000 UTC m=+410.565313231" watchObservedRunningTime="2026-07-26 15:56:54.347805414 +0000 UTC m=+410.566432463"
Jul 26 15:56:54.364970 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:54.364929    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65b99cfb6c-2dj4m" podStartSLOduration=2.364916531 podStartE2EDuration="2.364916531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:56:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:56:54.363597546 +0000 UTC m=+410.582224617" watchObservedRunningTime="2026-07-26 15:56:54.364916531 +0000 UTC m=+410.583543579"
Jul 26 15:56:56.215024 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:56.214994    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-svgpj"]
Jul 26 15:56:56.218379 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:56.218359    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-svgpj"
Jul 26 15:56:56.221428 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:56.221410    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-hmp57\""
Jul 26 15:56:56.272942 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:56.272919    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-svgpj"]
Jul 26 15:56:56.359089 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:56.359065    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk26l\" (UniqueName: \"kubernetes.io/projected/164cbe57-419f-427e-9547-b742a7ab7d88-kube-api-access-mk26l\") pod \"authorino-operator-75cc8d5cb7-svgpj\" (UID: \"164cbe57-419f-427e-9547-b742a7ab7d88\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-svgpj"
Jul 26 15:56:56.460284 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:56.460261    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk26l\" (UniqueName: \"kubernetes.io/projected/164cbe57-419f-427e-9547-b742a7ab7d88-kube-api-access-mk26l\") pod \"authorino-operator-75cc8d5cb7-svgpj\" (UID: \"164cbe57-419f-427e-9547-b742a7ab7d88\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-svgpj"
Jul 26 15:56:56.470935 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:56.470883    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk26l\" (UniqueName: \"kubernetes.io/projected/164cbe57-419f-427e-9547-b742a7ab7d88-kube-api-access-mk26l\") pod \"authorino-operator-75cc8d5cb7-svgpj\" (UID: \"164cbe57-419f-427e-9547-b742a7ab7d88\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-svgpj"
Jul 26 15:56:56.528950 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:56.528929    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-svgpj"
Jul 26 15:56:56.667657 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:56.667581    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-svgpj"]
Jul 26 15:56:56.671376 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:56:56.671349    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod164cbe57_419f_427e_9547_b742a7ab7d88.slice/crio-9db23e5b4650da0cf2e9c31b0622df54589889427065aecc75386819d176fa08 WatchSource:0}: Error finding container 9db23e5b4650da0cf2e9c31b0622df54589889427065aecc75386819d176fa08: Status 404 returned error can't find the container with id 9db23e5b4650da0cf2e9c31b0622df54589889427065aecc75386819d176fa08
Jul 26 15:56:57.350435 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:57.350400    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-svgpj" event={"ID":"164cbe57-419f-427e-9547-b742a7ab7d88","Type":"ContainerStarted","Data":"9db23e5b4650da0cf2e9c31b0622df54589889427065aecc75386819d176fa08"}
Jul 26 15:56:59.364487 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:59.364447    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-svgpj" event={"ID":"164cbe57-419f-427e-9547-b742a7ab7d88","Type":"ContainerStarted","Data":"2faeb90a11e916bf66acc9ce3b6a331a44a042329ebd05ad553939057f3f710f"}
Jul 26 15:56:59.364894 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:59.364514    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-svgpj"
Jul 26 15:56:59.398528 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:56:59.398488    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-svgpj" podStartSLOduration=1.221962742 podStartE2EDuration="3.398475873s" totalImagesPullingTime="2.176513131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:56:59.397042774 +0000 UTC m=+415.615669836" watchObservedRunningTime="2026-07-26 15:56:59.398475873 +0000 UTC m=+415.617102922"
Jul 26 15:57:03.257162 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:03.257124    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:57:03.257619 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:03.257205    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:57:03.261647 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:03.261610    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:57:03.386414 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:03.386384    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65b99cfb6c-2dj4m"
Jul 26 15:57:03.455905 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:03.455875    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d89fb465c-pzl29"]
Jul 26 15:57:04.245423 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:04.245391    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r"]
Jul 26 15:57:04.250453 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:04.250431    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r"
Jul 26 15:57:04.255431 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:04.255411    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rqt9k\""
Jul 26 15:57:04.264226 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:04.264202    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r"]
Jul 26 15:57:04.326694 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:04.326664    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl6zz\" (UniqueName: \"kubernetes.io/projected/ae1c42bc-e340-44c6-b800-73813eefb85d-kube-api-access-pl6zz\") pod \"limitador-operator-controller-manager-859d7b78bd-nxg8r\" (UID: \"ae1c42bc-e340-44c6-b800-73813eefb85d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r"
Jul 26 15:57:04.428099 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:04.428071    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl6zz\" (UniqueName: \"kubernetes.io/projected/ae1c42bc-e340-44c6-b800-73813eefb85d-kube-api-access-pl6zz\") pod \"limitador-operator-controller-manager-859d7b78bd-nxg8r\" (UID: \"ae1c42bc-e340-44c6-b800-73813eefb85d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r"
Jul 26 15:57:04.436251 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:04.436228    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl6zz\" (UniqueName: \"kubernetes.io/projected/ae1c42bc-e340-44c6-b800-73813eefb85d-kube-api-access-pl6zz\") pod \"limitador-operator-controller-manager-859d7b78bd-nxg8r\" (UID: \"ae1c42bc-e340-44c6-b800-73813eefb85d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r"
Jul 26 15:57:04.561337 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:04.561303    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r"
Jul 26 15:57:04.692953 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:04.692928    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r"]
Jul 26 15:57:04.694837 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:57:04.694810    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae1c42bc_e340_44c6_b800_73813eefb85d.slice/crio-e40455ac4dea93c536aa2fb46de41e308176fa91a91b5ce4e25f8430aa258d77 WatchSource:0}: Error finding container e40455ac4dea93c536aa2fb46de41e308176fa91a91b5ce4e25f8430aa258d77: Status 404 returned error can't find the container with id e40455ac4dea93c536aa2fb46de41e308176fa91a91b5ce4e25f8430aa258d77
Jul 26 15:57:05.338361 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:05.338332    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t2xm5"
Jul 26 15:57:05.396890 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:05.396806    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r" event={"ID":"ae1c42bc-e340-44c6-b800-73813eefb85d","Type":"ContainerStarted","Data":"e40455ac4dea93c536aa2fb46de41e308176fa91a91b5ce4e25f8430aa258d77"}
Jul 26 15:57:06.403732 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:06.403652    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r" event={"ID":"ae1c42bc-e340-44c6-b800-73813eefb85d","Type":"ContainerStarted","Data":"a75420cd7a2b068c4a42c29064f7df35bc2c9e4b28e4bd0c2860cc3e812d2284"}
Jul 26 15:57:06.404062 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:06.403754    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r"
Jul 26 15:57:06.421433 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:06.421392    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r" podStartSLOduration=1.03829773 podStartE2EDuration="2.42137933s" totalImagesPullingTime="1.3830816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:57:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:57:06.420056246 +0000 UTC m=+422.638683295" watchObservedRunningTime="2026-07-26 15:57:06.42137933 +0000 UTC m=+422.640006379"
Jul 26 15:57:10.370694 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:10.370663    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-svgpj"
Jul 26 15:57:17.413673 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:17.413625    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r"
Jul 26 15:57:21.132852 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.132814    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r"]
Jul 26 15:57:21.133778 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.133714    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r" podUID="ae1c42bc-e340-44c6-b800-73813eefb85d" containerName="manager" containerID="cri-o://a75420cd7a2b068c4a42c29064f7df35bc2c9e4b28e4bd0c2860cc3e812d2284" gracePeriod=2
Jul 26 15:57:21.143184 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.143153    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r"]
Jul 26 15:57:21.183177 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.183145    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf2w"]
Jul 26 15:57:21.183566 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.183549    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae1c42bc-e340-44c6-b800-73813eefb85d" containerName="manager"
Jul 26 15:57:21.183657 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.183567    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae1c42bc-e340-44c6-b800-73813eefb85d" containerName="manager"
Jul 26 15:57:21.183657 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.183627    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae1c42bc-e340-44c6-b800-73813eefb85d" containerName="manager"
Jul 26 15:57:21.186785 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.186763    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf2w"
Jul 26 15:57:21.189426 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:57:21.189401    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nxg8r\" is forbidden: User \"system:node:ip-10-0-142-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-224.ec2.internal' and this object" podUID="ae1c42bc-e340-44c6-b800-73813eefb85d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r"
Jul 26 15:57:21.200759 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.200728    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf2w"]
Jul 26 15:57:21.265124 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.265093    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgv9c\" (UniqueName: \"kubernetes.io/projected/6fc36ed8-e14b-4788-970b-68e8d22a685e-kube-api-access-dgv9c\") pod \"limitador-operator-controller-manager-859d7b78bd-lqf2w\" (UID: \"6fc36ed8-e14b-4788-970b-68e8d22a685e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf2w"
Jul 26 15:57:21.366017 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.365987    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgv9c\" (UniqueName: \"kubernetes.io/projected/6fc36ed8-e14b-4788-970b-68e8d22a685e-kube-api-access-dgv9c\") pod \"limitador-operator-controller-manager-859d7b78bd-lqf2w\" (UID: \"6fc36ed8-e14b-4788-970b-68e8d22a685e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf2w"
Jul 26 15:57:21.374527 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.374503    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgv9c\" (UniqueName: \"kubernetes.io/projected/6fc36ed8-e14b-4788-970b-68e8d22a685e-kube-api-access-dgv9c\") pod \"limitador-operator-controller-manager-859d7b78bd-lqf2w\" (UID: \"6fc36ed8-e14b-4788-970b-68e8d22a685e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf2w"
Jul 26 15:57:21.378216 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.378194    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r"
Jul 26 15:57:21.379897 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:57:21.379874    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nxg8r\" is forbidden: User \"system:node:ip-10-0-142-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-224.ec2.internal' and this object" podUID="ae1c42bc-e340-44c6-b800-73813eefb85d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r"
Jul 26 15:57:21.466961 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.466928    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pl6zz\" (UniqueName: \"kubernetes.io/projected/ae1c42bc-e340-44c6-b800-73813eefb85d-kube-api-access-pl6zz\") pod \"ae1c42bc-e340-44c6-b800-73813eefb85d\" (UID: \"ae1c42bc-e340-44c6-b800-73813eefb85d\") "
Jul 26 15:57:21.468993 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.468971    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae1c42bc-e340-44c6-b800-73813eefb85d-kube-api-access-pl6zz" (OuterVolumeSpecName: "kube-api-access-pl6zz") pod "ae1c42bc-e340-44c6-b800-73813eefb85d" (UID: "ae1c42bc-e340-44c6-b800-73813eefb85d"). InnerVolumeSpecName "kube-api-access-pl6zz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:57:21.485997 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.485969    2556 generic.go:356] "Generic (PLEG): container finished" podID="ae1c42bc-e340-44c6-b800-73813eefb85d" containerID="a75420cd7a2b068c4a42c29064f7df35bc2c9e4b28e4bd0c2860cc3e812d2284" exitCode=0
Jul 26 15:57:21.486106 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.486013    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r"
Jul 26 15:57:21.486106 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.486060    2556 scope.go:117] "RemoveContainer" containerID="a75420cd7a2b068c4a42c29064f7df35bc2c9e4b28e4bd0c2860cc3e812d2284"
Jul 26 15:57:21.488169 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:57:21.488145    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nxg8r\" is forbidden: User \"system:node:ip-10-0-142-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-224.ec2.internal' and this object" podUID="ae1c42bc-e340-44c6-b800-73813eefb85d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r"
Jul 26 15:57:21.495374 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.495357    2556 scope.go:117] "RemoveContainer" containerID="a75420cd7a2b068c4a42c29064f7df35bc2c9e4b28e4bd0c2860cc3e812d2284"
Jul 26 15:57:21.495654 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:57:21.495622    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a75420cd7a2b068c4a42c29064f7df35bc2c9e4b28e4bd0c2860cc3e812d2284\": container with ID starting with a75420cd7a2b068c4a42c29064f7df35bc2c9e4b28e4bd0c2860cc3e812d2284 not found: ID does not exist" containerID="a75420cd7a2b068c4a42c29064f7df35bc2c9e4b28e4bd0c2860cc3e812d2284"
Jul 26 15:57:21.495720 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.495666    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a75420cd7a2b068c4a42c29064f7df35bc2c9e4b28e4bd0c2860cc3e812d2284"} err="failed to get container status \"a75420cd7a2b068c4a42c29064f7df35bc2c9e4b28e4bd0c2860cc3e812d2284\": rpc error: code = NotFound desc = could not find container \"a75420cd7a2b068c4a42c29064f7df35bc2c9e4b28e4bd0c2860cc3e812d2284\": container with ID starting with a75420cd7a2b068c4a42c29064f7df35bc2c9e4b28e4bd0c2860cc3e812d2284 not found: ID does not exist"
Jul 26 15:57:21.496483 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:57:21.496453    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nxg8r\" is forbidden: User \"system:node:ip-10-0-142-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-224.ec2.internal' and this object" podUID="ae1c42bc-e340-44c6-b800-73813eefb85d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nxg8r"
Jul 26 15:57:21.525031 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.525009    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf2w"
Jul 26 15:57:21.567565 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.567535    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl6zz\" (UniqueName: \"kubernetes.io/projected/ae1c42bc-e340-44c6-b800-73813eefb85d-kube-api-access-pl6zz\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:57:21.664788 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:21.664762    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf2w"]
Jul 26 15:57:21.666582 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:57:21.666553    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fc36ed8_e14b_4788_970b_68e8d22a685e.slice/crio-c151bb85dc3c86cbce61b5a239135552f579a0a6e9f6091bfcb8b86569f12322 WatchSource:0}: Error finding container c151bb85dc3c86cbce61b5a239135552f579a0a6e9f6091bfcb8b86569f12322: Status 404 returned error can't find the container with id c151bb85dc3c86cbce61b5a239135552f579a0a6e9f6091bfcb8b86569f12322
Jul 26 15:57:22.215151 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:22.215115    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae1c42bc-e340-44c6-b800-73813eefb85d" path="/var/lib/kubelet/pods/ae1c42bc-e340-44c6-b800-73813eefb85d/volumes"
Jul 26 15:57:22.493740 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:22.493660    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf2w" event={"ID":"6fc36ed8-e14b-4788-970b-68e8d22a685e","Type":"ContainerStarted","Data":"cf5d00216db17a0f1d07bef7a2841dffcb7703c74f72d716a491311b288bdaa0"}
Jul 26 15:57:22.493740 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:22.493709    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf2w" event={"ID":"6fc36ed8-e14b-4788-970b-68e8d22a685e","Type":"ContainerStarted","Data":"c151bb85dc3c86cbce61b5a239135552f579a0a6e9f6091bfcb8b86569f12322"}
Jul 26 15:57:22.493942 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:22.493757    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf2w"
Jul 26 15:57:22.510302 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:22.510252    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf2w" podStartSLOduration=1.510238696 podStartE2EDuration="1.510238696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:57:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:57:22.509320737 +0000 UTC m=+438.727947787" watchObservedRunningTime="2026-07-26 15:57:22.510238696 +0000 UTC m=+438.728865745"
Jul 26 15:57:28.475181 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.475090    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d89fb465c-pzl29" podUID="e92343ce-ca2f-49bb-80b3-2d2037fbcea9" containerName="console" containerID="cri-o://3cbc25a69367fab160bd32c2b6df7c213689ef2b5aee1c1c2edbe97db4cd8978" gracePeriod=15
Jul 26 15:57:28.721082 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.721059    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:57:28.819298 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.819226    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-oauth-serving-cert\") pod \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") "
Jul 26 15:57:28.819298 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.819275    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vnd2\" (UniqueName: \"kubernetes.io/projected/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-kube-api-access-4vnd2\") pod \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") "
Jul 26 15:57:28.819476 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.819309    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-trusted-ca-bundle\") pod \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") "
Jul 26 15:57:28.819476 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.819335    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-console-oauth-config\") pod \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") "
Jul 26 15:57:28.819476 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.819373    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-service-ca\") pod \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") "
Jul 26 15:57:28.819476 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.819398    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-console-config\") pod \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") "
Jul 26 15:57:28.819476 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.819431    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-console-serving-cert\") pod \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\" (UID: \"e92343ce-ca2f-49bb-80b3-2d2037fbcea9\") "
Jul 26 15:57:28.819786 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.819761    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e92343ce-ca2f-49bb-80b3-2d2037fbcea9" (UID: "e92343ce-ca2f-49bb-80b3-2d2037fbcea9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:57:28.819845 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.819791    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e92343ce-ca2f-49bb-80b3-2d2037fbcea9" (UID: "e92343ce-ca2f-49bb-80b3-2d2037fbcea9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:57:28.819918 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.819865    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-service-ca" (OuterVolumeSpecName: "service-ca") pod "e92343ce-ca2f-49bb-80b3-2d2037fbcea9" (UID: "e92343ce-ca2f-49bb-80b3-2d2037fbcea9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:57:28.819918 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.819899    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-console-config" (OuterVolumeSpecName: "console-config") pod "e92343ce-ca2f-49bb-80b3-2d2037fbcea9" (UID: "e92343ce-ca2f-49bb-80b3-2d2037fbcea9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:57:28.821593 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.821567    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e92343ce-ca2f-49bb-80b3-2d2037fbcea9" (UID: "e92343ce-ca2f-49bb-80b3-2d2037fbcea9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:57:28.821593 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.821587    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e92343ce-ca2f-49bb-80b3-2d2037fbcea9" (UID: "e92343ce-ca2f-49bb-80b3-2d2037fbcea9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:57:28.821756 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.821626    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-kube-api-access-4vnd2" (OuterVolumeSpecName: "kube-api-access-4vnd2") pod "e92343ce-ca2f-49bb-80b3-2d2037fbcea9" (UID: "e92343ce-ca2f-49bb-80b3-2d2037fbcea9"). InnerVolumeSpecName "kube-api-access-4vnd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:57:28.920701 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.920677    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-console-serving-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:57:28.920701 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.920697    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-oauth-serving-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:57:28.920833 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.920707    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vnd2\" (UniqueName: \"kubernetes.io/projected/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-kube-api-access-4vnd2\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:57:28.920833 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.920716    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-trusted-ca-bundle\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:57:28.920833 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.920725    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-console-oauth-config\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:57:28.920833 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.920734    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-service-ca\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:57:28.920833 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:28.920744    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e92343ce-ca2f-49bb-80b3-2d2037fbcea9-console-config\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:57:29.532248 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:29.532210    2556 generic.go:356] "Generic (PLEG): container finished" podID="e92343ce-ca2f-49bb-80b3-2d2037fbcea9" containerID="3cbc25a69367fab160bd32c2b6df7c213689ef2b5aee1c1c2edbe97db4cd8978" exitCode=0
Jul 26 15:57:29.532671 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:29.532261    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d89fb465c-pzl29"
Jul 26 15:57:29.532671 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:29.532302    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d89fb465c-pzl29" event={"ID":"e92343ce-ca2f-49bb-80b3-2d2037fbcea9","Type":"ContainerDied","Data":"3cbc25a69367fab160bd32c2b6df7c213689ef2b5aee1c1c2edbe97db4cd8978"}
Jul 26 15:57:29.532671 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:29.532357    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d89fb465c-pzl29" event={"ID":"e92343ce-ca2f-49bb-80b3-2d2037fbcea9","Type":"ContainerDied","Data":"a755c0fbf2c503d430849a9a1399bd520233c6aadf2371a1b648eec86bb6b257"}
Jul 26 15:57:29.532671 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:29.532379    2556 scope.go:117] "RemoveContainer" containerID="3cbc25a69367fab160bd32c2b6df7c213689ef2b5aee1c1c2edbe97db4cd8978"
Jul 26 15:57:29.542956 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:29.542934    2556 scope.go:117] "RemoveContainer" containerID="3cbc25a69367fab160bd32c2b6df7c213689ef2b5aee1c1c2edbe97db4cd8978"
Jul 26 15:57:29.543301 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:57:29.543279    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cbc25a69367fab160bd32c2b6df7c213689ef2b5aee1c1c2edbe97db4cd8978\": container with ID starting with 3cbc25a69367fab160bd32c2b6df7c213689ef2b5aee1c1c2edbe97db4cd8978 not found: ID does not exist" containerID="3cbc25a69367fab160bd32c2b6df7c213689ef2b5aee1c1c2edbe97db4cd8978"
Jul 26 15:57:29.543355 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:29.543310    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cbc25a69367fab160bd32c2b6df7c213689ef2b5aee1c1c2edbe97db4cd8978"} err="failed to get container status \"3cbc25a69367fab160bd32c2b6df7c213689ef2b5aee1c1c2edbe97db4cd8978\": rpc error: code = NotFound desc = could not find container \"3cbc25a69367fab160bd32c2b6df7c213689ef2b5aee1c1c2edbe97db4cd8978\": container with ID starting with 3cbc25a69367fab160bd32c2b6df7c213689ef2b5aee1c1c2edbe97db4cd8978 not found: ID does not exist"
Jul 26 15:57:29.554280 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:29.554259    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d89fb465c-pzl29"]
Jul 26 15:57:29.559084 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:29.559064    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d89fb465c-pzl29"]
Jul 26 15:57:30.215842 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:30.215809    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e92343ce-ca2f-49bb-80b3-2d2037fbcea9" path="/var/lib/kubelet/pods/e92343ce-ca2f-49bb-80b3-2d2037fbcea9/volumes"
Jul 26 15:57:33.501571 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:33.501545    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lqf2w"
Jul 26 15:57:49.798150 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.798119    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"]
Jul 26 15:57:49.798572 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.798458    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e92343ce-ca2f-49bb-80b3-2d2037fbcea9" containerName="console"
Jul 26 15:57:49.798572 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.798469    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e92343ce-ca2f-49bb-80b3-2d2037fbcea9" containerName="console"
Jul 26 15:57:49.798572 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.798523    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e92343ce-ca2f-49bb-80b3-2d2037fbcea9" containerName="console"
Jul 26 15:57:49.809814 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.809772    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.812870 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.812839    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kwx5h\""
Jul 26 15:57:49.813165 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.813130    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"]
Jul 26 15:57:49.871302 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.871273    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/855e112d-785c-45b7-b518-3211bb669afc-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.871412 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.871321    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/855e112d-785c-45b7-b518-3211bb669afc-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.871412 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.871368    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/855e112d-785c-45b7-b518-3211bb669afc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.871412 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.871396    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/855e112d-785c-45b7-b518-3211bb669afc-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.871522 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.871417    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/855e112d-785c-45b7-b518-3211bb669afc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.871522 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.871451    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/855e112d-785c-45b7-b518-3211bb669afc-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.871522 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.871469    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgldv\" (UniqueName: \"kubernetes.io/projected/855e112d-785c-45b7-b518-3211bb669afc-kube-api-access-xgldv\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.871614 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.871523    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/855e112d-785c-45b7-b518-3211bb669afc-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.871614 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.871557    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/855e112d-785c-45b7-b518-3211bb669afc-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.972561 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.972532    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/855e112d-785c-45b7-b518-3211bb669afc-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.972698 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.972565    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgldv\" (UniqueName: \"kubernetes.io/projected/855e112d-785c-45b7-b518-3211bb669afc-kube-api-access-xgldv\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.972698 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.972583    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/855e112d-785c-45b7-b518-3211bb669afc-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.972790 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.972708    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/855e112d-785c-45b7-b518-3211bb669afc-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.972790 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.972750    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/855e112d-785c-45b7-b518-3211bb669afc-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.972869 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.972803    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/855e112d-785c-45b7-b518-3211bb669afc-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.972869 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.972845    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/855e112d-785c-45b7-b518-3211bb669afc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.972979 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.972875    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/855e112d-785c-45b7-b518-3211bb669afc-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.972979 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.972900    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/855e112d-785c-45b7-b518-3211bb669afc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.972979 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.972971    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/855e112d-785c-45b7-b518-3211bb669afc-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.973136 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.973087    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/855e112d-785c-45b7-b518-3211bb669afc-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.973191 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.973155    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/855e112d-785c-45b7-b518-3211bb669afc-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.973268 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.973248    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/855e112d-785c-45b7-b518-3211bb669afc-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.973524 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.973503    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/855e112d-785c-45b7-b518-3211bb669afc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.974781 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.974764    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/855e112d-785c-45b7-b518-3211bb669afc-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.975227 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.975210    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/855e112d-785c-45b7-b518-3211bb669afc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.980621 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.980601    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/855e112d-785c-45b7-b518-3211bb669afc-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:49.980967 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:49.980950    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgldv\" (UniqueName: \"kubernetes.io/projected/855e112d-785c-45b7-b518-3211bb669afc-kube-api-access-xgldv\") pod \"maas-default-gateway-openshift-default-5ccb968c66-59pq2\" (UID: \"855e112d-785c-45b7-b518-3211bb669afc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:50.121415 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:50.121327    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:50.264702 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:50.264677    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"]
Jul 26 15:57:50.266768 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:57:50.266743    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod855e112d_785c_45b7_b518_3211bb669afc.slice/crio-31c85063f6f1b8037db4bce380b6ef177d58e13a7252770522052c6d632cf7b0 WatchSource:0}: Error finding container 31c85063f6f1b8037db4bce380b6ef177d58e13a7252770522052c6d632cf7b0: Status 404 returned error can't find the container with id 31c85063f6f1b8037db4bce380b6ef177d58e13a7252770522052c6d632cf7b0
Jul 26 15:57:50.268701 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:50.268662    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 15:57:50.268789 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:50.268731    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 15:57:50.268789 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:50.268775    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 15:57:50.649487 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:50.649445    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2" event={"ID":"855e112d-785c-45b7-b518-3211bb669afc","Type":"ContainerStarted","Data":"bdb2f314747b60d523dfa64820d2562f1699868470b3c29d51f5c30444407861"}
Jul 26 15:57:50.649676 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:50.649503    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2" event={"ID":"855e112d-785c-45b7-b518-3211bb669afc","Type":"ContainerStarted","Data":"31c85063f6f1b8037db4bce380b6ef177d58e13a7252770522052c6d632cf7b0"}
Jul 26 15:57:50.668447 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:50.668397    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2" podStartSLOduration=1.668382051 podStartE2EDuration="1.668382051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:57:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:57:50.666121134 +0000 UTC m=+466.884748182" watchObservedRunningTime="2026-07-26 15:57:50.668382051 +0000 UTC m=+466.887009174"
Jul 26 15:57:51.121893 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:51.121862    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:51.126594 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:51.126568    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:51.655494 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:51.655467    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:57:51.656603 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:57:51.656578    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:58:04.261669 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:04.261619    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-pzk8z"]
Jul 26 15:58:04.266621 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:04.266596    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-pzk8z"
Jul 26 15:58:04.269491 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:04.269356    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-99mrw\""
Jul 26 15:58:04.271069 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:04.271041    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-pzk8z"]
Jul 26 15:58:04.383579 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:04.383507    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcpqs\" (UniqueName: \"kubernetes.io/projected/1d0c1444-90f9-4656-b1a5-0e6f0d883634-kube-api-access-tcpqs\") pod \"authorino-58cd955675-pzk8z\" (UID: \"1d0c1444-90f9-4656-b1a5-0e6f0d883634\") " pod="kuadrant-system/authorino-58cd955675-pzk8z"
Jul 26 15:58:04.484956 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:04.484930    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcpqs\" (UniqueName: \"kubernetes.io/projected/1d0c1444-90f9-4656-b1a5-0e6f0d883634-kube-api-access-tcpqs\") pod \"authorino-58cd955675-pzk8z\" (UID: \"1d0c1444-90f9-4656-b1a5-0e6f0d883634\") " pod="kuadrant-system/authorino-58cd955675-pzk8z"
Jul 26 15:58:04.492283 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:04.492250    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcpqs\" (UniqueName: \"kubernetes.io/projected/1d0c1444-90f9-4656-b1a5-0e6f0d883634-kube-api-access-tcpqs\") pod \"authorino-58cd955675-pzk8z\" (UID: \"1d0c1444-90f9-4656-b1a5-0e6f0d883634\") " pod="kuadrant-system/authorino-58cd955675-pzk8z"
Jul 26 15:58:04.585684 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:04.585620    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-pzk8z"
Jul 26 15:58:04.712526 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:04.712493    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-pzk8z"]
Jul 26 15:58:04.714772 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:58:04.714749    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d0c1444_90f9_4656_b1a5_0e6f0d883634.slice/crio-eaba06940ae8d228fa465557b596ab5aadb8cc95143d940f0c060b71ff6ffde6 WatchSource:0}: Error finding container eaba06940ae8d228fa465557b596ab5aadb8cc95143d940f0c060b71ff6ffde6: Status 404 returned error can't find the container with id eaba06940ae8d228fa465557b596ab5aadb8cc95143d940f0c060b71ff6ffde6
Jul 26 15:58:04.727052 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:04.727027    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-pzk8z" event={"ID":"1d0c1444-90f9-4656-b1a5-0e6f0d883634","Type":"ContainerStarted","Data":"eaba06940ae8d228fa465557b596ab5aadb8cc95143d940f0c060b71ff6ffde6"}
Jul 26 15:58:08.662563 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:08.662529    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-pzk8z"]
Jul 26 15:58:08.752993 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:08.752958    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-pzk8z" event={"ID":"1d0c1444-90f9-4656-b1a5-0e6f0d883634","Type":"ContainerStarted","Data":"1c9b07ce5af5107119f60fe8ded4578a6e1d79149ff59e80acc609d38759b879"}
Jul 26 15:58:08.767950 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:08.767902    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-pzk8z" podStartSLOduration=1.772822318 podStartE2EDuration="4.767888542s" totalImagesPullingTime="2.995066224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:58:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:58:08.766024972 +0000 UTC m=+484.984652022" watchObservedRunningTime="2026-07-26 15:58:08.767888542 +0000 UTC m=+484.986515591"
Jul 26 15:58:09.758431 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:09.758381    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-pzk8z" podUID="1d0c1444-90f9-4656-b1a5-0e6f0d883634" containerName="authorino" containerID="cri-o://1c9b07ce5af5107119f60fe8ded4578a6e1d79149ff59e80acc609d38759b879" gracePeriod=30
Jul 26 15:58:10.008651 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:10.008577    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-pzk8z"
Jul 26 15:58:10.142796 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:10.142760    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcpqs\" (UniqueName: \"kubernetes.io/projected/1d0c1444-90f9-4656-b1a5-0e6f0d883634-kube-api-access-tcpqs\") pod \"1d0c1444-90f9-4656-b1a5-0e6f0d883634\" (UID: \"1d0c1444-90f9-4656-b1a5-0e6f0d883634\") "
Jul 26 15:58:10.145095 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:10.145069    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d0c1444-90f9-4656-b1a5-0e6f0d883634-kube-api-access-tcpqs" (OuterVolumeSpecName: "kube-api-access-tcpqs") pod "1d0c1444-90f9-4656-b1a5-0e6f0d883634" (UID: "1d0c1444-90f9-4656-b1a5-0e6f0d883634"). InnerVolumeSpecName "kube-api-access-tcpqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:58:10.244117 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:10.244090    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcpqs\" (UniqueName: \"kubernetes.io/projected/1d0c1444-90f9-4656-b1a5-0e6f0d883634-kube-api-access-tcpqs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:58:10.764585 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:10.764546    2556 generic.go:356] "Generic (PLEG): container finished" podID="1d0c1444-90f9-4656-b1a5-0e6f0d883634" containerID="1c9b07ce5af5107119f60fe8ded4578a6e1d79149ff59e80acc609d38759b879" exitCode=0
Jul 26 15:58:10.765032 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:10.764592    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-pzk8z"
Jul 26 15:58:10.765032 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:10.764642    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-pzk8z" event={"ID":"1d0c1444-90f9-4656-b1a5-0e6f0d883634","Type":"ContainerDied","Data":"1c9b07ce5af5107119f60fe8ded4578a6e1d79149ff59e80acc609d38759b879"}
Jul 26 15:58:10.765032 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:10.764691    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-pzk8z" event={"ID":"1d0c1444-90f9-4656-b1a5-0e6f0d883634","Type":"ContainerDied","Data":"eaba06940ae8d228fa465557b596ab5aadb8cc95143d940f0c060b71ff6ffde6"}
Jul 26 15:58:10.765032 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:10.764711    2556 scope.go:117] "RemoveContainer" containerID="1c9b07ce5af5107119f60fe8ded4578a6e1d79149ff59e80acc609d38759b879"
Jul 26 15:58:10.773987 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:10.773964    2556 scope.go:117] "RemoveContainer" containerID="1c9b07ce5af5107119f60fe8ded4578a6e1d79149ff59e80acc609d38759b879"
Jul 26 15:58:10.774231 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:58:10.774213    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c9b07ce5af5107119f60fe8ded4578a6e1d79149ff59e80acc609d38759b879\": container with ID starting with 1c9b07ce5af5107119f60fe8ded4578a6e1d79149ff59e80acc609d38759b879 not found: ID does not exist" containerID="1c9b07ce5af5107119f60fe8ded4578a6e1d79149ff59e80acc609d38759b879"
Jul 26 15:58:10.774278 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:10.774241    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c9b07ce5af5107119f60fe8ded4578a6e1d79149ff59e80acc609d38759b879"} err="failed to get container status \"1c9b07ce5af5107119f60fe8ded4578a6e1d79149ff59e80acc609d38759b879\": rpc error: code = NotFound desc = could not find container \"1c9b07ce5af5107119f60fe8ded4578a6e1d79149ff59e80acc609d38759b879\": container with ID starting with 1c9b07ce5af5107119f60fe8ded4578a6e1d79149ff59e80acc609d38759b879 not found: ID does not exist"
Jul 26 15:58:10.794923 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:10.794901    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-pzk8z"]
Jul 26 15:58:10.810352 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:10.810330    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-pzk8z"]
Jul 26 15:58:12.215350 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:12.215310    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d0c1444-90f9-4656-b1a5-0e6f0d883634" path="/var/lib/kubelet/pods/1d0c1444-90f9-4656-b1a5-0e6f0d883634/volumes"
Jul 26 15:58:36.260584 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.260550    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dxvxc"]
Jul 26 15:58:36.261053 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.260888    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d0c1444-90f9-4656-b1a5-0e6f0d883634" containerName="authorino"
Jul 26 15:58:36.261053 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.260900    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d0c1444-90f9-4656-b1a5-0e6f0d883634" containerName="authorino"
Jul 26 15:58:36.261053 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.260959    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d0c1444-90f9-4656-b1a5-0e6f0d883634" containerName="authorino"
Jul 26 15:58:36.264670 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.264651    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dxvxc"
Jul 26 15:58:36.267247 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.267222    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-99mrw\""
Jul 26 15:58:36.269420 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.269394    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dxvxc"]
Jul 26 15:58:36.438731 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.438693    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frb9w\" (UniqueName: \"kubernetes.io/projected/02462dd2-7976-42ee-bef0-71a9ab06652c-kube-api-access-frb9w\") pod \"authorino-5d4b67c446-dxvxc\" (UID: \"02462dd2-7976-42ee-bef0-71a9ab06652c\") " pod="kuadrant-system/authorino-5d4b67c446-dxvxc"
Jul 26 15:58:36.512520 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.512459    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dxvxc"]
Jul 26 15:58:36.512668 ip-10-0-142-224 kubenswrapper[2556]: E0726 15:58:36.512642    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-frb9w], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-dxvxc" podUID="02462dd2-7976-42ee-bef0-71a9ab06652c"
Jul 26 15:58:36.539757 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.539726    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9c96d967b-jptwk"]
Jul 26 15:58:36.539859 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.539769    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frb9w\" (UniqueName: \"kubernetes.io/projected/02462dd2-7976-42ee-bef0-71a9ab06652c-kube-api-access-frb9w\") pod \"authorino-5d4b67c446-dxvxc\" (UID: \"02462dd2-7976-42ee-bef0-71a9ab06652c\") " pod="kuadrant-system/authorino-5d4b67c446-dxvxc"
Jul 26 15:58:36.542797 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.542781    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9c96d967b-jptwk"
Jul 26 15:58:36.544718 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.544701    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 26 15:58:36.547298 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.547272    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frb9w\" (UniqueName: \"kubernetes.io/projected/02462dd2-7976-42ee-bef0-71a9ab06652c-kube-api-access-frb9w\") pod \"authorino-5d4b67c446-dxvxc\" (UID: \"02462dd2-7976-42ee-bef0-71a9ab06652c\") " pod="kuadrant-system/authorino-5d4b67c446-dxvxc"
Jul 26 15:58:36.549471 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.549450    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9c96d967b-jptwk"]
Jul 26 15:58:36.640704 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.640678    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnfdb\" (UniqueName: \"kubernetes.io/projected/834c11b3-5157-40dc-99eb-5019d18ca8c6-kube-api-access-tnfdb\") pod \"authorino-9c96d967b-jptwk\" (UID: \"834c11b3-5157-40dc-99eb-5019d18ca8c6\") " pod="kuadrant-system/authorino-9c96d967b-jptwk"
Jul 26 15:58:36.640801 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.640733    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/834c11b3-5157-40dc-99eb-5019d18ca8c6-tls-cert\") pod \"authorino-9c96d967b-jptwk\" (UID: \"834c11b3-5157-40dc-99eb-5019d18ca8c6\") " pod="kuadrant-system/authorino-9c96d967b-jptwk"
Jul 26 15:58:36.741932 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.741906    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnfdb\" (UniqueName: \"kubernetes.io/projected/834c11b3-5157-40dc-99eb-5019d18ca8c6-kube-api-access-tnfdb\") pod \"authorino-9c96d967b-jptwk\" (UID: \"834c11b3-5157-40dc-99eb-5019d18ca8c6\") " pod="kuadrant-system/authorino-9c96d967b-jptwk"
Jul 26 15:58:36.742030 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.741949    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/834c11b3-5157-40dc-99eb-5019d18ca8c6-tls-cert\") pod \"authorino-9c96d967b-jptwk\" (UID: \"834c11b3-5157-40dc-99eb-5019d18ca8c6\") " pod="kuadrant-system/authorino-9c96d967b-jptwk"
Jul 26 15:58:36.744220 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.744203    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/834c11b3-5157-40dc-99eb-5019d18ca8c6-tls-cert\") pod \"authorino-9c96d967b-jptwk\" (UID: \"834c11b3-5157-40dc-99eb-5019d18ca8c6\") " pod="kuadrant-system/authorino-9c96d967b-jptwk"
Jul 26 15:58:36.749230 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.749212    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnfdb\" (UniqueName: \"kubernetes.io/projected/834c11b3-5157-40dc-99eb-5019d18ca8c6-kube-api-access-tnfdb\") pod \"authorino-9c96d967b-jptwk\" (UID: \"834c11b3-5157-40dc-99eb-5019d18ca8c6\") " pod="kuadrant-system/authorino-9c96d967b-jptwk"
Jul 26 15:58:36.859532 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.859462    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9c96d967b-jptwk"
Jul 26 15:58:36.897722 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.897693    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dxvxc"
Jul 26 15:58:36.905471 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.905443    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dxvxc"
Jul 26 15:58:36.993504 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:36.993475    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9c96d967b-jptwk"]
Jul 26 15:58:36.995908 ip-10-0-142-224 kubenswrapper[2556]: W0726 15:58:36.995883    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod834c11b3_5157_40dc_99eb_5019d18ca8c6.slice/crio-6a3d67d0268b46916c21907918f99b1d73afdbe6a01fdfd3f4a4bbeee5fab47a WatchSource:0}: Error finding container 6a3d67d0268b46916c21907918f99b1d73afdbe6a01fdfd3f4a4bbeee5fab47a: Status 404 returned error can't find the container with id 6a3d67d0268b46916c21907918f99b1d73afdbe6a01fdfd3f4a4bbeee5fab47a
Jul 26 15:58:37.044065 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:37.044036    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frb9w\" (UniqueName: \"kubernetes.io/projected/02462dd2-7976-42ee-bef0-71a9ab06652c-kube-api-access-frb9w\") pod \"02462dd2-7976-42ee-bef0-71a9ab06652c\" (UID: \"02462dd2-7976-42ee-bef0-71a9ab06652c\") "
Jul 26 15:58:37.046034 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:37.046014    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02462dd2-7976-42ee-bef0-71a9ab06652c-kube-api-access-frb9w" (OuterVolumeSpecName: "kube-api-access-frb9w") pod "02462dd2-7976-42ee-bef0-71a9ab06652c" (UID: "02462dd2-7976-42ee-bef0-71a9ab06652c"). InnerVolumeSpecName "kube-api-access-frb9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:58:37.145257 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:37.145189    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frb9w\" (UniqueName: \"kubernetes.io/projected/02462dd2-7976-42ee-bef0-71a9ab06652c-kube-api-access-frb9w\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 15:58:37.904525 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:37.904450    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9c96d967b-jptwk" event={"ID":"834c11b3-5157-40dc-99eb-5019d18ca8c6","Type":"ContainerStarted","Data":"ea1c533e163800162f8729f09cc95029161c93af7b1555f3df3dfcb5386b79bc"}
Jul 26 15:58:37.904525 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:37.904494    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9c96d967b-jptwk" event={"ID":"834c11b3-5157-40dc-99eb-5019d18ca8c6","Type":"ContainerStarted","Data":"6a3d67d0268b46916c21907918f99b1d73afdbe6a01fdfd3f4a4bbeee5fab47a"}
Jul 26 15:58:37.904525 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:37.904513    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dxvxc"
Jul 26 15:58:37.923796 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:37.923756    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-9c96d967b-jptwk" podStartSLOduration=1.644529881 podStartE2EDuration="1.923742033s" totalImagesPullingTime="279.212152ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:58:37.922342401 +0000 UTC m=+514.140969453" watchObservedRunningTime="2026-07-26 15:58:37.923742033 +0000 UTC m=+514.142369082"
Jul 26 15:58:37.945235 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:37.945208    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dxvxc"]
Jul 26 15:58:37.954723 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:37.954701    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dxvxc"]
Jul 26 15:58:38.219039 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:58:38.219007    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02462dd2-7976-42ee-bef0-71a9ab06652c" path="/var/lib/kubelet/pods/02462dd2-7976-42ee-bef0-71a9ab06652c/volumes"
Jul 26 15:59:27.168047 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:59:27.168015    2556 generic.go:356] "Generic (PLEG): container finished" podID="855e112d-785c-45b7-b518-3211bb669afc" containerID="bdb2f314747b60d523dfa64820d2562f1699868470b3c29d51f5c30444407861" exitCode=0
Jul 26 15:59:27.168456 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:59:27.168054    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2" event={"ID":"855e112d-785c-45b7-b518-3211bb669afc","Type":"ContainerDied","Data":"bdb2f314747b60d523dfa64820d2562f1699868470b3c29d51f5c30444407861"}
Jul 26 15:59:27.168456 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:59:27.168378    2556 scope.go:117] "RemoveContainer" containerID="bdb2f314747b60d523dfa64820d2562f1699868470b3c29d51f5c30444407861"
Jul 26 15:59:27.169375 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:59:27.169345    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 15:59:27.169434 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:59:27.169417    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 15:59:27.169470 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:59:27.169449    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 15:59:28.175290 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:59:28.175258    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2" event={"ID":"855e112d-785c-45b7-b518-3211bb669afc","Type":"ContainerStarted","Data":"d78af0f9f02f87df50602c1d60a21b73a2a79a3449bc904b3c54928b69325e29"}
Jul 26 15:59:29.121866 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:59:29.121833    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:59:29.122049 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:59:29.122028    2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-59pq2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 26 15:59:29.122097 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:59:29.122077    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2" podUID="855e112d-785c-45b7-b518-3211bb669afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 26 15:59:30.122651 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:59:30.122600    2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-59pq2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 26 15:59:30.123045 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:59:30.122680    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2" podUID="855e112d-785c-45b7-b518-3211bb669afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 26 15:59:31.122049 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:59:31.122012    2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-59pq2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 26 15:59:31.122218 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:59:31.122070    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2" podUID="855e112d-785c-45b7-b518-3211bb669afc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 26 15:59:32.125705 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:59:32.125676    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:59:32.126139 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:59:32.125961    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 15:59:32.126779 ip-10-0-142-224 kubenswrapper[2556]: I0726 15:59:32.126762    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-59pq2"
Jul 26 16:00:00.142316 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:00.142275    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29751360-lmdpl"]
Jul 26 16:00:00.145808 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:00.145790    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751360-lmdpl"
Jul 26 16:00:00.148285 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:00.148261    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlwwk\""
Jul 26 16:00:00.151071 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:00.151046    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29751360-lmdpl"]
Jul 26 16:00:00.157087 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:00.157066    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751360-lmdpl"
Jul 26 16:00:00.489498 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:00.489473    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29751360-lmdpl"]
Jul 26 16:00:00.491106 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:00:00.491077    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75dbe5be_cf40_4d4a_b48a_90c79e22e402.slice/crio-2bcc5563f0ddcfb43260032bada70b94cb5a1ee6a5b8d8209e47f7ee50bb8eb5 WatchSource:0}: Error finding container 2bcc5563f0ddcfb43260032bada70b94cb5a1ee6a5b8d8209e47f7ee50bb8eb5: Status 404 returned error can't find the container with id 2bcc5563f0ddcfb43260032bada70b94cb5a1ee6a5b8d8209e47f7ee50bb8eb5
Jul 26 16:00:01.340971 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:01.340932    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751360-lmdpl" event={"ID":"75dbe5be-cf40-4d4a-b48a-90c79e22e402","Type":"ContainerStarted","Data":"2bcc5563f0ddcfb43260032bada70b94cb5a1ee6a5b8d8209e47f7ee50bb8eb5"}
Jul 26 16:00:04.365097 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:04.365011    2556 generic.go:356] "Generic (PLEG): container finished" podID="75dbe5be-cf40-4d4a-b48a-90c79e22e402" containerID="d82a7affd630c420534265cea34c21e933632b3bd177e7d7e5215c4e662cd498" exitCode=0
Jul 26 16:00:04.365097 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:04.365055    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751360-lmdpl" event={"ID":"75dbe5be-cf40-4d4a-b48a-90c79e22e402","Type":"ContainerDied","Data":"d82a7affd630c420534265cea34c21e933632b3bd177e7d7e5215c4e662cd498"}
Jul 26 16:00:04.549097 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:04.549072    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 16:00:04.549340 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:04.549320    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 16:00:05.499564 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:05.499542    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751360-lmdpl"
Jul 26 16:00:06.376963 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:06.376935    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751360-lmdpl"
Jul 26 16:00:06.377135 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:06.376968    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751360-lmdpl" event={"ID":"75dbe5be-cf40-4d4a-b48a-90c79e22e402","Type":"ContainerDied","Data":"2bcc5563f0ddcfb43260032bada70b94cb5a1ee6a5b8d8209e47f7ee50bb8eb5"}
Jul 26 16:00:06.377135 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:06.377029    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bcc5563f0ddcfb43260032bada70b94cb5a1ee6a5b8d8209e47f7ee50bb8eb5"
Jul 26 16:00:08.043037 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.042992    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"]
Jul 26 16:00:08.043505 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.043367    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75dbe5be-cf40-4d4a-b48a-90c79e22e402" containerName="cleanup"
Jul 26 16:00:08.043505 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.043380    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="75dbe5be-cf40-4d4a-b48a-90c79e22e402" containerName="cleanup"
Jul 26 16:00:08.043505 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.043444    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="75dbe5be-cf40-4d4a-b48a-90c79e22e402" containerName="cleanup"
Jul 26 16:00:08.046383 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.046361    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:08.049057 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.049031    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 26 16:00:08.049057 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.049043    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8278j\""
Jul 26 16:00:08.049830 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.049808    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 26 16:00:08.049954 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.049868    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 26 16:00:08.055819 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.055800    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"]
Jul 26 16:00:08.059484 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.059462    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b854eea9-79c6-412e-870d-b8704516c0af-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rs4dk\" (UID: \"b854eea9-79c6-412e-870d-b8704516c0af\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:08.059587 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.059492    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b854eea9-79c6-412e-870d-b8704516c0af-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rs4dk\" (UID: \"b854eea9-79c6-412e-870d-b8704516c0af\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:08.059587 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.059526    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b854eea9-79c6-412e-870d-b8704516c0af-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rs4dk\" (UID: \"b854eea9-79c6-412e-870d-b8704516c0af\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:08.059725 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.059595    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s52j\" (UniqueName: \"kubernetes.io/projected/b854eea9-79c6-412e-870d-b8704516c0af-kube-api-access-7s52j\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rs4dk\" (UID: \"b854eea9-79c6-412e-870d-b8704516c0af\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:08.059725 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.059673    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b854eea9-79c6-412e-870d-b8704516c0af-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rs4dk\" (UID: \"b854eea9-79c6-412e-870d-b8704516c0af\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:08.059725 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.059705    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b854eea9-79c6-412e-870d-b8704516c0af-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rs4dk\" (UID: \"b854eea9-79c6-412e-870d-b8704516c0af\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:08.160698 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.160660    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s52j\" (UniqueName: \"kubernetes.io/projected/b854eea9-79c6-412e-870d-b8704516c0af-kube-api-access-7s52j\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rs4dk\" (UID: \"b854eea9-79c6-412e-870d-b8704516c0af\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:08.160698 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.160701    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b854eea9-79c6-412e-870d-b8704516c0af-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rs4dk\" (UID: \"b854eea9-79c6-412e-870d-b8704516c0af\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:08.160930 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.160721    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b854eea9-79c6-412e-870d-b8704516c0af-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rs4dk\" (UID: \"b854eea9-79c6-412e-870d-b8704516c0af\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:08.160930 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.160785    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b854eea9-79c6-412e-870d-b8704516c0af-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rs4dk\" (UID: \"b854eea9-79c6-412e-870d-b8704516c0af\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:08.160930 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.160804    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b854eea9-79c6-412e-870d-b8704516c0af-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rs4dk\" (UID: \"b854eea9-79c6-412e-870d-b8704516c0af\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:08.161079 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.160952    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b854eea9-79c6-412e-870d-b8704516c0af-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rs4dk\" (UID: \"b854eea9-79c6-412e-870d-b8704516c0af\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:08.161264 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.161230    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b854eea9-79c6-412e-870d-b8704516c0af-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rs4dk\" (UID: \"b854eea9-79c6-412e-870d-b8704516c0af\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:08.161386 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.161270    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b854eea9-79c6-412e-870d-b8704516c0af-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rs4dk\" (UID: \"b854eea9-79c6-412e-870d-b8704516c0af\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:08.161386 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.161239    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b854eea9-79c6-412e-870d-b8704516c0af-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rs4dk\" (UID: \"b854eea9-79c6-412e-870d-b8704516c0af\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:08.163009 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.162981    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b854eea9-79c6-412e-870d-b8704516c0af-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rs4dk\" (UID: \"b854eea9-79c6-412e-870d-b8704516c0af\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:08.163377 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.163357    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b854eea9-79c6-412e-870d-b8704516c0af-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rs4dk\" (UID: \"b854eea9-79c6-412e-870d-b8704516c0af\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:08.168431 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.168409    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s52j\" (UniqueName: \"kubernetes.io/projected/b854eea9-79c6-412e-870d-b8704516c0af-kube-api-access-7s52j\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rs4dk\" (UID: \"b854eea9-79c6-412e-870d-b8704516c0af\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:08.358934 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.358853    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:08.493682 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.493496    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"]
Jul 26 16:00:08.496238 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:00:08.496206    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb854eea9_79c6_412e_870d_b8704516c0af.slice/crio-80df67ede4e1a1fa51b68b5c1a7e41a1983a0e93124231bf04e0da2c8e1100c0 WatchSource:0}: Error finding container 80df67ede4e1a1fa51b68b5c1a7e41a1983a0e93124231bf04e0da2c8e1100c0: Status 404 returned error can't find the container with id 80df67ede4e1a1fa51b68b5c1a7e41a1983a0e93124231bf04e0da2c8e1100c0
Jul 26 16:00:08.501372 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:08.501353    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 16:00:09.393964 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:09.393926    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk" event={"ID":"b854eea9-79c6-412e-870d-b8704516c0af","Type":"ContainerStarted","Data":"80df67ede4e1a1fa51b68b5c1a7e41a1983a0e93124231bf04e0da2c8e1100c0"}
Jul 26 16:00:11.408136 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:11.408052    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk" event={"ID":"b854eea9-79c6-412e-870d-b8704516c0af","Type":"ContainerStarted","Data":"f18c36c94563574b9fbfea92d6ee46d8eeb1ebe69c809a33263ce63dee1a5089"}
Jul 26 16:00:11.425182 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:11.425133    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk" podStartSLOduration=1.001348527 podStartE2EDuration="3.425118019s" totalImagesPullingTime="2.423769492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:00:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:00:11.423950205 +0000 UTC m=+607.642577254" watchObservedRunningTime="2026-07-26 16:00:11.425118019 +0000 UTC m=+607.643745112"
Jul 26 16:00:18.359863 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:18.359824    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:18.360246 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:18.359885    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:18.372493 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:18.372464    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:18.454727 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:18.454703    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rs4dk"
Jul 26 16:00:24.457481 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.457441    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"]
Jul 26 16:00:24.461145 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.461113    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:24.463562 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.463533    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 26 16:00:24.473196 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.473172    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"]
Jul 26 16:00:24.494358 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.494333    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpzqx\" (UniqueName: \"kubernetes.io/projected/fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33-kube-api-access-mpzqx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798\" (UID: \"fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:24.494438 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.494377    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798\" (UID: \"fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:24.494438 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.494407    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798\" (UID: \"fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:24.494526 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.494468    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798\" (UID: \"fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:24.494526 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.494521    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798\" (UID: \"fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:24.494613 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.494550    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798\" (UID: \"fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:24.595626 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.595599    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798\" (UID: \"fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:24.595749 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.595681    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpzqx\" (UniqueName: \"kubernetes.io/projected/fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33-kube-api-access-mpzqx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798\" (UID: \"fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:24.595749 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.595739    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798\" (UID: \"fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:24.595870 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.595764    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798\" (UID: \"fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:24.595870 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.595805    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798\" (UID: \"fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:24.595870 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.595860    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798\" (UID: \"fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:24.596011 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.595947    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798\" (UID: \"fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:24.596212 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.596192    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798\" (UID: \"fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:24.596321 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.596205    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798\" (UID: \"fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:24.598036 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.598015    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798\" (UID: \"fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:24.598187 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.598168    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798\" (UID: \"fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:24.602867 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.602849    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpzqx\" (UniqueName: \"kubernetes.io/projected/fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33-kube-api-access-mpzqx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798\" (UID: \"fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:24.772820 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.772749    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:24.901410 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:24.901386    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"]
Jul 26 16:00:24.902650 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:00:24.902611    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb2730f2_8cdb_4dba_8d2d_1773b5e6aa33.slice/crio-431d8c6612bee15fe8d0cadf1b065bc78e7c667e9708ba24f6b9a31b912577b8 WatchSource:0}: Error finding container 431d8c6612bee15fe8d0cadf1b065bc78e7c667e9708ba24f6b9a31b912577b8: Status 404 returned error can't find the container with id 431d8c6612bee15fe8d0cadf1b065bc78e7c667e9708ba24f6b9a31b912577b8
Jul 26 16:00:25.481381 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:25.481348    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798" event={"ID":"fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33","Type":"ContainerStarted","Data":"e5b108a14ddfdb7ed6dc64e94ba3dd6c0ec49f741b3a60e83f5147853b3d3fe9"}
Jul 26 16:00:25.481758 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:25.481401    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798" event={"ID":"fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33","Type":"ContainerStarted","Data":"431d8c6612bee15fe8d0cadf1b065bc78e7c667e9708ba24f6b9a31b912577b8"}
Jul 26 16:00:25.499547 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:25.499494    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798" podStartSLOduration=1.294090161 podStartE2EDuration="1.499479625s" totalImagesPullingTime="205.389464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:00:25.496974889 +0000 UTC m=+621.715601960" watchObservedRunningTime="2026-07-26 16:00:25.499479625 +0000 UTC m=+621.718106707"
Jul 26 16:00:34.773222 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:34.773143    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:34.773783 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:34.773228    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:34.785888 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:34.785864    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:00:35.546745 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:00:35.546711    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798"
Jul 26 16:02:14.710233 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:02:14.710156    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9c96d967b-jptwk"]
Jul 26 16:02:14.710809 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:02:14.710370    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-9c96d967b-jptwk" podUID="834c11b3-5157-40dc-99eb-5019d18ca8c6" containerName="authorino" containerID="cri-o://ea1c533e163800162f8729f09cc95029161c93af7b1555f3df3dfcb5386b79bc" gracePeriod=30
Jul 26 16:02:14.954706 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:02:14.954683    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9c96d967b-jptwk"
Jul 26 16:02:14.990584 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:02:14.990515    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/834c11b3-5157-40dc-99eb-5019d18ca8c6-tls-cert\") pod \"834c11b3-5157-40dc-99eb-5019d18ca8c6\" (UID: \"834c11b3-5157-40dc-99eb-5019d18ca8c6\") "
Jul 26 16:02:14.990584 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:02:14.990581    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnfdb\" (UniqueName: \"kubernetes.io/projected/834c11b3-5157-40dc-99eb-5019d18ca8c6-kube-api-access-tnfdb\") pod \"834c11b3-5157-40dc-99eb-5019d18ca8c6\" (UID: \"834c11b3-5157-40dc-99eb-5019d18ca8c6\") "
Jul 26 16:02:14.992534 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:02:14.992504    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/834c11b3-5157-40dc-99eb-5019d18ca8c6-kube-api-access-tnfdb" (OuterVolumeSpecName: "kube-api-access-tnfdb") pod "834c11b3-5157-40dc-99eb-5019d18ca8c6" (UID: "834c11b3-5157-40dc-99eb-5019d18ca8c6"). InnerVolumeSpecName "kube-api-access-tnfdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:02:15.000468 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:02:15.000439    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/834c11b3-5157-40dc-99eb-5019d18ca8c6-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "834c11b3-5157-40dc-99eb-5019d18ca8c6" (UID: "834c11b3-5157-40dc-99eb-5019d18ca8c6"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:02:15.072679 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:02:15.072626    2556 generic.go:356] "Generic (PLEG): container finished" podID="834c11b3-5157-40dc-99eb-5019d18ca8c6" containerID="ea1c533e163800162f8729f09cc95029161c93af7b1555f3df3dfcb5386b79bc" exitCode=0
Jul 26 16:02:15.072856 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:02:15.072689    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9c96d967b-jptwk"
Jul 26 16:02:15.072856 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:02:15.072734    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9c96d967b-jptwk" event={"ID":"834c11b3-5157-40dc-99eb-5019d18ca8c6","Type":"ContainerDied","Data":"ea1c533e163800162f8729f09cc95029161c93af7b1555f3df3dfcb5386b79bc"}
Jul 26 16:02:15.072856 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:02:15.072782    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9c96d967b-jptwk" event={"ID":"834c11b3-5157-40dc-99eb-5019d18ca8c6","Type":"ContainerDied","Data":"6a3d67d0268b46916c21907918f99b1d73afdbe6a01fdfd3f4a4bbeee5fab47a"}
Jul 26 16:02:15.072856 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:02:15.072801    2556 scope.go:117] "RemoveContainer" containerID="ea1c533e163800162f8729f09cc95029161c93af7b1555f3df3dfcb5386b79bc"
Jul 26 16:02:15.085183 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:02:15.085142    2556 scope.go:117] "RemoveContainer" containerID="ea1c533e163800162f8729f09cc95029161c93af7b1555f3df3dfcb5386b79bc"
Jul 26 16:02:15.085845 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:02:15.085821    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea1c533e163800162f8729f09cc95029161c93af7b1555f3df3dfcb5386b79bc\": container with ID starting with ea1c533e163800162f8729f09cc95029161c93af7b1555f3df3dfcb5386b79bc not found: ID does not exist" containerID="ea1c533e163800162f8729f09cc95029161c93af7b1555f3df3dfcb5386b79bc"
Jul 26 16:02:15.085954 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:02:15.085853    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea1c533e163800162f8729f09cc95029161c93af7b1555f3df3dfcb5386b79bc"} err="failed to get container status \"ea1c533e163800162f8729f09cc95029161c93af7b1555f3df3dfcb5386b79bc\": rpc error: code = NotFound desc = could not find container \"ea1c533e163800162f8729f09cc95029161c93af7b1555f3df3dfcb5386b79bc\": container with ID starting with ea1c533e163800162f8729f09cc95029161c93af7b1555f3df3dfcb5386b79bc not found: ID does not exist"
Jul 26 16:02:15.091284 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:02:15.091265    2556 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/834c11b3-5157-40dc-99eb-5019d18ca8c6-tls-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:02:15.091346 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:02:15.091287    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnfdb\" (UniqueName: \"kubernetes.io/projected/834c11b3-5157-40dc-99eb-5019d18ca8c6-kube-api-access-tnfdb\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:02:15.098175 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:02:15.098151    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9c96d967b-jptwk"]
Jul 26 16:02:15.100183 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:02:15.100164    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-9c96d967b-jptwk"]
Jul 26 16:02:16.214949 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:02:16.214906    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="834c11b3-5157-40dc-99eb-5019d18ca8c6" path="/var/lib/kubelet/pods/834c11b3-5157-40dc-99eb-5019d18ca8c6/volumes"
Jul 26 16:05:04.581457 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:05:04.581386    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 16:05:04.582359 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:05:04.582334    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 16:10:04.613844 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:10:04.613811    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 16:10:04.617268 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:10:04.617250    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 16:13:02.148801 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.148768    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"]
Jul 26 16:13:02.149266 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.149115    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="834c11b3-5157-40dc-99eb-5019d18ca8c6" containerName="authorino"
Jul 26 16:13:02.149266 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.149126    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="834c11b3-5157-40dc-99eb-5019d18ca8c6" containerName="authorino"
Jul 26 16:13:02.149266 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.149182    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="834c11b3-5157-40dc-99eb-5019d18ca8c6" containerName="authorino"
Jul 26 16:13:02.152143 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.152127    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:02.154543 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.154522    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-ff15d0a1-kserve-self-signed-certs\""
Jul 26 16:13:02.167508 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.167486    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"]
Jul 26 16:13:02.273126 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.273096    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r89fl\" (UniqueName: \"kubernetes.io/projected/bb350303-f8de-43fc-aa74-259d8d671227-kube-api-access-r89fl\") pod \"e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") " pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:02.273299 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.273138    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-home\") pod \"e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") " pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:02.273299 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.273245    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-tmp-dir\") pod \"e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") " pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:02.273299 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.273274    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb350303-f8de-43fc-aa74-259d8d671227-tls-certs\") pod \"e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") " pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:02.273424 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.273303    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-model-cache\") pod \"e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") " pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:02.273424 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.273355    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-dshm\") pod \"e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") " pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:02.373795 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.373760    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r89fl\" (UniqueName: \"kubernetes.io/projected/bb350303-f8de-43fc-aa74-259d8d671227-kube-api-access-r89fl\") pod \"e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") " pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:02.373935 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.373802    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-home\") pod \"e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") " pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:02.373935 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.373882    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-tmp-dir\") pod \"e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") " pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:02.373935 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.373908    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb350303-f8de-43fc-aa74-259d8d671227-tls-certs\") pod \"e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") " pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:02.374092 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.373936    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-model-cache\") pod \"e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") " pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:02.374092 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.373962    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-dshm\") pod \"e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") " pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:02.374277 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.374254    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-home\") pod \"e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") " pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:02.374350 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.374289    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-tmp-dir\") pod \"e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") " pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:02.374390 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.374351    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-model-cache\") pod \"e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") " pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:02.376242 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.376220    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-dshm\") pod \"e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") " pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:02.376498 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.376472    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb350303-f8de-43fc-aa74-259d8d671227-tls-certs\") pod \"e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") " pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:02.382845 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.382824    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r89fl\" (UniqueName: \"kubernetes.io/projected/bb350303-f8de-43fc-aa74-259d8d671227-kube-api-access-r89fl\") pod \"e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") " pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:02.461330 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.461297    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:02.598914 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:02.598884    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"]
Jul 26 16:13:02.600426 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:13:02.600397    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb350303_f8de_43fc_aa74_259d8d671227.slice/crio-ee2ea5c9d5e592ca011b907776e0c703eeffce226b87242ab6d1711e62a01d76 WatchSource:0}: Error finding container ee2ea5c9d5e592ca011b907776e0c703eeffce226b87242ab6d1711e62a01d76: Status 404 returned error can't find the container with id ee2ea5c9d5e592ca011b907776e0c703eeffce226b87242ab6d1711e62a01d76
Jul 26 16:13:03.512243 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:03.512203    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt" event={"ID":"bb350303-f8de-43fc-aa74-259d8d671227","Type":"ContainerStarted","Data":"89ade467263ab04e47f636dde382e13f16ebd98b357e7986317d09dcb7eb3f6c"}
Jul 26 16:13:03.512666 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:03.512256    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt" event={"ID":"bb350303-f8de-43fc-aa74-259d8d671227","Type":"ContainerStarted","Data":"ee2ea5c9d5e592ca011b907776e0c703eeffce226b87242ab6d1711e62a01d76"}
Jul 26 16:13:03.527322 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:03.527272    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt" podStartSLOduration=1.527253317 podStartE2EDuration="1.527253317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:13:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:13:03.526730672 +0000 UTC m=+1379.745357721" watchObservedRunningTime="2026-07-26 16:13:03.527253317 +0000 UTC m=+1379.745880366"
Jul 26 16:13:08.734098 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.734057    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"]
Jul 26 16:13:08.737702 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.737681    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:08.739820 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.739802    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-ff15d0a1-kserve-self-signed-certs\""
Jul 26 16:13:08.745217 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.745193    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"]
Jul 26 16:13:08.832006 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.831981    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb8fb528-deb7-4090-9645-8b3fecb0f69d-tls-certs\") pod \"e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") " pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:08.832099 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.832010    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-model-cache\") pod \"e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") " pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:08.832099 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.832034    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2jhk\" (UniqueName: \"kubernetes.io/projected/fb8fb528-deb7-4090-9645-8b3fecb0f69d-kube-api-access-g2jhk\") pod \"e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") " pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:08.832175 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.832120    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-dshm\") pod \"e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") " pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:08.832175 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.832152    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-home\") pod \"e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") " pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:08.832243 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.832192    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-tmp-dir\") pod \"e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") " pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:08.932540 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.932511    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2jhk\" (UniqueName: \"kubernetes.io/projected/fb8fb528-deb7-4090-9645-8b3fecb0f69d-kube-api-access-g2jhk\") pod \"e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") " pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:08.932674 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.932565    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-dshm\") pod \"e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") " pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:08.932674 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.932595    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-home\") pod \"e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") " pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:08.932802 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.932679    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-tmp-dir\") pod \"e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") " pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:08.932802 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.932738    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb8fb528-deb7-4090-9645-8b3fecb0f69d-tls-certs\") pod \"e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") " pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:08.932802 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.932767    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-model-cache\") pod \"e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") " pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:08.933009 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.932985    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-home\") pod \"e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") " pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:08.933087 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.933062    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-tmp-dir\") pod \"e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") " pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:08.933152 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.933137    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-model-cache\") pod \"e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") " pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:08.934854 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.934831    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-dshm\") pod \"e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") " pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:08.935349 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.935325    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb8fb528-deb7-4090-9645-8b3fecb0f69d-tls-certs\") pod \"e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") " pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:08.943612 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:08.943585    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2jhk\" (UniqueName: \"kubernetes.io/projected/fb8fb528-deb7-4090-9645-8b3fecb0f69d-kube-api-access-g2jhk\") pod \"e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") " pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:09.048008 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:09.047937    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:09.183709 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:09.183685    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"]
Jul 26 16:13:09.185771 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:13:09.185745    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb8fb528_deb7_4090_9645_8b3fecb0f69d.slice/crio-ce17a4e9c0de327d1295e04de5d6b17a7b2d7f77bba109507a119bce4740ad0e WatchSource:0}: Error finding container ce17a4e9c0de327d1295e04de5d6b17a7b2d7f77bba109507a119bce4740ad0e: Status 404 returned error can't find the container with id ce17a4e9c0de327d1295e04de5d6b17a7b2d7f77bba109507a119bce4740ad0e
Jul 26 16:13:09.544022 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:09.543993    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v" event={"ID":"fb8fb528-deb7-4090-9645-8b3fecb0f69d","Type":"ContainerStarted","Data":"ccb367ee1d59608c777a7bbdb87f64b3be83cd3868f45c46d1893c21fd1a476d"}
Jul 26 16:13:09.544169 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:09.544031    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v" event={"ID":"fb8fb528-deb7-4090-9645-8b3fecb0f69d","Type":"ContainerStarted","Data":"ce17a4e9c0de327d1295e04de5d6b17a7b2d7f77bba109507a119bce4740ad0e"}
Jul 26 16:13:09.561291 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:09.561244    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v" podStartSLOduration=1.561229876 podStartE2EDuration="1.561229876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:13:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:13:09.558743721 +0000 UTC m=+1385.777370772" watchObservedRunningTime="2026-07-26 16:13:09.561229876 +0000 UTC m=+1385.779856925"
Jul 26 16:13:12.461532 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:12.461447    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:12.461951 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:12.461726    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:12.474387 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:12.474360    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:12.569815 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:12.569781    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:19.048441 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:19.048393    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:19.048441 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:19.048454    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:19.061201 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:19.061173    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:19.606744 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:19.606709    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:36.943918 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:36.943885    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"]
Jul 26 16:13:38.158787 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:38.158752    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"]
Jul 26 16:13:51.963076 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:51.963031    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt" podUID="bb350303-f8de-43fc-aa74-259d8d671227" containerName="main" containerID="cri-o://89ade467263ab04e47f636dde382e13f16ebd98b357e7986317d09dcb7eb3f6c" gracePeriod=45
Jul 26 16:13:52.220559 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.220502    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:52.294811 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.294787    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-dshm\") pod \"bb350303-f8de-43fc-aa74-259d8d671227\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") "
Jul 26 16:13:52.294921 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.294821    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-model-cache\") pod \"bb350303-f8de-43fc-aa74-259d8d671227\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") "
Jul 26 16:13:52.294921 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.294851    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-tmp-dir\") pod \"bb350303-f8de-43fc-aa74-259d8d671227\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") "
Jul 26 16:13:52.294921 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.294887    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r89fl\" (UniqueName: \"kubernetes.io/projected/bb350303-f8de-43fc-aa74-259d8d671227-kube-api-access-r89fl\") pod \"bb350303-f8de-43fc-aa74-259d8d671227\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") "
Jul 26 16:13:52.295079 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.294922    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-home\") pod \"bb350303-f8de-43fc-aa74-259d8d671227\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") "
Jul 26 16:13:52.295079 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.294966    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb350303-f8de-43fc-aa74-259d8d671227-tls-certs\") pod \"bb350303-f8de-43fc-aa74-259d8d671227\" (UID: \"bb350303-f8de-43fc-aa74-259d8d671227\") "
Jul 26 16:13:52.295183 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.295065    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-model-cache" (OuterVolumeSpecName: "model-cache") pod "bb350303-f8de-43fc-aa74-259d8d671227" (UID: "bb350303-f8de-43fc-aa74-259d8d671227"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:13:52.295183 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.295163    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bb350303-f8de-43fc-aa74-259d8d671227" (UID: "bb350303-f8de-43fc-aa74-259d8d671227"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:13:52.295291 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.295211    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-home" (OuterVolumeSpecName: "home") pod "bb350303-f8de-43fc-aa74-259d8d671227" (UID: "bb350303-f8de-43fc-aa74-259d8d671227"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:13:52.295506 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.295444    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-model-cache\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:13:52.295506 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.295469    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-tmp-dir\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:13:52.295506 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.295482    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-home\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:13:52.297180 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.297153    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb350303-f8de-43fc-aa74-259d8d671227-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bb350303-f8de-43fc-aa74-259d8d671227" (UID: "bb350303-f8de-43fc-aa74-259d8d671227"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:13:52.297180 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.297175    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb350303-f8de-43fc-aa74-259d8d671227-kube-api-access-r89fl" (OuterVolumeSpecName: "kube-api-access-r89fl") pod "bb350303-f8de-43fc-aa74-259d8d671227" (UID: "bb350303-f8de-43fc-aa74-259d8d671227"). InnerVolumeSpecName "kube-api-access-r89fl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:13:52.297315 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.297163    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-dshm" (OuterVolumeSpecName: "dshm") pod "bb350303-f8de-43fc-aa74-259d8d671227" (UID: "bb350303-f8de-43fc-aa74-259d8d671227"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:13:52.396452 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.396429    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r89fl\" (UniqueName: \"kubernetes.io/projected/bb350303-f8de-43fc-aa74-259d8d671227-kube-api-access-r89fl\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:13:52.396452 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.396451    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb350303-f8de-43fc-aa74-259d8d671227-tls-certs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:13:52.396585 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.396462    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb350303-f8de-43fc-aa74-259d8d671227-dshm\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:13:52.777830 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.777802    2556 generic.go:356] "Generic (PLEG): container finished" podID="bb350303-f8de-43fc-aa74-259d8d671227" containerID="89ade467263ab04e47f636dde382e13f16ebd98b357e7986317d09dcb7eb3f6c" exitCode=0
Jul 26 16:13:52.777991 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.777842    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"
Jul 26 16:13:52.777991 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.777857    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt" event={"ID":"bb350303-f8de-43fc-aa74-259d8d671227","Type":"ContainerDied","Data":"89ade467263ab04e47f636dde382e13f16ebd98b357e7986317d09dcb7eb3f6c"}
Jul 26 16:13:52.777991 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.777900    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt" event={"ID":"bb350303-f8de-43fc-aa74-259d8d671227","Type":"ContainerDied","Data":"ee2ea5c9d5e592ca011b907776e0c703eeffce226b87242ab6d1711e62a01d76"}
Jul 26 16:13:52.777991 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.777923    2556 scope.go:117] "RemoveContainer" containerID="89ade467263ab04e47f636dde382e13f16ebd98b357e7986317d09dcb7eb3f6c"
Jul 26 16:13:52.788677 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.788658    2556 scope.go:117] "RemoveContainer" containerID="89ade467263ab04e47f636dde382e13f16ebd98b357e7986317d09dcb7eb3f6c"
Jul 26 16:13:52.788951 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:13:52.788933    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89ade467263ab04e47f636dde382e13f16ebd98b357e7986317d09dcb7eb3f6c\": container with ID starting with 89ade467263ab04e47f636dde382e13f16ebd98b357e7986317d09dcb7eb3f6c not found: ID does not exist" containerID="89ade467263ab04e47f636dde382e13f16ebd98b357e7986317d09dcb7eb3f6c"
Jul 26 16:13:52.789014 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.788957    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89ade467263ab04e47f636dde382e13f16ebd98b357e7986317d09dcb7eb3f6c"} err="failed to get container status \"89ade467263ab04e47f636dde382e13f16ebd98b357e7986317d09dcb7eb3f6c\": rpc error: code = NotFound desc = could not find container \"89ade467263ab04e47f636dde382e13f16ebd98b357e7986317d09dcb7eb3f6c\": container with ID starting with 89ade467263ab04e47f636dde382e13f16ebd98b357e7986317d09dcb7eb3f6c not found: ID does not exist"
Jul 26 16:13:52.802213 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.802191    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"]
Jul 26 16:13:52.805266 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:52.805245    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-ff15d0a1-kserve-9cbdff679-5b6pt"]
Jul 26 16:13:53.178044 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.178008    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v" podUID="fb8fb528-deb7-4090-9645-8b3fecb0f69d" containerName="main" containerID="cri-o://ccb367ee1d59608c777a7bbdb87f64b3be83cd3868f45c46d1893c21fd1a476d" gracePeriod=45
Jul 26 16:13:53.432804 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.432749    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:53.608696 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.608671    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-tmp-dir\") pod \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") "
Jul 26 16:13:53.608830 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.608719    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-home\") pod \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") "
Jul 26 16:13:53.608830 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.608751    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2jhk\" (UniqueName: \"kubernetes.io/projected/fb8fb528-deb7-4090-9645-8b3fecb0f69d-kube-api-access-g2jhk\") pod \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") "
Jul 26 16:13:53.608830 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.608777    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-dshm\") pod \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") "
Jul 26 16:13:53.608830 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.608823    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb8fb528-deb7-4090-9645-8b3fecb0f69d-tls-certs\") pod \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") "
Jul 26 16:13:53.609050 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.608882    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-model-cache\") pod \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\" (UID: \"fb8fb528-deb7-4090-9645-8b3fecb0f69d\") "
Jul 26 16:13:53.609050 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.608984    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fb8fb528-deb7-4090-9645-8b3fecb0f69d" (UID: "fb8fb528-deb7-4090-9645-8b3fecb0f69d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:13:53.609050 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.608997    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-home" (OuterVolumeSpecName: "home") pod "fb8fb528-deb7-4090-9645-8b3fecb0f69d" (UID: "fb8fb528-deb7-4090-9645-8b3fecb0f69d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:13:53.609203 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.609163    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-model-cache" (OuterVolumeSpecName: "model-cache") pod "fb8fb528-deb7-4090-9645-8b3fecb0f69d" (UID: "fb8fb528-deb7-4090-9645-8b3fecb0f69d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:13:53.609263 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.609221    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-tmp-dir\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:13:53.609263 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.609243    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-home\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:13:53.610909 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.610886    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb8fb528-deb7-4090-9645-8b3fecb0f69d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fb8fb528-deb7-4090-9645-8b3fecb0f69d" (UID: "fb8fb528-deb7-4090-9645-8b3fecb0f69d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:13:53.611039 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.611018    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb8fb528-deb7-4090-9645-8b3fecb0f69d-kube-api-access-g2jhk" (OuterVolumeSpecName: "kube-api-access-g2jhk") pod "fb8fb528-deb7-4090-9645-8b3fecb0f69d" (UID: "fb8fb528-deb7-4090-9645-8b3fecb0f69d"). InnerVolumeSpecName "kube-api-access-g2jhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:13:53.611086 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.611027    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-dshm" (OuterVolumeSpecName: "dshm") pod "fb8fb528-deb7-4090-9645-8b3fecb0f69d" (UID: "fb8fb528-deb7-4090-9645-8b3fecb0f69d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:13:53.710486 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.710434    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2jhk\" (UniqueName: \"kubernetes.io/projected/fb8fb528-deb7-4090-9645-8b3fecb0f69d-kube-api-access-g2jhk\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:13:53.710486 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.710454    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-dshm\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:13:53.710486 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.710465    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb8fb528-deb7-4090-9645-8b3fecb0f69d-tls-certs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:13:53.710486 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.710474    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb8fb528-deb7-4090-9645-8b3fecb0f69d-model-cache\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:13:53.785404 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.785381    2556 generic.go:356] "Generic (PLEG): container finished" podID="fb8fb528-deb7-4090-9645-8b3fecb0f69d" containerID="ccb367ee1d59608c777a7bbdb87f64b3be83cd3868f45c46d1893c21fd1a476d" exitCode=0
Jul 26 16:13:53.785490 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.785425    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"
Jul 26 16:13:53.785490 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.785440    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v" event={"ID":"fb8fb528-deb7-4090-9645-8b3fecb0f69d","Type":"ContainerDied","Data":"ccb367ee1d59608c777a7bbdb87f64b3be83cd3868f45c46d1893c21fd1a476d"}
Jul 26 16:13:53.785490 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.785469    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v" event={"ID":"fb8fb528-deb7-4090-9645-8b3fecb0f69d","Type":"ContainerDied","Data":"ce17a4e9c0de327d1295e04de5d6b17a7b2d7f77bba109507a119bce4740ad0e"}
Jul 26 16:13:53.785490 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.785490    2556 scope.go:117] "RemoveContainer" containerID="ccb367ee1d59608c777a7bbdb87f64b3be83cd3868f45c46d1893c21fd1a476d"
Jul 26 16:13:53.794313 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.794297    2556 scope.go:117] "RemoveContainer" containerID="ccb367ee1d59608c777a7bbdb87f64b3be83cd3868f45c46d1893c21fd1a476d"
Jul 26 16:13:53.794579 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:13:53.794561    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccb367ee1d59608c777a7bbdb87f64b3be83cd3868f45c46d1893c21fd1a476d\": container with ID starting with ccb367ee1d59608c777a7bbdb87f64b3be83cd3868f45c46d1893c21fd1a476d not found: ID does not exist" containerID="ccb367ee1d59608c777a7bbdb87f64b3be83cd3868f45c46d1893c21fd1a476d"
Jul 26 16:13:53.794653 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.794586    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccb367ee1d59608c777a7bbdb87f64b3be83cd3868f45c46d1893c21fd1a476d"} err="failed to get container status \"ccb367ee1d59608c777a7bbdb87f64b3be83cd3868f45c46d1893c21fd1a476d\": rpc error: code = NotFound desc = could not find container \"ccb367ee1d59608c777a7bbdb87f64b3be83cd3868f45c46d1893c21fd1a476d\": container with ID starting with ccb367ee1d59608c777a7bbdb87f64b3be83cd3868f45c46d1893c21fd1a476d not found: ID does not exist"
Jul 26 16:13:53.806615 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.806590    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"]
Jul 26 16:13:53.811129 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:53.811110    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-ff15d0a1-kserve-db5c4bdcf-zv94v"]
Jul 26 16:13:54.215286 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:54.215257    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb350303-f8de-43fc-aa74-259d8d671227" path="/var/lib/kubelet/pods/bb350303-f8de-43fc-aa74-259d8d671227/volumes"
Jul 26 16:13:54.215647 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:13:54.215611    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb8fb528-deb7-4090-9645-8b3fecb0f69d" path="/var/lib/kubelet/pods/fb8fb528-deb7-4090-9645-8b3fecb0f69d/volumes"
Jul 26 16:15:00.142458 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:15:00.142419    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29751375-7zhps"]
Jul 26 16:15:00.143077 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:15:00.142947    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb8fb528-deb7-4090-9645-8b3fecb0f69d" containerName="main"
Jul 26 16:15:00.143077 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:15:00.142968    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb8fb528-deb7-4090-9645-8b3fecb0f69d" containerName="main"
Jul 26 16:15:00.143077 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:15:00.142984    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb350303-f8de-43fc-aa74-259d8d671227" containerName="main"
Jul 26 16:15:00.143077 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:15:00.142992    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb350303-f8de-43fc-aa74-259d8d671227" containerName="main"
Jul 26 16:15:00.143296 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:15:00.143094    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb8fb528-deb7-4090-9645-8b3fecb0f69d" containerName="main"
Jul 26 16:15:00.143296 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:15:00.143112    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb350303-f8de-43fc-aa74-259d8d671227" containerName="main"
Jul 26 16:15:00.146304 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:15:00.146284    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751375-7zhps"
Jul 26 16:15:00.149110 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:15:00.149084    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlwwk\""
Jul 26 16:15:00.153322 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:15:00.153302    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29751375-7zhps"]
Jul 26 16:15:00.157679 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:15:00.157657    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751375-7zhps"
Jul 26 16:15:00.296785 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:15:00.296761    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29751375-7zhps"]
Jul 26 16:15:00.299578 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:15:00.299553    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod060e8050_752e_4f25_a1c4_1efaf3afded6.slice/crio-ec15c0c737f7c83888b32e97e64f09091e22ed0f29cf827ec96ab7394f7ae465 WatchSource:0}: Error finding container ec15c0c737f7c83888b32e97e64f09091e22ed0f29cf827ec96ab7394f7ae465: Status 404 returned error can't find the container with id ec15c0c737f7c83888b32e97e64f09091e22ed0f29cf827ec96ab7394f7ae465
Jul 26 16:15:01.168073 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:15:01.168046    2556 generic.go:356] "Generic (PLEG): container finished" podID="060e8050-752e-4f25-a1c4-1efaf3afded6" containerID="13a702b1f320226a85fd46326bd911b3ce441e5cba194b7a8b54734f46def689" exitCode=0
Jul 26 16:15:01.168367 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:15:01.168129    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751375-7zhps" event={"ID":"060e8050-752e-4f25-a1c4-1efaf3afded6","Type":"ContainerDied","Data":"13a702b1f320226a85fd46326bd911b3ce441e5cba194b7a8b54734f46def689"}
Jul 26 16:15:01.168367 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:15:01.168186    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751375-7zhps" event={"ID":"060e8050-752e-4f25-a1c4-1efaf3afded6","Type":"ContainerStarted","Data":"ec15c0c737f7c83888b32e97e64f09091e22ed0f29cf827ec96ab7394f7ae465"}
Jul 26 16:15:02.300881 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:15:02.300857    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751375-7zhps"
Jul 26 16:15:03.180402 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:15:03.180369    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751375-7zhps"
Jul 26 16:15:03.180402 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:15:03.180394    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751375-7zhps" event={"ID":"060e8050-752e-4f25-a1c4-1efaf3afded6","Type":"ContainerDied","Data":"ec15c0c737f7c83888b32e97e64f09091e22ed0f29cf827ec96ab7394f7ae465"}
Jul 26 16:15:03.180703 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:15:03.180436    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec15c0c737f7c83888b32e97e64f09091e22ed0f29cf827ec96ab7394f7ae465"
Jul 26 16:15:04.648678 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:15:04.648546    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 16:15:04.664003 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:15:04.653102    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 16:17:19.881718 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:19.881684    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"]
Jul 26 16:17:19.882121 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:19.882040    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="060e8050-752e-4f25-a1c4-1efaf3afded6" containerName="cleanup"
Jul 26 16:17:19.882121 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:19.882051    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="060e8050-752e-4f25-a1c4-1efaf3afded6" containerName="cleanup"
Jul 26 16:17:19.882121 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:19.882113    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="060e8050-752e-4f25-a1c4-1efaf3afded6" containerName="cleanup"
Jul 26 16:17:19.885071 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:19.885055    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:19.887524 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:19.887503    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6abd1847-openshift-default-dockercfg-wl5k6\""
Jul 26 16:17:19.905229 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:19.905206    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"]
Jul 26 16:17:20.041726 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.041691    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-istio-envoy\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.041726 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.041736    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f259077-c876-4cec-944f-e72b2b8cf009-istiod-ca-cert\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.042041 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.041783    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mpww\" (UniqueName: \"kubernetes.io/projected/8f259077-c876-4cec-944f-e72b2b8cf009-kube-api-access-9mpww\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.042041 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.041805    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-workload-certs\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.042041 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.041821    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f259077-c876-4cec-944f-e72b2b8cf009-istio-podinfo\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.042041 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.041839    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-credential-socket\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.042041 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.041856    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-istio-data\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.042041 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.041931    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-workload-socket\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.042041 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.041977    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f259077-c876-4cec-944f-e72b2b8cf009-istio-token\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.143290 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.143198    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-istio-envoy\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.143290 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.143236    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f259077-c876-4cec-944f-e72b2b8cf009-istiod-ca-cert\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.143290 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.143261    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mpww\" (UniqueName: \"kubernetes.io/projected/8f259077-c876-4cec-944f-e72b2b8cf009-kube-api-access-9mpww\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.143582 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.143377    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-workload-certs\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.143582 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.143409    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f259077-c876-4cec-944f-e72b2b8cf009-istio-podinfo\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.143582 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.143440    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-credential-socket\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.143582 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.143510    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-istio-data\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.144270 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.143599    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-workload-socket\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.144270 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.143670    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f259077-c876-4cec-944f-e72b2b8cf009-istio-token\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.144270 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.143758    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-credential-socket\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.144270 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.143853    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-workload-certs\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.144270 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.143986    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-istio-data\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.144270 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.144033    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-workload-socket\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.144270 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.144061    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f259077-c876-4cec-944f-e72b2b8cf009-istiod-ca-cert\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.145759 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.145738    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-istio-envoy\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.145986 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.145966    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f259077-c876-4cec-944f-e72b2b8cf009-istio-podinfo\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.151403 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.151383    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f259077-c876-4cec-944f-e72b2b8cf009-istio-token\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.151926 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.151906    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mpww\" (UniqueName: \"kubernetes.io/projected/8f259077-c876-4cec-944f-e72b2b8cf009-kube-api-access-9mpww\") pod \"e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") " pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.194516 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.194478    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:20.336811 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.336778    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"]
Jul 26 16:17:20.337597 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:17:20.337566    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f259077_c876_4cec_944f_e72b2b8cf009.slice/crio-6c97ba4947b0ea436c79d681cf1459f5e5e634fc6e5213c589e9532b71e99907 WatchSource:0}: Error finding container 6c97ba4947b0ea436c79d681cf1459f5e5e634fc6e5213c589e9532b71e99907: Status 404 returned error can't find the container with id 6c97ba4947b0ea436c79d681cf1459f5e5e634fc6e5213c589e9532b71e99907
Jul 26 16:17:20.339654 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.339593    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:17:20.339738 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.339683    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:17:20.339738 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.339716    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:17:20.913267 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.913230    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr" event={"ID":"8f259077-c876-4cec-944f-e72b2b8cf009","Type":"ContainerStarted","Data":"8f627bde0a980da24ab582dae05e5699ced20837c7eddfdc61216be0e0141c39"}
Jul 26 16:17:20.913688 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.913314    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr" event={"ID":"8f259077-c876-4cec-944f-e72b2b8cf009","Type":"ContainerStarted","Data":"6c97ba4947b0ea436c79d681cf1459f5e5e634fc6e5213c589e9532b71e99907"}
Jul 26 16:17:20.948827 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:20.948773    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr" podStartSLOduration=1.9487580690000001 podStartE2EDuration="1.948758069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:17:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:17:20.946680497 +0000 UTC m=+1637.165307564" watchObservedRunningTime="2026-07-26 16:17:20.948758069 +0000 UTC m=+1637.167385118"
Jul 26 16:17:21.195255 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:21.195220    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:21.200095 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:21.200072    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:21.918591 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:21.918561    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:21.919487 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:21.919469    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:37.960797 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:37.960762    2556 patch_prober.go:28] interesting pod/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 26 16:17:37.961210 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:37.960832    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr" podUID="8f259077-c876-4cec-944f-e72b2b8cf009" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 26 16:17:39.019613 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:39.019575    2556 generic.go:356] "Generic (PLEG): container finished" podID="8f259077-c876-4cec-944f-e72b2b8cf009" containerID="8f627bde0a980da24ab582dae05e5699ced20837c7eddfdc61216be0e0141c39" exitCode=0
Jul 26 16:17:39.020110 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:39.019667    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr" event={"ID":"8f259077-c876-4cec-944f-e72b2b8cf009","Type":"ContainerDied","Data":"8f627bde0a980da24ab582dae05e5699ced20837c7eddfdc61216be0e0141c39"}
Jul 26 16:17:39.020110 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:39.020071    2556 scope.go:117] "RemoveContainer" containerID="8f627bde0a980da24ab582dae05e5699ced20837c7eddfdc61216be0e0141c39"
Jul 26 16:17:39.021170 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:39.021138    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:17:39.021231 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:39.021218    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:17:39.021272 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:39.021254    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:17:40.027335 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:40.027298    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr" event={"ID":"8f259077-c876-4cec-944f-e72b2b8cf009","Type":"ContainerStarted","Data":"f89d5341435f691b477837220c39371470e7fea84c8c49c92a0020587aa78ede"}
Jul 26 16:17:40.195536 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:40.195505    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:40.195738 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:40.195718    2556 patch_prober.go:28] interesting pod/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 26 16:17:40.195795 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:40.195765    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr" podUID="8f259077-c876-4cec-944f-e72b2b8cf009" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 26 16:17:41.195574 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:41.195531    2556 patch_prober.go:28] interesting pod/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 26 16:17:41.195998 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:41.195592    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr" podUID="8f259077-c876-4cec-944f-e72b2b8cf009" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 26 16:17:42.195451 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:42.195414    2556 patch_prober.go:28] interesting pod/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 26 16:17:42.195649 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:42.195474    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr" podUID="8f259077-c876-4cec-944f-e72b2b8cf009" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 26 16:17:43.194948 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:43.194915    2556 patch_prober.go:28] interesting pod/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 26 16:17:43.195120 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:43.194975    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr" podUID="8f259077-c876-4cec-944f-e72b2b8cf009" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 26 16:17:44.198578 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:44.198543    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:44.199014 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:44.198938    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:44.199552 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:44.199532    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:17:47.955939 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:47.955898    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd1847-9k7kf"]
Jul 26 16:17:47.959886 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:47.959865    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd1847-9k7kf"
Jul 26 16:17:47.962381 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:47.962345    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlwwk\""
Jul 26 16:17:47.962540 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:47.962355    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 26 16:17:47.966941 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:47.966899    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd1847-9k7kf"]
Jul 26 16:17:47.995836 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:47.995806    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79b6ab32-be51-47a0-9986-a23edb6a1a13-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6abd1847-9k7kf\" (UID: \"79b6ab32-be51-47a0-9986-a23edb6a1a13\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd1847-9k7kf"
Jul 26 16:17:48.096560 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:48.096528    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79b6ab32-be51-47a0-9986-a23edb6a1a13-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6abd1847-9k7kf\" (UID: \"79b6ab32-be51-47a0-9986-a23edb6a1a13\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd1847-9k7kf"
Jul 26 16:17:48.097170 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:48.097151    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79b6ab32-be51-47a0-9986-a23edb6a1a13-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6abd1847-9k7kf\" (UID: \"79b6ab32-be51-47a0-9986-a23edb6a1a13\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd1847-9k7kf"
Jul 26 16:17:48.274281 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:48.274219    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd1847-9k7kf"
Jul 26 16:17:48.404554 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:48.404529    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd1847-9k7kf"]
Jul 26 16:17:48.406612 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:17:48.406576    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b6ab32_be51_47a0_9986_a23edb6a1a13.slice/crio-d48f2dc810323ff4347b5df370e9bfa85b5cb5011ca952fdb0f6fe3e459927bb WatchSource:0}: Error finding container d48f2dc810323ff4347b5df370e9bfa85b5cb5011ca952fdb0f6fe3e459927bb: Status 404 returned error can't find the container with id d48f2dc810323ff4347b5df370e9bfa85b5cb5011ca952fdb0f6fe3e459927bb
Jul 26 16:17:49.078726 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:49.078676    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd1847-9k7kf" event={"ID":"79b6ab32-be51-47a0-9986-a23edb6a1a13","Type":"ContainerStarted","Data":"5e8a582fae9566a4450444328411da0dff85c0428640075a50fed2fae3ec3a58"}
Jul 26 16:17:49.079010 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:49.078744    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd1847-9k7kf" event={"ID":"79b6ab32-be51-47a0-9986-a23edb6a1a13","Type":"ContainerStarted","Data":"d48f2dc810323ff4347b5df370e9bfa85b5cb5011ca952fdb0f6fe3e459927bb"}
Jul 26 16:17:50.086052 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:50.086018    2556 generic.go:356] "Generic (PLEG): container finished" podID="79b6ab32-be51-47a0-9986-a23edb6a1a13" containerID="5e8a582fae9566a4450444328411da0dff85c0428640075a50fed2fae3ec3a58" exitCode=0
Jul 26 16:17:50.086450 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:50.086086    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd1847-9k7kf" event={"ID":"79b6ab32-be51-47a0-9986-a23edb6a1a13","Type":"ContainerDied","Data":"5e8a582fae9566a4450444328411da0dff85c0428640075a50fed2fae3ec3a58"}
Jul 26 16:17:50.213036 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:50.213014    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd1847-9k7kf"
Jul 26 16:17:50.313789 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:50.313760    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79b6ab32-be51-47a0-9986-a23edb6a1a13-maas-api-service-ca\") pod \"79b6ab32-be51-47a0-9986-a23edb6a1a13\" (UID: \"79b6ab32-be51-47a0-9986-a23edb6a1a13\") "
Jul 26 16:17:50.314078 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:50.314056    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79b6ab32-be51-47a0-9986-a23edb6a1a13-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "79b6ab32-be51-47a0-9986-a23edb6a1a13" (UID: "79b6ab32-be51-47a0-9986-a23edb6a1a13"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:17:50.414366 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:50.414310    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79b6ab32-be51-47a0-9986-a23edb6a1a13-maas-api-service-ca\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:17:51.092918 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:51.092888    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd1847-9k7kf"
Jul 26 16:17:51.093273 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:51.092920    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd1847-9k7kf" event={"ID":"79b6ab32-be51-47a0-9986-a23edb6a1a13","Type":"ContainerDied","Data":"d48f2dc810323ff4347b5df370e9bfa85b5cb5011ca952fdb0f6fe3e459927bb"}
Jul 26 16:17:51.093273 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:17:51.092965    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d48f2dc810323ff4347b5df370e9bfa85b5cb5011ca952fdb0f6fe3e459927bb"
Jul 26 16:18:03.039845 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:03.039807    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd1847-9k7kf"]
Jul 26 16:18:03.044166 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:03.044139    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd1847-9k7kf"]
Jul 26 16:18:03.173025 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:03.172990    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"]
Jul 26 16:18:03.173241 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:03.173211    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr" podUID="8f259077-c876-4cec-944f-e72b2b8cf009" containerName="istio-proxy" containerID="cri-o://f89d5341435f691b477837220c39371470e7fea84c8c49c92a0020587aa78ede" gracePeriod=30
Jul 26 16:18:04.226039 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.225984    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79b6ab32-be51-47a0-9986-a23edb6a1a13" path="/var/lib/kubelet/pods/79b6ab32-be51-47a0-9986-a23edb6a1a13/volumes"
Jul 26 16:18:04.234416 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.234390    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"]
Jul 26 16:18:04.234796 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.234779    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79b6ab32-be51-47a0-9986-a23edb6a1a13" containerName="revoke-keys"
Jul 26 16:18:04.234886 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.234798    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="79b6ab32-be51-47a0-9986-a23edb6a1a13" containerName="revoke-keys"
Jul 26 16:18:04.234943 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.234921    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="79b6ab32-be51-47a0-9986-a23edb6a1a13" containerName="revoke-keys"
Jul 26 16:18:04.239295 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.239277    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.241681 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.241663    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-d78a04d0-gw-openshift-default-dockercfg-rkrvl\""
Jul 26 16:18:04.249379 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.249354    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"]
Jul 26 16:18:04.327705 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.327668    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-data\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.327896 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.327712    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29zkx\" (UniqueName: \"kubernetes.io/projected/07617025-8bc5-4da4-ba4e-9d68b578dfeb-kube-api-access-29zkx\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.327896 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.327740    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-workload-socket\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.327896 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.327769    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istiod-ca-cert\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.327896 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.327839    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-podinfo\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.328116 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.327989    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-credential-socket\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.328116 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.328032    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-envoy\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.328234 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.328131    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-token\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.328234 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.328209    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-workload-certs\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.429402 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.429354    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-credential-socket\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.429402 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.429402    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-envoy\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.429692 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.429428    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-token\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.429692 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.429472    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-workload-certs\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.429692 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.429494    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-data\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.429692 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.429513    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29zkx\" (UniqueName: \"kubernetes.io/projected/07617025-8bc5-4da4-ba4e-9d68b578dfeb-kube-api-access-29zkx\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.429692 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.429540    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-workload-socket\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.429692 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.429573    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istiod-ca-cert\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.429692 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.429629    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-podinfo\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.430036 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.429779    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-credential-socket\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.430036 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.429938    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-workload-socket\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.430036 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.429969    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-data\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.430036 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.430010    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-workload-certs\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.430528 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.430501    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istiod-ca-cert\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.431863 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.431844    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-envoy\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.432109 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.432090    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-podinfo\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.439799 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.439775    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-token\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.440224 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.440201    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29zkx\" (UniqueName: \"kubernetes.io/projected/07617025-8bc5-4da4-ba4e-9d68b578dfeb-kube-api-access-29zkx\") pod \"e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") " pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.552366 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.552288    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:04.691679 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.691651    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"]
Jul 26 16:18:04.692959 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:18:04.692928    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07617025_8bc5_4da4_ba4e_9d68b578dfeb.slice/crio-09f8d082c7df542295fb9361c6b3c50e50768a88d7523346c1d4abd5b6176bc2 WatchSource:0}: Error finding container 09f8d082c7df542295fb9361c6b3c50e50768a88d7523346c1d4abd5b6176bc2: Status 404 returned error can't find the container with id 09f8d082c7df542295fb9361c6b3c50e50768a88d7523346c1d4abd5b6176bc2
Jul 26 16:18:04.695207 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.695174    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:18:04.695320 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.695252    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:18:04.695320 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:04.695295    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:18:05.181169 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:05.181129    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9" event={"ID":"07617025-8bc5-4da4-ba4e-9d68b578dfeb","Type":"ContainerStarted","Data":"6c3f73338cc8d6d579c024e5aadcc9c8ca95bf4f30686fa4be61ea7ad1d803ea"}
Jul 26 16:18:05.181367 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:05.181185    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9" event={"ID":"07617025-8bc5-4da4-ba4e-9d68b578dfeb","Type":"ContainerStarted","Data":"09f8d082c7df542295fb9361c6b3c50e50768a88d7523346c1d4abd5b6176bc2"}
Jul 26 16:18:05.202908 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:05.202863    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9" podStartSLOduration=1.202849437 podStartE2EDuration="1.202849437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:18:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:18:05.201925546 +0000 UTC m=+1681.420552595" watchObservedRunningTime="2026-07-26 16:18:05.202849437 +0000 UTC m=+1681.421476485"
Jul 26 16:18:05.552897 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:05.552821    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:05.557601 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:05.557575    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:06.187238 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:06.187210    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:06.188283 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:06.188257    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:08.419917 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.419895    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:18:08.564095 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.564029    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-credential-socket\") pod \"8f259077-c876-4cec-944f-e72b2b8cf009\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") "
Jul 26 16:18:08.564095 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.564068    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-istio-data\") pod \"8f259077-c876-4cec-944f-e72b2b8cf009\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") "
Jul 26 16:18:08.564302 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.564122    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f259077-c876-4cec-944f-e72b2b8cf009-istio-token\") pod \"8f259077-c876-4cec-944f-e72b2b8cf009\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") "
Jul 26 16:18:08.564302 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.564154    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-workload-socket\") pod \"8f259077-c876-4cec-944f-e72b2b8cf009\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") "
Jul 26 16:18:08.564302 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.564171    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f259077-c876-4cec-944f-e72b2b8cf009-istiod-ca-cert\") pod \"8f259077-c876-4cec-944f-e72b2b8cf009\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") "
Jul 26 16:18:08.564302 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.564194    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mpww\" (UniqueName: \"kubernetes.io/projected/8f259077-c876-4cec-944f-e72b2b8cf009-kube-api-access-9mpww\") pod \"8f259077-c876-4cec-944f-e72b2b8cf009\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") "
Jul 26 16:18:08.564302 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.564263    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-istio-envoy\") pod \"8f259077-c876-4cec-944f-e72b2b8cf009\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") "
Jul 26 16:18:08.564588 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.564308    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-workload-certs\") pod \"8f259077-c876-4cec-944f-e72b2b8cf009\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") "
Jul 26 16:18:08.564588 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.564314    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8f259077-c876-4cec-944f-e72b2b8cf009" (UID: "8f259077-c876-4cec-944f-e72b2b8cf009"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:18:08.564588 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.564343    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f259077-c876-4cec-944f-e72b2b8cf009-istio-podinfo\") pod \"8f259077-c876-4cec-944f-e72b2b8cf009\" (UID: \"8f259077-c876-4cec-944f-e72b2b8cf009\") "
Jul 26 16:18:08.564588 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.564433    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8f259077-c876-4cec-944f-e72b2b8cf009" (UID: "8f259077-c876-4cec-944f-e72b2b8cf009"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:18:08.564816 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.564715    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8f259077-c876-4cec-944f-e72b2b8cf009" (UID: "8f259077-c876-4cec-944f-e72b2b8cf009"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:18:08.564816 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.564719    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-workload-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:18:08.564816 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.564739    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f259077-c876-4cec-944f-e72b2b8cf009-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8f259077-c876-4cec-944f-e72b2b8cf009" (UID: "8f259077-c876-4cec-944f-e72b2b8cf009"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:18:08.564816 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.564754    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-credential-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:18:08.565179 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.565158    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-istio-data" (OuterVolumeSpecName: "istio-data") pod "8f259077-c876-4cec-944f-e72b2b8cf009" (UID: "8f259077-c876-4cec-944f-e72b2b8cf009"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:18:08.566529 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.566510    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f259077-c876-4cec-944f-e72b2b8cf009-istio-token" (OuterVolumeSpecName: "istio-token") pod "8f259077-c876-4cec-944f-e72b2b8cf009" (UID: "8f259077-c876-4cec-944f-e72b2b8cf009"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:18:08.566612 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.566578    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8f259077-c876-4cec-944f-e72b2b8cf009" (UID: "8f259077-c876-4cec-944f-e72b2b8cf009"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:18:08.566887 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.566857    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f259077-c876-4cec-944f-e72b2b8cf009-kube-api-access-9mpww" (OuterVolumeSpecName: "kube-api-access-9mpww") pod "8f259077-c876-4cec-944f-e72b2b8cf009" (UID: "8f259077-c876-4cec-944f-e72b2b8cf009"). InnerVolumeSpecName "kube-api-access-9mpww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:18:08.566887 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.566866    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8f259077-c876-4cec-944f-e72b2b8cf009-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8f259077-c876-4cec-944f-e72b2b8cf009" (UID: "8f259077-c876-4cec-944f-e72b2b8cf009"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 16:18:08.666099 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.666076    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f259077-c876-4cec-944f-e72b2b8cf009-istio-podinfo\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:18:08.666099 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.666095    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-istio-data\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:18:08.666099 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.666104    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f259077-c876-4cec-944f-e72b2b8cf009-istio-token\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:18:08.666273 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.666112    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f259077-c876-4cec-944f-e72b2b8cf009-istiod-ca-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:18:08.666273 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.666120    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mpww\" (UniqueName: \"kubernetes.io/projected/8f259077-c876-4cec-944f-e72b2b8cf009-kube-api-access-9mpww\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:18:08.666273 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.666129    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-istio-envoy\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:18:08.666273 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:08.666139    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f259077-c876-4cec-944f-e72b2b8cf009-workload-certs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:18:09.204845 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:09.204815    2556 generic.go:356] "Generic (PLEG): container finished" podID="8f259077-c876-4cec-944f-e72b2b8cf009" containerID="f89d5341435f691b477837220c39371470e7fea84c8c49c92a0020587aa78ede" exitCode=0
Jul 26 16:18:09.204998 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:09.204864    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"
Jul 26 16:18:09.204998 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:09.204915    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr" event={"ID":"8f259077-c876-4cec-944f-e72b2b8cf009","Type":"ContainerDied","Data":"f89d5341435f691b477837220c39371470e7fea84c8c49c92a0020587aa78ede"}
Jul 26 16:18:09.204998 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:09.204974    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr" event={"ID":"8f259077-c876-4cec-944f-e72b2b8cf009","Type":"ContainerDied","Data":"6c97ba4947b0ea436c79d681cf1459f5e5e634fc6e5213c589e9532b71e99907"}
Jul 26 16:18:09.204998 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:09.204999    2556 scope.go:117] "RemoveContainer" containerID="f89d5341435f691b477837220c39371470e7fea84c8c49c92a0020587aa78ede"
Jul 26 16:18:09.215244 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:09.215227    2556 scope.go:117] "RemoveContainer" containerID="8f627bde0a980da24ab582dae05e5699ced20837c7eddfdc61216be0e0141c39"
Jul 26 16:18:09.228820 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:09.228792    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"]
Jul 26 16:18:09.230240 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:09.230224    2556 scope.go:117] "RemoveContainer" containerID="f89d5341435f691b477837220c39371470e7fea84c8c49c92a0020587aa78ede"
Jul 26 16:18:09.230493 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:18:09.230472    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f89d5341435f691b477837220c39371470e7fea84c8c49c92a0020587aa78ede\": container with ID starting with f89d5341435f691b477837220c39371470e7fea84c8c49c92a0020587aa78ede not found: ID does not exist" containerID="f89d5341435f691b477837220c39371470e7fea84c8c49c92a0020587aa78ede"
Jul 26 16:18:09.230540 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:09.230506    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f89d5341435f691b477837220c39371470e7fea84c8c49c92a0020587aa78ede"} err="failed to get container status \"f89d5341435f691b477837220c39371470e7fea84c8c49c92a0020587aa78ede\": rpc error: code = NotFound desc = could not find container \"f89d5341435f691b477837220c39371470e7fea84c8c49c92a0020587aa78ede\": container with ID starting with f89d5341435f691b477837220c39371470e7fea84c8c49c92a0020587aa78ede not found: ID does not exist"
Jul 26 16:18:09.230540 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:09.230530    2556 scope.go:117] "RemoveContainer" containerID="8f627bde0a980da24ab582dae05e5699ced20837c7eddfdc61216be0e0141c39"
Jul 26 16:18:09.230774 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:18:09.230755    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f627bde0a980da24ab582dae05e5699ced20837c7eddfdc61216be0e0141c39\": container with ID starting with 8f627bde0a980da24ab582dae05e5699ced20837c7eddfdc61216be0e0141c39 not found: ID does not exist" containerID="8f627bde0a980da24ab582dae05e5699ced20837c7eddfdc61216be0e0141c39"
Jul 26 16:18:09.230828 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:09.230779    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f627bde0a980da24ab582dae05e5699ced20837c7eddfdc61216be0e0141c39"} err="failed to get container status \"8f627bde0a980da24ab582dae05e5699ced20837c7eddfdc61216be0e0141c39\": rpc error: code = NotFound desc = could not find container \"8f627bde0a980da24ab582dae05e5699ced20837c7eddfdc61216be0e0141c39\": container with ID starting with 8f627bde0a980da24ab582dae05e5699ced20837c7eddfdc61216be0e0141c39 not found: ID does not exist"
Jul 26 16:18:09.230960 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:09.230939    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6abd1847-openshift-default-5789ddd6f8-5w5zr"]
Jul 26 16:18:10.216103 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:10.216072    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f259077-c876-4cec-944f-e72b2b8cf009" path="/var/lib/kubelet/pods/8f259077-c876-4cec-944f-e72b2b8cf009/volumes"
Jul 26 16:18:21.578484 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:21.577243    2556 patch_prober.go:28] interesting pod/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": read tcp 10.133.0.2:52114->10.133.0.57:15021: read: connection reset by peer" start-of-body=
Jul 26 16:18:21.578484 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:21.577309    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9" podUID="07617025-8bc5-4da4-ba4e-9d68b578dfeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": read tcp 10.133.0.2:52114->10.133.0.57:15021: read: connection reset by peer"
Jul 26 16:18:22.290963 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:22.290927    2556 generic.go:356] "Generic (PLEG): container finished" podID="07617025-8bc5-4da4-ba4e-9d68b578dfeb" containerID="6c3f73338cc8d6d579c024e5aadcc9c8ca95bf4f30686fa4be61ea7ad1d803ea" exitCode=0
Jul 26 16:18:22.291132 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:22.291001    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9" event={"ID":"07617025-8bc5-4da4-ba4e-9d68b578dfeb","Type":"ContainerDied","Data":"6c3f73338cc8d6d579c024e5aadcc9c8ca95bf4f30686fa4be61ea7ad1d803ea"}
Jul 26 16:18:22.291363 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:22.291343    2556 scope.go:117] "RemoveContainer" containerID="6c3f73338cc8d6d579c024e5aadcc9c8ca95bf4f30686fa4be61ea7ad1d803ea"
Jul 26 16:18:22.292320 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:22.292293    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:18:22.292420 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:22.292360    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:18:22.292420 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:22.292403    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:18:23.299160 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:23.299128    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9" event={"ID":"07617025-8bc5-4da4-ba4e-9d68b578dfeb","Type":"ContainerStarted","Data":"4740b97a036f2b02c57986c3ab0f8af8109b63ee3ffd6dcef1280ed28a922f63"}
Jul 26 16:18:23.553300 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:23.553194    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:23.553562 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:23.553283    2556 patch_prober.go:28] interesting pod/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 26 16:18:23.553750 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:23.553717    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9" podUID="07617025-8bc5-4da4-ba4e-9d68b578dfeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 26 16:18:24.553123 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:24.553087    2556 patch_prober.go:28] interesting pod/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 26 16:18:24.553714 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:24.553684    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9" podUID="07617025-8bc5-4da4-ba4e-9d68b578dfeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 26 16:18:25.553168 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:25.553127    2556 patch_prober.go:28] interesting pod/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 26 16:18:25.553669 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:25.553210    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9" podUID="07617025-8bc5-4da4-ba4e-9d68b578dfeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 26 16:18:26.553602 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:26.553513    2556 patch_prober.go:28] interesting pod/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 26 16:18:26.554919 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:26.554887    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9" podUID="07617025-8bc5-4da4-ba4e-9d68b578dfeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 26 16:18:27.553180 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:27.553140    2556 patch_prober.go:28] interesting pod/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 26 16:18:27.553383 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:27.553219    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9" podUID="07617025-8bc5-4da4-ba4e-9d68b578dfeb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 26 16:18:28.556544 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:28.556513    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:28.556970 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:28.556835    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:28.557402 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:28.557385    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:31.707113 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:31.707077    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d78a04d0-ghssh"]
Jul 26 16:18:31.707480 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:31.707439    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f259077-c876-4cec-944f-e72b2b8cf009" containerName="istio-proxy"
Jul 26 16:18:31.707480 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:31.707450    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f259077-c876-4cec-944f-e72b2b8cf009" containerName="istio-proxy"
Jul 26 16:18:31.707480 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:31.707460    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f259077-c876-4cec-944f-e72b2b8cf009" containerName="istio-proxy"
Jul 26 16:18:31.707480 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:31.707466    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f259077-c876-4cec-944f-e72b2b8cf009" containerName="istio-proxy"
Jul 26 16:18:31.707619 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:31.707537    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f259077-c876-4cec-944f-e72b2b8cf009" containerName="istio-proxy"
Jul 26 16:18:31.707619 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:31.707544    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f259077-c876-4cec-944f-e72b2b8cf009" containerName="istio-proxy"
Jul 26 16:18:31.711257 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:31.711240    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d78a04d0-ghssh"
Jul 26 16:18:31.713690 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:31.713666    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 26 16:18:31.714673 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:31.714621    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlwwk\""
Jul 26 16:18:31.717491 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:31.717472    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d78a04d0-ghssh"]
Jul 26 16:18:31.855005 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:31.854973    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbc0dca6-70c8-41dd-9b59-77dbc2e25738-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d78a04d0-ghssh\" (UID: \"dbc0dca6-70c8-41dd-9b59-77dbc2e25738\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d78a04d0-ghssh"
Jul 26 16:18:31.955359 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:31.955336    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbc0dca6-70c8-41dd-9b59-77dbc2e25738-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d78a04d0-ghssh\" (UID: \"dbc0dca6-70c8-41dd-9b59-77dbc2e25738\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d78a04d0-ghssh"
Jul 26 16:18:31.955930 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:31.955914    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbc0dca6-70c8-41dd-9b59-77dbc2e25738-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d78a04d0-ghssh\" (UID: \"dbc0dca6-70c8-41dd-9b59-77dbc2e25738\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d78a04d0-ghssh"
Jul 26 16:18:32.022607 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:32.022548    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d78a04d0-ghssh"
Jul 26 16:18:32.361153 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:32.361127    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d78a04d0-ghssh"]
Jul 26 16:18:32.363398 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:18:32.363373    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbc0dca6_70c8_41dd_9b59_77dbc2e25738.slice/crio-1461e5c20c3ecaefd7b3924d21b564e3dd3a8642a9ca7134270c7b15a1d0be95 WatchSource:0}: Error finding container 1461e5c20c3ecaefd7b3924d21b564e3dd3a8642a9ca7134270c7b15a1d0be95: Status 404 returned error can't find the container with id 1461e5c20c3ecaefd7b3924d21b564e3dd3a8642a9ca7134270c7b15a1d0be95
Jul 26 16:18:33.356724 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:33.356608    2556 generic.go:356] "Generic (PLEG): container finished" podID="dbc0dca6-70c8-41dd-9b59-77dbc2e25738" containerID="b3f5895712f5b26d9179364e639388d4c1be06085d8d252ea7e817cf23544588" exitCode=0
Jul 26 16:18:33.356724 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:33.356694    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d78a04d0-ghssh" event={"ID":"dbc0dca6-70c8-41dd-9b59-77dbc2e25738","Type":"ContainerDied","Data":"b3f5895712f5b26d9179364e639388d4c1be06085d8d252ea7e817cf23544588"}
Jul 26 16:18:33.357114 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:33.356751    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d78a04d0-ghssh" event={"ID":"dbc0dca6-70c8-41dd-9b59-77dbc2e25738","Type":"ContainerStarted","Data":"1461e5c20c3ecaefd7b3924d21b564e3dd3a8642a9ca7134270c7b15a1d0be95"}
Jul 26 16:18:34.499440 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:34.499413    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d78a04d0-ghssh"
Jul 26 16:18:34.575905 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:34.575879    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbc0dca6-70c8-41dd-9b59-77dbc2e25738-maas-api-service-ca\") pod \"dbc0dca6-70c8-41dd-9b59-77dbc2e25738\" (UID: \"dbc0dca6-70c8-41dd-9b59-77dbc2e25738\") "
Jul 26 16:18:34.576193 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:34.576171    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbc0dca6-70c8-41dd-9b59-77dbc2e25738-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dbc0dca6-70c8-41dd-9b59-77dbc2e25738" (UID: "dbc0dca6-70c8-41dd-9b59-77dbc2e25738"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:18:34.678446 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:34.678410    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbc0dca6-70c8-41dd-9b59-77dbc2e25738-maas-api-service-ca\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:18:35.368853 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:35.368822    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d78a04d0-ghssh" event={"ID":"dbc0dca6-70c8-41dd-9b59-77dbc2e25738","Type":"ContainerDied","Data":"1461e5c20c3ecaefd7b3924d21b564e3dd3a8642a9ca7134270c7b15a1d0be95"}
Jul 26 16:18:35.368853 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:35.368850    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d78a04d0-ghssh"
Jul 26 16:18:35.369057 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:35.368867    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1461e5c20c3ecaefd7b3924d21b564e3dd3a8642a9ca7134270c7b15a1d0be95"
Jul 26 16:18:46.776418 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:46.776371    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d78a04d0-ghssh"]
Jul 26 16:18:46.778771 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:46.778746    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d78a04d0-ghssh"]
Jul 26 16:18:46.910181 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:46.910149    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"]
Jul 26 16:18:46.910470 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:46.910437    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9" podUID="07617025-8bc5-4da4-ba4e-9d68b578dfeb" containerName="istio-proxy" containerID="cri-o://4740b97a036f2b02c57986c3ab0f8af8109b63ee3ffd6dcef1280ed28a922f63" gracePeriod=30
Jul 26 16:18:47.691019 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.690988    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"]
Jul 26 16:18:47.691357 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.691345    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbc0dca6-70c8-41dd-9b59-77dbc2e25738" containerName="revoke-keys"
Jul 26 16:18:47.691419 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.691358    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbc0dca6-70c8-41dd-9b59-77dbc2e25738" containerName="revoke-keys"
Jul 26 16:18:47.691475 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.691432    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbc0dca6-70c8-41dd-9b59-77dbc2e25738" containerName="revoke-keys"
Jul 26 16:18:47.694589 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.694571    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.696764 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.696736    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7a3c8582-openshift-default-dockercfg-vbdc7\""
Jul 26 16:18:47.705295 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.705274    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"]
Jul 26 16:18:47.764358 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.764331    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-token\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.764472 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.764370    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istiod-ca-cert\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.764472 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.764425    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq2jp\" (UniqueName: \"kubernetes.io/projected/0a6f333b-86de-4be4-92e8-e7a0ac34999b-kube-api-access-tq2jp\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.764548 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.764477    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-workload-certs\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.764548 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.764517    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-podinfo\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.764616 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.764584    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-data\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.764616 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.764603    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-credential-socket\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.764699 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.764627    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-workload-socket\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.764699 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.764663    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-envoy\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.865870 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.865831    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-token\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.866323 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.865885    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istiod-ca-cert\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.866323 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.865914    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq2jp\" (UniqueName: \"kubernetes.io/projected/0a6f333b-86de-4be4-92e8-e7a0ac34999b-kube-api-access-tq2jp\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.866323 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.865970    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-workload-certs\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.866323 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.866023    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-podinfo\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.866323 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.866095    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-data\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.866323 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.866167    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-credential-socket\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.866323 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.866222    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-workload-socket\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.866323 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.866251    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-envoy\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.866716 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.866418    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-workload-certs\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.866716 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.866462    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-data\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.866716 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.866535    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-credential-socket\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.866716 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.866557    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-workload-socket\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.866716 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.866687    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istiod-ca-cert\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.868456 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.868430    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-envoy\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.868573 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.868550    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-podinfo\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.873292 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.873270    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq2jp\" (UniqueName: \"kubernetes.io/projected/0a6f333b-86de-4be4-92e8-e7a0ac34999b-kube-api-access-tq2jp\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:47.873398 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:47.873359    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-token\") pod \"e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") " pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:48.006025 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:48.005964    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:48.142241 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:48.142210    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"]
Jul 26 16:18:48.143562 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:18:48.143529    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a6f333b_86de_4be4_92e8_e7a0ac34999b.slice/crio-1d0e0871cfccacf20cbb383f728f5957a1f14062c67ffa677b112d1500152f22 WatchSource:0}: Error finding container 1d0e0871cfccacf20cbb383f728f5957a1f14062c67ffa677b112d1500152f22: Status 404 returned error can't find the container with id 1d0e0871cfccacf20cbb383f728f5957a1f14062c67ffa677b112d1500152f22
Jul 26 16:18:48.153272 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:48.153226    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:18:48.153369 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:48.153311    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:18:48.153369 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:48.153351    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:18:48.223984 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:48.223958    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbc0dca6-70c8-41dd-9b59-77dbc2e25738" path="/var/lib/kubelet/pods/dbc0dca6-70c8-41dd-9b59-77dbc2e25738/volumes"
Jul 26 16:18:48.442094 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:48.442054    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz" event={"ID":"0a6f333b-86de-4be4-92e8-e7a0ac34999b","Type":"ContainerStarted","Data":"704880c28c3e094842d78311f991601091546ea6a5203257c0838b756c9c60b6"}
Jul 26 16:18:48.442276 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:48.442128    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz" event={"ID":"0a6f333b-86de-4be4-92e8-e7a0ac34999b","Type":"ContainerStarted","Data":"1d0e0871cfccacf20cbb383f728f5957a1f14062c67ffa677b112d1500152f22"}
Jul 26 16:18:48.462928 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:48.462886    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz" podStartSLOduration=1.462871384 podStartE2EDuration="1.462871384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:18:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:18:48.460321551 +0000 UTC m=+1724.678948603" watchObservedRunningTime="2026-07-26 16:18:48.462871384 +0000 UTC m=+1724.681498433"
Jul 26 16:18:49.007075 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:49.007045    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:49.011522 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:49.011497    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:49.447613 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:49.447585    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:49.448503 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:49.448483    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:18:52.164074 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.164050    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:52.204752 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.204696    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-envoy\") pod \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") "
Jul 26 16:18:52.204752 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.204732    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istiod-ca-cert\") pod \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") "
Jul 26 16:18:52.204934 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.204755    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-workload-socket\") pod \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") "
Jul 26 16:18:52.204934 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.204777    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29zkx\" (UniqueName: \"kubernetes.io/projected/07617025-8bc5-4da4-ba4e-9d68b578dfeb-kube-api-access-29zkx\") pod \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") "
Jul 26 16:18:52.204934 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.204800    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-credential-socket\") pod \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") "
Jul 26 16:18:52.204934 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.204833    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-podinfo\") pod \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") "
Jul 26 16:18:52.204934 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.204864    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-data\") pod \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") "
Jul 26 16:18:52.204934 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.204930    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-token\") pod \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") "
Jul 26 16:18:52.205244 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.204954    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-workload-certs\") pod \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\" (UID: \"07617025-8bc5-4da4-ba4e-9d68b578dfeb\") "
Jul 26 16:18:52.205244 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.205023    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "07617025-8bc5-4da4-ba4e-9d68b578dfeb" (UID: "07617025-8bc5-4da4-ba4e-9d68b578dfeb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:18:52.205244 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.205167    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "07617025-8bc5-4da4-ba4e-9d68b578dfeb" (UID: "07617025-8bc5-4da4-ba4e-9d68b578dfeb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:18:52.205386 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.205353    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "07617025-8bc5-4da4-ba4e-9d68b578dfeb" (UID: "07617025-8bc5-4da4-ba4e-9d68b578dfeb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:18:52.205500 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.205464    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-workload-certs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:18:52.205500 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.205486    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istiod-ca-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:18:52.205628 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.205499    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-workload-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:18:52.206091 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.205785    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-data" (OuterVolumeSpecName: "istio-data") pod "07617025-8bc5-4da4-ba4e-9d68b578dfeb" (UID: "07617025-8bc5-4da4-ba4e-9d68b578dfeb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:18:52.206091 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.206050    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "07617025-8bc5-4da4-ba4e-9d68b578dfeb" (UID: "07617025-8bc5-4da4-ba4e-9d68b578dfeb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:18:52.207081 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.207059    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "07617025-8bc5-4da4-ba4e-9d68b578dfeb" (UID: "07617025-8bc5-4da4-ba4e-9d68b578dfeb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:18:52.207175 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.207126    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "07617025-8bc5-4da4-ba4e-9d68b578dfeb" (UID: "07617025-8bc5-4da4-ba4e-9d68b578dfeb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 16:18:52.207236 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.207215    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-token" (OuterVolumeSpecName: "istio-token") pod "07617025-8bc5-4da4-ba4e-9d68b578dfeb" (UID: "07617025-8bc5-4da4-ba4e-9d68b578dfeb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:18:52.207504 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.207483    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07617025-8bc5-4da4-ba4e-9d68b578dfeb-kube-api-access-29zkx" (OuterVolumeSpecName: "kube-api-access-29zkx") pod "07617025-8bc5-4da4-ba4e-9d68b578dfeb" (UID: "07617025-8bc5-4da4-ba4e-9d68b578dfeb"). InnerVolumeSpecName "kube-api-access-29zkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:18:52.306351 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.306332    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-envoy\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:18:52.306438 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.306352    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29zkx\" (UniqueName: \"kubernetes.io/projected/07617025-8bc5-4da4-ba4e-9d68b578dfeb-kube-api-access-29zkx\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:18:52.306438 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.306363    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-credential-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:18:52.306438 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.306372    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-podinfo\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:18:52.306438 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.306381    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-data\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:18:52.306438 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.306389    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07617025-8bc5-4da4-ba4e-9d68b578dfeb-istio-token\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:18:52.466034 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.465978    2556 generic.go:356] "Generic (PLEG): container finished" podID="07617025-8bc5-4da4-ba4e-9d68b578dfeb" containerID="4740b97a036f2b02c57986c3ab0f8af8109b63ee3ffd6dcef1280ed28a922f63" exitCode=0
Jul 26 16:18:52.466034 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.466026    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"
Jul 26 16:18:52.466176 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.466066    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9" event={"ID":"07617025-8bc5-4da4-ba4e-9d68b578dfeb","Type":"ContainerDied","Data":"4740b97a036f2b02c57986c3ab0f8af8109b63ee3ffd6dcef1280ed28a922f63"}
Jul 26 16:18:52.466176 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.466121    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9" event={"ID":"07617025-8bc5-4da4-ba4e-9d68b578dfeb","Type":"ContainerDied","Data":"09f8d082c7df542295fb9361c6b3c50e50768a88d7523346c1d4abd5b6176bc2"}
Jul 26 16:18:52.466176 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.466150    2556 scope.go:117] "RemoveContainer" containerID="4740b97a036f2b02c57986c3ab0f8af8109b63ee3ffd6dcef1280ed28a922f63"
Jul 26 16:18:52.475973 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.475945    2556 scope.go:117] "RemoveContainer" containerID="6c3f73338cc8d6d579c024e5aadcc9c8ca95bf4f30686fa4be61ea7ad1d803ea"
Jul 26 16:18:52.483961 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.483939    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"]
Jul 26 16:18:52.484429 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.484417    2556 scope.go:117] "RemoveContainer" containerID="4740b97a036f2b02c57986c3ab0f8af8109b63ee3ffd6dcef1280ed28a922f63"
Jul 26 16:18:52.484724 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:18:52.484705    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4740b97a036f2b02c57986c3ab0f8af8109b63ee3ffd6dcef1280ed28a922f63\": container with ID starting with 4740b97a036f2b02c57986c3ab0f8af8109b63ee3ffd6dcef1280ed28a922f63 not found: ID does not exist" containerID="4740b97a036f2b02c57986c3ab0f8af8109b63ee3ffd6dcef1280ed28a922f63"
Jul 26 16:18:52.484802 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.484733    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4740b97a036f2b02c57986c3ab0f8af8109b63ee3ffd6dcef1280ed28a922f63"} err="failed to get container status \"4740b97a036f2b02c57986c3ab0f8af8109b63ee3ffd6dcef1280ed28a922f63\": rpc error: code = NotFound desc = could not find container \"4740b97a036f2b02c57986c3ab0f8af8109b63ee3ffd6dcef1280ed28a922f63\": container with ID starting with 4740b97a036f2b02c57986c3ab0f8af8109b63ee3ffd6dcef1280ed28a922f63 not found: ID does not exist"
Jul 26 16:18:52.484802 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.484750    2556 scope.go:117] "RemoveContainer" containerID="6c3f73338cc8d6d579c024e5aadcc9c8ca95bf4f30686fa4be61ea7ad1d803ea"
Jul 26 16:18:52.484984 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:18:52.484967    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c3f73338cc8d6d579c024e5aadcc9c8ca95bf4f30686fa4be61ea7ad1d803ea\": container with ID starting with 6c3f73338cc8d6d579c024e5aadcc9c8ca95bf4f30686fa4be61ea7ad1d803ea not found: ID does not exist" containerID="6c3f73338cc8d6d579c024e5aadcc9c8ca95bf4f30686fa4be61ea7ad1d803ea"
Jul 26 16:18:52.485026 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.484991    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c3f73338cc8d6d579c024e5aadcc9c8ca95bf4f30686fa4be61ea7ad1d803ea"} err="failed to get container status \"6c3f73338cc8d6d579c024e5aadcc9c8ca95bf4f30686fa4be61ea7ad1d803ea\": rpc error: code = NotFound desc = could not find container \"6c3f73338cc8d6d579c024e5aadcc9c8ca95bf4f30686fa4be61ea7ad1d803ea\": container with ID starting with 6c3f73338cc8d6d579c024e5aadcc9c8ca95bf4f30686fa4be61ea7ad1d803ea not found: ID does not exist"
Jul 26 16:18:52.491204 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:52.491180    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-d78a04d0-gw-openshift-default-5d67c66f76-4rjh9"]
Jul 26 16:18:54.215906 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:18:54.215871    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07617025-8bc5-4da4-ba4e-9d68b578dfeb" path="/var/lib/kubelet/pods/07617025-8bc5-4da4-ba4e-9d68b578dfeb/volumes"
Jul 26 16:19:04.861923 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:04.861171    2556 patch_prober.go:28] interesting pod/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": read tcp 10.133.0.2:39950->10.133.0.59:15021: read: connection reset by peer" start-of-body=
Jul 26 16:19:04.861923 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:04.861222    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz" podUID="0a6f333b-86de-4be4-92e8-e7a0ac34999b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": read tcp 10.133.0.2:39950->10.133.0.59:15021: read: connection reset by peer"
Jul 26 16:19:05.545426 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:05.543409    2556 generic.go:356] "Generic (PLEG): container finished" podID="0a6f333b-86de-4be4-92e8-e7a0ac34999b" containerID="704880c28c3e094842d78311f991601091546ea6a5203257c0838b756c9c60b6" exitCode=0
Jul 26 16:19:05.545426 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:05.543473    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz" event={"ID":"0a6f333b-86de-4be4-92e8-e7a0ac34999b","Type":"ContainerDied","Data":"704880c28c3e094842d78311f991601091546ea6a5203257c0838b756c9c60b6"}
Jul 26 16:19:05.545426 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:05.544068    2556 scope.go:117] "RemoveContainer" containerID="704880c28c3e094842d78311f991601091546ea6a5203257c0838b756c9c60b6"
Jul 26 16:19:05.546447 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:05.546417    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:19:05.546525 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:05.546483    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:19:05.546525 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:05.546519    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:19:06.554225 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:06.554176    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz" event={"ID":"0a6f333b-86de-4be4-92e8-e7a0ac34999b","Type":"ContainerStarted","Data":"3d162bb543325f9caa1db86515f9e06c6151a360b270bae0088df2b372617045"}
Jul 26 16:19:07.007159 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:07.007126    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:19:07.007367 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:07.007344    2556 patch_prober.go:28] interesting pod/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 26 16:19:07.007426 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:07.007406    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz" podUID="0a6f333b-86de-4be4-92e8-e7a0ac34999b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 26 16:19:08.006525 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:08.006487    2556 patch_prober.go:28] interesting pod/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 26 16:19:08.006955 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:08.006553    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz" podUID="0a6f333b-86de-4be4-92e8-e7a0ac34999b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 26 16:19:09.006556 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:09.006520    2556 patch_prober.go:28] interesting pod/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 26 16:19:09.006967 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:09.006569    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz" podUID="0a6f333b-86de-4be4-92e8-e7a0ac34999b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 26 16:19:10.006543 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:10.006512    2556 patch_prober.go:28] interesting pod/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 26 16:19:10.006718 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:10.006562    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz" podUID="0a6f333b-86de-4be4-92e8-e7a0ac34999b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 26 16:19:11.010387 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:11.010349    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:19:11.010827 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:11.010744    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:19:11.011614 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:11.011592    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:19:15.624792 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:15.624758    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7a3c8582-ltqv6"]
Jul 26 16:19:15.625144 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:15.625107    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07617025-8bc5-4da4-ba4e-9d68b578dfeb" containerName="istio-proxy"
Jul 26 16:19:15.625144 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:15.625119    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="07617025-8bc5-4da4-ba4e-9d68b578dfeb" containerName="istio-proxy"
Jul 26 16:19:15.625144 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:15.625128    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07617025-8bc5-4da4-ba4e-9d68b578dfeb" containerName="istio-proxy"
Jul 26 16:19:15.625144 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:15.625133    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="07617025-8bc5-4da4-ba4e-9d68b578dfeb" containerName="istio-proxy"
Jul 26 16:19:15.625277 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:15.625191    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="07617025-8bc5-4da4-ba4e-9d68b578dfeb" containerName="istio-proxy"
Jul 26 16:19:15.625277 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:15.625201    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="07617025-8bc5-4da4-ba4e-9d68b578dfeb" containerName="istio-proxy"
Jul 26 16:19:15.628536 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:15.628517    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7a3c8582-ltqv6"
Jul 26 16:19:15.630902 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:15.630879    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlwwk\""
Jul 26 16:19:15.631034 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:15.630953    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 26 16:19:15.635669 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:15.635646    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7a3c8582-ltqv6"]
Jul 26 16:19:15.714142 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:15.714118    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7a3c8582-ltqv6\" (UID: \"9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7a3c8582-ltqv6"
Jul 26 16:19:15.815066 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:15.815045    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7a3c8582-ltqv6\" (UID: \"9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7a3c8582-ltqv6"
Jul 26 16:19:15.815619 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:15.815599    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7a3c8582-ltqv6\" (UID: \"9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7a3c8582-ltqv6"
Jul 26 16:19:15.941053 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:15.941013    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7a3c8582-ltqv6"
Jul 26 16:19:16.075566 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:16.075541    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7a3c8582-ltqv6"]
Jul 26 16:19:16.077132 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:19:16.077108    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cdb28ad_4dbc_4e87_9bc7_b053d1411c1a.slice/crio-112266dcddcf1f883dd9075979d5a05b0127092566d80b839cab9249abd23e0e WatchSource:0}: Error finding container 112266dcddcf1f883dd9075979d5a05b0127092566d80b839cab9249abd23e0e: Status 404 returned error can't find the container with id 112266dcddcf1f883dd9075979d5a05b0127092566d80b839cab9249abd23e0e
Jul 26 16:19:16.615743 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:16.615670    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7a3c8582-ltqv6" event={"ID":"9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a","Type":"ContainerStarted","Data":"84c13954f4e41749b42556064e0dc02dc67f3fd231ddbbedb2459ca582aac5ce"}
Jul 26 16:19:16.615743 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:16.615722    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7a3c8582-ltqv6" event={"ID":"9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a","Type":"ContainerStarted","Data":"112266dcddcf1f883dd9075979d5a05b0127092566d80b839cab9249abd23e0e"}
Jul 26 16:19:16.634620 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:16.634576    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7a3c8582-ltqv6" podStartSLOduration=1.6345619999999998 podStartE2EDuration="1.634562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:19:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:19:16.632906826 +0000 UTC m=+1752.851533865" watchObservedRunningTime="2026-07-26 16:19:16.634562 +0000 UTC m=+1752.853189049"
Jul 26 16:19:17.623577 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:17.623537    2556 generic.go:356] "Generic (PLEG): container finished" podID="9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a" containerID="84c13954f4e41749b42556064e0dc02dc67f3fd231ddbbedb2459ca582aac5ce" exitCode=0
Jul 26 16:19:17.623836 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:17.623588    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7a3c8582-ltqv6" event={"ID":"9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a","Type":"ContainerDied","Data":"84c13954f4e41749b42556064e0dc02dc67f3fd231ddbbedb2459ca582aac5ce"}
Jul 26 16:19:18.768107 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:18.768085    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7a3c8582-ltqv6"
Jul 26 16:19:18.942925 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:18.942899    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a-maas-api-service-ca\") pod \"9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a\" (UID: \"9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a\") "
Jul 26 16:19:18.943239 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:18.943217    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a" (UID: "9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:19:19.043506 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:19.043477    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a-maas-api-service-ca\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:19:19.636390 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:19.636360    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7a3c8582-ltqv6"
Jul 26 16:19:19.636390 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:19.636373    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7a3c8582-ltqv6" event={"ID":"9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a","Type":"ContainerDied","Data":"112266dcddcf1f883dd9075979d5a05b0127092566d80b839cab9249abd23e0e"}
Jul 26 16:19:19.636600 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:19.636426    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="112266dcddcf1f883dd9075979d5a05b0127092566d80b839cab9249abd23e0e"
Jul 26 16:19:30.700092 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:30.700061    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7a3c8582-ltqv6"]
Jul 26 16:19:30.702388 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:30.702363    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7a3c8582-ltqv6"]
Jul 26 16:19:31.867504 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:31.867470    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"]
Jul 26 16:19:31.867923 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:31.867696    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz" podUID="0a6f333b-86de-4be4-92e8-e7a0ac34999b" containerName="istio-proxy" containerID="cri-o://3d162bb543325f9caa1db86515f9e06c6151a360b270bae0088df2b372617045" gracePeriod=30
Jul 26 16:19:32.215699 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.215667    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a" path="/var/lib/kubelet/pods/9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a/volumes"
Jul 26 16:19:32.607108 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.607033    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"]
Jul 26 16:19:32.607589 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.607572    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a" containerName="revoke-keys"
Jul 26 16:19:32.607646 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.607593    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a" containerName="revoke-keys"
Jul 26 16:19:32.607701 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.607691    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cdb28ad-4dbc-4e87-9bc7-b053d1411c1a" containerName="revoke-keys"
Jul 26 16:19:32.611236 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.611216    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.613676 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.613656    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f22ea10f-openshift-default-dockercfg-79fwk\""
Jul 26 16:19:32.619003 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.618976    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"]
Jul 26 16:19:32.748572 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.748532    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-credential-socket\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.748572 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.748567    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-data\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.748821 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.748602    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-workload-certs\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.748821 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.748669    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-podinfo\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.748821 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.748701    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-envoy\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.748821 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.748718    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8751e35-13f5-44c2-8798-129e2c20fefc-istiod-ca-cert\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.748821 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.748736    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rnqx\" (UniqueName: \"kubernetes.io/projected/d8751e35-13f5-44c2-8798-129e2c20fefc-kube-api-access-4rnqx\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.748821 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.748808    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-workload-socket\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.749147 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.748858    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-token\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.849366 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.849335    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-workload-socket\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.849531 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.849375    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-token\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.849531 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.849445    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-credential-socket\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.849531 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.849466    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-data\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.849531 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.849504    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-workload-certs\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.849772 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.849629    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-podinfo\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.849772 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.849700    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-envoy\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.849772 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.849724    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8751e35-13f5-44c2-8798-129e2c20fefc-istiod-ca-cert\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.849772 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.849749    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rnqx\" (UniqueName: \"kubernetes.io/projected/d8751e35-13f5-44c2-8798-129e2c20fefc-kube-api-access-4rnqx\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.849772 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.849768    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-workload-socket\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.850023 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.849817    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-workload-certs\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.850023 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.849852    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-data\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.850023 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.849931    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-credential-socket\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.850317 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.850297    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8751e35-13f5-44c2-8798-129e2c20fefc-istiod-ca-cert\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.851784 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.851763    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-envoy\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.851990 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.851971    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-podinfo\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.858135 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.858085    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rnqx\" (UniqueName: \"kubernetes.io/projected/d8751e35-13f5-44c2-8798-129e2c20fefc-kube-api-access-4rnqx\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.858578 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.858560    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-token\") pod \"e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") " pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:32.923563 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:32.923547    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:33.067355 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:33.067322    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"]
Jul 26 16:19:33.068879 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:19:33.068847    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8751e35_13f5_44c2_8798_129e2c20fefc.slice/crio-2f752e1286682192910b8734464f718bcda71150f00baae2b36850ea86df7e91 WatchSource:0}: Error finding container 2f752e1286682192910b8734464f718bcda71150f00baae2b36850ea86df7e91: Status 404 returned error can't find the container with id 2f752e1286682192910b8734464f718bcda71150f00baae2b36850ea86df7e91
Jul 26 16:19:33.070928 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:33.070885    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:19:33.071013 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:33.070968    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:19:33.071013 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:33.071005    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:19:33.717737 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:33.717699    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8" event={"ID":"d8751e35-13f5-44c2-8798-129e2c20fefc","Type":"ContainerStarted","Data":"3c294918d42b356b8e2f0e3eeb0e312a828514de302ed3a25062a584e5608cb8"}
Jul 26 16:19:33.717916 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:33.717759    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8" event={"ID":"d8751e35-13f5-44c2-8798-129e2c20fefc","Type":"ContainerStarted","Data":"2f752e1286682192910b8734464f718bcda71150f00baae2b36850ea86df7e91"}
Jul 26 16:19:33.743649 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:33.743583    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8" podStartSLOduration=1.743567359 podStartE2EDuration="1.743567359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:19:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:19:33.741733682 +0000 UTC m=+1769.960360751" watchObservedRunningTime="2026-07-26 16:19:33.743567359 +0000 UTC m=+1769.962194411"
Jul 26 16:19:33.924435 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:33.924401    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:34.928910 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:34.928876    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:35.728025 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:35.728000    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:35.728782 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:35.728764    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:37.121237 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.121214    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:19:37.188024 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.188000    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-workload-certs\") pod \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") "
Jul 26 16:19:37.188137 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.188034    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-workload-socket\") pod \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") "
Jul 26 16:19:37.188137 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.188073    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-envoy\") pod \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") "
Jul 26 16:19:37.188137 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.188096    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-credential-socket\") pod \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") "
Jul 26 16:19:37.188305 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.188139    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-token\") pod \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") "
Jul 26 16:19:37.188305 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.188176    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-podinfo\") pod \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") "
Jul 26 16:19:37.188305 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.188207    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-data\") pod \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") "
Jul 26 16:19:37.188305 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.188237    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istiod-ca-cert\") pod \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") "
Jul 26 16:19:37.188305 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.188278    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0a6f333b-86de-4be4-92e8-e7a0ac34999b" (UID: "0a6f333b-86de-4be4-92e8-e7a0ac34999b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:19:37.188553 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.188309    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq2jp\" (UniqueName: \"kubernetes.io/projected/0a6f333b-86de-4be4-92e8-e7a0ac34999b-kube-api-access-tq2jp\") pod \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\" (UID: \"0a6f333b-86de-4be4-92e8-e7a0ac34999b\") "
Jul 26 16:19:37.188553 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.188399    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0a6f333b-86de-4be4-92e8-e7a0ac34999b" (UID: "0a6f333b-86de-4be4-92e8-e7a0ac34999b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:19:37.188553 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.188420    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0a6f333b-86de-4be4-92e8-e7a0ac34999b" (UID: "0a6f333b-86de-4be4-92e8-e7a0ac34999b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:19:37.188723 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.188696    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-credential-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:19:37.188723 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.188718    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-workload-certs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:19:37.188884 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.188733    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-workload-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:19:37.188884 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.188707    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0a6f333b-86de-4be4-92e8-e7a0ac34999b" (UID: "0a6f333b-86de-4be4-92e8-e7a0ac34999b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:19:37.189112 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.189091    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-data" (OuterVolumeSpecName: "istio-data") pod "0a6f333b-86de-4be4-92e8-e7a0ac34999b" (UID: "0a6f333b-86de-4be4-92e8-e7a0ac34999b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:19:37.190547 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.190516    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-token" (OuterVolumeSpecName: "istio-token") pod "0a6f333b-86de-4be4-92e8-e7a0ac34999b" (UID: "0a6f333b-86de-4be4-92e8-e7a0ac34999b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:19:37.190653 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.190564    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0a6f333b-86de-4be4-92e8-e7a0ac34999b" (UID: "0a6f333b-86de-4be4-92e8-e7a0ac34999b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 16:19:37.190729 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.190668    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0a6f333b-86de-4be4-92e8-e7a0ac34999b" (UID: "0a6f333b-86de-4be4-92e8-e7a0ac34999b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:19:37.190912 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.190892    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a6f333b-86de-4be4-92e8-e7a0ac34999b-kube-api-access-tq2jp" (OuterVolumeSpecName: "kube-api-access-tq2jp") pod "0a6f333b-86de-4be4-92e8-e7a0ac34999b" (UID: "0a6f333b-86de-4be4-92e8-e7a0ac34999b"). InnerVolumeSpecName "kube-api-access-tq2jp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:19:37.290175 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.290141    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-podinfo\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:19:37.290175 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.290170    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-data\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:19:37.290175 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.290179    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istiod-ca-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:19:37.290395 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.290189    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq2jp\" (UniqueName: \"kubernetes.io/projected/0a6f333b-86de-4be4-92e8-e7a0ac34999b-kube-api-access-tq2jp\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:19:37.290395 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.290200    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-envoy\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:19:37.290395 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.290209    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a6f333b-86de-4be4-92e8-e7a0ac34999b-istio-token\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:19:37.740459 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.740428    2556 generic.go:356] "Generic (PLEG): container finished" podID="0a6f333b-86de-4be4-92e8-e7a0ac34999b" containerID="3d162bb543325f9caa1db86515f9e06c6151a360b270bae0088df2b372617045" exitCode=0
Jul 26 16:19:37.740663 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.740482    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"
Jul 26 16:19:37.740663 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.740512    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz" event={"ID":"0a6f333b-86de-4be4-92e8-e7a0ac34999b","Type":"ContainerDied","Data":"3d162bb543325f9caa1db86515f9e06c6151a360b270bae0088df2b372617045"}
Jul 26 16:19:37.740663 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.740567    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz" event={"ID":"0a6f333b-86de-4be4-92e8-e7a0ac34999b","Type":"ContainerDied","Data":"1d0e0871cfccacf20cbb383f728f5957a1f14062c67ffa677b112d1500152f22"}
Jul 26 16:19:37.740663 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.740591    2556 scope.go:117] "RemoveContainer" containerID="3d162bb543325f9caa1db86515f9e06c6151a360b270bae0088df2b372617045"
Jul 26 16:19:37.750406 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.750386    2556 scope.go:117] "RemoveContainer" containerID="704880c28c3e094842d78311f991601091546ea6a5203257c0838b756c9c60b6"
Jul 26 16:19:37.758520 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.758502    2556 scope.go:117] "RemoveContainer" containerID="3d162bb543325f9caa1db86515f9e06c6151a360b270bae0088df2b372617045"
Jul 26 16:19:37.758830 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:19:37.758808    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d162bb543325f9caa1db86515f9e06c6151a360b270bae0088df2b372617045\": container with ID starting with 3d162bb543325f9caa1db86515f9e06c6151a360b270bae0088df2b372617045 not found: ID does not exist" containerID="3d162bb543325f9caa1db86515f9e06c6151a360b270bae0088df2b372617045"
Jul 26 16:19:37.758911 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.758837    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d162bb543325f9caa1db86515f9e06c6151a360b270bae0088df2b372617045"} err="failed to get container status \"3d162bb543325f9caa1db86515f9e06c6151a360b270bae0088df2b372617045\": rpc error: code = NotFound desc = could not find container \"3d162bb543325f9caa1db86515f9e06c6151a360b270bae0088df2b372617045\": container with ID starting with 3d162bb543325f9caa1db86515f9e06c6151a360b270bae0088df2b372617045 not found: ID does not exist"
Jul 26 16:19:37.758911 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.758860    2556 scope.go:117] "RemoveContainer" containerID="704880c28c3e094842d78311f991601091546ea6a5203257c0838b756c9c60b6"
Jul 26 16:19:37.759171 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:19:37.759145    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"704880c28c3e094842d78311f991601091546ea6a5203257c0838b756c9c60b6\": container with ID starting with 704880c28c3e094842d78311f991601091546ea6a5203257c0838b756c9c60b6 not found: ID does not exist" containerID="704880c28c3e094842d78311f991601091546ea6a5203257c0838b756c9c60b6"
Jul 26 16:19:37.759261 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.759179    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"704880c28c3e094842d78311f991601091546ea6a5203257c0838b756c9c60b6"} err="failed to get container status \"704880c28c3e094842d78311f991601091546ea6a5203257c0838b756c9c60b6\": rpc error: code = NotFound desc = could not find container \"704880c28c3e094842d78311f991601091546ea6a5203257c0838b756c9c60b6\": container with ID starting with 704880c28c3e094842d78311f991601091546ea6a5203257c0838b756c9c60b6 not found: ID does not exist"
Jul 26 16:19:37.761954 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.761934    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"]
Jul 26 16:19:37.771702 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:37.771676    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7a3c8582-openshift-default-5b45f45b9d-v9krz"]
Jul 26 16:19:38.215505 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:38.215468    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a6f333b-86de-4be4-92e8-e7a0ac34999b" path="/var/lib/kubelet/pods/0a6f333b-86de-4be4-92e8-e7a0ac34999b/volumes"
Jul 26 16:19:48.810763 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:48.810736    2556 generic.go:356] "Generic (PLEG): container finished" podID="d8751e35-13f5-44c2-8798-129e2c20fefc" containerID="3c294918d42b356b8e2f0e3eeb0e312a828514de302ed3a25062a584e5608cb8" exitCode=0
Jul 26 16:19:48.811085 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:48.810789    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8" event={"ID":"d8751e35-13f5-44c2-8798-129e2c20fefc","Type":"ContainerDied","Data":"3c294918d42b356b8e2f0e3eeb0e312a828514de302ed3a25062a584e5608cb8"}
Jul 26 16:19:48.811201 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:48.811175    2556 scope.go:117] "RemoveContainer" containerID="3c294918d42b356b8e2f0e3eeb0e312a828514de302ed3a25062a584e5608cb8"
Jul 26 16:19:48.812117 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:48.812089    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:19:48.812180 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:48.812158    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:19:48.812215 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:48.812189    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:19:49.825350 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:49.825302    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8" event={"ID":"d8751e35-13f5-44c2-8798-129e2c20fefc","Type":"ContainerStarted","Data":"7d5eff54fb13a41a2551d9cefb859f33fe1e9120105ed162da298659e79c12e5"}
Jul 26 16:19:49.924037 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:49.924001    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:49.925183 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:49.925155    2556 patch_prober.go:28] interesting pod/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 26 16:19:49.925302 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:49.925205    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8" podUID="d8751e35-13f5-44c2-8798-129e2c20fefc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 26 16:19:50.728060 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:50.728022    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:50.924927 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:50.924894    2556 patch_prober.go:28] interesting pod/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 26 16:19:50.925296 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:50.924944    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8" podUID="d8751e35-13f5-44c2-8798-129e2c20fefc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 26 16:19:51.924477 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:51.924421    2556 patch_prober.go:28] interesting pod/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 26 16:19:51.924686 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:51.924498    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8" podUID="d8751e35-13f5-44c2-8798-129e2c20fefc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 26 16:19:52.924514 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:52.924480    2556 patch_prober.go:28] interesting pod/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 26 16:19:52.924906 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:52.924531    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8" podUID="d8751e35-13f5-44c2-8798-129e2c20fefc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 26 16:19:53.924651 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:53.924605    2556 patch_prober.go:28] interesting pod/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 26 16:19:53.925023 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:53.924680    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8" podUID="d8751e35-13f5-44c2-8798-129e2c20fefc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 26 16:19:54.928532 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:54.928497    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:54.929587 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:54.929563    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:19:59.956530 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:59.956444    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f22ea10f-wfqkm"]
Jul 26 16:19:59.956931 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:59.956914    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a6f333b-86de-4be4-92e8-e7a0ac34999b" containerName="istio-proxy"
Jul 26 16:19:59.956931 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:59.956932    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a6f333b-86de-4be4-92e8-e7a0ac34999b" containerName="istio-proxy"
Jul 26 16:19:59.957008 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:59.956941    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a6f333b-86de-4be4-92e8-e7a0ac34999b" containerName="istio-proxy"
Jul 26 16:19:59.957008 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:59.956947    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a6f333b-86de-4be4-92e8-e7a0ac34999b" containerName="istio-proxy"
Jul 26 16:19:59.957008 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:59.957001    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a6f333b-86de-4be4-92e8-e7a0ac34999b" containerName="istio-proxy"
Jul 26 16:19:59.957104 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:59.957010    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a6f333b-86de-4be4-92e8-e7a0ac34999b" containerName="istio-proxy"
Jul 26 16:19:59.960381 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:59.960360    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f22ea10f-wfqkm"
Jul 26 16:19:59.962742 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:59.962719    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 26 16:19:59.962877 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:59.962771    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlwwk\""
Jul 26 16:19:59.967037 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:19:59.967014    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f22ea10f-wfqkm"]
Jul 26 16:20:00.080315 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:00.080282    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9478ae91-726b-4242-9942-71932092dde5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f22ea10f-wfqkm\" (UID: \"9478ae91-726b-4242-9942-71932092dde5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f22ea10f-wfqkm"
Jul 26 16:20:00.181122 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:00.181078    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9478ae91-726b-4242-9942-71932092dde5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f22ea10f-wfqkm\" (UID: \"9478ae91-726b-4242-9942-71932092dde5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f22ea10f-wfqkm"
Jul 26 16:20:00.181760 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:00.181744    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9478ae91-726b-4242-9942-71932092dde5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f22ea10f-wfqkm\" (UID: \"9478ae91-726b-4242-9942-71932092dde5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f22ea10f-wfqkm"
Jul 26 16:20:00.271994 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:00.271928    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f22ea10f-wfqkm"
Jul 26 16:20:00.400752 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:00.400650    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f22ea10f-wfqkm"]
Jul 26 16:20:00.400752 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:20:00.400716    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9478ae91_726b_4242_9942_71932092dde5.slice/crio-1b2abf8687fc1ce97ab01ce1c18ec578206f47486293c4fcb0fc010ee6868b39 WatchSource:0}: Error finding container 1b2abf8687fc1ce97ab01ce1c18ec578206f47486293c4fcb0fc010ee6868b39: Status 404 returned error can't find the container with id 1b2abf8687fc1ce97ab01ce1c18ec578206f47486293c4fcb0fc010ee6868b39
Jul 26 16:20:00.899628 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:00.899562    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f22ea10f-wfqkm" event={"ID":"9478ae91-726b-4242-9942-71932092dde5","Type":"ContainerStarted","Data":"5e1a010373da9540274c538e66cbf50dad42e12d81ebeb6c2e5d89a0d199f344"}
Jul 26 16:20:00.899748 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:00.899620    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f22ea10f-wfqkm" event={"ID":"9478ae91-726b-4242-9942-71932092dde5","Type":"ContainerStarted","Data":"1b2abf8687fc1ce97ab01ce1c18ec578206f47486293c4fcb0fc010ee6868b39"}
Jul 26 16:20:00.914794 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:00.914740    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f22ea10f-wfqkm" podStartSLOduration=1.914721313 podStartE2EDuration="1.914721313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:19:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:20:00.914047956 +0000 UTC m=+1797.132675005" watchObservedRunningTime="2026-07-26 16:20:00.914721313 +0000 UTC m=+1797.133348364"
Jul 26 16:20:01.906847 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:01.906801    2556 generic.go:356] "Generic (PLEG): container finished" podID="9478ae91-726b-4242-9942-71932092dde5" containerID="5e1a010373da9540274c538e66cbf50dad42e12d81ebeb6c2e5d89a0d199f344" exitCode=0
Jul 26 16:20:01.907225 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:01.906884    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f22ea10f-wfqkm" event={"ID":"9478ae91-726b-4242-9942-71932092dde5","Type":"ContainerDied","Data":"5e1a010373da9540274c538e66cbf50dad42e12d81ebeb6c2e5d89a0d199f344"}
Jul 26 16:20:03.049157 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:03.049134    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f22ea10f-wfqkm"
Jul 26 16:20:03.107194 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:03.107164    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9478ae91-726b-4242-9942-71932092dde5-maas-api-service-ca\") pod \"9478ae91-726b-4242-9942-71932092dde5\" (UID: \"9478ae91-726b-4242-9942-71932092dde5\") "
Jul 26 16:20:03.107529 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:03.107506    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9478ae91-726b-4242-9942-71932092dde5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9478ae91-726b-4242-9942-71932092dde5" (UID: "9478ae91-726b-4242-9942-71932092dde5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:20:03.208487 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:03.208452    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9478ae91-726b-4242-9942-71932092dde5-maas-api-service-ca\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:20:03.919456 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:03.919429    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f22ea10f-wfqkm"
Jul 26 16:20:03.919656 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:03.919472    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f22ea10f-wfqkm" event={"ID":"9478ae91-726b-4242-9942-71932092dde5","Type":"ContainerDied","Data":"1b2abf8687fc1ce97ab01ce1c18ec578206f47486293c4fcb0fc010ee6868b39"}
Jul 26 16:20:03.919656 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:03.919517    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b2abf8687fc1ce97ab01ce1c18ec578206f47486293c4fcb0fc010ee6868b39"
Jul 26 16:20:04.687124 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:04.687097    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 16:20:04.691547 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:04.691524    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 16:20:15.027326 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:15.027291    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f22ea10f-wfqkm"]
Jul 26 16:20:15.029643 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:15.029610    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f22ea10f-wfqkm"]
Jul 26 16:20:15.159024 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:15.158990    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"]
Jul 26 16:20:15.159256 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:15.159203    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8" podUID="d8751e35-13f5-44c2-8798-129e2c20fefc" containerName="istio-proxy" containerID="cri-o://7d5eff54fb13a41a2551d9cefb859f33fe1e9120105ed162da298659e79c12e5" gracePeriod=30
Jul 26 16:20:16.215254 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:16.215218    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9478ae91-726b-4242-9942-71932092dde5" path="/var/lib/kubelet/pods/9478ae91-726b-4242-9942-71932092dde5/volumes"
Jul 26 16:20:20.408753 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.408729    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:20:20.561207 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.561131    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-data\") pod \"d8751e35-13f5-44c2-8798-129e2c20fefc\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") "
Jul 26 16:20:20.561207 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.561163    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-podinfo\") pod \"d8751e35-13f5-44c2-8798-129e2c20fefc\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") "
Jul 26 16:20:20.561207 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.561182    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-workload-certs\") pod \"d8751e35-13f5-44c2-8798-129e2c20fefc\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") "
Jul 26 16:20:20.561207 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.561201    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rnqx\" (UniqueName: \"kubernetes.io/projected/d8751e35-13f5-44c2-8798-129e2c20fefc-kube-api-access-4rnqx\") pod \"d8751e35-13f5-44c2-8798-129e2c20fefc\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") "
Jul 26 16:20:20.561530 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.561219    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-token\") pod \"d8751e35-13f5-44c2-8798-129e2c20fefc\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") "
Jul 26 16:20:20.561530 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.561260    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8751e35-13f5-44c2-8798-129e2c20fefc-istiod-ca-cert\") pod \"d8751e35-13f5-44c2-8798-129e2c20fefc\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") "
Jul 26 16:20:20.561530 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.561275    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-workload-socket\") pod \"d8751e35-13f5-44c2-8798-129e2c20fefc\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") "
Jul 26 16:20:20.561530 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.561311    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-credential-socket\") pod \"d8751e35-13f5-44c2-8798-129e2c20fefc\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") "
Jul 26 16:20:20.561530 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.561332    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-envoy\") pod \"d8751e35-13f5-44c2-8798-129e2c20fefc\" (UID: \"d8751e35-13f5-44c2-8798-129e2c20fefc\") "
Jul 26 16:20:20.561530 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.561461    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d8751e35-13f5-44c2-8798-129e2c20fefc" (UID: "d8751e35-13f5-44c2-8798-129e2c20fefc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:20:20.561865 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.561669    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-workload-certs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:20:20.561865 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.561855    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d8751e35-13f5-44c2-8798-129e2c20fefc" (UID: "d8751e35-13f5-44c2-8798-129e2c20fefc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:20:20.561979 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.561857    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8751e35-13f5-44c2-8798-129e2c20fefc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d8751e35-13f5-44c2-8798-129e2c20fefc" (UID: "d8751e35-13f5-44c2-8798-129e2c20fefc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:20:20.561979 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.561939    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d8751e35-13f5-44c2-8798-129e2c20fefc" (UID: "d8751e35-13f5-44c2-8798-129e2c20fefc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:20:20.562095 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.562073    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-data" (OuterVolumeSpecName: "istio-data") pod "d8751e35-13f5-44c2-8798-129e2c20fefc" (UID: "d8751e35-13f5-44c2-8798-129e2c20fefc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:20:20.563475 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.563448    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d8751e35-13f5-44c2-8798-129e2c20fefc" (UID: "d8751e35-13f5-44c2-8798-129e2c20fefc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:20:20.563595 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.563476    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8751e35-13f5-44c2-8798-129e2c20fefc-kube-api-access-4rnqx" (OuterVolumeSpecName: "kube-api-access-4rnqx") pod "d8751e35-13f5-44c2-8798-129e2c20fefc" (UID: "d8751e35-13f5-44c2-8798-129e2c20fefc"). InnerVolumeSpecName "kube-api-access-4rnqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:20:20.563595 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.563528    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-token" (OuterVolumeSpecName: "istio-token") pod "d8751e35-13f5-44c2-8798-129e2c20fefc" (UID: "d8751e35-13f5-44c2-8798-129e2c20fefc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:20:20.563595 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.563552    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d8751e35-13f5-44c2-8798-129e2c20fefc" (UID: "d8751e35-13f5-44c2-8798-129e2c20fefc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 16:20:20.662799 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.662777    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-data\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:20:20.662799 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.662797    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-podinfo\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:20:20.662932 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.662807    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rnqx\" (UniqueName: \"kubernetes.io/projected/d8751e35-13f5-44c2-8798-129e2c20fefc-kube-api-access-4rnqx\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:20:20.662932 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.662816    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-token\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:20:20.662932 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.662824    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8751e35-13f5-44c2-8798-129e2c20fefc-istiod-ca-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:20:20.662932 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.662832    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-workload-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:20:20.662932 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.662840    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-credential-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:20:20.662932 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:20.662847    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8751e35-13f5-44c2-8798-129e2c20fefc-istio-envoy\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:20:21.019472 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:21.019431    2556 generic.go:356] "Generic (PLEG): container finished" podID="d8751e35-13f5-44c2-8798-129e2c20fefc" containerID="7d5eff54fb13a41a2551d9cefb859f33fe1e9120105ed162da298659e79c12e5" exitCode=0
Jul 26 16:20:21.019690 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:21.019485    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"
Jul 26 16:20:21.019690 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:21.019482    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8" event={"ID":"d8751e35-13f5-44c2-8798-129e2c20fefc","Type":"ContainerDied","Data":"7d5eff54fb13a41a2551d9cefb859f33fe1e9120105ed162da298659e79c12e5"}
Jul 26 16:20:21.019690 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:21.019626    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8" event={"ID":"d8751e35-13f5-44c2-8798-129e2c20fefc","Type":"ContainerDied","Data":"2f752e1286682192910b8734464f718bcda71150f00baae2b36850ea86df7e91"}
Jul 26 16:20:21.019690 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:21.019686    2556 scope.go:117] "RemoveContainer" containerID="7d5eff54fb13a41a2551d9cefb859f33fe1e9120105ed162da298659e79c12e5"
Jul 26 16:20:21.029406 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:21.029387    2556 scope.go:117] "RemoveContainer" containerID="3c294918d42b356b8e2f0e3eeb0e312a828514de302ed3a25062a584e5608cb8"
Jul 26 16:20:21.037790 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:21.037774    2556 scope.go:117] "RemoveContainer" containerID="7d5eff54fb13a41a2551d9cefb859f33fe1e9120105ed162da298659e79c12e5"
Jul 26 16:20:21.038063 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:20:21.038045    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d5eff54fb13a41a2551d9cefb859f33fe1e9120105ed162da298659e79c12e5\": container with ID starting with 7d5eff54fb13a41a2551d9cefb859f33fe1e9120105ed162da298659e79c12e5 not found: ID does not exist" containerID="7d5eff54fb13a41a2551d9cefb859f33fe1e9120105ed162da298659e79c12e5"
Jul 26 16:20:21.038135 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:21.038077    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d5eff54fb13a41a2551d9cefb859f33fe1e9120105ed162da298659e79c12e5"} err="failed to get container status \"7d5eff54fb13a41a2551d9cefb859f33fe1e9120105ed162da298659e79c12e5\": rpc error: code = NotFound desc = could not find container \"7d5eff54fb13a41a2551d9cefb859f33fe1e9120105ed162da298659e79c12e5\": container with ID starting with 7d5eff54fb13a41a2551d9cefb859f33fe1e9120105ed162da298659e79c12e5 not found: ID does not exist"
Jul 26 16:20:21.038135 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:21.038100    2556 scope.go:117] "RemoveContainer" containerID="3c294918d42b356b8e2f0e3eeb0e312a828514de302ed3a25062a584e5608cb8"
Jul 26 16:20:21.038367 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:20:21.038347    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c294918d42b356b8e2f0e3eeb0e312a828514de302ed3a25062a584e5608cb8\": container with ID starting with 3c294918d42b356b8e2f0e3eeb0e312a828514de302ed3a25062a584e5608cb8 not found: ID does not exist" containerID="3c294918d42b356b8e2f0e3eeb0e312a828514de302ed3a25062a584e5608cb8"
Jul 26 16:20:21.038406 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:21.038373    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c294918d42b356b8e2f0e3eeb0e312a828514de302ed3a25062a584e5608cb8"} err="failed to get container status \"3c294918d42b356b8e2f0e3eeb0e312a828514de302ed3a25062a584e5608cb8\": rpc error: code = NotFound desc = could not find container \"3c294918d42b356b8e2f0e3eeb0e312a828514de302ed3a25062a584e5608cb8\": container with ID starting with 3c294918d42b356b8e2f0e3eeb0e312a828514de302ed3a25062a584e5608cb8 not found: ID does not exist"
Jul 26 16:20:21.041826 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:21.041804    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"]
Jul 26 16:20:21.045177 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:21.045156    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f22ea10f-openshift-default-775cc754dd-7kmg8"]
Jul 26 16:20:22.216015 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:20:22.215979    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8751e35-13f5-44c2-8798-129e2c20fefc" path="/var/lib/kubelet/pods/d8751e35-13f5-44c2-8798-129e2c20fefc/volumes"
Jul 26 16:21:52.922229 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:52.922192    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"]
Jul 26 16:21:52.922777 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:52.922571    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8751e35-13f5-44c2-8798-129e2c20fefc" containerName="istio-proxy"
Jul 26 16:21:52.922777 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:52.922585    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8751e35-13f5-44c2-8798-129e2c20fefc" containerName="istio-proxy"
Jul 26 16:21:52.922777 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:52.922603    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9478ae91-726b-4242-9942-71932092dde5" containerName="revoke-keys"
Jul 26 16:21:52.922777 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:52.922609    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9478ae91-726b-4242-9942-71932092dde5" containerName="revoke-keys"
Jul 26 16:21:52.922777 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:52.922693    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8751e35-13f5-44c2-8798-129e2c20fefc" containerName="istio-proxy"
Jul 26 16:21:52.922777 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:52.922706    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8751e35-13f5-44c2-8798-129e2c20fefc" containerName="istio-proxy"
Jul 26 16:21:52.922777 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:52.922714    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9478ae91-726b-4242-9942-71932092dde5" containerName="revoke-keys"
Jul 26 16:21:52.925818 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:52.925802    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:52.928296 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:52.928275    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6d044d53-openshift-default-dockercfg-tp58q\""
Jul 26 16:21:52.949582 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:52.949559    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"]
Jul 26 16:21:52.981830 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:52.981808    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-workload-certs\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:52.981947 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:52.981845    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-podinfo\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:52.981947 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:52.981867    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-workload-socket\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:52.981947 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:52.981917    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d523552-52aa-449f-afa3-4bec7fb85c45-istiod-ca-cert\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:52.982067 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:52.982020    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-credential-socket\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:52.982067 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:52.982059    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-token\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:52.982132 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:52.982084    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-data\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:52.982132 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:52.982106    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98d8t\" (UniqueName: \"kubernetes.io/projected/3d523552-52aa-449f-afa3-4bec7fb85c45-kube-api-access-98d8t\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:52.982201 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:52.982132    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-envoy\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:53.082803 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.082776    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-credential-socket\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:53.082972 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.082810    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-token\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:53.082972 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.082831    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-data\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:53.082972 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.082853    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98d8t\" (UniqueName: \"kubernetes.io/projected/3d523552-52aa-449f-afa3-4bec7fb85c45-kube-api-access-98d8t\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:53.083155 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.082971    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-envoy\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:53.083155 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.083031    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-workload-certs\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:53.083155 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.083068    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-podinfo\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:53.083155 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.083143    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-workload-socket\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:53.083369 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.083180    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d523552-52aa-449f-afa3-4bec7fb85c45-istiod-ca-cert\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:53.083369 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.083188    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-credential-socket\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:53.083369 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.083240    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-data\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:53.083530 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.083420    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-workload-certs\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:53.083530 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.083489    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-workload-socket\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:53.083821 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.083802    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d523552-52aa-449f-afa3-4bec7fb85c45-istiod-ca-cert\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:53.085299 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.085276    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-envoy\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:53.085395 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.085354    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-podinfo\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:53.093734 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.093703    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98d8t\" (UniqueName: \"kubernetes.io/projected/3d523552-52aa-449f-afa3-4bec7fb85c45-kube-api-access-98d8t\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:53.093840 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.093755    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-token\") pod \"e2e-mt-6d044d53-openshift-default-7757948784-6xcs2\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") " pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:53.236051 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.235975    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:53.372981 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.372477    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"]
Jul 26 16:21:53.377575 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:21:53.377545    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d523552_52aa_449f_afa3_4bec7fb85c45.slice/crio-f4224e97b99515394ed4d4170f18fb447cfa196aabd6514bcae82f55e73c5fd6 WatchSource:0}: Error finding container f4224e97b99515394ed4d4170f18fb447cfa196aabd6514bcae82f55e73c5fd6: Status 404 returned error can't find the container with id f4224e97b99515394ed4d4170f18fb447cfa196aabd6514bcae82f55e73c5fd6
Jul 26 16:21:53.379429 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.379396    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:21:53.379511 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.379461    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:21:53.379511 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.379489    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:21:53.521928 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.521818    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2" event={"ID":"3d523552-52aa-449f-afa3-4bec7fb85c45","Type":"ContainerStarted","Data":"fbf8923918ab82e3e79c1d37178b5a9334dc6fb89720a1c74134ec0651724157"}
Jul 26 16:21:53.521928 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.521900    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2" event={"ID":"3d523552-52aa-449f-afa3-4bec7fb85c45","Type":"ContainerStarted","Data":"f4224e97b99515394ed4d4170f18fb447cfa196aabd6514bcae82f55e73c5fd6"}
Jul 26 16:21:53.540826 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:53.540611    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2" podStartSLOduration=1.5405909800000002 podStartE2EDuration="1.54059098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:21:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:21:53.539812769 +0000 UTC m=+1909.758439845" watchObservedRunningTime="2026-07-26 16:21:53.54059098 +0000 UTC m=+1909.759218028"
Jul 26 16:21:54.236850 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:54.236819    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:54.241659 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:54.241617    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:54.529688 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:54.529605    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:21:54.530496 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:21:54.530475    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:22:07.686408 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:07.686365    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d044d53-fdgw7"]
Jul 26 16:22:07.686881 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:07.686804    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8751e35-13f5-44c2-8798-129e2c20fefc" containerName="istio-proxy"
Jul 26 16:22:07.686881 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:07.686820    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8751e35-13f5-44c2-8798-129e2c20fefc" containerName="istio-proxy"
Jul 26 16:22:07.690018 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:07.689990    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d044d53-fdgw7"
Jul 26 16:22:07.692480 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:07.692461    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 26 16:22:07.692603 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:07.692483    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlwwk\""
Jul 26 16:22:07.699849 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:07.699581    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d044d53-fdgw7"]
Jul 26 16:22:07.812377 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:07.812342    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ccde9ed-7f08-4f07-a8bc-114965e37383-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6d044d53-fdgw7\" (UID: \"2ccde9ed-7f08-4f07-a8bc-114965e37383\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d044d53-fdgw7"
Jul 26 16:22:07.913087 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:07.913043    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ccde9ed-7f08-4f07-a8bc-114965e37383-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6d044d53-fdgw7\" (UID: \"2ccde9ed-7f08-4f07-a8bc-114965e37383\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d044d53-fdgw7"
Jul 26 16:22:07.913705 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:07.913687    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ccde9ed-7f08-4f07-a8bc-114965e37383-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6d044d53-fdgw7\" (UID: \"2ccde9ed-7f08-4f07-a8bc-114965e37383\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d044d53-fdgw7"
Jul 26 16:22:08.003911 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:08.003817    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d044d53-fdgw7"
Jul 26 16:22:08.149492 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:08.149453    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d044d53-fdgw7"]
Jul 26 16:22:08.150204 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:22:08.150177    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ccde9ed_7f08_4f07_a8bc_114965e37383.slice/crio-37f8bed8e2b2b63a82330a3de5c0a74c0e8b772efc1c511ffa04ac4176b4f79f WatchSource:0}: Error finding container 37f8bed8e2b2b63a82330a3de5c0a74c0e8b772efc1c511ffa04ac4176b4f79f: Status 404 returned error can't find the container with id 37f8bed8e2b2b63a82330a3de5c0a74c0e8b772efc1c511ffa04ac4176b4f79f
Jul 26 16:22:08.610516 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:08.610483    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d044d53-fdgw7" event={"ID":"2ccde9ed-7f08-4f07-a8bc-114965e37383","Type":"ContainerStarted","Data":"2de67fb6c08c7618023967ea81b2b18b7d7a2503a7100782c2110ddd11896c1d"}
Jul 26 16:22:08.610659 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:08.610538    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d044d53-fdgw7" event={"ID":"2ccde9ed-7f08-4f07-a8bc-114965e37383","Type":"ContainerStarted","Data":"37f8bed8e2b2b63a82330a3de5c0a74c0e8b772efc1c511ffa04ac4176b4f79f"}
Jul 26 16:22:08.626207 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:08.626160    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d044d53-fdgw7" podStartSLOduration=1.626145599 podStartE2EDuration="1.626145599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:22:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:22:08.624402728 +0000 UTC m=+1924.843029798" watchObservedRunningTime="2026-07-26 16:22:08.626145599 +0000 UTC m=+1924.844772647"
Jul 26 16:22:09.618732 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:09.618701    2556 generic.go:356] "Generic (PLEG): container finished" podID="2ccde9ed-7f08-4f07-a8bc-114965e37383" containerID="2de67fb6c08c7618023967ea81b2b18b7d7a2503a7100782c2110ddd11896c1d" exitCode=0
Jul 26 16:22:09.619121 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:09.618758    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d044d53-fdgw7" event={"ID":"2ccde9ed-7f08-4f07-a8bc-114965e37383","Type":"ContainerDied","Data":"2de67fb6c08c7618023967ea81b2b18b7d7a2503a7100782c2110ddd11896c1d"}
Jul 26 16:22:09.821700 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:09.820227    2556 patch_prober.go:28] interesting pod/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": read tcp 10.133.0.2:53970->10.133.0.63:15021: read: connection reset by peer" start-of-body=
Jul 26 16:22:09.821700 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:09.820287    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2" podUID="3d523552-52aa-449f-afa3-4bec7fb85c45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": read tcp 10.133.0.2:53970->10.133.0.63:15021: read: connection reset by peer"
Jul 26 16:22:10.625958 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:10.625924    2556 generic.go:356] "Generic (PLEG): container finished" podID="3d523552-52aa-449f-afa3-4bec7fb85c45" containerID="fbf8923918ab82e3e79c1d37178b5a9334dc6fb89720a1c74134ec0651724157" exitCode=0
Jul 26 16:22:10.626378 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:10.625997    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2" event={"ID":"3d523552-52aa-449f-afa3-4bec7fb85c45","Type":"ContainerDied","Data":"fbf8923918ab82e3e79c1d37178b5a9334dc6fb89720a1c74134ec0651724157"}
Jul 26 16:22:10.626457 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:10.626444    2556 scope.go:117] "RemoveContainer" containerID="fbf8923918ab82e3e79c1d37178b5a9334dc6fb89720a1c74134ec0651724157"
Jul 26 16:22:10.627408 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:10.627375    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:22:10.627513 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:10.627443    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:22:10.627513 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:10.627478    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:22:10.795295 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:10.795269    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d044d53-fdgw7"
Jul 26 16:22:10.839682 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:10.839654    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ccde9ed-7f08-4f07-a8bc-114965e37383-maas-api-service-ca\") pod \"2ccde9ed-7f08-4f07-a8bc-114965e37383\" (UID: \"2ccde9ed-7f08-4f07-a8bc-114965e37383\") "
Jul 26 16:22:10.839955 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:10.839932    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ccde9ed-7f08-4f07-a8bc-114965e37383-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2ccde9ed-7f08-4f07-a8bc-114965e37383" (UID: "2ccde9ed-7f08-4f07-a8bc-114965e37383"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:22:10.940196 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:10.940173    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ccde9ed-7f08-4f07-a8bc-114965e37383-maas-api-service-ca\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:22:11.633721 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:11.633686    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2" event={"ID":"3d523552-52aa-449f-afa3-4bec7fb85c45","Type":"ContainerStarted","Data":"cabb9bc24a90a1f14e0acac1f84c748d0dc5b01499c7acb03666500dd48a5789"}
Jul 26 16:22:11.635013 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:11.634986    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d044d53-fdgw7" event={"ID":"2ccde9ed-7f08-4f07-a8bc-114965e37383","Type":"ContainerDied","Data":"37f8bed8e2b2b63a82330a3de5c0a74c0e8b772efc1c511ffa04ac4176b4f79f"}
Jul 26 16:22:11.635130 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:11.635014    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d044d53-fdgw7"
Jul 26 16:22:11.635130 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:11.635033    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37f8bed8e2b2b63a82330a3de5c0a74c0e8b772efc1c511ffa04ac4176b4f79f"
Jul 26 16:22:12.236653 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:12.236608    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:22:12.236908 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:12.236882    2556 patch_prober.go:28] interesting pod/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 26 16:22:12.236973 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:12.236949    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2" podUID="3d523552-52aa-449f-afa3-4bec7fb85c45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 26 16:22:13.237332 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:13.237303    2556 patch_prober.go:28] interesting pod/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 26 16:22:13.237700 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:13.237353    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2" podUID="3d523552-52aa-449f-afa3-4bec7fb85c45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 26 16:22:14.236507 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:14.236473    2556 patch_prober.go:28] interesting pod/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 26 16:22:14.236695 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:14.236524    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2" podUID="3d523552-52aa-449f-afa3-4bec7fb85c45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 26 16:22:15.236440 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:15.236403    2556 patch_prober.go:28] interesting pod/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 26 16:22:15.236849 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:15.236463    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2" podUID="3d523552-52aa-449f-afa3-4bec7fb85c45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 26 16:22:16.240126 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:16.240096    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:22:16.240518 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:16.240432    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:22:16.241240 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:16.241217    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:22:22.755603 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:22.755571    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d044d53-fdgw7"]
Jul 26 16:22:22.760007 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:22.759984    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d044d53-fdgw7"]
Jul 26 16:22:24.216434 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:24.216399    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ccde9ed-7f08-4f07-a8bc-114965e37383" path="/var/lib/kubelet/pods/2ccde9ed-7f08-4f07-a8bc-114965e37383/volumes"
Jul 26 16:22:29.403140 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:29.403095    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"]
Jul 26 16:22:29.403530 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:29.403329    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2" podUID="3d523552-52aa-449f-afa3-4bec7fb85c45" containerName="istio-proxy" containerID="cri-o://cabb9bc24a90a1f14e0acac1f84c748d0dc5b01499c7acb03666500dd48a5789" gracePeriod=30
Jul 26 16:22:31.242597 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:31.242561    2556 patch_prober.go:28] interesting pod/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 26 16:22:31.242988 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:31.242623    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2" podUID="3d523552-52aa-449f-afa3-4bec7fb85c45" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 26 16:22:34.656713 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.656688    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:22:34.740231 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.740195    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-podinfo\") pod \"3d523552-52aa-449f-afa3-4bec7fb85c45\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") "
Jul 26 16:22:34.740231 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.740232    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-data\") pod \"3d523552-52aa-449f-afa3-4bec7fb85c45\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") "
Jul 26 16:22:34.740492 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.740248    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-envoy\") pod \"3d523552-52aa-449f-afa3-4bec7fb85c45\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") "
Jul 26 16:22:34.740492 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.740282    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-credential-socket\") pod \"3d523552-52aa-449f-afa3-4bec7fb85c45\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") "
Jul 26 16:22:34.740492 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.740303    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-token\") pod \"3d523552-52aa-449f-afa3-4bec7fb85c45\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") "
Jul 26 16:22:34.740492 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.740329    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d523552-52aa-449f-afa3-4bec7fb85c45-istiod-ca-cert\") pod \"3d523552-52aa-449f-afa3-4bec7fb85c45\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") "
Jul 26 16:22:34.740492 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.740359    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-workload-socket\") pod \"3d523552-52aa-449f-afa3-4bec7fb85c45\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") "
Jul 26 16:22:34.740492 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.740416    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-workload-certs\") pod \"3d523552-52aa-449f-afa3-4bec7fb85c45\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") "
Jul 26 16:22:34.740849 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.740502    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98d8t\" (UniqueName: \"kubernetes.io/projected/3d523552-52aa-449f-afa3-4bec7fb85c45-kube-api-access-98d8t\") pod \"3d523552-52aa-449f-afa3-4bec7fb85c45\" (UID: \"3d523552-52aa-449f-afa3-4bec7fb85c45\") "
Jul 26 16:22:34.740849 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.740711    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d523552-52aa-449f-afa3-4bec7fb85c45" (UID: "3d523552-52aa-449f-afa3-4bec7fb85c45"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:22:34.740849 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.740817    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-credential-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:22:34.740849 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.740813    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d523552-52aa-449f-afa3-4bec7fb85c45" (UID: "3d523552-52aa-449f-afa3-4bec7fb85c45"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:22:34.741046 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.740896    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d523552-52aa-449f-afa3-4bec7fb85c45" (UID: "3d523552-52aa-449f-afa3-4bec7fb85c45"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:22:34.741046 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.740912    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d523552-52aa-449f-afa3-4bec7fb85c45-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d523552-52aa-449f-afa3-4bec7fb85c45" (UID: "3d523552-52aa-449f-afa3-4bec7fb85c45"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:22:34.741158 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.741142    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d523552-52aa-449f-afa3-4bec7fb85c45" (UID: "3d523552-52aa-449f-afa3-4bec7fb85c45"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:22:34.742809 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.742776    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d523552-52aa-449f-afa3-4bec7fb85c45" (UID: "3d523552-52aa-449f-afa3-4bec7fb85c45"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:22:34.742929 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.742834    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d523552-52aa-449f-afa3-4bec7fb85c45" (UID: "3d523552-52aa-449f-afa3-4bec7fb85c45"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:22:34.742929 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.742899    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d523552-52aa-449f-afa3-4bec7fb85c45" (UID: "3d523552-52aa-449f-afa3-4bec7fb85c45"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 16:22:34.743009 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.742978    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d523552-52aa-449f-afa3-4bec7fb85c45-kube-api-access-98d8t" (OuterVolumeSpecName: "kube-api-access-98d8t") pod "3d523552-52aa-449f-afa3-4bec7fb85c45" (UID: "3d523552-52aa-449f-afa3-4bec7fb85c45"). InnerVolumeSpecName "kube-api-access-98d8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:22:34.776853 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.776823    2556 generic.go:356] "Generic (PLEG): container finished" podID="3d523552-52aa-449f-afa3-4bec7fb85c45" containerID="cabb9bc24a90a1f14e0acac1f84c748d0dc5b01499c7acb03666500dd48a5789" exitCode=0
Jul 26 16:22:34.776989 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.776864    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"
Jul 26 16:22:34.776989 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.776904    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2" event={"ID":"3d523552-52aa-449f-afa3-4bec7fb85c45","Type":"ContainerDied","Data":"cabb9bc24a90a1f14e0acac1f84c748d0dc5b01499c7acb03666500dd48a5789"}
Jul 26 16:22:34.776989 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.776960    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2" event={"ID":"3d523552-52aa-449f-afa3-4bec7fb85c45","Type":"ContainerDied","Data":"f4224e97b99515394ed4d4170f18fb447cfa196aabd6514bcae82f55e73c5fd6"}
Jul 26 16:22:34.777147 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.776986    2556 scope.go:117] "RemoveContainer" containerID="cabb9bc24a90a1f14e0acac1f84c748d0dc5b01499c7acb03666500dd48a5789"
Jul 26 16:22:34.788987 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.788922    2556 scope.go:117] "RemoveContainer" containerID="fbf8923918ab82e3e79c1d37178b5a9334dc6fb89720a1c74134ec0651724157"
Jul 26 16:22:34.797613 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.797595    2556 scope.go:117] "RemoveContainer" containerID="cabb9bc24a90a1f14e0acac1f84c748d0dc5b01499c7acb03666500dd48a5789"
Jul 26 16:22:34.797898 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:22:34.797873    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cabb9bc24a90a1f14e0acac1f84c748d0dc5b01499c7acb03666500dd48a5789\": container with ID starting with cabb9bc24a90a1f14e0acac1f84c748d0dc5b01499c7acb03666500dd48a5789 not found: ID does not exist" containerID="cabb9bc24a90a1f14e0acac1f84c748d0dc5b01499c7acb03666500dd48a5789"
Jul 26 16:22:34.797963 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.797910    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cabb9bc24a90a1f14e0acac1f84c748d0dc5b01499c7acb03666500dd48a5789"} err="failed to get container status \"cabb9bc24a90a1f14e0acac1f84c748d0dc5b01499c7acb03666500dd48a5789\": rpc error: code = NotFound desc = could not find container \"cabb9bc24a90a1f14e0acac1f84c748d0dc5b01499c7acb03666500dd48a5789\": container with ID starting with cabb9bc24a90a1f14e0acac1f84c748d0dc5b01499c7acb03666500dd48a5789 not found: ID does not exist"
Jul 26 16:22:34.797963 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.797935    2556 scope.go:117] "RemoveContainer" containerID="fbf8923918ab82e3e79c1d37178b5a9334dc6fb89720a1c74134ec0651724157"
Jul 26 16:22:34.798185 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:22:34.798168    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbf8923918ab82e3e79c1d37178b5a9334dc6fb89720a1c74134ec0651724157\": container with ID starting with fbf8923918ab82e3e79c1d37178b5a9334dc6fb89720a1c74134ec0651724157 not found: ID does not exist" containerID="fbf8923918ab82e3e79c1d37178b5a9334dc6fb89720a1c74134ec0651724157"
Jul 26 16:22:34.798226 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.798192    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbf8923918ab82e3e79c1d37178b5a9334dc6fb89720a1c74134ec0651724157"} err="failed to get container status \"fbf8923918ab82e3e79c1d37178b5a9334dc6fb89720a1c74134ec0651724157\": rpc error: code = NotFound desc = could not find container \"fbf8923918ab82e3e79c1d37178b5a9334dc6fb89720a1c74134ec0651724157\": container with ID starting with fbf8923918ab82e3e79c1d37178b5a9334dc6fb89720a1c74134ec0651724157 not found: ID does not exist"
Jul 26 16:22:34.798979 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.798960    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"]
Jul 26 16:22:34.803225 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.803199    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6d044d53-openshift-default-7757948784-6xcs2"]
Jul 26 16:22:34.841752 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.841731    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98d8t\" (UniqueName: \"kubernetes.io/projected/3d523552-52aa-449f-afa3-4bec7fb85c45-kube-api-access-98d8t\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:22:34.841752 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.841751    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-podinfo\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:22:34.841873 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.841762    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-data\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:22:34.841873 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.841770    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-envoy\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:22:34.841873 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.841778    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d523552-52aa-449f-afa3-4bec7fb85c45-istio-token\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:22:34.841873 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.841785    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d523552-52aa-449f-afa3-4bec7fb85c45-istiod-ca-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:22:34.841873 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.841792    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-workload-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:22:34.841873 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:34.841800    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d523552-52aa-449f-afa3-4bec7fb85c45-workload-certs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:22:36.216335 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:36.216299    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d523552-52aa-449f-afa3-4bec7fb85c45" path="/var/lib/kubelet/pods/3d523552-52aa-449f-afa3-4bec7fb85c45/volumes"
Jul 26 16:22:48.847987 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.847955    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"]
Jul 26 16:22:48.848343 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.848287    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d523552-52aa-449f-afa3-4bec7fb85c45" containerName="istio-proxy"
Jul 26 16:22:48.848343 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.848298    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d523552-52aa-449f-afa3-4bec7fb85c45" containerName="istio-proxy"
Jul 26 16:22:48.848343 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.848315    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d523552-52aa-449f-afa3-4bec7fb85c45" containerName="istio-proxy"
Jul 26 16:22:48.848343 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.848321    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d523552-52aa-449f-afa3-4bec7fb85c45" containerName="istio-proxy"
Jul 26 16:22:48.848343 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.848332    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ccde9ed-7f08-4f07-a8bc-114965e37383" containerName="revoke-keys"
Jul 26 16:22:48.848343 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.848337    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ccde9ed-7f08-4f07-a8bc-114965e37383" containerName="revoke-keys"
Jul 26 16:22:48.848541 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.848390    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d523552-52aa-449f-afa3-4bec7fb85c45" containerName="istio-proxy"
Jul 26 16:22:48.848541 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.848400    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d523552-52aa-449f-afa3-4bec7fb85c45" containerName="istio-proxy"
Jul 26 16:22:48.848541 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.848407    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ccde9ed-7f08-4f07-a8bc-114965e37383" containerName="revoke-keys"
Jul 26 16:22:48.851544 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.851524    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:48.854549 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.854530    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-631b3d03-openshift-default-dockercfg-nzv9b\""
Jul 26 16:22:48.871916 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.871886    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"]
Jul 26 16:22:48.954821 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.954786    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-workload-certs\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:48.954997 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.954833    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istiod-ca-cert\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:48.954997 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.954882    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-credential-socket\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:48.954997 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.954914    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-token\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:48.954997 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.954971    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-workload-socket\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:48.954997 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.954996    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-envoy\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:48.955208 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.955059    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-podinfo\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:48.955208 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.955088    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-data\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:48.955208 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:48.955114    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5drv\" (UniqueName: \"kubernetes.io/projected/984d87ae-72ca-43c1-9f61-4cc2ce766a56-kube-api-access-z5drv\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:49.055463 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.055438    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-data\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:49.055595 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.055470    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5drv\" (UniqueName: \"kubernetes.io/projected/984d87ae-72ca-43c1-9f61-4cc2ce766a56-kube-api-access-z5drv\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:49.055595 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.055516    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-workload-certs\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:49.055595 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.055540    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istiod-ca-cert\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:49.055595 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.055556    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-credential-socket\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:49.055595 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.055570    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-token\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:49.055595 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.055589    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-workload-socket\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:49.055932 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.055611    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-envoy\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:49.055932 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.055681    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-podinfo\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:49.055932 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.055853    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-data\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:49.055932 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.055924    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-credential-socket\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:49.056190 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.056021    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-workload-certs\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:49.056190 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.056102    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-workload-socket\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:49.056269 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.056249    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istiod-ca-cert\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:49.057909 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.057889    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-envoy\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:49.058097 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.058081    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-podinfo\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:49.064011 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.063989    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-token\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:49.064942 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.064923    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5drv\" (UniqueName: \"kubernetes.io/projected/984d87ae-72ca-43c1-9f61-4cc2ce766a56-kube-api-access-z5drv\") pod \"e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") " pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:49.161819 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.161763    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:49.298799 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.298775    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"]
Jul 26 16:22:49.300936 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:22:49.300907    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod984d87ae_72ca_43c1_9f61_4cc2ce766a56.slice/crio-1c6a38a8953dccd0a38f87ef58893c0e3af5e02d530203cebb2090c6b1bf1186 WatchSource:0}: Error finding container 1c6a38a8953dccd0a38f87ef58893c0e3af5e02d530203cebb2090c6b1bf1186: Status 404 returned error can't find the container with id 1c6a38a8953dccd0a38f87ef58893c0e3af5e02d530203cebb2090c6b1bf1186
Jul 26 16:22:49.303168 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.303135    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:22:49.303243 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.303203    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:22:49.303243 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.303230    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:22:49.866263 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.866216    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw" event={"ID":"984d87ae-72ca-43c1-9f61-4cc2ce766a56","Type":"ContainerStarted","Data":"e6158b39f92c89f5b6043c526d177eb89bab547ec7a510d2ca8d0c6c1b8b442f"}
Jul 26 16:22:49.866740 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.866282    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw" event={"ID":"984d87ae-72ca-43c1-9f61-4cc2ce766a56","Type":"ContainerStarted","Data":"1c6a38a8953dccd0a38f87ef58893c0e3af5e02d530203cebb2090c6b1bf1186"}
Jul 26 16:22:49.894071 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:49.894025    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw" podStartSLOduration=1.894010838 podStartE2EDuration="1.894010838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:22:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:22:49.892651555 +0000 UTC m=+1966.111278624" watchObservedRunningTime="2026-07-26 16:22:49.894010838 +0000 UTC m=+1966.112637886"
Jul 26 16:22:50.162409 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:50.162325    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:50.167821 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:50.167796    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:50.872792 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:50.872754    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:22:50.873483 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:22:50.873465    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:23:05.874957 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:05.874925    2556 patch_prober.go:28] interesting pod/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 26 16:23:05.875350 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:05.874990    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw" podUID="984d87ae-72ca-43c1-9f61-4cc2ce766a56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 26 16:23:05.982263 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:05.982180    2556 generic.go:356] "Generic (PLEG): container finished" podID="984d87ae-72ca-43c1-9f61-4cc2ce766a56" containerID="e6158b39f92c89f5b6043c526d177eb89bab547ec7a510d2ca8d0c6c1b8b442f" exitCode=0
Jul 26 16:23:05.982414 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:05.982257    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw" event={"ID":"984d87ae-72ca-43c1-9f61-4cc2ce766a56","Type":"ContainerDied","Data":"e6158b39f92c89f5b6043c526d177eb89bab547ec7a510d2ca8d0c6c1b8b442f"}
Jul 26 16:23:05.982695 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:05.982680    2556 scope.go:117] "RemoveContainer" containerID="e6158b39f92c89f5b6043c526d177eb89bab547ec7a510d2ca8d0c6c1b8b442f"
Jul 26 16:23:05.983689 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:05.983662    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:23:05.983765 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:05.983729    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:23:05.983765 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:05.983758    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:23:06.990272 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:06.990239    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw" event={"ID":"984d87ae-72ca-43c1-9f61-4cc2ce766a56","Type":"ContainerStarted","Data":"0d106baec79af6bbef7e8015814e21fafebf9663092dec5d09c8312564e215fc"}
Jul 26 16:23:07.163004 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:07.162966    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:23:07.163458 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:07.163336    2556 patch_prober.go:28] interesting pod/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 26 16:23:07.163624 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:07.163599    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw" podUID="984d87ae-72ca-43c1-9f61-4cc2ce766a56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 26 16:23:08.162579 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:08.162537    2556 patch_prober.go:28] interesting pod/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 26 16:23:08.163200 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:08.163166    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw" podUID="984d87ae-72ca-43c1-9f61-4cc2ce766a56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 26 16:23:09.162786 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:09.162748    2556 patch_prober.go:28] interesting pod/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 26 16:23:09.163362 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:09.163333    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw" podUID="984d87ae-72ca-43c1-9f61-4cc2ce766a56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 26 16:23:10.163175 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:10.163134    2556 patch_prober.go:28] interesting pod/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 26 16:23:10.163775 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:10.163740    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw" podUID="984d87ae-72ca-43c1-9f61-4cc2ce766a56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 26 16:23:11.166001 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:11.165966    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:23:11.166461 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:11.166434    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:23:11.167098 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:11.167076    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:23:20.804020 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:20.803985    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-631b3d03-nnwjw"]
Jul 26 16:23:20.807268 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:20.807252    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-631b3d03-nnwjw"
Jul 26 16:23:20.809738 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:20.809712    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 26 16:23:20.809862 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:20.809713    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlwwk\""
Jul 26 16:23:20.816060 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:20.816040    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-631b3d03-nnwjw"]
Jul 26 16:23:20.920667 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:20.920617    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/905c1a8d-c55b-40d3-af1b-a917264723d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-631b3d03-nnwjw\" (UID: \"905c1a8d-c55b-40d3-af1b-a917264723d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-631b3d03-nnwjw"
Jul 26 16:23:21.021580 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:21.021539    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/905c1a8d-c55b-40d3-af1b-a917264723d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-631b3d03-nnwjw\" (UID: \"905c1a8d-c55b-40d3-af1b-a917264723d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-631b3d03-nnwjw"
Jul 26 16:23:21.022129 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:21.022110    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/905c1a8d-c55b-40d3-af1b-a917264723d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-631b3d03-nnwjw\" (UID: \"905c1a8d-c55b-40d3-af1b-a917264723d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-631b3d03-nnwjw"
Jul 26 16:23:21.118377 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:21.118314    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-631b3d03-nnwjw"
Jul 26 16:23:21.458768 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:21.458737    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-631b3d03-nnwjw"]
Jul 26 16:23:21.460591 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:23:21.460567    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod905c1a8d_c55b_40d3_af1b_a917264723d5.slice/crio-4e62ec1459bf42e057dd3311406a849da7dda677ede4aff3b42f81be1721b802 WatchSource:0}: Error finding container 4e62ec1459bf42e057dd3311406a849da7dda677ede4aff3b42f81be1721b802: Status 404 returned error can't find the container with id 4e62ec1459bf42e057dd3311406a849da7dda677ede4aff3b42f81be1721b802
Jul 26 16:23:22.076853 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:22.076826    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-631b3d03-nnwjw" event={"ID":"905c1a8d-c55b-40d3-af1b-a917264723d5","Type":"ContainerStarted","Data":"f8cd48784f66ea0ac546136fa38ed107fdc8172ca4a471feae594bfcdf0c7685"}
Jul 26 16:23:22.077125 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:22.076881    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-631b3d03-nnwjw" event={"ID":"905c1a8d-c55b-40d3-af1b-a917264723d5","Type":"ContainerStarted","Data":"4e62ec1459bf42e057dd3311406a849da7dda677ede4aff3b42f81be1721b802"}
Jul 26 16:23:23.084307 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:23.084271    2556 generic.go:356] "Generic (PLEG): container finished" podID="905c1a8d-c55b-40d3-af1b-a917264723d5" containerID="f8cd48784f66ea0ac546136fa38ed107fdc8172ca4a471feae594bfcdf0c7685" exitCode=0
Jul 26 16:23:23.084728 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:23.084356    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-631b3d03-nnwjw" event={"ID":"905c1a8d-c55b-40d3-af1b-a917264723d5","Type":"ContainerDied","Data":"f8cd48784f66ea0ac546136fa38ed107fdc8172ca4a471feae594bfcdf0c7685"}
Jul 26 16:23:23.214174 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:23.214150    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-631b3d03-nnwjw"
Jul 26 16:23:23.239685 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:23.239661    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/905c1a8d-c55b-40d3-af1b-a917264723d5-maas-api-service-ca\") pod \"905c1a8d-c55b-40d3-af1b-a917264723d5\" (UID: \"905c1a8d-c55b-40d3-af1b-a917264723d5\") "
Jul 26 16:23:23.240060 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:23.240036    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/905c1a8d-c55b-40d3-af1b-a917264723d5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "905c1a8d-c55b-40d3-af1b-a917264723d5" (UID: "905c1a8d-c55b-40d3-af1b-a917264723d5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:23:23.340712 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:23.340654    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/905c1a8d-c55b-40d3-af1b-a917264723d5-maas-api-service-ca\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:23:24.091043 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:24.091018    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-631b3d03-nnwjw"
Jul 26 16:23:24.091043 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:24.091035    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-631b3d03-nnwjw" event={"ID":"905c1a8d-c55b-40d3-af1b-a917264723d5","Type":"ContainerDied","Data":"4e62ec1459bf42e057dd3311406a849da7dda677ede4aff3b42f81be1721b802"}
Jul 26 16:23:24.091465 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:24.091075    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e62ec1459bf42e057dd3311406a849da7dda677ede4aff3b42f81be1721b802"
Jul 26 16:23:40.897552 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:40.897511    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-631b3d03-nnwjw"]
Jul 26 16:23:40.899664 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:40.899628    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-631b3d03-nnwjw"]
Jul 26 16:23:42.215261 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:23:42.215225    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="905c1a8d-c55b-40d3-af1b-a917264723d5" path="/var/lib/kubelet/pods/905c1a8d-c55b-40d3-af1b-a917264723d5/volumes"
Jul 26 16:24:04.394532 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:04.394496    2556 scope.go:117] "RemoveContainer" containerID="5e8a582fae9566a4450444328411da0dff85c0428640075a50fed2fae3ec3a58"
Jul 26 16:24:46.777357 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:46.777282    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"]
Jul 26 16:24:46.777908 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:46.777495    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw" podUID="984d87ae-72ca-43c1-9f61-4cc2ce766a56" containerName="istio-proxy" containerID="cri-o://0d106baec79af6bbef7e8015814e21fafebf9663092dec5d09c8312564e215fc" gracePeriod=30
Jul 26 16:24:52.024945 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.024920    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:24:52.175885 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.175862    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-data\") pod \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") "
Jul 26 16:24:52.176019 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.175912    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-podinfo\") pod \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") "
Jul 26 16:24:52.176019 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.175941    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istiod-ca-cert\") pod \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") "
Jul 26 16:24:52.176019 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.175983    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-credential-socket\") pod \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") "
Jul 26 16:24:52.176019 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.176018    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-token\") pod \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") "
Jul 26 16:24:52.176234 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.176049    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-workload-certs\") pod \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") "
Jul 26 16:24:52.176234 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.176124    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-envoy\") pod \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") "
Jul 26 16:24:52.176234 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.176168    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5drv\" (UniqueName: \"kubernetes.io/projected/984d87ae-72ca-43c1-9f61-4cc2ce766a56-kube-api-access-z5drv\") pod \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") "
Jul 26 16:24:52.176234 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.176215    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-workload-socket\") pod \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\" (UID: \"984d87ae-72ca-43c1-9f61-4cc2ce766a56\") "
Jul 26 16:24:52.176446 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.176277    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "984d87ae-72ca-43c1-9f61-4cc2ce766a56" (UID: "984d87ae-72ca-43c1-9f61-4cc2ce766a56"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:24:52.176518 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.176441    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "984d87ae-72ca-43c1-9f61-4cc2ce766a56" (UID: "984d87ae-72ca-43c1-9f61-4cc2ce766a56"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:24:52.176518 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.176490    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-credential-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:24:52.176718 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.176686    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "984d87ae-72ca-43c1-9f61-4cc2ce766a56" (UID: "984d87ae-72ca-43c1-9f61-4cc2ce766a56"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:24:52.176804 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.176694    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "984d87ae-72ca-43c1-9f61-4cc2ce766a56" (UID: "984d87ae-72ca-43c1-9f61-4cc2ce766a56"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:24:52.176928 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.176904    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-data" (OuterVolumeSpecName: "istio-data") pod "984d87ae-72ca-43c1-9f61-4cc2ce766a56" (UID: "984d87ae-72ca-43c1-9f61-4cc2ce766a56"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:24:52.178314 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.178286    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "984d87ae-72ca-43c1-9f61-4cc2ce766a56" (UID: "984d87ae-72ca-43c1-9f61-4cc2ce766a56"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:24:52.178403 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.178358    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/984d87ae-72ca-43c1-9f61-4cc2ce766a56-kube-api-access-z5drv" (OuterVolumeSpecName: "kube-api-access-z5drv") pod "984d87ae-72ca-43c1-9f61-4cc2ce766a56" (UID: "984d87ae-72ca-43c1-9f61-4cc2ce766a56"). InnerVolumeSpecName "kube-api-access-z5drv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:24:52.178502 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.178485    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "984d87ae-72ca-43c1-9f61-4cc2ce766a56" (UID: "984d87ae-72ca-43c1-9f61-4cc2ce766a56"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 16:24:52.178606 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.178580    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-token" (OuterVolumeSpecName: "istio-token") pod "984d87ae-72ca-43c1-9f61-4cc2ce766a56" (UID: "984d87ae-72ca-43c1-9f61-4cc2ce766a56"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:24:52.277848 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.277826    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5drv\" (UniqueName: \"kubernetes.io/projected/984d87ae-72ca-43c1-9f61-4cc2ce766a56-kube-api-access-z5drv\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:24:52.277969 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.277852    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-workload-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:24:52.277969 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.277868    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-data\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:24:52.277969 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.277881    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-podinfo\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:24:52.277969 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.277895    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istiod-ca-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:24:52.277969 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.277909    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-token\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:24:52.277969 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.277921    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-workload-certs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:24:52.277969 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.277933    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/984d87ae-72ca-43c1-9f61-4cc2ce766a56-istio-envoy\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:24:52.592009 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.591916    2556 generic.go:356] "Generic (PLEG): container finished" podID="984d87ae-72ca-43c1-9f61-4cc2ce766a56" containerID="0d106baec79af6bbef7e8015814e21fafebf9663092dec5d09c8312564e215fc" exitCode=0
Jul 26 16:24:52.592009 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.591954    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw" event={"ID":"984d87ae-72ca-43c1-9f61-4cc2ce766a56","Type":"ContainerDied","Data":"0d106baec79af6bbef7e8015814e21fafebf9663092dec5d09c8312564e215fc"}
Jul 26 16:24:52.592009 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.591969    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"
Jul 26 16:24:52.592009 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.591993    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw" event={"ID":"984d87ae-72ca-43c1-9f61-4cc2ce766a56","Type":"ContainerDied","Data":"1c6a38a8953dccd0a38f87ef58893c0e3af5e02d530203cebb2090c6b1bf1186"}
Jul 26 16:24:52.592339 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.592017    2556 scope.go:117] "RemoveContainer" containerID="0d106baec79af6bbef7e8015814e21fafebf9663092dec5d09c8312564e215fc"
Jul 26 16:24:52.600844 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.600828    2556 scope.go:117] "RemoveContainer" containerID="e6158b39f92c89f5b6043c526d177eb89bab547ec7a510d2ca8d0c6c1b8b442f"
Jul 26 16:24:52.608950 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.608932    2556 scope.go:117] "RemoveContainer" containerID="0d106baec79af6bbef7e8015814e21fafebf9663092dec5d09c8312564e215fc"
Jul 26 16:24:52.609202 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:24:52.609186    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d106baec79af6bbef7e8015814e21fafebf9663092dec5d09c8312564e215fc\": container with ID starting with 0d106baec79af6bbef7e8015814e21fafebf9663092dec5d09c8312564e215fc not found: ID does not exist" containerID="0d106baec79af6bbef7e8015814e21fafebf9663092dec5d09c8312564e215fc"
Jul 26 16:24:52.609280 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.609213    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d106baec79af6bbef7e8015814e21fafebf9663092dec5d09c8312564e215fc"} err="failed to get container status \"0d106baec79af6bbef7e8015814e21fafebf9663092dec5d09c8312564e215fc\": rpc error: code = NotFound desc = could not find container \"0d106baec79af6bbef7e8015814e21fafebf9663092dec5d09c8312564e215fc\": container with ID starting with 0d106baec79af6bbef7e8015814e21fafebf9663092dec5d09c8312564e215fc not found: ID does not exist"
Jul 26 16:24:52.609280 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.609235    2556 scope.go:117] "RemoveContainer" containerID="e6158b39f92c89f5b6043c526d177eb89bab547ec7a510d2ca8d0c6c1b8b442f"
Jul 26 16:24:52.609513 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:24:52.609487    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6158b39f92c89f5b6043c526d177eb89bab547ec7a510d2ca8d0c6c1b8b442f\": container with ID starting with e6158b39f92c89f5b6043c526d177eb89bab547ec7a510d2ca8d0c6c1b8b442f not found: ID does not exist" containerID="e6158b39f92c89f5b6043c526d177eb89bab547ec7a510d2ca8d0c6c1b8b442f"
Jul 26 16:24:52.609563 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.609518    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6158b39f92c89f5b6043c526d177eb89bab547ec7a510d2ca8d0c6c1b8b442f"} err="failed to get container status \"e6158b39f92c89f5b6043c526d177eb89bab547ec7a510d2ca8d0c6c1b8b442f\": rpc error: code = NotFound desc = could not find container \"e6158b39f92c89f5b6043c526d177eb89bab547ec7a510d2ca8d0c6c1b8b442f\": container with ID starting with e6158b39f92c89f5b6043c526d177eb89bab547ec7a510d2ca8d0c6c1b8b442f not found: ID does not exist"
Jul 26 16:24:52.610550 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.610532    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"]
Jul 26 16:24:52.614097 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:52.614076    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-631b3d03-openshift-default-85fc6c47fb-rhncw"]
Jul 26 16:24:54.215496 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:24:54.215465    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="984d87ae-72ca-43c1-9f61-4cc2ce766a56" path="/var/lib/kubelet/pods/984d87ae-72ca-43c1-9f61-4cc2ce766a56/volumes"
Jul 26 16:25:04.416548 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:04.416515    2556 scope.go:117] "RemoveContainer" containerID="b3f5895712f5b26d9179364e639388d4c1be06085d8d252ea7e817cf23544588"
Jul 26 16:25:04.723120 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:04.723039    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 16:25:04.729330 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:04.729305    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 16:25:42.637918 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.637883    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"]
Jul 26 16:25:42.638491 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.638445    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="984d87ae-72ca-43c1-9f61-4cc2ce766a56" containerName="istio-proxy"
Jul 26 16:25:42.638491 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.638465    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="984d87ae-72ca-43c1-9f61-4cc2ce766a56" containerName="istio-proxy"
Jul 26 16:25:42.638623 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.638506    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="984d87ae-72ca-43c1-9f61-4cc2ce766a56" containerName="istio-proxy"
Jul 26 16:25:42.638623 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.638515    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="984d87ae-72ca-43c1-9f61-4cc2ce766a56" containerName="istio-proxy"
Jul 26 16:25:42.638623 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.638526    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="905c1a8d-c55b-40d3-af1b-a917264723d5" containerName="revoke-keys"
Jul 26 16:25:42.638623 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.638534    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="905c1a8d-c55b-40d3-af1b-a917264723d5" containerName="revoke-keys"
Jul 26 16:25:42.638850 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.638625    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="984d87ae-72ca-43c1-9f61-4cc2ce766a56" containerName="istio-proxy"
Jul 26 16:25:42.638850 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.638658    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="905c1a8d-c55b-40d3-af1b-a917264723d5" containerName="revoke-keys"
Jul 26 16:25:42.641677 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.641657    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.644117 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.644097    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-54fb7c-openshift-default-dockercfg-lslxb\""
Jul 26 16:25:42.655265 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.655242    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"]
Jul 26 16:25:42.700252 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.700219    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94j5q\" (UniqueName: \"kubernetes.io/projected/01f6c633-eda6-4d6f-942e-f92db3cf3f49-kube-api-access-94j5q\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.700384 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.700257    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-workload-socket\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.700384 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.700279    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-credential-socket\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.700384 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.700363    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-envoy\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.700550 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.700390    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-workload-certs\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.700550 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.700409    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-data\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.700550 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.700450    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-podinfo\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.700550 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.700482    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-token\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.700550 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.700508    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istiod-ca-cert\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.801727 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.801697    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-envoy\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.801879 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.801731    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-workload-certs\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.801879 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.801754    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-data\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.801879 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.801794    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-podinfo\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.801879 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.801812    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-token\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.801879 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.801829    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istiod-ca-cert\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.802156 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.801996    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94j5q\" (UniqueName: \"kubernetes.io/projected/01f6c633-eda6-4d6f-942e-f92db3cf3f49-kube-api-access-94j5q\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.802156 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.802050    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-workload-socket\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.802156 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.802075    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-credential-socket\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.802156 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.802131    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-workload-certs\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.802366 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.802251    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-data\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.802479 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.802415    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-credential-socket\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.802530 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.802502    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-workload-socket\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.802746 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.802726    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istiod-ca-cert\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.803915 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.803897    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-envoy\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.804314 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.804297    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-podinfo\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.810153 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.810133    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94j5q\" (UniqueName: \"kubernetes.io/projected/01f6c633-eda6-4d6f-942e-f92db3cf3f49-kube-api-access-94j5q\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.810343 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.810326    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-token\") pod \"e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") " pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:42.952199 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:42.952170    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:43.087171 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:43.087142    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"]
Jul 26 16:25:43.088659 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:25:43.088618    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f6c633_eda6_4d6f_942e_f92db3cf3f49.slice/crio-b331afda8adf32713bcdace5b1e62bcc8676079ff5a5a135bc8585cbde676f10 WatchSource:0}: Error finding container b331afda8adf32713bcdace5b1e62bcc8676079ff5a5a135bc8585cbde676f10: Status 404 returned error can't find the container with id b331afda8adf32713bcdace5b1e62bcc8676079ff5a5a135bc8585cbde676f10
Jul 26 16:25:43.091272 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:43.091241    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:25:43.091358 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:43.091299    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:25:43.091358 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:43.091331    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:25:43.879153 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:43.879118    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr" event={"ID":"01f6c633-eda6-4d6f-942e-f92db3cf3f49","Type":"ContainerStarted","Data":"22de0c8c716e7919b7086dda8a81e37c731a5b1984aad7d16f1b827a23e30f6a"}
Jul 26 16:25:43.879534 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:43.879174    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr" event={"ID":"01f6c633-eda6-4d6f-942e-f92db3cf3f49","Type":"ContainerStarted","Data":"b331afda8adf32713bcdace5b1e62bcc8676079ff5a5a135bc8585cbde676f10"}
Jul 26 16:25:43.922057 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:43.922012    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr" podStartSLOduration=1.921997807 podStartE2EDuration="1.921997807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:25:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:25:43.919650241 +0000 UTC m=+2140.138277308" watchObservedRunningTime="2026-07-26 16:25:43.921997807 +0000 UTC m=+2140.140624856"
Jul 26 16:25:43.952522 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:43.952492    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:44.956788 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:44.956751    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:45.889701 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:45.889667    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:45.890478 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:45.890457    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:25:51.070647 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.070606    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"]
Jul 26 16:25:51.071106 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.071049    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="984d87ae-72ca-43c1-9f61-4cc2ce766a56" containerName="istio-proxy"
Jul 26 16:25:51.074317 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.074298    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.078797 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.078773    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-3b85e1-openshift-default-dockercfg-c6zb8\""
Jul 26 16:25:51.090026 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.090002    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"]
Jul 26 16:25:51.174972 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.174937    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-credential-socket\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.174972 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.174976    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-podinfo\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.175197 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.175007    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-envoy\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.175197 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.175111    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-workload-certs\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.175197 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.175137    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istiod-ca-cert\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.175197 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.175175    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twmfk\" (UniqueName: \"kubernetes.io/projected/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-kube-api-access-twmfk\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.175389 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.175239    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-workload-socket\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.175389 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.175283    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-token\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.175389 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.175310    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-data\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.276612 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.276580    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-credential-socket\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.276612 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.276613    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-podinfo\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.276868 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.276659    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-envoy\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.276868 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.276721    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-workload-certs\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.276868 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.276736    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istiod-ca-cert\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.276868 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.276783    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twmfk\" (UniqueName: \"kubernetes.io/projected/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-kube-api-access-twmfk\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.276868 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.276818    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-workload-socket\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.276868 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.276845    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-token\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.277197 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.276872    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-data\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.277197 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.277040    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-credential-socket\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.277197 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.277111    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-workload-certs\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.277332 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.277247    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-workload-socket\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.277460 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.277440    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istiod-ca-cert\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.277508 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.277486    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-data\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.278999 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.278975    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-envoy\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.279154 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.279138    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-podinfo\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.284311 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.284289    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-token\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.284444 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.284426    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twmfk\" (UniqueName: \"kubernetes.io/projected/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-kube-api-access-twmfk\") pod \"e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") " pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.385521 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.385437    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:51.525911 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.525887    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"]
Jul 26 16:25:51.528051 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:25:51.528025    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff07b80e_ac6e_40ce_9eff_1a054fc3fdfb.slice/crio-6753f5b5261ef40bc7ace393636e24611a7a7bc65bd37f8ed33af7026551b156 WatchSource:0}: Error finding container 6753f5b5261ef40bc7ace393636e24611a7a7bc65bd37f8ed33af7026551b156: Status 404 returned error can't find the container with id 6753f5b5261ef40bc7ace393636e24611a7a7bc65bd37f8ed33af7026551b156
Jul 26 16:25:51.530363 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.530329    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:25:51.530455 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.530397    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:25:51.530455 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.530426    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:25:51.923223 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.923187    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x" event={"ID":"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb","Type":"ContainerStarted","Data":"1f4be8a9a19a56cc852e94d8dc210c4be3f8dd437b9fc879f1cde19b67cf02ef"}
Jul 26 16:25:51.923422 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.923246    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x" event={"ID":"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb","Type":"ContainerStarted","Data":"6753f5b5261ef40bc7ace393636e24611a7a7bc65bd37f8ed33af7026551b156"}
Jul 26 16:25:51.946351 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:51.946297    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x" podStartSLOduration=0.946278987 podStartE2EDuration="946.278987ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:25:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:25:51.943246718 +0000 UTC m=+2148.161873770" watchObservedRunningTime="2026-07-26 16:25:51.946278987 +0000 UTC m=+2148.164906040"
Jul 26 16:25:52.386343 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:52.386257    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:52.391168 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:52.391141    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:52.928988 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:52.928955    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:25:52.930048 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:25:52.930028    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:26:01.131131 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:01.129953    2556 patch_prober.go:28] interesting pod/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": read tcp 10.133.0.2:50566->10.133.0.67:15021: read: connection reset by peer" start-of-body=
Jul 26 16:26:01.131131 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:01.130028    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr" podUID="01f6c633-eda6-4d6f-942e-f92db3cf3f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": read tcp 10.133.0.2:50566->10.133.0.67:15021: read: connection reset by peer"
Jul 26 16:26:01.994257 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:01.994223    2556 generic.go:356] "Generic (PLEG): container finished" podID="01f6c633-eda6-4d6f-942e-f92db3cf3f49" containerID="22de0c8c716e7919b7086dda8a81e37c731a5b1984aad7d16f1b827a23e30f6a" exitCode=0
Jul 26 16:26:01.994432 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:01.994299    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr" event={"ID":"01f6c633-eda6-4d6f-942e-f92db3cf3f49","Type":"ContainerDied","Data":"22de0c8c716e7919b7086dda8a81e37c731a5b1984aad7d16f1b827a23e30f6a"}
Jul 26 16:26:01.994718 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:01.994690    2556 scope.go:117] "RemoveContainer" containerID="22de0c8c716e7919b7086dda8a81e37c731a5b1984aad7d16f1b827a23e30f6a"
Jul 26 16:26:01.995750 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:01.995719    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:26:01.995851 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:01.995785    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:26:01.995851 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:01.995827    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:26:03.004332 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:03.004289    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr" event={"ID":"01f6c633-eda6-4d6f-942e-f92db3cf3f49","Type":"ContainerStarted","Data":"21d15c209491b53cd82ab897a97914f5f5bdcc5d63fdb270bb81d7948e788c4b"}
Jul 26 16:26:03.952868 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:03.952833    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:26:03.953542 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:03.953510    2556 patch_prober.go:28] interesting pod/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 26 16:26:03.953744 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:03.953715    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr" podUID="01f6c633-eda6-4d6f-942e-f92db3cf3f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 26 16:26:04.443741 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:04.443709    2556 scope.go:117] "RemoveContainer" containerID="84c13954f4e41749b42556064e0dc02dc67f3fd231ddbbedb2459ca582aac5ce"
Jul 26 16:26:04.479933 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:04.479908    2556 scope.go:117] "RemoveContainer" containerID="5e1a010373da9540274c538e66cbf50dad42e12d81ebeb6c2e5d89a0d199f344"
Jul 26 16:26:04.953329 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:04.953293    2556 patch_prober.go:28] interesting pod/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 26 16:26:04.953621 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:04.953592    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr" podUID="01f6c633-eda6-4d6f-942e-f92db3cf3f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 26 16:26:05.953109 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:05.953068    2556 patch_prober.go:28] interesting pod/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 26 16:26:05.953715 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:05.953681    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr" podUID="01f6c633-eda6-4d6f-942e-f92db3cf3f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 26 16:26:06.953535 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:06.953063    2556 patch_prober.go:28] interesting pod/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 26 16:26:06.953535 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:06.953143    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr" podUID="01f6c633-eda6-4d6f-942e-f92db3cf3f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 26 16:26:07.956201 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:07.956170    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:26:07.956601 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:07.956434    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:26:07.957325 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:07.957308    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:26:08.973117 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:08.970763    2556 patch_prober.go:28] interesting pod/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 26 16:26:08.973117 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:08.970827    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x" podUID="ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 26 16:26:10.045038 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:10.045007    2556 generic.go:356] "Generic (PLEG): container finished" podID="ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" containerID="1f4be8a9a19a56cc852e94d8dc210c4be3f8dd437b9fc879f1cde19b67cf02ef" exitCode=0
Jul 26 16:26:10.045433 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:10.045082    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x" event={"ID":"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb","Type":"ContainerDied","Data":"1f4be8a9a19a56cc852e94d8dc210c4be3f8dd437b9fc879f1cde19b67cf02ef"}
Jul 26 16:26:10.045494 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:10.045479    2556 scope.go:117] "RemoveContainer" containerID="1f4be8a9a19a56cc852e94d8dc210c4be3f8dd437b9fc879f1cde19b67cf02ef"
Jul 26 16:26:10.046445 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:10.046419    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:26:10.046499 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:10.046483    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:26:10.046536 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:10.046526    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:26:11.056706 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:11.056666    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x" event={"ID":"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb","Type":"ContainerStarted","Data":"b643f0b75391cbfcdc63ee1352a34a812cc46d391737e7512a6692c336b06e8c"}
Jul 26 16:26:11.386752 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:11.386656    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:26:11.386911 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:11.386887    2556 patch_prober.go:28] interesting pod/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 26 16:26:11.386954 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:11.386936    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x" podUID="ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 26 16:26:12.386202 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:12.386156    2556 patch_prober.go:28] interesting pod/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 26 16:26:12.386609 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:12.386216    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x" podUID="ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 26 16:26:13.386208 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:13.386175    2556 patch_prober.go:28] interesting pod/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 26 16:26:13.386614 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:13.386227    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x" podUID="ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 26 16:26:14.386150 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:14.386111    2556 patch_prober.go:28] interesting pod/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 26 16:26:14.386331 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:14.386173    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x" podUID="ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 26 16:26:15.390176 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:15.390145    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:26:15.390612 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:15.390407    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:26:15.390987 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:15.390970    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:26:38.256336 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.256307    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"]
Jul 26 16:26:38.260889 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.260871    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:38.264814 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.264786    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-3b85e1\"/\"default-dockercfg-29vx7\""
Jul 26 16:26:38.264951 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.264909    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-3b85e1\"/\"kube-root-ca.crt\""
Jul 26 16:26:38.265028 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.264814    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-3b85e1\"/\"test-model-3b85e1-kserve-self-signed-certs\""
Jul 26 16:26:38.265028 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.264851    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-3b85e1\"/\"openshift-service-ca.crt\""
Jul 26 16:26:38.274208 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.274184    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"]
Jul 26 16:26:38.379048 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.379024    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-tmp-dir\") pod \"test-model-3b85e1-kserve-7b8bf54d6f-cgmg4\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") " pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:38.379173 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.379054    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-dshm\") pod \"test-model-3b85e1-kserve-7b8bf54d6f-cgmg4\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") " pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:38.379173 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.379069    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxl4q\" (UniqueName: \"kubernetes.io/projected/7ad0949f-8370-44f0-9b75-979c873e3e6b-kube-api-access-wxl4q\") pod \"test-model-3b85e1-kserve-7b8bf54d6f-cgmg4\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") " pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:38.379173 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.379093    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ad0949f-8370-44f0-9b75-979c873e3e6b-tls-certs\") pod \"test-model-3b85e1-kserve-7b8bf54d6f-cgmg4\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") " pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:38.379345 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.379190    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-model-cache\") pod \"test-model-3b85e1-kserve-7b8bf54d6f-cgmg4\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") " pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:38.379345 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.379245    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-home\") pod \"test-model-3b85e1-kserve-7b8bf54d6f-cgmg4\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") " pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:38.479773 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.479752    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-tmp-dir\") pod \"test-model-3b85e1-kserve-7b8bf54d6f-cgmg4\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") " pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:38.479886 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.479778    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-dshm\") pod \"test-model-3b85e1-kserve-7b8bf54d6f-cgmg4\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") " pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:38.479886 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.479794    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxl4q\" (UniqueName: \"kubernetes.io/projected/7ad0949f-8370-44f0-9b75-979c873e3e6b-kube-api-access-wxl4q\") pod \"test-model-3b85e1-kserve-7b8bf54d6f-cgmg4\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") " pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:38.479886 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.479818    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ad0949f-8370-44f0-9b75-979c873e3e6b-tls-certs\") pod \"test-model-3b85e1-kserve-7b8bf54d6f-cgmg4\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") " pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:38.479886 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.479851    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-model-cache\") pod \"test-model-3b85e1-kserve-7b8bf54d6f-cgmg4\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") " pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:38.479886 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.479882    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-home\") pod \"test-model-3b85e1-kserve-7b8bf54d6f-cgmg4\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") " pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:38.480185 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.480162    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-tmp-dir\") pod \"test-model-3b85e1-kserve-7b8bf54d6f-cgmg4\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") " pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:38.480285 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.480265    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-model-cache\") pod \"test-model-3b85e1-kserve-7b8bf54d6f-cgmg4\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") " pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:38.480327 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.480293    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-home\") pod \"test-model-3b85e1-kserve-7b8bf54d6f-cgmg4\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") " pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:38.482035 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.482007    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-dshm\") pod \"test-model-3b85e1-kserve-7b8bf54d6f-cgmg4\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") " pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:38.482270 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.482252    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ad0949f-8370-44f0-9b75-979c873e3e6b-tls-certs\") pod \"test-model-3b85e1-kserve-7b8bf54d6f-cgmg4\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") " pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:38.490516 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.490497    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxl4q\" (UniqueName: \"kubernetes.io/projected/7ad0949f-8370-44f0-9b75-979c873e3e6b-kube-api-access-wxl4q\") pod \"test-model-3b85e1-kserve-7b8bf54d6f-cgmg4\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") " pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:38.574497 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.574423    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:38.707057 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:38.707033    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"]
Jul 26 16:26:38.708376 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:26:38.708355    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ad0949f_8370_44f0_9b75_979c873e3e6b.slice/crio-9d472dbe42a1d59ed4191d6bc728549649ee4acf5830cea98aba497634f7f65e WatchSource:0}: Error finding container 9d472dbe42a1d59ed4191d6bc728549649ee4acf5830cea98aba497634f7f65e: Status 404 returned error can't find the container with id 9d472dbe42a1d59ed4191d6bc728549649ee4acf5830cea98aba497634f7f65e
Jul 26 16:26:39.212702 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:39.212666    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4" event={"ID":"7ad0949f-8370-44f0-9b75-979c873e3e6b","Type":"ContainerStarted","Data":"423c9a0be0a6eafb3bd030aff8f3f0b04cfc5181bc3ba0cd308c9e3d0cdf8f57"}
Jul 26 16:26:39.212864 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:39.212712    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4" event={"ID":"7ad0949f-8370-44f0-9b75-979c873e3e6b","Type":"ContainerStarted","Data":"9d472dbe42a1d59ed4191d6bc728549649ee4acf5830cea98aba497634f7f65e"}
Jul 26 16:26:39.229506 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:39.229463    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4" podStartSLOduration=1.229448327 podStartE2EDuration="1.229448327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:26:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:26:39.228345553 +0000 UTC m=+2195.446972607" watchObservedRunningTime="2026-07-26 16:26:39.229448327 +0000 UTC m=+2195.448075378"
Jul 26 16:26:48.575528 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:48.575496    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:48.576000 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:48.575540    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:48.587958 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:48.587930    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:26:49.276604 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:26:49.276575    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:27:19.178887 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:19.178856    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"]
Jul 26 16:27:19.315851 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:19.315819    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54fb7c-j98vk"]
Jul 26 16:27:19.319549 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:19.319530    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54fb7c-j98vk"
Jul 26 16:27:19.322031 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:19.322011    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlwwk\""
Jul 26 16:27:19.322198 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:19.322185    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 26 16:27:19.326837 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:19.326680    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54fb7c-j98vk"]
Jul 26 16:27:19.421247 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:19.421220    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73b2cbb0-399a-4b35-aa7c-624967b776eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-54fb7c-j98vk\" (UID: \"73b2cbb0-399a-4b35-aa7c-624967b776eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54fb7c-j98vk"
Jul 26 16:27:19.522661 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:19.522583    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73b2cbb0-399a-4b35-aa7c-624967b776eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-54fb7c-j98vk\" (UID: \"73b2cbb0-399a-4b35-aa7c-624967b776eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54fb7c-j98vk"
Jul 26 16:27:19.523162 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:19.523142    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73b2cbb0-399a-4b35-aa7c-624967b776eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-54fb7c-j98vk\" (UID: \"73b2cbb0-399a-4b35-aa7c-624967b776eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54fb7c-j98vk"
Jul 26 16:27:19.631927 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:19.631904    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54fb7c-j98vk"
Jul 26 16:27:19.769996 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:19.769973    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54fb7c-j98vk"]
Jul 26 16:27:19.770145 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:27:19.770124    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73b2cbb0_399a_4b35_aa7c_624967b776eb.slice/crio-54829dd8ee4c0cd5714f852fb6f3687292cc7aa35b6fed44c435b0db4cc7f4dc WatchSource:0}: Error finding container 54829dd8ee4c0cd5714f852fb6f3687292cc7aa35b6fed44c435b0db4cc7f4dc: Status 404 returned error can't find the container with id 54829dd8ee4c0cd5714f852fb6f3687292cc7aa35b6fed44c435b0db4cc7f4dc
Jul 26 16:27:20.437114 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:20.437088    2556 generic.go:356] "Generic (PLEG): container finished" podID="73b2cbb0-399a-4b35-aa7c-624967b776eb" containerID="371cc6ef5071017424719e673ce589d019a74be8af1adad5fed3a0f548112732" exitCode=0
Jul 26 16:27:20.437501 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:20.437178    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54fb7c-j98vk" event={"ID":"73b2cbb0-399a-4b35-aa7c-624967b776eb","Type":"ContainerDied","Data":"371cc6ef5071017424719e673ce589d019a74be8af1adad5fed3a0f548112732"}
Jul 26 16:27:20.437501 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:20.437236    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54fb7c-j98vk" event={"ID":"73b2cbb0-399a-4b35-aa7c-624967b776eb","Type":"ContainerStarted","Data":"54829dd8ee4c0cd5714f852fb6f3687292cc7aa35b6fed44c435b0db4cc7f4dc"}
Jul 26 16:27:21.575362 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:21.575341    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54fb7c-j98vk"
Jul 26 16:27:21.638670 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:21.638627    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73b2cbb0-399a-4b35-aa7c-624967b776eb-maas-api-service-ca\") pod \"73b2cbb0-399a-4b35-aa7c-624967b776eb\" (UID: \"73b2cbb0-399a-4b35-aa7c-624967b776eb\") "
Jul 26 16:27:21.638883 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:21.638862    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73b2cbb0-399a-4b35-aa7c-624967b776eb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "73b2cbb0-399a-4b35-aa7c-624967b776eb" (UID: "73b2cbb0-399a-4b35-aa7c-624967b776eb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:27:21.740016 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:21.739960    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73b2cbb0-399a-4b35-aa7c-624967b776eb-maas-api-service-ca\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:27:22.449426 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:22.449398    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54fb7c-j98vk" event={"ID":"73b2cbb0-399a-4b35-aa7c-624967b776eb","Type":"ContainerDied","Data":"54829dd8ee4c0cd5714f852fb6f3687292cc7aa35b6fed44c435b0db4cc7f4dc"}
Jul 26 16:27:22.449426 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:22.449422    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54fb7c-j98vk"
Jul 26 16:27:22.449583 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:22.449441    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54829dd8ee4c0cd5714f852fb6f3687292cc7aa35b6fed44c435b0db4cc7f4dc"
Jul 26 16:27:34.198067 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.197967    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4" podUID="7ad0949f-8370-44f0-9b75-979c873e3e6b" containerName="main" containerID="cri-o://423c9a0be0a6eafb3bd030aff8f3f0b04cfc5181bc3ba0cd308c9e3d0cdf8f57" gracePeriod=45
Jul 26 16:27:34.410810 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.410778    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54fb7c-j98vk"]
Jul 26 16:27:34.413059 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.413034    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-54fb7c-j98vk"]
Jul 26 16:27:34.448216 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.448165    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:27:34.518950 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.518917    2556 generic.go:356] "Generic (PLEG): container finished" podID="7ad0949f-8370-44f0-9b75-979c873e3e6b" containerID="423c9a0be0a6eafb3bd030aff8f3f0b04cfc5181bc3ba0cd308c9e3d0cdf8f57" exitCode=0
Jul 26 16:27:34.519063 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.518958    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"
Jul 26 16:27:34.519063 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.519007    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4" event={"ID":"7ad0949f-8370-44f0-9b75-979c873e3e6b","Type":"ContainerDied","Data":"423c9a0be0a6eafb3bd030aff8f3f0b04cfc5181bc3ba0cd308c9e3d0cdf8f57"}
Jul 26 16:27:34.519063 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.519043    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4" event={"ID":"7ad0949f-8370-44f0-9b75-979c873e3e6b","Type":"ContainerDied","Data":"9d472dbe42a1d59ed4191d6bc728549649ee4acf5830cea98aba497634f7f65e"}
Jul 26 16:27:34.519063 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.519060    2556 scope.go:117] "RemoveContainer" containerID="423c9a0be0a6eafb3bd030aff8f3f0b04cfc5181bc3ba0cd308c9e3d0cdf8f57"
Jul 26 16:27:34.527478 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.527462    2556 scope.go:117] "RemoveContainer" containerID="423c9a0be0a6eafb3bd030aff8f3f0b04cfc5181bc3ba0cd308c9e3d0cdf8f57"
Jul 26 16:27:34.527765 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:27:34.527748    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"423c9a0be0a6eafb3bd030aff8f3f0b04cfc5181bc3ba0cd308c9e3d0cdf8f57\": container with ID starting with 423c9a0be0a6eafb3bd030aff8f3f0b04cfc5181bc3ba0cd308c9e3d0cdf8f57 not found: ID does not exist" containerID="423c9a0be0a6eafb3bd030aff8f3f0b04cfc5181bc3ba0cd308c9e3d0cdf8f57"
Jul 26 16:27:34.527833 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.527777    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"423c9a0be0a6eafb3bd030aff8f3f0b04cfc5181bc3ba0cd308c9e3d0cdf8f57"} err="failed to get container status \"423c9a0be0a6eafb3bd030aff8f3f0b04cfc5181bc3ba0cd308c9e3d0cdf8f57\": rpc error: code = NotFound desc = could not find container \"423c9a0be0a6eafb3bd030aff8f3f0b04cfc5181bc3ba0cd308c9e3d0cdf8f57\": container with ID starting with 423c9a0be0a6eafb3bd030aff8f3f0b04cfc5181bc3ba0cd308c9e3d0cdf8f57 not found: ID does not exist"
Jul 26 16:27:34.539076 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.539055    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxl4q\" (UniqueName: \"kubernetes.io/projected/7ad0949f-8370-44f0-9b75-979c873e3e6b-kube-api-access-wxl4q\") pod \"7ad0949f-8370-44f0-9b75-979c873e3e6b\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") "
Jul 26 16:27:34.539163 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.539117    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-dshm\") pod \"7ad0949f-8370-44f0-9b75-979c873e3e6b\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") "
Jul 26 16:27:34.539223 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.539167    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-tmp-dir\") pod \"7ad0949f-8370-44f0-9b75-979c873e3e6b\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") "
Jul 26 16:27:34.539223 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.539184    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-model-cache\") pod \"7ad0949f-8370-44f0-9b75-979c873e3e6b\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") "
Jul 26 16:27:34.539223 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.539202    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-home\") pod \"7ad0949f-8370-44f0-9b75-979c873e3e6b\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") "
Jul 26 16:27:34.539378 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.539236    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ad0949f-8370-44f0-9b75-979c873e3e6b-tls-certs\") pod \"7ad0949f-8370-44f0-9b75-979c873e3e6b\" (UID: \"7ad0949f-8370-44f0-9b75-979c873e3e6b\") "
Jul 26 16:27:34.539516 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.539465    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7ad0949f-8370-44f0-9b75-979c873e3e6b" (UID: "7ad0949f-8370-44f0-9b75-979c873e3e6b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:27:34.539516 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.539469    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-model-cache" (OuterVolumeSpecName: "model-cache") pod "7ad0949f-8370-44f0-9b75-979c873e3e6b" (UID: "7ad0949f-8370-44f0-9b75-979c873e3e6b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:27:34.539516 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.539484    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-home" (OuterVolumeSpecName: "home") pod "7ad0949f-8370-44f0-9b75-979c873e3e6b" (UID: "7ad0949f-8370-44f0-9b75-979c873e3e6b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:27:34.539894 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.539875    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-tmp-dir\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:27:34.539894 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.539896    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-model-cache\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:27:34.540041 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.539904    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-home\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:27:34.541221 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.541195    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ad0949f-8370-44f0-9b75-979c873e3e6b-kube-api-access-wxl4q" (OuterVolumeSpecName: "kube-api-access-wxl4q") pod "7ad0949f-8370-44f0-9b75-979c873e3e6b" (UID: "7ad0949f-8370-44f0-9b75-979c873e3e6b"). InnerVolumeSpecName "kube-api-access-wxl4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:27:34.541221 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.541217    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-dshm" (OuterVolumeSpecName: "dshm") pod "7ad0949f-8370-44f0-9b75-979c873e3e6b" (UID: "7ad0949f-8370-44f0-9b75-979c873e3e6b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:27:34.541339 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.541302    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ad0949f-8370-44f0-9b75-979c873e3e6b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7ad0949f-8370-44f0-9b75-979c873e3e6b" (UID: "7ad0949f-8370-44f0-9b75-979c873e3e6b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:27:34.640848 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.640830    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ad0949f-8370-44f0-9b75-979c873e3e6b-tls-certs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:27:34.640848 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.640850    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxl4q\" (UniqueName: \"kubernetes.io/projected/7ad0949f-8370-44f0-9b75-979c873e3e6b-kube-api-access-wxl4q\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:27:34.641159 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.640859    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ad0949f-8370-44f0-9b75-979c873e3e6b-dshm\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:27:34.840816 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.840789    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"]
Jul 26 16:27:34.845044 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:34.845024    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-3b85e1/test-model-3b85e1-kserve-7b8bf54d6f-cgmg4"]
Jul 26 16:27:36.215652 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:36.215603    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73b2cbb0-399a-4b35-aa7c-624967b776eb" path="/var/lib/kubelet/pods/73b2cbb0-399a-4b35-aa7c-624967b776eb/volumes"
Jul 26 16:27:36.216203 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:36.216182    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ad0949f-8370-44f0-9b75-979c873e3e6b" path="/var/lib/kubelet/pods/7ad0949f-8370-44f0-9b75-979c873e3e6b/volumes"
Jul 26 16:27:41.017999 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:41.017958    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"]
Jul 26 16:27:41.018452 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:41.018235    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr" podUID="01f6c633-eda6-4d6f-942e-f92db3cf3f49" containerName="istio-proxy" containerID="cri-o://21d15c209491b53cd82ab897a97914f5f5bdcc5d63fdb270bb81d7948e788c4b" gracePeriod=30
Jul 26 16:27:41.329421 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:41.329347    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3b85e1-8txfw"]
Jul 26 16:27:41.329731 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:41.329719    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73b2cbb0-399a-4b35-aa7c-624967b776eb" containerName="revoke-keys"
Jul 26 16:27:41.329781 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:41.329733    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="73b2cbb0-399a-4b35-aa7c-624967b776eb" containerName="revoke-keys"
Jul 26 16:27:41.329781 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:41.329745    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ad0949f-8370-44f0-9b75-979c873e3e6b" containerName="main"
Jul 26 16:27:41.329781 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:41.329750    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ad0949f-8370-44f0-9b75-979c873e3e6b" containerName="main"
Jul 26 16:27:41.329877 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:41.329806    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ad0949f-8370-44f0-9b75-979c873e3e6b" containerName="main"
Jul 26 16:27:41.329877 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:41.329815    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="73b2cbb0-399a-4b35-aa7c-624967b776eb" containerName="revoke-keys"
Jul 26 16:27:41.332716 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:41.332700    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3b85e1-8txfw"
Jul 26 16:27:41.335213 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:41.335185    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlwwk\""
Jul 26 16:27:41.335357 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:41.335230    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 26 16:27:41.340843 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:41.340822    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3b85e1-8txfw"]
Jul 26 16:27:41.392629 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:41.392602    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e01bfff4-98c3-4aca-8766-6511fe2be701-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-3b85e1-8txfw\" (UID: \"e01bfff4-98c3-4aca-8766-6511fe2be701\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3b85e1-8txfw"
Jul 26 16:27:41.493212 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:41.493186    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e01bfff4-98c3-4aca-8766-6511fe2be701-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-3b85e1-8txfw\" (UID: \"e01bfff4-98c3-4aca-8766-6511fe2be701\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3b85e1-8txfw"
Jul 26 16:27:41.493798 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:41.493779    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e01bfff4-98c3-4aca-8766-6511fe2be701-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-3b85e1-8txfw\" (UID: \"e01bfff4-98c3-4aca-8766-6511fe2be701\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3b85e1-8txfw"
Jul 26 16:27:41.644937 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:41.644871    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3b85e1-8txfw"
Jul 26 16:27:41.774310 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:41.774283    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3b85e1-8txfw"]
Jul 26 16:27:41.776199 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:27:41.776175    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode01bfff4_98c3_4aca_8766_6511fe2be701.slice/crio-e77244001da20d8323f0055e93621d2ecc3c4a0242c85f023dd547ad256f97ae WatchSource:0}: Error finding container e77244001da20d8323f0055e93621d2ecc3c4a0242c85f023dd547ad256f97ae: Status 404 returned error can't find the container with id e77244001da20d8323f0055e93621d2ecc3c4a0242c85f023dd547ad256f97ae
Jul 26 16:27:42.566907 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:42.566875    2556 generic.go:356] "Generic (PLEG): container finished" podID="e01bfff4-98c3-4aca-8766-6511fe2be701" containerID="b1009b50b9a1985fcf8770d3744db840367ca4c857fdaf1d13b29d081fab0cca" exitCode=0
Jul 26 16:27:42.567222 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:42.566931    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3b85e1-8txfw" event={"ID":"e01bfff4-98c3-4aca-8766-6511fe2be701","Type":"ContainerDied","Data":"b1009b50b9a1985fcf8770d3744db840367ca4c857fdaf1d13b29d081fab0cca"}
Jul 26 16:27:42.567222 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:42.566979    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3b85e1-8txfw" event={"ID":"e01bfff4-98c3-4aca-8766-6511fe2be701","Type":"ContainerStarted","Data":"e77244001da20d8323f0055e93621d2ecc3c4a0242c85f023dd547ad256f97ae"}
Jul 26 16:27:43.707434 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:43.707412    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3b85e1-8txfw"
Jul 26 16:27:43.813530 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:43.813501    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e01bfff4-98c3-4aca-8766-6511fe2be701-maas-api-service-ca\") pod \"e01bfff4-98c3-4aca-8766-6511fe2be701\" (UID: \"e01bfff4-98c3-4aca-8766-6511fe2be701\") "
Jul 26 16:27:43.813831 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:43.813803    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e01bfff4-98c3-4aca-8766-6511fe2be701-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e01bfff4-98c3-4aca-8766-6511fe2be701" (UID: "e01bfff4-98c3-4aca-8766-6511fe2be701"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:27:43.915198 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:43.915144    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e01bfff4-98c3-4aca-8766-6511fe2be701-maas-api-service-ca\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:27:44.579050 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:44.578974    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3b85e1-8txfw"
Jul 26 16:27:44.579050 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:44.579010    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3b85e1-8txfw" event={"ID":"e01bfff4-98c3-4aca-8766-6511fe2be701","Type":"ContainerDied","Data":"e77244001da20d8323f0055e93621d2ecc3c4a0242c85f023dd547ad256f97ae"}
Jul 26 16:27:44.579256 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:44.579075    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e77244001da20d8323f0055e93621d2ecc3c4a0242c85f023dd547ad256f97ae"
Jul 26 16:27:46.271703 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.271679    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:27:46.335708 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.335642    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94j5q\" (UniqueName: \"kubernetes.io/projected/01f6c633-eda6-4d6f-942e-f92db3cf3f49-kube-api-access-94j5q\") pod \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") "
Jul 26 16:27:46.335708 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.335698    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istiod-ca-cert\") pod \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") "
Jul 26 16:27:46.335898 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.335727    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-workload-socket\") pod \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") "
Jul 26 16:27:46.335898 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.335751    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-data\") pod \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") "
Jul 26 16:27:46.335898 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.335768    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-workload-certs\") pod \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") "
Jul 26 16:27:46.335898 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.335795    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-token\") pod \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") "
Jul 26 16:27:46.335898 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.335848    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-podinfo\") pod \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") "
Jul 26 16:27:46.336156 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.335904    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-envoy\") pod \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") "
Jul 26 16:27:46.336156 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.335958    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-credential-socket\") pod \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\" (UID: \"01f6c633-eda6-4d6f-942e-f92db3cf3f49\") "
Jul 26 16:27:46.336156 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.336026    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "01f6c633-eda6-4d6f-942e-f92db3cf3f49" (UID: "01f6c633-eda6-4d6f-942e-f92db3cf3f49"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:27:46.336156 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.336100    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "01f6c633-eda6-4d6f-942e-f92db3cf3f49" (UID: "01f6c633-eda6-4d6f-942e-f92db3cf3f49"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:27:46.336156 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.336026    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "01f6c633-eda6-4d6f-942e-f92db3cf3f49" (UID: "01f6c633-eda6-4d6f-942e-f92db3cf3f49"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:27:46.336420 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.336234    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "01f6c633-eda6-4d6f-942e-f92db3cf3f49" (UID: "01f6c633-eda6-4d6f-942e-f92db3cf3f49"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:27:46.336420 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.336354    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-credential-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:27:46.336420 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.336371    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istiod-ca-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:27:46.336420 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.336383    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-workload-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:27:46.336420 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.336396    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-workload-certs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:27:46.336732 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.336709    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-data" (OuterVolumeSpecName: "istio-data") pod "01f6c633-eda6-4d6f-942e-f92db3cf3f49" (UID: "01f6c633-eda6-4d6f-942e-f92db3cf3f49"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:27:46.337748 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.337724    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01f6c633-eda6-4d6f-942e-f92db3cf3f49-kube-api-access-94j5q" (OuterVolumeSpecName: "kube-api-access-94j5q") pod "01f6c633-eda6-4d6f-942e-f92db3cf3f49" (UID: "01f6c633-eda6-4d6f-942e-f92db3cf3f49"). InnerVolumeSpecName "kube-api-access-94j5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:27:46.338070 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.338042    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "01f6c633-eda6-4d6f-942e-f92db3cf3f49" (UID: "01f6c633-eda6-4d6f-942e-f92db3cf3f49"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 16:27:46.338371 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.338353    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "01f6c633-eda6-4d6f-942e-f92db3cf3f49" (UID: "01f6c633-eda6-4d6f-942e-f92db3cf3f49"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:27:46.338443 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.338357    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-token" (OuterVolumeSpecName: "istio-token") pod "01f6c633-eda6-4d6f-942e-f92db3cf3f49" (UID: "01f6c633-eda6-4d6f-942e-f92db3cf3f49"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:27:46.437009 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.436986    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94j5q\" (UniqueName: \"kubernetes.io/projected/01f6c633-eda6-4d6f-942e-f92db3cf3f49-kube-api-access-94j5q\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:27:46.437088 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.437009    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-data\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:27:46.437088 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.437022    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-token\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:27:46.437088 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.437030    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-podinfo\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:27:46.437088 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.437037    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01f6c633-eda6-4d6f-942e-f92db3cf3f49-istio-envoy\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:27:46.593434 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.593382    2556 generic.go:356] "Generic (PLEG): container finished" podID="01f6c633-eda6-4d6f-942e-f92db3cf3f49" containerID="21d15c209491b53cd82ab897a97914f5f5bdcc5d63fdb270bb81d7948e788c4b" exitCode=0
Jul 26 16:27:46.593434 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.593421    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr" event={"ID":"01f6c633-eda6-4d6f-942e-f92db3cf3f49","Type":"ContainerDied","Data":"21d15c209491b53cd82ab897a97914f5f5bdcc5d63fdb270bb81d7948e788c4b"}
Jul 26 16:27:46.593544 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.593431    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"
Jul 26 16:27:46.593544 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.593462    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr" event={"ID":"01f6c633-eda6-4d6f-942e-f92db3cf3f49","Type":"ContainerDied","Data":"b331afda8adf32713bcdace5b1e62bcc8676079ff5a5a135bc8585cbde676f10"}
Jul 26 16:27:46.593544 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.593484    2556 scope.go:117] "RemoveContainer" containerID="21d15c209491b53cd82ab897a97914f5f5bdcc5d63fdb270bb81d7948e788c4b"
Jul 26 16:27:46.603319 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.603304    2556 scope.go:117] "RemoveContainer" containerID="22de0c8c716e7919b7086dda8a81e37c731a5b1984aad7d16f1b827a23e30f6a"
Jul 26 16:27:46.611415 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.611398    2556 scope.go:117] "RemoveContainer" containerID="21d15c209491b53cd82ab897a97914f5f5bdcc5d63fdb270bb81d7948e788c4b"
Jul 26 16:27:46.611678 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:27:46.611660    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21d15c209491b53cd82ab897a97914f5f5bdcc5d63fdb270bb81d7948e788c4b\": container with ID starting with 21d15c209491b53cd82ab897a97914f5f5bdcc5d63fdb270bb81d7948e788c4b not found: ID does not exist" containerID="21d15c209491b53cd82ab897a97914f5f5bdcc5d63fdb270bb81d7948e788c4b"
Jul 26 16:27:46.611718 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.611687    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21d15c209491b53cd82ab897a97914f5f5bdcc5d63fdb270bb81d7948e788c4b"} err="failed to get container status \"21d15c209491b53cd82ab897a97914f5f5bdcc5d63fdb270bb81d7948e788c4b\": rpc error: code = NotFound desc = could not find container \"21d15c209491b53cd82ab897a97914f5f5bdcc5d63fdb270bb81d7948e788c4b\": container with ID starting with 21d15c209491b53cd82ab897a97914f5f5bdcc5d63fdb270bb81d7948e788c4b not found: ID does not exist"
Jul 26 16:27:46.611718 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.611705    2556 scope.go:117] "RemoveContainer" containerID="22de0c8c716e7919b7086dda8a81e37c731a5b1984aad7d16f1b827a23e30f6a"
Jul 26 16:27:46.611939 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:27:46.611923    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22de0c8c716e7919b7086dda8a81e37c731a5b1984aad7d16f1b827a23e30f6a\": container with ID starting with 22de0c8c716e7919b7086dda8a81e37c731a5b1984aad7d16f1b827a23e30f6a not found: ID does not exist" containerID="22de0c8c716e7919b7086dda8a81e37c731a5b1984aad7d16f1b827a23e30f6a"
Jul 26 16:27:46.611986 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.611943    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22de0c8c716e7919b7086dda8a81e37c731a5b1984aad7d16f1b827a23e30f6a"} err="failed to get container status \"22de0c8c716e7919b7086dda8a81e37c731a5b1984aad7d16f1b827a23e30f6a\": rpc error: code = NotFound desc = could not find container \"22de0c8c716e7919b7086dda8a81e37c731a5b1984aad7d16f1b827a23e30f6a\": container with ID starting with 22de0c8c716e7919b7086dda8a81e37c731a5b1984aad7d16f1b827a23e30f6a not found: ID does not exist"
Jul 26 16:27:46.617143 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.617119    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"]
Jul 26 16:27:46.620308 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:46.620287    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-54fb7c-openshift-default-5d89dd9756-thsvr"]
Jul 26 16:27:48.216683 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:48.216651    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01f6c633-eda6-4d6f-942e-f92db3cf3f49" path="/var/lib/kubelet/pods/01f6c633-eda6-4d6f-942e-f92db3cf3f49/volumes"
Jul 26 16:27:56.402617 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:56.402575    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3b85e1-8txfw"]
Jul 26 16:27:56.405094 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:56.405070    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-3b85e1-8txfw"]
Jul 26 16:27:58.215483 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:27:58.215449    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e01bfff4-98c3-4aca-8766-6511fe2be701" path="/var/lib/kubelet/pods/e01bfff4-98c3-4aca-8766-6511fe2be701/volumes"
Jul 26 16:28:02.961992 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:02.961953    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"]
Jul 26 16:28:02.962758 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:02.962725    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x" podUID="ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" containerName="istio-proxy" containerID="cri-o://b643f0b75391cbfcdc63ee1352a34a812cc46d391737e7512a6692c336b06e8c" gracePeriod=30
Jul 26 16:28:03.924401 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:03.924359    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"]
Jul 26 16:28:03.924894 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:03.924874    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01f6c633-eda6-4d6f-942e-f92db3cf3f49" containerName="istio-proxy"
Jul 26 16:28:03.924966 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:03.924898    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="01f6c633-eda6-4d6f-942e-f92db3cf3f49" containerName="istio-proxy"
Jul 26 16:28:03.924966 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:03.924916    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e01bfff4-98c3-4aca-8766-6511fe2be701" containerName="revoke-keys"
Jul 26 16:28:03.924966 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:03.924925    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e01bfff4-98c3-4aca-8766-6511fe2be701" containerName="revoke-keys"
Jul 26 16:28:03.925061 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:03.925026    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e01bfff4-98c3-4aca-8766-6511fe2be701" containerName="revoke-keys"
Jul 26 16:28:03.925061 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:03.925040    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="01f6c633-eda6-4d6f-942e-f92db3cf3f49" containerName="istio-proxy"
Jul 26 16:28:03.929783 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:03.929761    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:03.932447 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:03.932425    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-948a62-openshift-default-dockercfg-96grb\""
Jul 26 16:28:03.939904 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:03.939881    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"]
Jul 26 16:28:04.084950 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.084914    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-podinfo\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.085346 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.084977    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-envoy\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.085346 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.085015    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-workload-socket\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.085346 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.085040    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-workload-certs\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.085346 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.085128    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-694zq\" (UniqueName: \"kubernetes.io/projected/1bd3b1b1-c651-4180-8956-681d65b80d50-kube-api-access-694zq\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.085346 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.085195    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bd3b1b1-c651-4180-8956-681d65b80d50-istiod-ca-cert\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.085346 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.085239    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-credential-socket\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.085346 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.085273    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-token\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.085346 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.085310    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-data\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.186145 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.186052    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-workload-socket\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.186145 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.186094    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-workload-certs\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.186145 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.186131    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-694zq\" (UniqueName: \"kubernetes.io/projected/1bd3b1b1-c651-4180-8956-681d65b80d50-kube-api-access-694zq\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.186444 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.186151    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bd3b1b1-c651-4180-8956-681d65b80d50-istiod-ca-cert\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.186444 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.186172    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-credential-socket\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.186444 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.186193    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-token\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.186444 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.186265    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-data\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.186444 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.186318    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-podinfo\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.186444 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.186382    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-envoy\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.186777 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.186536    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-workload-socket\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.186777 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.186560    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-credential-socket\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.186901 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.186837    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-data\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.186901 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.186842    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-workload-certs\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.187036 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.187013    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bd3b1b1-c651-4180-8956-681d65b80d50-istiod-ca-cert\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.188767 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.188746    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-envoy\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.188889 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.188871    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-podinfo\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.195016 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.194992    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-token\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.195105 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.195050    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-694zq\" (UniqueName: \"kubernetes.io/projected/1bd3b1b1-c651-4180-8956-681d65b80d50-kube-api-access-694zq\") pod \"e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") " pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.243458 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.243433    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-948a62-openshift-default-dockercfg-96grb\""
Jul 26 16:28:04.251515 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.251497    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:04.394416 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.394390    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"]
Jul 26 16:28:04.395552 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:28:04.395521    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd3b1b1_c651_4180_8956_681d65b80d50.slice/crio-f9fa3ac95e8218fe5d3b86d32e61e070545de8a52f50fe4dac2f7d094f3c397d WatchSource:0}: Error finding container f9fa3ac95e8218fe5d3b86d32e61e070545de8a52f50fe4dac2f7d094f3c397d: Status 404 returned error can't find the container with id f9fa3ac95e8218fe5d3b86d32e61e070545de8a52f50fe4dac2f7d094f3c397d
Jul 26 16:28:04.397773 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.397730    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:28:04.397852 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.397823    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:28:04.397888 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.397867    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:28:04.697366 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.697278    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7" event={"ID":"1bd3b1b1-c651-4180-8956-681d65b80d50","Type":"ContainerStarted","Data":"7692cfc32f7f18dc6e0b69339afc877f4f479b6281c20f7e8021cd8f9d13b0c0"}
Jul 26 16:28:04.697366 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.697334    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7" event={"ID":"1bd3b1b1-c651-4180-8956-681d65b80d50","Type":"ContainerStarted","Data":"f9fa3ac95e8218fe5d3b86d32e61e070545de8a52f50fe4dac2f7d094f3c397d"}
Jul 26 16:28:04.718053 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:04.718008    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7" podStartSLOduration=1.717992499 podStartE2EDuration="1.717992499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:28:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:28:04.717137274 +0000 UTC m=+2280.935764323" watchObservedRunningTime="2026-07-26 16:28:04.717992499 +0000 UTC m=+2280.936619548"
Jul 26 16:28:05.252194 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:05.252157    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:05.257123 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:05.257096    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:05.703556 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:05.703529    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:05.704556 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:05.704537    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:08.223215 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.223192    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:28:08.319999 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.319935    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istiod-ca-cert\") pod \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") "
Jul 26 16:28:08.319999 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.319970    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-credential-socket\") pod \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") "
Jul 26 16:28:08.320151 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.320019    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twmfk\" (UniqueName: \"kubernetes.io/projected/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-kube-api-access-twmfk\") pod \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") "
Jul 26 16:28:08.320151 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.320042    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-token\") pod \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") "
Jul 26 16:28:08.320151 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.320067    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-data\") pod \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") "
Jul 26 16:28:08.320151 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.320105    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-podinfo\") pod \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") "
Jul 26 16:28:08.320344 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.320187    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-workload-socket\") pod \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") "
Jul 26 16:28:08.320344 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.320212    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-workload-certs\") pod \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") "
Jul 26 16:28:08.320344 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.320238    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-envoy\") pod \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\" (UID: \"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb\") "
Jul 26 16:28:08.320514 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.320382    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" (UID: "ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:28:08.320514 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.320423    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" (UID: "ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:28:08.320700 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.320680    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-credential-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:28:08.320760 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.320705    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istiod-ca-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:28:08.320760 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.320681    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" (UID: "ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:28:08.320760 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.320702    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" (UID: "ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:28:08.320975 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.320950    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-data" (OuterVolumeSpecName: "istio-data") pod "ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" (UID: "ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:28:08.322327 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.322299    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-kube-api-access-twmfk" (OuterVolumeSpecName: "kube-api-access-twmfk") pod "ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" (UID: "ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb"). InnerVolumeSpecName "kube-api-access-twmfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:28:08.322424 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.322336    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" (UID: "ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 16:28:08.322651 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.322618    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-token" (OuterVolumeSpecName: "istio-token") pod "ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" (UID: "ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:28:08.322767 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.322753    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" (UID: "ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:28:08.421888 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.421864    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twmfk\" (UniqueName: \"kubernetes.io/projected/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-kube-api-access-twmfk\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:28:08.421888 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.421886    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-token\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:28:08.422016 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.421895    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-data\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:28:08.422016 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.421903    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-podinfo\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:28:08.422016 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.421910    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-workload-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:28:08.422016 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.421919    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-workload-certs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:28:08.422016 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.421926    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb-istio-envoy\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:28:08.722458 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.722429    2556 generic.go:356] "Generic (PLEG): container finished" podID="ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" containerID="b643f0b75391cbfcdc63ee1352a34a812cc46d391737e7512a6692c336b06e8c" exitCode=0
Jul 26 16:28:08.722602 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.722481    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"
Jul 26 16:28:08.722602 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.722501    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x" event={"ID":"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb","Type":"ContainerDied","Data":"b643f0b75391cbfcdc63ee1352a34a812cc46d391737e7512a6692c336b06e8c"}
Jul 26 16:28:08.722602 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.722540    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x" event={"ID":"ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb","Type":"ContainerDied","Data":"6753f5b5261ef40bc7ace393636e24611a7a7bc65bd37f8ed33af7026551b156"}
Jul 26 16:28:08.722602 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.722563    2556 scope.go:117] "RemoveContainer" containerID="b643f0b75391cbfcdc63ee1352a34a812cc46d391737e7512a6692c336b06e8c"
Jul 26 16:28:08.732688 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.732670    2556 scope.go:117] "RemoveContainer" containerID="1f4be8a9a19a56cc852e94d8dc210c4be3f8dd437b9fc879f1cde19b67cf02ef"
Jul 26 16:28:08.740742 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.740724    2556 scope.go:117] "RemoveContainer" containerID="b643f0b75391cbfcdc63ee1352a34a812cc46d391737e7512a6692c336b06e8c"
Jul 26 16:28:08.740990 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:28:08.740968    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b643f0b75391cbfcdc63ee1352a34a812cc46d391737e7512a6692c336b06e8c\": container with ID starting with b643f0b75391cbfcdc63ee1352a34a812cc46d391737e7512a6692c336b06e8c not found: ID does not exist" containerID="b643f0b75391cbfcdc63ee1352a34a812cc46d391737e7512a6692c336b06e8c"
Jul 26 16:28:08.741094 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.740997    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b643f0b75391cbfcdc63ee1352a34a812cc46d391737e7512a6692c336b06e8c"} err="failed to get container status \"b643f0b75391cbfcdc63ee1352a34a812cc46d391737e7512a6692c336b06e8c\": rpc error: code = NotFound desc = could not find container \"b643f0b75391cbfcdc63ee1352a34a812cc46d391737e7512a6692c336b06e8c\": container with ID starting with b643f0b75391cbfcdc63ee1352a34a812cc46d391737e7512a6692c336b06e8c not found: ID does not exist"
Jul 26 16:28:08.741094 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.741013    2556 scope.go:117] "RemoveContainer" containerID="1f4be8a9a19a56cc852e94d8dc210c4be3f8dd437b9fc879f1cde19b67cf02ef"
Jul 26 16:28:08.741234 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:28:08.741219    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f4be8a9a19a56cc852e94d8dc210c4be3f8dd437b9fc879f1cde19b67cf02ef\": container with ID starting with 1f4be8a9a19a56cc852e94d8dc210c4be3f8dd437b9fc879f1cde19b67cf02ef not found: ID does not exist" containerID="1f4be8a9a19a56cc852e94d8dc210c4be3f8dd437b9fc879f1cde19b67cf02ef"
Jul 26 16:28:08.741274 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.741237    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f4be8a9a19a56cc852e94d8dc210c4be3f8dd437b9fc879f1cde19b67cf02ef"} err="failed to get container status \"1f4be8a9a19a56cc852e94d8dc210c4be3f8dd437b9fc879f1cde19b67cf02ef\": rpc error: code = NotFound desc = could not find container \"1f4be8a9a19a56cc852e94d8dc210c4be3f8dd437b9fc879f1cde19b67cf02ef\": container with ID starting with 1f4be8a9a19a56cc852e94d8dc210c4be3f8dd437b9fc879f1cde19b67cf02ef not found: ID does not exist"
Jul 26 16:28:08.747044 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.747024    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"]
Jul 26 16:28:08.752949 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:08.752927    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-3b85e1-openshift-default-85db55b8c6-8sb9x"]
Jul 26 16:28:10.216801 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:10.216769    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" path="/var/lib/kubelet/pods/ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb/volumes"
Jul 26 16:28:12.039028 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.038987    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"]
Jul 26 16:28:12.039498 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.039403    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" containerName="istio-proxy"
Jul 26 16:28:12.039498 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.039415    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" containerName="istio-proxy"
Jul 26 16:28:12.039498 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.039428    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01f6c633-eda6-4d6f-942e-f92db3cf3f49" containerName="istio-proxy"
Jul 26 16:28:12.039498 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.039435    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="01f6c633-eda6-4d6f-942e-f92db3cf3f49" containerName="istio-proxy"
Jul 26 16:28:12.039498 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.039450    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" containerName="istio-proxy"
Jul 26 16:28:12.039498 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.039456    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" containerName="istio-proxy"
Jul 26 16:28:12.039798 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.039527    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" containerName="istio-proxy"
Jul 26 16:28:12.039798 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.039542    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="01f6c633-eda6-4d6f-942e-f92db3cf3f49" containerName="istio-proxy"
Jul 26 16:28:12.042729 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.042709    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.050522 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.046429    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-df352b-openshift-default-dockercfg-2bl2v\""
Jul 26 16:28:12.059957 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.058024    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"]
Jul 26 16:28:12.159657 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.155090    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-credential-socket\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.159657 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.155146    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2eab1e2-9968-4480-8d20-03ef05514175-istio-podinfo\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.159657 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.155179    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-workload-socket\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.159657 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.155212    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-istio-data\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.159657 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.155272    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2eab1e2-9968-4480-8d20-03ef05514175-istiod-ca-cert\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.159657 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.155296    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn5dx\" (UniqueName: \"kubernetes.io/projected/b2eab1e2-9968-4480-8d20-03ef05514175-kube-api-access-wn5dx\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.159657 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.155326    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-workload-certs\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.159657 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.155398    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-istio-envoy\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.159657 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.155463    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2eab1e2-9968-4480-8d20-03ef05514175-istio-token\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.256526 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.256478    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-istio-envoy\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.256726 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.256563    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2eab1e2-9968-4480-8d20-03ef05514175-istio-token\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.256726 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.256603    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-credential-socket\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.256726 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.256648    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2eab1e2-9968-4480-8d20-03ef05514175-istio-podinfo\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.256726 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.256677    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-workload-socket\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.256726 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.256713    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-istio-data\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.257026 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.256771    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2eab1e2-9968-4480-8d20-03ef05514175-istiod-ca-cert\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.257026 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.256797    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn5dx\" (UniqueName: \"kubernetes.io/projected/b2eab1e2-9968-4480-8d20-03ef05514175-kube-api-access-wn5dx\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.257026 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.256827    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-workload-certs\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.257284 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.257247    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-workload-certs\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.257857 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.257826    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-workload-socket\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.257978 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.257946    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-credential-socket\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.258652 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.258591    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-istio-data\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.259246 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.259188    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2eab1e2-9968-4480-8d20-03ef05514175-istiod-ca-cert\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.263148 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.263113    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2eab1e2-9968-4480-8d20-03ef05514175-istio-podinfo\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.268524 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.268480    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn5dx\" (UniqueName: \"kubernetes.io/projected/b2eab1e2-9968-4480-8d20-03ef05514175-kube-api-access-wn5dx\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.270096 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.270065    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2eab1e2-9968-4480-8d20-03ef05514175-istio-token\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.272966 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.272949    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-istio-envoy\") pod \"e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") " pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.363646 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.363560    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:12.525148 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.525119    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"]
Jul 26 16:28:12.529479 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.529442    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:28:12.529608 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.529518    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:28:12.529608 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.529569    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:28:12.749847 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.749121    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp" event={"ID":"b2eab1e2-9968-4480-8d20-03ef05514175","Type":"ContainerStarted","Data":"e5f1a0d00e4823451daa73016d4897527626e3a409ed675b4104201bfdac335a"}
Jul 26 16:28:12.750051 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:12.749885    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp" event={"ID":"b2eab1e2-9968-4480-8d20-03ef05514175","Type":"ContainerStarted","Data":"abbee7c96619a546dea0cfac9421e74f5355cc8ee6cbdfd6f6b2db0501f14181"}
Jul 26 16:28:13.364957 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:13.364917    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:13.367539 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:13.367224    2556 patch_prober.go:28] interesting pod/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Jul 26 16:28:13.367539 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:13.367278    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp" podUID="b2eab1e2-9968-4480-8d20-03ef05514175" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Jul 26 16:28:14.371338 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:14.371311    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:14.392771 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:14.392718    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp" podStartSLOduration=2.3927055680000002 podStartE2EDuration="2.392705568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:28:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:28:12.773889982 +0000 UTC m=+2288.992517033" watchObservedRunningTime="2026-07-26 16:28:14.392705568 +0000 UTC m=+2290.611332607"
Jul 26 16:28:14.767611 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:14.767572    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:14.769471 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:14.769448    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:18.794396 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:18.794362    2556 generic.go:356] "Generic (PLEG): container finished" podID="1bd3b1b1-c651-4180-8956-681d65b80d50" containerID="7692cfc32f7f18dc6e0b69339afc877f4f479b6281c20f7e8021cd8f9d13b0c0" exitCode=0
Jul 26 16:28:18.794821 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:18.794402    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7" event={"ID":"1bd3b1b1-c651-4180-8956-681d65b80d50","Type":"ContainerDied","Data":"7692cfc32f7f18dc6e0b69339afc877f4f479b6281c20f7e8021cd8f9d13b0c0"}
Jul 26 16:28:18.794821 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:18.794805    2556 scope.go:117] "RemoveContainer" containerID="7692cfc32f7f18dc6e0b69339afc877f4f479b6281c20f7e8021cd8f9d13b0c0"
Jul 26 16:28:18.798544 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:18.798498    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:28:18.798700 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:18.798588    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:28:18.798700 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:18.798658    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:28:19.802091 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:19.802044    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7" event={"ID":"1bd3b1b1-c651-4180-8956-681d65b80d50","Type":"ContainerStarted","Data":"409cea1960c4c3cc9cb727ab10b655b8bfebb8418837f8ff846e0815ca2697dd"}
Jul 26 16:28:20.252450 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:20.252411    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:20.253688 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:20.253653    2556 patch_prober.go:28] interesting pod/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 26 16:28:20.253833 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:20.253737    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7" podUID="1bd3b1b1-c651-4180-8956-681d65b80d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 26 16:28:20.703784 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:20.703741    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:21.252752 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:21.252712    2556 patch_prober.go:28] interesting pod/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 26 16:28:21.253391 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:21.253357    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7" podUID="1bd3b1b1-c651-4180-8956-681d65b80d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 26 16:28:22.252000 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:22.251954    2556 patch_prober.go:28] interesting pod/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 26 16:28:22.252212 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:22.252023    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7" podUID="1bd3b1b1-c651-4180-8956-681d65b80d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 26 16:28:23.252563 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:23.252521    2556 patch_prober.go:28] interesting pod/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 26 16:28:23.253083 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:23.252584    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7" podUID="1bd3b1b1-c651-4180-8956-681d65b80d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 26 16:28:24.257119 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:24.257086    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:24.258170 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:24.258147    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:26.842941 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:26.842907    2556 generic.go:356] "Generic (PLEG): container finished" podID="b2eab1e2-9968-4480-8d20-03ef05514175" containerID="e5f1a0d00e4823451daa73016d4897527626e3a409ed675b4104201bfdac335a" exitCode=0
Jul 26 16:28:26.843366 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:26.842982    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp" event={"ID":"b2eab1e2-9968-4480-8d20-03ef05514175","Type":"ContainerDied","Data":"e5f1a0d00e4823451daa73016d4897527626e3a409ed675b4104201bfdac335a"}
Jul 26 16:28:26.843366 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:26.843332    2556 scope.go:117] "RemoveContainer" containerID="e5f1a0d00e4823451daa73016d4897527626e3a409ed675b4104201bfdac335a"
Jul 26 16:28:26.844268 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:26.844241    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:28:26.844322 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:26.844307    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:28:26.844361 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:26.844340    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:28:27.448647 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:27.448602    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-948a62-kdp4m"]
Jul 26 16:28:27.449236 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:27.449221    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff07b80e-ac6e-40ce-9eff-1a054fc3fdfb" containerName="istio-proxy"
Jul 26 16:28:27.452620 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:27.452602    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-948a62-kdp4m"
Jul 26 16:28:27.455541 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:27.455518    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 26 16:28:27.455692 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:27.455615    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlwwk\""
Jul 26 16:28:27.458511 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:27.458490    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-948a62-kdp4m"]
Jul 26 16:28:27.513377 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:27.513351    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54985eb9-18a5-4f73-8f6e-d007ae16499d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-948a62-kdp4m\" (UID: \"54985eb9-18a5-4f73-8f6e-d007ae16499d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-948a62-kdp4m"
Jul 26 16:28:27.613937 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:27.613907    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54985eb9-18a5-4f73-8f6e-d007ae16499d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-948a62-kdp4m\" (UID: \"54985eb9-18a5-4f73-8f6e-d007ae16499d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-948a62-kdp4m"
Jul 26 16:28:27.614490 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:27.614472    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54985eb9-18a5-4f73-8f6e-d007ae16499d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-948a62-kdp4m\" (UID: \"54985eb9-18a5-4f73-8f6e-d007ae16499d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-948a62-kdp4m"
Jul 26 16:28:27.764996 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:27.764917    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-948a62-kdp4m"
Jul 26 16:28:27.854118 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:27.854072    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp" event={"ID":"b2eab1e2-9968-4480-8d20-03ef05514175","Type":"ContainerStarted","Data":"a3333d240b4679de1a52f1d5e09ef45304834c5747f5f74b39a3823800098b8e"}
Jul 26 16:28:28.112889 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:28.112862    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-948a62-kdp4m"]
Jul 26 16:28:28.114272 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:28:28.114238    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54985eb9_18a5_4f73_8f6e_d007ae16499d.slice/crio-832f6c30dec6b37d7a6cf1dd49b7222aec94b2b082b9c4eced06b68a34300a1d WatchSource:0}: Error finding container 832f6c30dec6b37d7a6cf1dd49b7222aec94b2b082b9c4eced06b68a34300a1d: Status 404 returned error can't find the container with id 832f6c30dec6b37d7a6cf1dd49b7222aec94b2b082b9c4eced06b68a34300a1d
Jul 26 16:28:28.364848 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:28.364758    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:28.366297 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:28.366264    2556 patch_prober.go:28] interesting pod/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Jul 26 16:28:28.366420 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:28.366322    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp" podUID="b2eab1e2-9968-4480-8d20-03ef05514175" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Jul 26 16:28:28.867922 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:28.867880    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-948a62-kdp4m" event={"ID":"54985eb9-18a5-4f73-8f6e-d007ae16499d","Type":"ContainerStarted","Data":"8ac04f5dcf2ecdd0bf8cdf4baa82da281aba8865a3eb9113605795b6ae7671e5"}
Jul 26 16:28:28.868409 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:28.867952    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-948a62-kdp4m" event={"ID":"54985eb9-18a5-4f73-8f6e-d007ae16499d","Type":"ContainerStarted","Data":"832f6c30dec6b37d7a6cf1dd49b7222aec94b2b082b9c4eced06b68a34300a1d"}
Jul 26 16:28:28.886363 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:28.886306    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-948a62-kdp4m" podStartSLOduration=1.886288419 podStartE2EDuration="1.886288419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:28:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:28:28.883305801 +0000 UTC m=+2305.101932870" watchObservedRunningTime="2026-07-26 16:28:28.886288419 +0000 UTC m=+2305.104915469"
Jul 26 16:28:29.365174 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:29.365131    2556 patch_prober.go:28] interesting pod/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Jul 26 16:28:29.365381 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:29.365195    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp" podUID="b2eab1e2-9968-4480-8d20-03ef05514175" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Jul 26 16:28:29.767764 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:29.767716    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:29.874610 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:29.874573    2556 generic.go:356] "Generic (PLEG): container finished" podID="54985eb9-18a5-4f73-8f6e-d007ae16499d" containerID="8ac04f5dcf2ecdd0bf8cdf4baa82da281aba8865a3eb9113605795b6ae7671e5" exitCode=0
Jul 26 16:28:29.875013 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:29.874614    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-948a62-kdp4m" event={"ID":"54985eb9-18a5-4f73-8f6e-d007ae16499d","Type":"ContainerDied","Data":"8ac04f5dcf2ecdd0bf8cdf4baa82da281aba8865a3eb9113605795b6ae7671e5"}
Jul 26 16:28:30.365021 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:30.364984    2556 patch_prober.go:28] interesting pod/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Jul 26 16:28:30.365287 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:30.365261    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp" podUID="b2eab1e2-9968-4480-8d20-03ef05514175" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Jul 26 16:28:31.028727 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:31.028705    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-948a62-kdp4m"
Jul 26 16:28:31.172676 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:31.172645    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54985eb9-18a5-4f73-8f6e-d007ae16499d-maas-api-service-ca\") pod \"54985eb9-18a5-4f73-8f6e-d007ae16499d\" (UID: \"54985eb9-18a5-4f73-8f6e-d007ae16499d\") "
Jul 26 16:28:31.173023 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:31.172999    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54985eb9-18a5-4f73-8f6e-d007ae16499d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "54985eb9-18a5-4f73-8f6e-d007ae16499d" (UID: "54985eb9-18a5-4f73-8f6e-d007ae16499d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:28:31.274383 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:31.274353    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54985eb9-18a5-4f73-8f6e-d007ae16499d-maas-api-service-ca\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:28:31.365236 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:31.364766    2556 patch_prober.go:28] interesting pod/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Jul 26 16:28:31.365236 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:31.364833    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp" podUID="b2eab1e2-9968-4480-8d20-03ef05514175" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Jul 26 16:28:31.890835 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:31.890803    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-948a62-kdp4m"
Jul 26 16:28:31.891007 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:31.890856    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-948a62-kdp4m" event={"ID":"54985eb9-18a5-4f73-8f6e-d007ae16499d","Type":"ContainerDied","Data":"832f6c30dec6b37d7a6cf1dd49b7222aec94b2b082b9c4eced06b68a34300a1d"}
Jul 26 16:28:31.891007 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:31.890901    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="832f6c30dec6b37d7a6cf1dd49b7222aec94b2b082b9c4eced06b68a34300a1d"
Jul 26 16:28:32.368284 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:32.368255    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:32.369376 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:32.369352    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:28:47.540730 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:47.540674    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-948a62-kdp4m"]
Jul 26 16:28:47.542325 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:47.542288    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-948a62-kdp4m"]
Jul 26 16:28:48.215538 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:48.215504    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54985eb9-18a5-4f73-8f6e-d007ae16499d" path="/var/lib/kubelet/pods/54985eb9-18a5-4f73-8f6e-d007ae16499d/volumes"
Jul 26 16:28:53.901275 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:53.901242    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"]
Jul 26 16:28:53.901785 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:53.901456    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7" podUID="1bd3b1b1-c651-4180-8956-681d65b80d50" containerName="istio-proxy" containerID="cri-o://409cea1960c4c3cc9cb727ab10b655b8bfebb8418837f8ff846e0815ca2697dd" gracePeriod=30
Jul 26 16:28:54.260287 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:54.260245    2556 patch_prober.go:28] interesting pod/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 26 16:28:54.260458 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:54.260325    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7" podUID="1bd3b1b1-c651-4180-8956-681d65b80d50" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 26 16:28:59.049730 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.049696    2556 generic.go:356] "Generic (PLEG): container finished" podID="1bd3b1b1-c651-4180-8956-681d65b80d50" containerID="409cea1960c4c3cc9cb727ab10b655b8bfebb8418837f8ff846e0815ca2697dd" exitCode=0
Jul 26 16:28:59.050168 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.049764    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7" event={"ID":"1bd3b1b1-c651-4180-8956-681d65b80d50","Type":"ContainerDied","Data":"409cea1960c4c3cc9cb727ab10b655b8bfebb8418837f8ff846e0815ca2697dd"}
Jul 26 16:28:59.050168 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.049854    2556 scope.go:117] "RemoveContainer" containerID="7692cfc32f7f18dc6e0b69339afc877f4f479b6281c20f7e8021cd8f9d13b0c0"
Jul 26 16:28:59.163899 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.163877    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:28:59.212704 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.212681    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-podinfo\") pod \"1bd3b1b1-c651-4180-8956-681d65b80d50\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") "
Jul 26 16:28:59.212832 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.212733    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-workload-socket\") pod \"1bd3b1b1-c651-4180-8956-681d65b80d50\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") "
Jul 26 16:28:59.212900 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.212877    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-envoy\") pod \"1bd3b1b1-c651-4180-8956-681d65b80d50\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") "
Jul 26 16:28:59.212970 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.212954    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-694zq\" (UniqueName: \"kubernetes.io/projected/1bd3b1b1-c651-4180-8956-681d65b80d50-kube-api-access-694zq\") pod \"1bd3b1b1-c651-4180-8956-681d65b80d50\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") "
Jul 26 16:28:59.213023 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.212964    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1bd3b1b1-c651-4180-8956-681d65b80d50" (UID: "1bd3b1b1-c651-4180-8956-681d65b80d50"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:28:59.213023 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.213000    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bd3b1b1-c651-4180-8956-681d65b80d50-istiod-ca-cert\") pod \"1bd3b1b1-c651-4180-8956-681d65b80d50\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") "
Jul 26 16:28:59.213140 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.213123    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-data\") pod \"1bd3b1b1-c651-4180-8956-681d65b80d50\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") "
Jul 26 16:28:59.213197 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.213183    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-token\") pod \"1bd3b1b1-c651-4180-8956-681d65b80d50\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") "
Jul 26 16:28:59.213253 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.213214    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-workload-certs\") pod \"1bd3b1b1-c651-4180-8956-681d65b80d50\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") "
Jul 26 16:28:59.213253 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.213239    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-credential-socket\") pod \"1bd3b1b1-c651-4180-8956-681d65b80d50\" (UID: \"1bd3b1b1-c651-4180-8956-681d65b80d50\") "
Jul 26 16:28:59.213450 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.213426    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd3b1b1-c651-4180-8956-681d65b80d50-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1bd3b1b1-c651-4180-8956-681d65b80d50" (UID: "1bd3b1b1-c651-4180-8956-681d65b80d50"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:28:59.213618 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.213541    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1bd3b1b1-c651-4180-8956-681d65b80d50" (UID: "1bd3b1b1-c651-4180-8956-681d65b80d50"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:28:59.213618 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.213562    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-workload-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:28:59.213618 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.213579    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bd3b1b1-c651-4180-8956-681d65b80d50-istiod-ca-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:28:59.213880 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.213681    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1bd3b1b1-c651-4180-8956-681d65b80d50" (UID: "1bd3b1b1-c651-4180-8956-681d65b80d50"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:28:59.214280 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.214255    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-data" (OuterVolumeSpecName: "istio-data") pod "1bd3b1b1-c651-4180-8956-681d65b80d50" (UID: "1bd3b1b1-c651-4180-8956-681d65b80d50"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:28:59.215069 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.215040    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1bd3b1b1-c651-4180-8956-681d65b80d50" (UID: "1bd3b1b1-c651-4180-8956-681d65b80d50"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 16:28:59.215265 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.215232    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-token" (OuterVolumeSpecName: "istio-token") pod "1bd3b1b1-c651-4180-8956-681d65b80d50" (UID: "1bd3b1b1-c651-4180-8956-681d65b80d50"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:28:59.215345 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.215273    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1bd3b1b1-c651-4180-8956-681d65b80d50" (UID: "1bd3b1b1-c651-4180-8956-681d65b80d50"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:28:59.215491 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.215471    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bd3b1b1-c651-4180-8956-681d65b80d50-kube-api-access-694zq" (OuterVolumeSpecName: "kube-api-access-694zq") pod "1bd3b1b1-c651-4180-8956-681d65b80d50" (UID: "1bd3b1b1-c651-4180-8956-681d65b80d50"). InnerVolumeSpecName "kube-api-access-694zq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:28:59.314388 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.314363    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-data\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:28:59.314388 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.314387    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-token\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:28:59.314528 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.314400    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-workload-certs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:28:59.314528 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.314413    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-credential-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:28:59.314528 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.314426    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-podinfo\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:28:59.314528 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.314438    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bd3b1b1-c651-4180-8956-681d65b80d50-istio-envoy\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:28:59.314528 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:28:59.314450    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-694zq\" (UniqueName: \"kubernetes.io/projected/1bd3b1b1-c651-4180-8956-681d65b80d50-kube-api-access-694zq\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:29:00.056896 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:00.056866    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"
Jul 26 16:29:00.057327 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:00.056889    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7" event={"ID":"1bd3b1b1-c651-4180-8956-681d65b80d50","Type":"ContainerDied","Data":"f9fa3ac95e8218fe5d3b86d32e61e070545de8a52f50fe4dac2f7d094f3c397d"}
Jul 26 16:29:00.057327 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:00.056956    2556 scope.go:117] "RemoveContainer" containerID="409cea1960c4c3cc9cb727ab10b655b8bfebb8418837f8ff846e0815ca2697dd"
Jul 26 16:29:00.091474 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:00.091438    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"]
Jul 26 16:29:00.099862 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:00.099834    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-948a62-openshift-default-7f88b8596-dc8z7"]
Jul 26 16:29:00.215997 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:00.215966    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bd3b1b1-c651-4180-8956-681d65b80d50" path="/var/lib/kubelet/pods/1bd3b1b1-c651-4180-8956-681d65b80d50/volumes"
Jul 26 16:29:04.549451 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:04.549415    2556 scope.go:117] "RemoveContainer" containerID="2de67fb6c08c7618023967ea81b2b18b7d7a2503a7100782c2110ddd11896c1d"
Jul 26 16:29:20.783613 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:20.783577    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"]
Jul 26 16:29:20.784051 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:20.783819    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp" podUID="b2eab1e2-9968-4480-8d20-03ef05514175" containerName="istio-proxy" containerID="cri-o://a3333d240b4679de1a52f1d5e09ef45304834c5747f5f74b39a3823800098b8e" gracePeriod=30
Jul 26 16:29:21.710331 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.710296    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"]
Jul 26 16:29:21.710684 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.710670    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bd3b1b1-c651-4180-8956-681d65b80d50" containerName="istio-proxy"
Jul 26 16:29:21.710742 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.710685    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bd3b1b1-c651-4180-8956-681d65b80d50" containerName="istio-proxy"
Jul 26 16:29:21.710742 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.710693    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bd3b1b1-c651-4180-8956-681d65b80d50" containerName="istio-proxy"
Jul 26 16:29:21.710742 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.710700    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bd3b1b1-c651-4180-8956-681d65b80d50" containerName="istio-proxy"
Jul 26 16:29:21.710742 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.710715    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54985eb9-18a5-4f73-8f6e-d007ae16499d" containerName="revoke-keys"
Jul 26 16:29:21.710742 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.710722    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="54985eb9-18a5-4f73-8f6e-d007ae16499d" containerName="revoke-keys"
Jul 26 16:29:21.710899 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.710777    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="54985eb9-18a5-4f73-8f6e-d007ae16499d" containerName="revoke-keys"
Jul 26 16:29:21.710899 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.710788    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bd3b1b1-c651-4180-8956-681d65b80d50" containerName="istio-proxy"
Jul 26 16:29:21.710899 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.710795    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bd3b1b1-c651-4180-8956-681d65b80d50" containerName="istio-proxy"
Jul 26 16:29:21.713890 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.713874    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.716285 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.716266    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-76272d-openshift-default-dockercfg-gbdvx\""
Jul 26 16:29:21.729289 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.729262    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"]
Jul 26 16:29:21.801877 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.801842    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-envoy\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.802349 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.801905    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-token\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.802349 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.801942    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ct9x\" (UniqueName: \"kubernetes.io/projected/bd21a728-a63a-458a-9416-2e7e207df9a9-kube-api-access-4ct9x\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.802349 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.801959    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-podinfo\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.802349 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.801977    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd21a728-a63a-458a-9416-2e7e207df9a9-istiod-ca-cert\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.802349 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.802050    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-credential-socket\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.802349 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.802078    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-data\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.802349 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.802099    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-workload-certs\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.802349 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.802129    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-workload-socket\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.903083 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.903054    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd21a728-a63a-458a-9416-2e7e207df9a9-istiod-ca-cert\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.903235 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.903117    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-credential-socket\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.903235 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.903149    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-data\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.903235 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.903178    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-workload-certs\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.903345 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.903294    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-workload-socket\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.903389 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.903359    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-envoy\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.903437 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.903421    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-token\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.903490 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.903460    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ct9x\" (UniqueName: \"kubernetes.io/projected/bd21a728-a63a-458a-9416-2e7e207df9a9-kube-api-access-4ct9x\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.903490 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.903485    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-podinfo\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.903602 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.903580    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-credential-socket\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.903675 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.903628    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-workload-socket\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.903723 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.903711    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-workload-certs\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.903905 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.903884    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd21a728-a63a-458a-9416-2e7e207df9a9-istiod-ca-cert\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.903970 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.903929    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-data\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.905959 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.905934    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-envoy\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.906111 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.906094    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-podinfo\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.911254 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.911230    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-token\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:21.911395 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:21.911380    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ct9x\" (UniqueName: \"kubernetes.io/projected/bd21a728-a63a-458a-9416-2e7e207df9a9-kube-api-access-4ct9x\") pod \"e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") " pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:22.024161 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:22.024100    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:22.200776 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:22.200749    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"]
Jul 26 16:29:22.202142 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:29:22.202114    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd21a728_a63a_458a_9416_2e7e207df9a9.slice/crio-1ecf19c13e3896b36b1fc60d3094fea030d6476c9d1d8e3c30b24ecd32cb509c WatchSource:0}: Error finding container 1ecf19c13e3896b36b1fc60d3094fea030d6476c9d1d8e3c30b24ecd32cb509c: Status 404 returned error can't find the container with id 1ecf19c13e3896b36b1fc60d3094fea030d6476c9d1d8e3c30b24ecd32cb509c
Jul 26 16:29:22.204606 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:22.204575    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:29:22.204707 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:22.204650    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:29:22.204707 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:22.204685    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:29:23.192081 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:23.192050    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg" event={"ID":"bd21a728-a63a-458a-9416-2e7e207df9a9","Type":"ContainerStarted","Data":"d3a7bee6d67ee564143466361eb024fbff71430ff37f7089804a9b67ce18ef2c"}
Jul 26 16:29:23.192437 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:23.192096    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg" event={"ID":"bd21a728-a63a-458a-9416-2e7e207df9a9","Type":"ContainerStarted","Data":"1ecf19c13e3896b36b1fc60d3094fea030d6476c9d1d8e3c30b24ecd32cb509c"}
Jul 26 16:29:23.213822 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:23.213781    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg" podStartSLOduration=2.21376566 podStartE2EDuration="2.21376566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:29:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:29:23.211133904 +0000 UTC m=+2359.429760952" watchObservedRunningTime="2026-07-26 16:29:23.21376566 +0000 UTC m=+2359.432392708"
Jul 26 16:29:24.027587 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:24.027532    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:24.032397 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:24.032363    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:24.197937 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:24.197911    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:24.198740 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:24.198723    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:26.034788 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.034764    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:29:26.138170 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.138095    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2eab1e2-9968-4480-8d20-03ef05514175-istiod-ca-cert\") pod \"b2eab1e2-9968-4480-8d20-03ef05514175\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") "
Jul 26 16:29:26.138170 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.138128    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-istio-envoy\") pod \"b2eab1e2-9968-4480-8d20-03ef05514175\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") "
Jul 26 16:29:26.138370 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.138172    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-workload-socket\") pod \"b2eab1e2-9968-4480-8d20-03ef05514175\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") "
Jul 26 16:29:26.138370 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.138221    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2eab1e2-9968-4480-8d20-03ef05514175-istio-podinfo\") pod \"b2eab1e2-9968-4480-8d20-03ef05514175\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") "
Jul 26 16:29:26.138370 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.138257    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-istio-data\") pod \"b2eab1e2-9968-4480-8d20-03ef05514175\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") "
Jul 26 16:29:26.138370 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.138285    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-workload-certs\") pod \"b2eab1e2-9968-4480-8d20-03ef05514175\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") "
Jul 26 16:29:26.138370 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.138306    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2eab1e2-9968-4480-8d20-03ef05514175-istio-token\") pod \"b2eab1e2-9968-4480-8d20-03ef05514175\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") "
Jul 26 16:29:26.138370 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.138331    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wn5dx\" (UniqueName: \"kubernetes.io/projected/b2eab1e2-9968-4480-8d20-03ef05514175-kube-api-access-wn5dx\") pod \"b2eab1e2-9968-4480-8d20-03ef05514175\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") "
Jul 26 16:29:26.138370 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.138359    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-credential-socket\") pod \"b2eab1e2-9968-4480-8d20-03ef05514175\" (UID: \"b2eab1e2-9968-4480-8d20-03ef05514175\") "
Jul 26 16:29:26.138771 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.138503    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b2eab1e2-9968-4480-8d20-03ef05514175" (UID: "b2eab1e2-9968-4480-8d20-03ef05514175"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:29:26.138771 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.138532    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2eab1e2-9968-4480-8d20-03ef05514175-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b2eab1e2-9968-4480-8d20-03ef05514175" (UID: "b2eab1e2-9968-4480-8d20-03ef05514175"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:29:26.138771 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.138736    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b2eab1e2-9968-4480-8d20-03ef05514175" (UID: "b2eab1e2-9968-4480-8d20-03ef05514175"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:29:26.138949 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.138846    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-credential-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:29:26.138949 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.138867    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2eab1e2-9968-4480-8d20-03ef05514175-istiod-ca-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:29:26.138949 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.138883    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-workload-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:29:26.138949 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.138914    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b2eab1e2-9968-4480-8d20-03ef05514175" (UID: "b2eab1e2-9968-4480-8d20-03ef05514175"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:29:26.139216 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.139175    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-istio-data" (OuterVolumeSpecName: "istio-data") pod "b2eab1e2-9968-4480-8d20-03ef05514175" (UID: "b2eab1e2-9968-4480-8d20-03ef05514175"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:29:26.140563 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.140542    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2eab1e2-9968-4480-8d20-03ef05514175-istio-token" (OuterVolumeSpecName: "istio-token") pod "b2eab1e2-9968-4480-8d20-03ef05514175" (UID: "b2eab1e2-9968-4480-8d20-03ef05514175"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:29:26.140563 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.140552    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b2eab1e2-9968-4480-8d20-03ef05514175-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b2eab1e2-9968-4480-8d20-03ef05514175" (UID: "b2eab1e2-9968-4480-8d20-03ef05514175"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 16:29:26.140889 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.140862    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b2eab1e2-9968-4480-8d20-03ef05514175" (UID: "b2eab1e2-9968-4480-8d20-03ef05514175"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:29:26.140889 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.140872    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2eab1e2-9968-4480-8d20-03ef05514175-kube-api-access-wn5dx" (OuterVolumeSpecName: "kube-api-access-wn5dx") pod "b2eab1e2-9968-4480-8d20-03ef05514175" (UID: "b2eab1e2-9968-4480-8d20-03ef05514175"). InnerVolumeSpecName "kube-api-access-wn5dx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:29:26.211064 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.211036    2556 generic.go:356] "Generic (PLEG): container finished" podID="b2eab1e2-9968-4480-8d20-03ef05514175" containerID="a3333d240b4679de1a52f1d5e09ef45304834c5747f5f74b39a3823800098b8e" exitCode=0
Jul 26 16:29:26.211191 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.211163    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"
Jul 26 16:29:26.215980 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.215954    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp" event={"ID":"b2eab1e2-9968-4480-8d20-03ef05514175","Type":"ContainerDied","Data":"a3333d240b4679de1a52f1d5e09ef45304834c5747f5f74b39a3823800098b8e"}
Jul 26 16:29:26.216087 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.215989    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp" event={"ID":"b2eab1e2-9968-4480-8d20-03ef05514175","Type":"ContainerDied","Data":"abbee7c96619a546dea0cfac9421e74f5355cc8ee6cbdfd6f6b2db0501f14181"}
Jul 26 16:29:26.216087 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.216010    2556 scope.go:117] "RemoveContainer" containerID="a3333d240b4679de1a52f1d5e09ef45304834c5747f5f74b39a3823800098b8e"
Jul 26 16:29:26.226322 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.226306    2556 scope.go:117] "RemoveContainer" containerID="e5f1a0d00e4823451daa73016d4897527626e3a409ed675b4104201bfdac335a"
Jul 26 16:29:26.234570 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.234549    2556 scope.go:117] "RemoveContainer" containerID="a3333d240b4679de1a52f1d5e09ef45304834c5747f5f74b39a3823800098b8e"
Jul 26 16:29:26.234844 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:29:26.234826    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3333d240b4679de1a52f1d5e09ef45304834c5747f5f74b39a3823800098b8e\": container with ID starting with a3333d240b4679de1a52f1d5e09ef45304834c5747f5f74b39a3823800098b8e not found: ID does not exist" containerID="a3333d240b4679de1a52f1d5e09ef45304834c5747f5f74b39a3823800098b8e"
Jul 26 16:29:26.234902 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.234852    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3333d240b4679de1a52f1d5e09ef45304834c5747f5f74b39a3823800098b8e"} err="failed to get container status \"a3333d240b4679de1a52f1d5e09ef45304834c5747f5f74b39a3823800098b8e\": rpc error: code = NotFound desc = could not find container \"a3333d240b4679de1a52f1d5e09ef45304834c5747f5f74b39a3823800098b8e\": container with ID starting with a3333d240b4679de1a52f1d5e09ef45304834c5747f5f74b39a3823800098b8e not found: ID does not exist"
Jul 26 16:29:26.234902 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.234868    2556 scope.go:117] "RemoveContainer" containerID="e5f1a0d00e4823451daa73016d4897527626e3a409ed675b4104201bfdac335a"
Jul 26 16:29:26.235092 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:29:26.235076    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5f1a0d00e4823451daa73016d4897527626e3a409ed675b4104201bfdac335a\": container with ID starting with e5f1a0d00e4823451daa73016d4897527626e3a409ed675b4104201bfdac335a not found: ID does not exist" containerID="e5f1a0d00e4823451daa73016d4897527626e3a409ed675b4104201bfdac335a"
Jul 26 16:29:26.235137 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.235097    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5f1a0d00e4823451daa73016d4897527626e3a409ed675b4104201bfdac335a"} err="failed to get container status \"e5f1a0d00e4823451daa73016d4897527626e3a409ed675b4104201bfdac335a\": rpc error: code = NotFound desc = could not find container \"e5f1a0d00e4823451daa73016d4897527626e3a409ed675b4104201bfdac335a\": container with ID starting with e5f1a0d00e4823451daa73016d4897527626e3a409ed675b4104201bfdac335a not found: ID does not exist"
Jul 26 16:29:26.239657 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.239612    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2eab1e2-9968-4480-8d20-03ef05514175-istio-podinfo\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:29:26.239809 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.239786    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-istio-data\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:29:26.239912 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.239811    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-workload-certs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:29:26.239912 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.239825    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2eab1e2-9968-4480-8d20-03ef05514175-istio-token\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:29:26.239912 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.239837    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wn5dx\" (UniqueName: \"kubernetes.io/projected/b2eab1e2-9968-4480-8d20-03ef05514175-kube-api-access-wn5dx\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:29:26.239912 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.239850    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2eab1e2-9968-4480-8d20-03ef05514175-istio-envoy\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:29:26.242452 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.242432    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"]
Jul 26 16:29:26.246980 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:26.246960    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-df352b-openshift-default-79d4746ff4-x5ktp"]
Jul 26 16:29:28.217610 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:28.217565    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2eab1e2-9968-4480-8d20-03ef05514175" path="/var/lib/kubelet/pods/b2eab1e2-9968-4480-8d20-03ef05514175/volumes"
Jul 26 16:29:30.400288 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.400258    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"]
Jul 26 16:29:30.400713 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.400623    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2eab1e2-9968-4480-8d20-03ef05514175" containerName="istio-proxy"
Jul 26 16:29:30.400713 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.400647    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2eab1e2-9968-4480-8d20-03ef05514175" containerName="istio-proxy"
Jul 26 16:29:30.400713 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.400660    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2eab1e2-9968-4480-8d20-03ef05514175" containerName="istio-proxy"
Jul 26 16:29:30.400713 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.400668    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2eab1e2-9968-4480-8d20-03ef05514175" containerName="istio-proxy"
Jul 26 16:29:30.400896 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.400756    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2eab1e2-9968-4480-8d20-03ef05514175" containerName="istio-proxy"
Jul 26 16:29:30.400896 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.400765    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2eab1e2-9968-4480-8d20-03ef05514175" containerName="istio-proxy"
Jul 26 16:29:30.405354 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.405332    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.407822 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.407803    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-99124e-openshift-default-dockercfg-xsj7z\""
Jul 26 16:29:30.420115 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.420087    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"]
Jul 26 16:29:30.573769 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.573732    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-credential-socket\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.574034 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.573789    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-token\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.574034 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.573867    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-workload-certs\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.574034 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.573908    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istiod-ca-cert\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.574034 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.573930    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-workload-socket\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.574034 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.573978    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpzj8\" (UniqueName: \"kubernetes.io/projected/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-kube-api-access-wpzj8\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.574034 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.574020    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-envoy\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.574241 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.574045    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-data\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.574241 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.574067    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-podinfo\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.675530 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.675493    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-data\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.675757 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.675538    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-podinfo\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.675757 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.675575    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-credential-socket\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.675757 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.675605    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-token\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.675757 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.675658    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-workload-certs\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.675757 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.675685    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istiod-ca-cert\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.676039 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.675833    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-workload-socket\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.676039 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.675884    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpzj8\" (UniqueName: \"kubernetes.io/projected/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-kube-api-access-wpzj8\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.676039 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.675920    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-envoy\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.676039 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.675973    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-data\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.676039 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.676024    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-credential-socket\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.676306 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.676079    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-workload-certs\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.676306 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.676243    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-workload-socket\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.676384 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.676337    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istiod-ca-cert\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.678083 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.678064    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-envoy\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.678083 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.678072    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-podinfo\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.688879 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.688857    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-token\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.688966 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.688894    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpzj8\" (UniqueName: \"kubernetes.io/projected/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-kube-api-access-wpzj8\") pod \"e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") " pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.715580 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.715549    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:30.876668 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.876628    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"]
Jul 26 16:29:30.878815 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:29:30.878787    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda1fa1c5_d7bc_48d9_b455_93b0037fca5f.slice/crio-510b557421eca7f7fe3b0492f0c0a5c6f724ba7e380d04d2e43e38f9764c7483 WatchSource:0}: Error finding container 510b557421eca7f7fe3b0492f0c0a5c6f724ba7e380d04d2e43e38f9764c7483: Status 404 returned error can't find the container with id 510b557421eca7f7fe3b0492f0c0a5c6f724ba7e380d04d2e43e38f9764c7483
Jul 26 16:29:30.881116 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.881087    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:29:30.881183 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.881152    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:29:30.881225 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:30.881184    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:29:31.246220 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:31.246140    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q" event={"ID":"da1fa1c5-d7bc-48d9-b455-93b0037fca5f","Type":"ContainerStarted","Data":"67824c68bf6694cbba7c2913505de8a19a34dd29a9d4e3f0b903e59f4e4bdef5"}
Jul 26 16:29:31.246220 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:31.246198    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q" event={"ID":"da1fa1c5-d7bc-48d9-b455-93b0037fca5f","Type":"ContainerStarted","Data":"510b557421eca7f7fe3b0492f0c0a5c6f724ba7e380d04d2e43e38f9764c7483"}
Jul 26 16:29:31.266816 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:31.266770    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q" podStartSLOduration=1.266756684 podStartE2EDuration="1.266756684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:29:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:29:31.265226242 +0000 UTC m=+2367.483853318" watchObservedRunningTime="2026-07-26 16:29:31.266756684 +0000 UTC m=+2367.485383724"
Jul 26 16:29:31.716699 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:31.716670    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:31.720890 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:31.720868    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:32.255867 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:32.255830    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:32.256956 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:32.256933    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:39.200176 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:39.200143    2556 patch_prober.go:28] interesting pod/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Jul 26 16:29:39.200672 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:39.200205    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg" podUID="bd21a728-a63a-458a-9416-2e7e207df9a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Jul 26 16:29:39.300038 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:39.300009    2556 generic.go:356] "Generic (PLEG): container finished" podID="bd21a728-a63a-458a-9416-2e7e207df9a9" containerID="d3a7bee6d67ee564143466361eb024fbff71430ff37f7089804a9b67ce18ef2c" exitCode=0
Jul 26 16:29:39.300190 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:39.300083    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg" event={"ID":"bd21a728-a63a-458a-9416-2e7e207df9a9","Type":"ContainerDied","Data":"d3a7bee6d67ee564143466361eb024fbff71430ff37f7089804a9b67ce18ef2c"}
Jul 26 16:29:39.300417 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:39.300404    2556 scope.go:117] "RemoveContainer" containerID="d3a7bee6d67ee564143466361eb024fbff71430ff37f7089804a9b67ce18ef2c"
Jul 26 16:29:39.301341 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:39.301315    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:29:39.301418 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:39.301404    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:29:39.301463 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:39.301444    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:29:40.307665 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:40.307558    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg" event={"ID":"bd21a728-a63a-458a-9416-2e7e207df9a9","Type":"ContainerStarted","Data":"f4f4bbdd3a331419aaed1f6a4c8e4112e54e67739c4d0bc308c7e98571145a97"}
Jul 26 16:29:41.024686 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:41.024647    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:41.024868 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:41.024833    2556 patch_prober.go:28] interesting pod/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Jul 26 16:29:41.024915 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:41.024879    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg" podUID="bd21a728-a63a-458a-9416-2e7e207df9a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Jul 26 16:29:42.025089 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:42.025043    2556 patch_prober.go:28] interesting pod/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Jul 26 16:29:42.025467 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:42.025112    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg" podUID="bd21a728-a63a-458a-9416-2e7e207df9a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Jul 26 16:29:43.025064 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:43.025025    2556 patch_prober.go:28] interesting pod/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Jul 26 16:29:43.025243 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:43.025091    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg" podUID="bd21a728-a63a-458a-9416-2e7e207df9a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Jul 26 16:29:44.025424 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:44.025388    2556 patch_prober.go:28] interesting pod/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Jul 26 16:29:44.025820 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:44.025441    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg" podUID="bd21a728-a63a-458a-9416-2e7e207df9a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Jul 26 16:29:45.028188 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:45.028161    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:45.030504 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:45.028508    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:45.030504 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:45.029312    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:29:45.344190 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:45.344092    2556 generic.go:356] "Generic (PLEG): container finished" podID="da1fa1c5-d7bc-48d9-b455-93b0037fca5f" containerID="67824c68bf6694cbba7c2913505de8a19a34dd29a9d4e3f0b903e59f4e4bdef5" exitCode=0
Jul 26 16:29:45.344190 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:45.344163    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q" event={"ID":"da1fa1c5-d7bc-48d9-b455-93b0037fca5f","Type":"ContainerDied","Data":"67824c68bf6694cbba7c2913505de8a19a34dd29a9d4e3f0b903e59f4e4bdef5"}
Jul 26 16:29:45.344575 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:45.344557    2556 scope.go:117] "RemoveContainer" containerID="67824c68bf6694cbba7c2913505de8a19a34dd29a9d4e3f0b903e59f4e4bdef5"
Jul 26 16:29:45.345659 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:45.345616    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:29:45.345728 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:45.345693    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:29:45.345768 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:45.345730    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:29:46.356927 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:46.356883    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q" event={"ID":"da1fa1c5-d7bc-48d9-b455-93b0037fca5f","Type":"ContainerStarted","Data":"f2228dcbcddd44d030a6025fe186a3553ad29148ee0c2f018639718ea7d48aa4"}
Jul 26 16:29:46.716368 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:46.716336    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:46.717593 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:46.717565    2556 patch_prober.go:28] interesting pod/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Jul 26 16:29:46.717729 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:46.717625    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q" podUID="da1fa1c5-d7bc-48d9-b455-93b0037fca5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Jul 26 16:29:47.256294 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:47.256259    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:47.716971 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:47.716935    2556 patch_prober.go:28] interesting pod/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Jul 26 16:29:47.717372 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:47.716992    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q" podUID="da1fa1c5-d7bc-48d9-b455-93b0037fca5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Jul 26 16:29:48.716529 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:48.716489    2556 patch_prober.go:28] interesting pod/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Jul 26 16:29:48.716732 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:48.716549    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q" podUID="da1fa1c5-d7bc-48d9-b455-93b0037fca5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Jul 26 16:29:49.716815 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:49.716779    2556 patch_prober.go:28] interesting pod/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Jul 26 16:29:49.717206 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:49.716834    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q" podUID="da1fa1c5-d7bc-48d9-b455-93b0037fca5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Jul 26 16:29:50.720145 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:50.720115    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:29:50.721323 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:29:50.721299    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:30:00.222440 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:00.222408    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-99124e-29751390-nq6b7"]
Jul 26 16:30:00.225868 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:00.225851    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-76272d-29751390-dq44s"]
Jul 26 16:30:00.225977 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:00.225959    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-99124e-29751390-nq6b7"
Jul 26 16:30:00.229028 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:00.229013    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-76272d-29751390-dq44s"
Jul 26 16:30:00.229484 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:00.229468    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlwwk\""
Jul 26 16:30:00.236430 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:00.236413    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-99124e-29751390-nq6b7"
Jul 26 16:30:00.244372 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:00.244355    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-76272d-29751390-dq44s"
Jul 26 16:30:00.245932 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:00.245910    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29751390-7vqlj"]
Jul 26 16:30:00.249802 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:00.249781    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-76272d-29751390-dq44s"]
Jul 26 16:30:00.249919 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:00.249884    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751390-7vqlj"
Jul 26 16:30:00.252509 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:00.252489    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-99124e-29751390-nq6b7"]
Jul 26 16:30:00.274079 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:00.274051    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29751390-7vqlj"]
Jul 26 16:30:00.291431 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:00.291405    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751390-7vqlj"
Jul 26 16:30:00.413436 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:00.413405    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-99124e-29751390-nq6b7"]
Jul 26 16:30:00.445898 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:00.445858    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-99124e-29751390-nq6b7" event={"ID":"04ece964-5931-442c-b0d4-69f4011aaf36","Type":"ContainerStarted","Data":"cb2f43098d575aea2378bd737c261879c44ddd32533aa12f02031bb495dbf82a"}
Jul 26 16:30:00.470795 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:00.470560    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29751390-7vqlj"]
Jul 26 16:30:00.478065 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:30:00.478013    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a8386a3_8fa7_43dd_b101_0107a02aef58.slice/crio-e0e4f5e70821a6cb1ae78706d2bf0d8a4cddab2fff401264028ff10bce0e5d93 WatchSource:0}: Error finding container e0e4f5e70821a6cb1ae78706d2bf0d8a4cddab2fff401264028ff10bce0e5d93: Status 404 returned error can't find the container with id e0e4f5e70821a6cb1ae78706d2bf0d8a4cddab2fff401264028ff10bce0e5d93
Jul 26 16:30:00.649496 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:00.649466    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-76272d-29751390-dq44s"]
Jul 26 16:30:00.650193 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:30:00.650163    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4030bd48_e106_489e_86cd_37042537adc5.slice/crio-6396fa276a1e142eef39b2037fd1a23b659adcd57bb1a845ea3cc4c777be1ae1 WatchSource:0}: Error finding container 6396fa276a1e142eef39b2037fd1a23b659adcd57bb1a845ea3cc4c777be1ae1: Status 404 returned error can't find the container with id 6396fa276a1e142eef39b2037fd1a23b659adcd57bb1a845ea3cc4c777be1ae1
Jul 26 16:30:01.453115 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:01.453084    2556 generic.go:356] "Generic (PLEG): container finished" podID="3a8386a3-8fa7-43dd-b101-0107a02aef58" containerID="09bb00f5b9da18d55c39f328c53595e36289f6b35850f374e90e8fa91bd7a884" exitCode=0
Jul 26 16:30:01.453453 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:01.453162    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751390-7vqlj" event={"ID":"3a8386a3-8fa7-43dd-b101-0107a02aef58","Type":"ContainerDied","Data":"09bb00f5b9da18d55c39f328c53595e36289f6b35850f374e90e8fa91bd7a884"}
Jul 26 16:30:01.453453 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:01.453215    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751390-7vqlj" event={"ID":"3a8386a3-8fa7-43dd-b101-0107a02aef58","Type":"ContainerStarted","Data":"e0e4f5e70821a6cb1ae78706d2bf0d8a4cddab2fff401264028ff10bce0e5d93"}
Jul 26 16:30:01.454750 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:01.454730    2556 generic.go:356] "Generic (PLEG): container finished" podID="04ece964-5931-442c-b0d4-69f4011aaf36" containerID="755cac44b18b64925590f586697ad9d1f405c9407fc66a5dd6ac6442ff263dc0" exitCode=0
Jul 26 16:30:01.454842 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:01.454809    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-99124e-29751390-nq6b7" event={"ID":"04ece964-5931-442c-b0d4-69f4011aaf36","Type":"ContainerDied","Data":"755cac44b18b64925590f586697ad9d1f405c9407fc66a5dd6ac6442ff263dc0"}
Jul 26 16:30:01.456256 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:01.456233    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-76272d-29751390-dq44s" event={"ID":"4030bd48-e106-489e-86cd-37042537adc5","Type":"ContainerStarted","Data":"a4cc101103c562d53f6510b3a476c42ca0f2e87068f1ff2a0dc64bcaf9c6d632"}
Jul 26 16:30:01.456345 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:01.456276    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-76272d-29751390-dq44s" event={"ID":"4030bd48-e106-489e-86cd-37042537adc5","Type":"ContainerStarted","Data":"6396fa276a1e142eef39b2037fd1a23b659adcd57bb1a845ea3cc4c777be1ae1"}
Jul 26 16:30:01.495105 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:01.495059    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-76272d-29751390-dq44s" podStartSLOduration=1.495045792 podStartE2EDuration="1.495045792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:30:01.493031473 +0000 UTC m=+2397.711658523" watchObservedRunningTime="2026-07-26 16:30:01.495045792 +0000 UTC m=+2397.713672840"
Jul 26 16:30:02.463487 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:02.463458    2556 generic.go:356] "Generic (PLEG): container finished" podID="4030bd48-e106-489e-86cd-37042537adc5" containerID="a4cc101103c562d53f6510b3a476c42ca0f2e87068f1ff2a0dc64bcaf9c6d632" exitCode=0
Jul 26 16:30:02.463914 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:02.463553    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-76272d-29751390-dq44s" event={"ID":"4030bd48-e106-489e-86cd-37042537adc5","Type":"ContainerDied","Data":"a4cc101103c562d53f6510b3a476c42ca0f2e87068f1ff2a0dc64bcaf9c6d632"}
Jul 26 16:30:02.597909 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:02.597885    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751390-7vqlj"
Jul 26 16:30:02.635828 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:02.635803    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-99124e-29751390-nq6b7"
Jul 26 16:30:03.470800 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:03.470770    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751390-7vqlj"
Jul 26 16:30:03.470800 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:03.470797    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751390-7vqlj" event={"ID":"3a8386a3-8fa7-43dd-b101-0107a02aef58","Type":"ContainerDied","Data":"e0e4f5e70821a6cb1ae78706d2bf0d8a4cddab2fff401264028ff10bce0e5d93"}
Jul 26 16:30:03.471256 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:03.470846    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0e4f5e70821a6cb1ae78706d2bf0d8a4cddab2fff401264028ff10bce0e5d93"
Jul 26 16:30:03.472076 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:03.472052    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-99124e-29751390-nq6b7" event={"ID":"04ece964-5931-442c-b0d4-69f4011aaf36","Type":"ContainerDied","Data":"cb2f43098d575aea2378bd737c261879c44ddd32533aa12f02031bb495dbf82a"}
Jul 26 16:30:03.472191 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:03.472095    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb2f43098d575aea2378bd737c261879c44ddd32533aa12f02031bb495dbf82a"
Jul 26 16:30:03.472191 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:03.472059    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-99124e-29751390-nq6b7"
Jul 26 16:30:03.612523 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:03.612500    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-76272d-29751390-dq44s"
Jul 26 16:30:04.480206 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:04.480124    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-76272d-29751390-dq44s"
Jul 26 16:30:04.480206 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:04.480159    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-76272d-29751390-dq44s" event={"ID":"4030bd48-e106-489e-86cd-37042537adc5","Type":"ContainerDied","Data":"6396fa276a1e142eef39b2037fd1a23b659adcd57bb1a845ea3cc4c777be1ae1"}
Jul 26 16:30:04.480655 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:04.480210    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6396fa276a1e142eef39b2037fd1a23b659adcd57bb1a845ea3cc4c777be1ae1"
Jul 26 16:30:04.578481 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:04.578454    2556 scope.go:117] "RemoveContainer" containerID="f8cd48784f66ea0ac546136fa38ed107fdc8172ca4a471feae594bfcdf0c7685"
Jul 26 16:30:04.764416 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:04.764345    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 16:30:04.772593 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:04.772570    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 16:30:31.570714 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.570622    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"]
Jul 26 16:30:31.571066 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.571055    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a8386a3-8fa7-43dd-b101-0107a02aef58" containerName="cleanup"
Jul 26 16:30:31.571107 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.571069    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a8386a3-8fa7-43dd-b101-0107a02aef58" containerName="cleanup"
Jul 26 16:30:31.571107 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.571080    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04ece964-5931-442c-b0d4-69f4011aaf36" containerName="cleanup"
Jul 26 16:30:31.571107 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.571086    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="04ece964-5931-442c-b0d4-69f4011aaf36" containerName="cleanup"
Jul 26 16:30:31.571107 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.571101    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4030bd48-e106-489e-86cd-37042537adc5" containerName="cleanup"
Jul 26 16:30:31.571107 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.571107    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4030bd48-e106-489e-86cd-37042537adc5" containerName="cleanup"
Jul 26 16:30:31.571264 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.571163    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4030bd48-e106-489e-86cd-37042537adc5" containerName="cleanup"
Jul 26 16:30:31.571264 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.571171    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a8386a3-8fa7-43dd-b101-0107a02aef58" containerName="cleanup"
Jul 26 16:30:31.571264 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.571179    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="04ece964-5931-442c-b0d4-69f4011aaf36" containerName="cleanup"
Jul 26 16:30:31.574076 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.574061    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:31.576712 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.576692    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-99124e\"/\"default-dockercfg-mvccj\""
Jul 26 16:30:31.576812 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.576749    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-99124e\"/\"openshift-service-ca.crt\""
Jul 26 16:30:31.577479 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.577459    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-99124e\"/\"kube-root-ca.crt\""
Jul 26 16:30:31.577523 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.577490    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-99124e\"/\"auth-test-model-99124e-kserve-self-signed-certs\""
Jul 26 16:30:31.584854 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.584832    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"]
Jul 26 16:30:31.625115 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.625095    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-model-cache\") pod \"auth-test-model-99124e-kserve-fd7cfbb7-48wsl\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") " pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:31.625212 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.625139    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/483a9c07-c44b-4002-8d89-d5e4359cba0a-tls-certs\") pod \"auth-test-model-99124e-kserve-fd7cfbb7-48wsl\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") " pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:31.625212 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.625157    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-tmp-dir\") pod \"auth-test-model-99124e-kserve-fd7cfbb7-48wsl\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") " pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:31.625291 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.625227    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-dshm\") pod \"auth-test-model-99124e-kserve-fd7cfbb7-48wsl\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") " pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:31.625291 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.625264    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-home\") pod \"auth-test-model-99124e-kserve-fd7cfbb7-48wsl\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") " pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:31.625355 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.625328    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xvfb\" (UniqueName: \"kubernetes.io/projected/483a9c07-c44b-4002-8d89-d5e4359cba0a-kube-api-access-2xvfb\") pod \"auth-test-model-99124e-kserve-fd7cfbb7-48wsl\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") " pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:31.726470 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.726445    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xvfb\" (UniqueName: \"kubernetes.io/projected/483a9c07-c44b-4002-8d89-d5e4359cba0a-kube-api-access-2xvfb\") pod \"auth-test-model-99124e-kserve-fd7cfbb7-48wsl\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") " pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:31.726602 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.726506    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-model-cache\") pod \"auth-test-model-99124e-kserve-fd7cfbb7-48wsl\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") " pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:31.726602 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.726557    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/483a9c07-c44b-4002-8d89-d5e4359cba0a-tls-certs\") pod \"auth-test-model-99124e-kserve-fd7cfbb7-48wsl\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") " pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:31.726602 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.726578    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-tmp-dir\") pod \"auth-test-model-99124e-kserve-fd7cfbb7-48wsl\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") " pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:31.726804 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.726682    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-dshm\") pod \"auth-test-model-99124e-kserve-fd7cfbb7-48wsl\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") " pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:31.726804 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.726721    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-home\") pod \"auth-test-model-99124e-kserve-fd7cfbb7-48wsl\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") " pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:31.726953 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.726929    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-model-cache\") pod \"auth-test-model-99124e-kserve-fd7cfbb7-48wsl\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") " pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:31.727071 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.727048    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-tmp-dir\") pod \"auth-test-model-99124e-kserve-fd7cfbb7-48wsl\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") " pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:31.727302 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.727280    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-home\") pod \"auth-test-model-99124e-kserve-fd7cfbb7-48wsl\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") " pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:31.729414 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.729387    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/483a9c07-c44b-4002-8d89-d5e4359cba0a-tls-certs\") pod \"auth-test-model-99124e-kserve-fd7cfbb7-48wsl\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") " pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:31.734098 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.734051    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-dshm\") pod \"auth-test-model-99124e-kserve-fd7cfbb7-48wsl\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") " pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:31.738096 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.738075    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xvfb\" (UniqueName: \"kubernetes.io/projected/483a9c07-c44b-4002-8d89-d5e4359cba0a-kube-api-access-2xvfb\") pod \"auth-test-model-99124e-kserve-fd7cfbb7-48wsl\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") " pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:31.884185 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:31.884131    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:32.040901 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:32.040874    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"]
Jul 26 16:30:32.042508 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:30:32.042485    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod483a9c07_c44b_4002_8d89_d5e4359cba0a.slice/crio-05ce71c34d53c28318bcadbf3d63bbbf8b92fc87cc27486fc4be687a69641a21 WatchSource:0}: Error finding container 05ce71c34d53c28318bcadbf3d63bbbf8b92fc87cc27486fc4be687a69641a21: Status 404 returned error can't find the container with id 05ce71c34d53c28318bcadbf3d63bbbf8b92fc87cc27486fc4be687a69641a21
Jul 26 16:30:32.643950 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:32.643914    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl" event={"ID":"483a9c07-c44b-4002-8d89-d5e4359cba0a","Type":"ContainerStarted","Data":"f0b40d3bc8f0d58548b81a242ef7cd3219fc32f9353574b7a15fb3cd3912e065"}
Jul 26 16:30:32.643950 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:32.643961    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl" event={"ID":"483a9c07-c44b-4002-8d89-d5e4359cba0a","Type":"ContainerStarted","Data":"05ce71c34d53c28318bcadbf3d63bbbf8b92fc87cc27486fc4be687a69641a21"}
Jul 26 16:30:32.663100 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:32.663058    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl" podStartSLOduration=1.663042392 podStartE2EDuration="1.663042392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:30:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:30:32.661735696 +0000 UTC m=+2428.880362747" watchObservedRunningTime="2026-07-26 16:30:32.663042392 +0000 UTC m=+2428.881669441"
Jul 26 16:30:41.884825 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:41.884778    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:41.885195 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:41.884847    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:41.897139 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:41.897117    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:30:42.711103 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:30:42.711075    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:34:04.637609 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:34:04.637576    2556 scope.go:117] "RemoveContainer" containerID="371cc6ef5071017424719e673ce589d019a74be8af1adad5fed3a0f548112732"
Jul 26 16:34:04.646295 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:34:04.646274    2556 scope.go:117] "RemoveContainer" containerID="b1009b50b9a1985fcf8770d3744db840367ca4c857fdaf1d13b29d081fab0cca"
Jul 26 16:35:04.673117 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:04.673032    2556 scope.go:117] "RemoveContainer" containerID="8ac04f5dcf2ecdd0bf8cdf4baa82da281aba8865a3eb9113605795b6ae7671e5"
Jul 26 16:35:04.802167 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:04.802136    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 16:35:04.813526 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:04.813502    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 16:35:13.377774 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:13.377742    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"]
Jul 26 16:35:20.160736 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.160697    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"]
Jul 26 16:35:20.164259 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.164242    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:20.167774 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.167742    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-76272d\"/\"openshift-service-ca.crt\""
Jul 26 16:35:20.167902 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.167809    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-76272d\"/\"default-dockercfg-rgg8b\""
Jul 26 16:35:20.167902 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.167807    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-76272d\"/\"sub-test-model-76272d-kserve-self-signed-certs\""
Jul 26 16:35:20.168026 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.167989    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-76272d\"/\"kube-root-ca.crt\""
Jul 26 16:35:20.174321 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.174297    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"]
Jul 26 16:35:20.207420 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.207382    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-home\") pod \"sub-test-model-76272d-kserve-6589d4595f-pbtf5\" (UID: \"f15aa993-b183-406c-9060-048624940330\") " pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:20.207587 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.207444    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfqxv\" (UniqueName: \"kubernetes.io/projected/f15aa993-b183-406c-9060-048624940330-kube-api-access-vfqxv\") pod \"sub-test-model-76272d-kserve-6589d4595f-pbtf5\" (UID: \"f15aa993-b183-406c-9060-048624940330\") " pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:20.207587 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.207480    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-model-cache\") pod \"sub-test-model-76272d-kserve-6589d4595f-pbtf5\" (UID: \"f15aa993-b183-406c-9060-048624940330\") " pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:20.207587 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.207511    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f15aa993-b183-406c-9060-048624940330-tls-certs\") pod \"sub-test-model-76272d-kserve-6589d4595f-pbtf5\" (UID: \"f15aa993-b183-406c-9060-048624940330\") " pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:20.207587 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.207567    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-tmp-dir\") pod \"sub-test-model-76272d-kserve-6589d4595f-pbtf5\" (UID: \"f15aa993-b183-406c-9060-048624940330\") " pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:20.207881 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.207680    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-dshm\") pod \"sub-test-model-76272d-kserve-6589d4595f-pbtf5\" (UID: \"f15aa993-b183-406c-9060-048624940330\") " pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:20.308284 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.308252    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-home\") pod \"sub-test-model-76272d-kserve-6589d4595f-pbtf5\" (UID: \"f15aa993-b183-406c-9060-048624940330\") " pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:20.308446 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.308293    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfqxv\" (UniqueName: \"kubernetes.io/projected/f15aa993-b183-406c-9060-048624940330-kube-api-access-vfqxv\") pod \"sub-test-model-76272d-kserve-6589d4595f-pbtf5\" (UID: \"f15aa993-b183-406c-9060-048624940330\") " pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:20.308446 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.308402    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-model-cache\") pod \"sub-test-model-76272d-kserve-6589d4595f-pbtf5\" (UID: \"f15aa993-b183-406c-9060-048624940330\") " pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:20.308446 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.308439    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f15aa993-b183-406c-9060-048624940330-tls-certs\") pod \"sub-test-model-76272d-kserve-6589d4595f-pbtf5\" (UID: \"f15aa993-b183-406c-9060-048624940330\") " pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:20.308605 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.308582    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-tmp-dir\") pod \"sub-test-model-76272d-kserve-6589d4595f-pbtf5\" (UID: \"f15aa993-b183-406c-9060-048624940330\") " pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:20.308685 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.308650    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-home\") pod \"sub-test-model-76272d-kserve-6589d4595f-pbtf5\" (UID: \"f15aa993-b183-406c-9060-048624940330\") " pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:20.308733 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.308706    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-dshm\") pod \"sub-test-model-76272d-kserve-6589d4595f-pbtf5\" (UID: \"f15aa993-b183-406c-9060-048624940330\") " pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:20.308776 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.308748    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-model-cache\") pod \"sub-test-model-76272d-kserve-6589d4595f-pbtf5\" (UID: \"f15aa993-b183-406c-9060-048624940330\") " pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:20.308886 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.308871    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-tmp-dir\") pod \"sub-test-model-76272d-kserve-6589d4595f-pbtf5\" (UID: \"f15aa993-b183-406c-9060-048624940330\") " pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:20.310755 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.310736    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-dshm\") pod \"sub-test-model-76272d-kserve-6589d4595f-pbtf5\" (UID: \"f15aa993-b183-406c-9060-048624940330\") " pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:20.310891 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.310875    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f15aa993-b183-406c-9060-048624940330-tls-certs\") pod \"sub-test-model-76272d-kserve-6589d4595f-pbtf5\" (UID: \"f15aa993-b183-406c-9060-048624940330\") " pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:20.316665 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.316626    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfqxv\" (UniqueName: \"kubernetes.io/projected/f15aa993-b183-406c-9060-048624940330-kube-api-access-vfqxv\") pod \"sub-test-model-76272d-kserve-6589d4595f-pbtf5\" (UID: \"f15aa993-b183-406c-9060-048624940330\") " pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:20.474366 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.474334    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:20.610041 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:20.610010    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"]
Jul 26 16:35:20.611587 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:35:20.611560    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf15aa993_b183_406c_9060_048624940330.slice/crio-e2d6eee8be41d9c328f39af92d7f941c5d6ce3a169f1d9d7c62cb0be4ede75f0 WatchSource:0}: Error finding container e2d6eee8be41d9c328f39af92d7f941c5d6ce3a169f1d9d7c62cb0be4ede75f0: Status 404 returned error can't find the container with id e2d6eee8be41d9c328f39af92d7f941c5d6ce3a169f1d9d7c62cb0be4ede75f0
Jul 26 16:35:21.296256 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:21.296222    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5" event={"ID":"f15aa993-b183-406c-9060-048624940330","Type":"ContainerStarted","Data":"fe4030776432563bc7ef4a70aa571418703f348f2e63bd62758ae3dee1863468"}
Jul 26 16:35:21.296256 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:21.296260    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5" event={"ID":"f15aa993-b183-406c-9060-048624940330","Type":"ContainerStarted","Data":"e2d6eee8be41d9c328f39af92d7f941c5d6ce3a169f1d9d7c62cb0be4ede75f0"}
Jul 26 16:35:21.313933 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:21.313888    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5" podStartSLOduration=1.31387164 podStartE2EDuration="1.31387164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:35:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:35:21.310908083 +0000 UTC m=+2717.529535133" watchObservedRunningTime="2026-07-26 16:35:21.31387164 +0000 UTC m=+2717.532498689"
Jul 26 16:35:28.396614 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:28.396573    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl" podUID="483a9c07-c44b-4002-8d89-d5e4359cba0a" containerName="main" containerID="cri-o://f0b40d3bc8f0d58548b81a242ef7cd3219fc32f9353574b7a15fb3cd3912e065" gracePeriod=45
Jul 26 16:35:28.641346 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:28.641321    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:35:28.673582 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:28.673557    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/483a9c07-c44b-4002-8d89-d5e4359cba0a-tls-certs\") pod \"483a9c07-c44b-4002-8d89-d5e4359cba0a\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") "
Jul 26 16:35:28.673739 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:28.673594    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-dshm\") pod \"483a9c07-c44b-4002-8d89-d5e4359cba0a\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") "
Jul 26 16:35:28.673739 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:28.673682    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-tmp-dir\") pod \"483a9c07-c44b-4002-8d89-d5e4359cba0a\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") "
Jul 26 16:35:28.673739 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:28.673706    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-home\") pod \"483a9c07-c44b-4002-8d89-d5e4359cba0a\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") "
Jul 26 16:35:28.673739 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:28.673731    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-model-cache\") pod \"483a9c07-c44b-4002-8d89-d5e4359cba0a\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") "
Jul 26 16:35:28.673954 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:28.673758    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xvfb\" (UniqueName: \"kubernetes.io/projected/483a9c07-c44b-4002-8d89-d5e4359cba0a-kube-api-access-2xvfb\") pod \"483a9c07-c44b-4002-8d89-d5e4359cba0a\" (UID: \"483a9c07-c44b-4002-8d89-d5e4359cba0a\") "
Jul 26 16:35:28.674013 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:28.673941    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-home" (OuterVolumeSpecName: "home") pod "483a9c07-c44b-4002-8d89-d5e4359cba0a" (UID: "483a9c07-c44b-4002-8d89-d5e4359cba0a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:35:28.674013 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:28.673965    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "483a9c07-c44b-4002-8d89-d5e4359cba0a" (UID: "483a9c07-c44b-4002-8d89-d5e4359cba0a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:35:28.674013 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:28.673984    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-model-cache" (OuterVolumeSpecName: "model-cache") pod "483a9c07-c44b-4002-8d89-d5e4359cba0a" (UID: "483a9c07-c44b-4002-8d89-d5e4359cba0a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:35:28.674182 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:28.674112    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-tmp-dir\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:35:28.674182 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:28.674133    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-home\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:35:28.674182 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:28.674147    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-model-cache\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:35:28.675732 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:28.675710    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/483a9c07-c44b-4002-8d89-d5e4359cba0a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "483a9c07-c44b-4002-8d89-d5e4359cba0a" (UID: "483a9c07-c44b-4002-8d89-d5e4359cba0a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:35:28.675841 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:28.675791    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/483a9c07-c44b-4002-8d89-d5e4359cba0a-kube-api-access-2xvfb" (OuterVolumeSpecName: "kube-api-access-2xvfb") pod "483a9c07-c44b-4002-8d89-d5e4359cba0a" (UID: "483a9c07-c44b-4002-8d89-d5e4359cba0a"). InnerVolumeSpecName "kube-api-access-2xvfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:35:28.676012 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:28.675994    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-dshm" (OuterVolumeSpecName: "dshm") pod "483a9c07-c44b-4002-8d89-d5e4359cba0a" (UID: "483a9c07-c44b-4002-8d89-d5e4359cba0a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:35:28.774519 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:28.774494    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xvfb\" (UniqueName: \"kubernetes.io/projected/483a9c07-c44b-4002-8d89-d5e4359cba0a-kube-api-access-2xvfb\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:35:28.774519 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:28.774517    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/483a9c07-c44b-4002-8d89-d5e4359cba0a-tls-certs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:35:28.774675 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:28.774525    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/483a9c07-c44b-4002-8d89-d5e4359cba0a-dshm\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:35:29.342722 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:29.342690    2556 generic.go:356] "Generic (PLEG): container finished" podID="483a9c07-c44b-4002-8d89-d5e4359cba0a" containerID="f0b40d3bc8f0d58548b81a242ef7cd3219fc32f9353574b7a15fb3cd3912e065" exitCode=0
Jul 26 16:35:29.342722 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:29.342722    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"
Jul 26 16:35:29.342946 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:29.342767    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl" event={"ID":"483a9c07-c44b-4002-8d89-d5e4359cba0a","Type":"ContainerDied","Data":"f0b40d3bc8f0d58548b81a242ef7cd3219fc32f9353574b7a15fb3cd3912e065"}
Jul 26 16:35:29.342946 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:29.342801    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl" event={"ID":"483a9c07-c44b-4002-8d89-d5e4359cba0a","Type":"ContainerDied","Data":"05ce71c34d53c28318bcadbf3d63bbbf8b92fc87cc27486fc4be687a69641a21"}
Jul 26 16:35:29.342946 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:29.342818    2556 scope.go:117] "RemoveContainer" containerID="f0b40d3bc8f0d58548b81a242ef7cd3219fc32f9353574b7a15fb3cd3912e065"
Jul 26 16:35:29.352711 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:29.352695    2556 scope.go:117] "RemoveContainer" containerID="f0b40d3bc8f0d58548b81a242ef7cd3219fc32f9353574b7a15fb3cd3912e065"
Jul 26 16:35:29.352972 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:35:29.352955    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0b40d3bc8f0d58548b81a242ef7cd3219fc32f9353574b7a15fb3cd3912e065\": container with ID starting with f0b40d3bc8f0d58548b81a242ef7cd3219fc32f9353574b7a15fb3cd3912e065 not found: ID does not exist" containerID="f0b40d3bc8f0d58548b81a242ef7cd3219fc32f9353574b7a15fb3cd3912e065"
Jul 26 16:35:29.353017 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:29.352981    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0b40d3bc8f0d58548b81a242ef7cd3219fc32f9353574b7a15fb3cd3912e065"} err="failed to get container status \"f0b40d3bc8f0d58548b81a242ef7cd3219fc32f9353574b7a15fb3cd3912e065\": rpc error: code = NotFound desc = could not find container \"f0b40d3bc8f0d58548b81a242ef7cd3219fc32f9353574b7a15fb3cd3912e065\": container with ID starting with f0b40d3bc8f0d58548b81a242ef7cd3219fc32f9353574b7a15fb3cd3912e065 not found: ID does not exist"
Jul 26 16:35:29.364250 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:29.364230    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"]
Jul 26 16:35:29.367889 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:29.367869    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-99124e/auth-test-model-99124e-kserve-fd7cfbb7-48wsl"]
Jul 26 16:35:30.215786 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:30.215754    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="483a9c07-c44b-4002-8d89-d5e4359cba0a" path="/var/lib/kubelet/pods/483a9c07-c44b-4002-8d89-d5e4359cba0a/volumes"
Jul 26 16:35:30.474939 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:30.474859    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:30.474939 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:30.474902    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:30.487522 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:30.487497    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:35:31.366745 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:35:31.366716    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:37:03.891589 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:03.891554    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"]
Jul 26 16:37:18.910159 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:18.910110    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5" podUID="f15aa993-b183-406c-9060-048624940330" containerName="main" containerID="cri-o://fe4030776432563bc7ef4a70aa571418703f348f2e63bd62758ae3dee1863468" gracePeriod=45
Jul 26 16:37:19.172604 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.172579    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:37:19.275502 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.275472    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-dshm\") pod \"f15aa993-b183-406c-9060-048624940330\" (UID: \"f15aa993-b183-406c-9060-048624940330\") "
Jul 26 16:37:19.275673 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.275575    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-home\") pod \"f15aa993-b183-406c-9060-048624940330\" (UID: \"f15aa993-b183-406c-9060-048624940330\") "
Jul 26 16:37:19.275673 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.275609    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-tmp-dir\") pod \"f15aa993-b183-406c-9060-048624940330\" (UID: \"f15aa993-b183-406c-9060-048624940330\") "
Jul 26 16:37:19.275673 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.275660    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfqxv\" (UniqueName: \"kubernetes.io/projected/f15aa993-b183-406c-9060-048624940330-kube-api-access-vfqxv\") pod \"f15aa993-b183-406c-9060-048624940330\" (UID: \"f15aa993-b183-406c-9060-048624940330\") "
Jul 26 16:37:19.275849 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.275686    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-model-cache\") pod \"f15aa993-b183-406c-9060-048624940330\" (UID: \"f15aa993-b183-406c-9060-048624940330\") "
Jul 26 16:37:19.275849 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.275797    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f15aa993-b183-406c-9060-048624940330-tls-certs\") pod \"f15aa993-b183-406c-9060-048624940330\" (UID: \"f15aa993-b183-406c-9060-048624940330\") "
Jul 26 16:37:19.275987 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.275881    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-home" (OuterVolumeSpecName: "home") pod "f15aa993-b183-406c-9060-048624940330" (UID: "f15aa993-b183-406c-9060-048624940330"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:37:19.275987 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.275894    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f15aa993-b183-406c-9060-048624940330" (UID: "f15aa993-b183-406c-9060-048624940330"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:37:19.275987 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.275968    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-model-cache" (OuterVolumeSpecName: "model-cache") pod "f15aa993-b183-406c-9060-048624940330" (UID: "f15aa993-b183-406c-9060-048624940330"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:37:19.276211 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.276193    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-home\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:37:19.276281 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.276214    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-tmp-dir\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:37:19.276281 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.276229    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-model-cache\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:37:19.277747 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.277716    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-dshm" (OuterVolumeSpecName: "dshm") pod "f15aa993-b183-406c-9060-048624940330" (UID: "f15aa993-b183-406c-9060-048624940330"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:37:19.277857 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.277763    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f15aa993-b183-406c-9060-048624940330-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f15aa993-b183-406c-9060-048624940330" (UID: "f15aa993-b183-406c-9060-048624940330"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:37:19.277857 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.277806    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f15aa993-b183-406c-9060-048624940330-kube-api-access-vfqxv" (OuterVolumeSpecName: "kube-api-access-vfqxv") pod "f15aa993-b183-406c-9060-048624940330" (UID: "f15aa993-b183-406c-9060-048624940330"). InnerVolumeSpecName "kube-api-access-vfqxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:37:19.377234 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.377208    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfqxv\" (UniqueName: \"kubernetes.io/projected/f15aa993-b183-406c-9060-048624940330-kube-api-access-vfqxv\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:37:19.377234 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.377232    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f15aa993-b183-406c-9060-048624940330-tls-certs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:37:19.377370 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.377245    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f15aa993-b183-406c-9060-048624940330-dshm\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:37:19.975381 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.975350    2556 generic.go:356] "Generic (PLEG): container finished" podID="f15aa993-b183-406c-9060-048624940330" containerID="fe4030776432563bc7ef4a70aa571418703f348f2e63bd62758ae3dee1863468" exitCode=0
Jul 26 16:37:19.975782 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.975390    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"
Jul 26 16:37:19.975782 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.975435    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5" event={"ID":"f15aa993-b183-406c-9060-048624940330","Type":"ContainerDied","Data":"fe4030776432563bc7ef4a70aa571418703f348f2e63bd62758ae3dee1863468"}
Jul 26 16:37:19.975782 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.975479    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5" event={"ID":"f15aa993-b183-406c-9060-048624940330","Type":"ContainerDied","Data":"e2d6eee8be41d9c328f39af92d7f941c5d6ce3a169f1d9d7c62cb0be4ede75f0"}
Jul 26 16:37:19.975782 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.975497    2556 scope.go:117] "RemoveContainer" containerID="fe4030776432563bc7ef4a70aa571418703f348f2e63bd62758ae3dee1863468"
Jul 26 16:37:19.992754 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.992734    2556 scope.go:117] "RemoveContainer" containerID="fe4030776432563bc7ef4a70aa571418703f348f2e63bd62758ae3dee1863468"
Jul 26 16:37:19.993030 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:37:19.993013    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe4030776432563bc7ef4a70aa571418703f348f2e63bd62758ae3dee1863468\": container with ID starting with fe4030776432563bc7ef4a70aa571418703f348f2e63bd62758ae3dee1863468 not found: ID does not exist" containerID="fe4030776432563bc7ef4a70aa571418703f348f2e63bd62758ae3dee1863468"
Jul 26 16:37:19.993081 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:19.993037    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe4030776432563bc7ef4a70aa571418703f348f2e63bd62758ae3dee1863468"} err="failed to get container status \"fe4030776432563bc7ef4a70aa571418703f348f2e63bd62758ae3dee1863468\": rpc error: code = NotFound desc = could not find container \"fe4030776432563bc7ef4a70aa571418703f348f2e63bd62758ae3dee1863468\": container with ID starting with fe4030776432563bc7ef4a70aa571418703f348f2e63bd62758ae3dee1863468 not found: ID does not exist"
Jul 26 16:37:20.003629 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:20.003607    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"]
Jul 26 16:37:20.007828 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:20.007806    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-76272d/sub-test-model-76272d-kserve-6589d4595f-pbtf5"]
Jul 26 16:37:20.215747 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:20.215719    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f15aa993-b183-406c-9060-048624940330" path="/var/lib/kubelet/pods/f15aa993-b183-406c-9060-048624940330/volumes"
Jul 26 16:37:34.054586 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.054543    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"]
Jul 26 16:37:34.055059 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.055030    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f15aa993-b183-406c-9060-048624940330" containerName="main"
Jul 26 16:37:34.055059 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.055048    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f15aa993-b183-406c-9060-048624940330" containerName="main"
Jul 26 16:37:34.055134 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.055062    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="483a9c07-c44b-4002-8d89-d5e4359cba0a" containerName="main"
Jul 26 16:37:34.055134 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.055068    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="483a9c07-c44b-4002-8d89-d5e4359cba0a" containerName="main"
Jul 26 16:37:34.055202 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.055140    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f15aa993-b183-406c-9060-048624940330" containerName="main"
Jul 26 16:37:34.055202 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.055149    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="483a9c07-c44b-4002-8d89-d5e4359cba0a" containerName="main"
Jul 26 16:37:34.060730 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.060701    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:34.066081 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.066039    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-99124e\"/\"kube-root-ca.crt\""
Jul 26 16:37:34.066232 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.066129    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-99124e\"/\"openshift-service-ca.crt\""
Jul 26 16:37:34.067746 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.067719    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-99124e\"/\"rate-test-model-99124e-kserve-self-signed-certs\""
Jul 26 16:37:34.067981 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.067964    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-99124e\"/\"default-dockercfg-mvccj\""
Jul 26 16:37:34.072026 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.072004    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"]
Jul 26 16:37:34.093039 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.093011    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5160b86-d906-42de-9a5f-215b1ef15aea-tls-certs\") pod \"rate-test-model-99124e-kserve-7498464d99-782sn\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") " pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:34.093142 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.093061    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-model-cache\") pod \"rate-test-model-99124e-kserve-7498464d99-782sn\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") " pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:34.093142 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.093101    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl89c\" (UniqueName: \"kubernetes.io/projected/b5160b86-d906-42de-9a5f-215b1ef15aea-kube-api-access-zl89c\") pod \"rate-test-model-99124e-kserve-7498464d99-782sn\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") " pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:34.093142 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.093122    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-home\") pod \"rate-test-model-99124e-kserve-7498464d99-782sn\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") " pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:34.093259 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.093191    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-dshm\") pod \"rate-test-model-99124e-kserve-7498464d99-782sn\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") " pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:34.093298 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.093258    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-tmp-dir\") pod \"rate-test-model-99124e-kserve-7498464d99-782sn\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") " pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:34.194216 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.194189    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl89c\" (UniqueName: \"kubernetes.io/projected/b5160b86-d906-42de-9a5f-215b1ef15aea-kube-api-access-zl89c\") pod \"rate-test-model-99124e-kserve-7498464d99-782sn\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") " pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:34.194335 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.194224    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-home\") pod \"rate-test-model-99124e-kserve-7498464d99-782sn\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") " pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:34.194335 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.194252    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-dshm\") pod \"rate-test-model-99124e-kserve-7498464d99-782sn\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") " pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:34.194335 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.194295    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-tmp-dir\") pod \"rate-test-model-99124e-kserve-7498464d99-782sn\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") " pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:34.194501 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.194381    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5160b86-d906-42de-9a5f-215b1ef15aea-tls-certs\") pod \"rate-test-model-99124e-kserve-7498464d99-782sn\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") " pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:34.194501 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.194418    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-model-cache\") pod \"rate-test-model-99124e-kserve-7498464d99-782sn\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") " pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:34.194622 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.194601    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-home\") pod \"rate-test-model-99124e-kserve-7498464d99-782sn\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") " pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:34.194798 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.194777    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-tmp-dir\") pod \"rate-test-model-99124e-kserve-7498464d99-782sn\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") " pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:34.194798 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.194791    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-model-cache\") pod \"rate-test-model-99124e-kserve-7498464d99-782sn\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") " pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:34.196426 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.196408    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-dshm\") pod \"rate-test-model-99124e-kserve-7498464d99-782sn\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") " pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:34.196808 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.196790    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5160b86-d906-42de-9a5f-215b1ef15aea-tls-certs\") pod \"rate-test-model-99124e-kserve-7498464d99-782sn\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") " pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:34.203618 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.203594    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl89c\" (UniqueName: \"kubernetes.io/projected/b5160b86-d906-42de-9a5f-215b1ef15aea-kube-api-access-zl89c\") pod \"rate-test-model-99124e-kserve-7498464d99-782sn\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") " pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:34.374142 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.374060    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:34.504668 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:34.504624    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"]
Jul 26 16:37:34.505956 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:37:34.505929    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5160b86_d906_42de_9a5f_215b1ef15aea.slice/crio-7ecbc2060fdb97357e1121997ff0b0f24bbca17ef1240737b98852e4c69a72c4 WatchSource:0}: Error finding container 7ecbc2060fdb97357e1121997ff0b0f24bbca17ef1240737b98852e4c69a72c4: Status 404 returned error can't find the container with id 7ecbc2060fdb97357e1121997ff0b0f24bbca17ef1240737b98852e4c69a72c4
Jul 26 16:37:35.079211 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:35.079173    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn" event={"ID":"b5160b86-d906-42de-9a5f-215b1ef15aea","Type":"ContainerStarted","Data":"64af3ef5bcbb3afa1b75bb1fe29f6f5bb1d59182d918a83f5178196856e69198"}
Jul 26 16:37:35.079723 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:35.079226    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn" event={"ID":"b5160b86-d906-42de-9a5f-215b1ef15aea","Type":"ContainerStarted","Data":"7ecbc2060fdb97357e1121997ff0b0f24bbca17ef1240737b98852e4c69a72c4"}
Jul 26 16:37:35.095346 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:35.095301    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn" podStartSLOduration=1.095287293 podStartE2EDuration="1.095287293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:37:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:37:35.094296694 +0000 UTC m=+2851.312923744" watchObservedRunningTime="2026-07-26 16:37:35.095287293 +0000 UTC m=+2851.313914343"
Jul 26 16:37:44.374377 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:44.374336    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:44.374928 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:44.374388    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:44.386988 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:44.386962    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:37:45.160734 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:37:45.160704    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:38:43.514381 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:43.514346    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"]
Jul 26 16:38:44.463178 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:44.463146    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7652-139656884535088"]
Jul 26 16:38:44.466617 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:44.466596    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884535088"
Jul 26 16:38:44.472155 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:44.472129    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bplww\""
Jul 26 16:38:44.502119 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:44.502090    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7652-139656884535088"]
Jul 26 16:38:44.660500 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:44.660464    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jccm9\" (UniqueName: \"kubernetes.io/projected/66826c48-7faa-490e-91d9-9e56854ccc15-kube-api-access-jccm9\") pod \"test-curl-7652-139656884535088\" (UID: \"66826c48-7faa-490e-91d9-9e56854ccc15\") " pod="opendatahub/test-curl-7652-139656884535088"
Jul 26 16:38:44.761820 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:44.761745    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jccm9\" (UniqueName: \"kubernetes.io/projected/66826c48-7faa-490e-91d9-9e56854ccc15-kube-api-access-jccm9\") pod \"test-curl-7652-139656884535088\" (UID: \"66826c48-7faa-490e-91d9-9e56854ccc15\") " pod="opendatahub/test-curl-7652-139656884535088"
Jul 26 16:38:44.772399 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:44.772371    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jccm9\" (UniqueName: \"kubernetes.io/projected/66826c48-7faa-490e-91d9-9e56854ccc15-kube-api-access-jccm9\") pod \"test-curl-7652-139656884535088\" (UID: \"66826c48-7faa-490e-91d9-9e56854ccc15\") " pod="opendatahub/test-curl-7652-139656884535088"
Jul 26 16:38:44.776625 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:44.776604    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884535088"
Jul 26 16:38:44.922231 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:44.922202    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7652-139656884535088"]
Jul 26 16:38:44.922350 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:38:44.922258    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66826c48_7faa_490e_91d9_9e56854ccc15.slice/crio-06ddb545b8215232e48967453b7fc2f39433d7b9972b0be11eebe2c968f07015 WatchSource:0}: Error finding container 06ddb545b8215232e48967453b7fc2f39433d7b9972b0be11eebe2c968f07015: Status 404 returned error can't find the container with id 06ddb545b8215232e48967453b7fc2f39433d7b9972b0be11eebe2c968f07015
Jul 26 16:38:44.923585 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:44.923563    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 16:38:45.487576 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:45.487541    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7652-139656884535088" event={"ID":"66826c48-7faa-490e-91d9-9e56854ccc15","Type":"ContainerStarted","Data":"06ddb545b8215232e48967453b7fc2f39433d7b9972b0be11eebe2c968f07015"}
Jul 26 16:38:46.495518 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:46.495485    2556 generic.go:356] "Generic (PLEG): container finished" podID="66826c48-7faa-490e-91d9-9e56854ccc15" containerID="3ee7c14a1d5c6432dada034c5f8a1b0f75875e9de7943bc071d018ae6b90caeb" exitCode=0
Jul 26 16:38:46.495911 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:46.495571    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7652-139656884535088" event={"ID":"66826c48-7faa-490e-91d9-9e56854ccc15","Type":"ContainerDied","Data":"3ee7c14a1d5c6432dada034c5f8a1b0f75875e9de7943bc071d018ae6b90caeb"}
Jul 26 16:38:47.630978 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:47.630958    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884535088"
Jul 26 16:38:47.689137 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:47.689113    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jccm9\" (UniqueName: \"kubernetes.io/projected/66826c48-7faa-490e-91d9-9e56854ccc15-kube-api-access-jccm9\") pod \"66826c48-7faa-490e-91d9-9e56854ccc15\" (UID: \"66826c48-7faa-490e-91d9-9e56854ccc15\") "
Jul 26 16:38:47.691160 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:47.691129    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66826c48-7faa-490e-91d9-9e56854ccc15-kube-api-access-jccm9" (OuterVolumeSpecName: "kube-api-access-jccm9") pod "66826c48-7faa-490e-91d9-9e56854ccc15" (UID: "66826c48-7faa-490e-91d9-9e56854ccc15"). InnerVolumeSpecName "kube-api-access-jccm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:38:47.714815 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:47.714789    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7652-139656884535088_66826c48-7faa-490e-91d9-9e56854ccc15/test-curl-7652-139656884535088/0.log"
Jul 26 16:38:47.755627 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:47.755570    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7652-139656884535088"]
Jul 26 16:38:47.763908 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:47.763887    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7652-139656884535088"]
Jul 26 16:38:47.790100 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:47.790081    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jccm9\" (UniqueName: \"kubernetes.io/projected/66826c48-7faa-490e-91d9-9e56854ccc15-kube-api-access-jccm9\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:38:48.219778 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:48.217349    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66826c48-7faa-490e-91d9-9e56854ccc15" path="/var/lib/kubelet/pods/66826c48-7faa-490e-91d9-9e56854ccc15/volumes"
Jul 26 16:38:48.507387 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:48.507315    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884535088"
Jul 26 16:38:48.507387 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:48.507376    2556 scope.go:117] "RemoveContainer" containerID="3ee7c14a1d5c6432dada034c5f8a1b0f75875e9de7943bc071d018ae6b90caeb"
Jul 26 16:38:50.840259 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:50.840219    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7652-139656884348944"]
Jul 26 16:38:50.840791 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:50.840772    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66826c48-7faa-490e-91d9-9e56854ccc15" containerName="test-curl-7652-139656884535088"
Jul 26 16:38:50.840874 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:50.840794    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="66826c48-7faa-490e-91d9-9e56854ccc15" containerName="test-curl-7652-139656884535088"
Jul 26 16:38:50.840932 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:50.840921    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="66826c48-7faa-490e-91d9-9e56854ccc15" containerName="test-curl-7652-139656884535088"
Jul 26 16:38:50.845321 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:50.845297    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884348944"
Jul 26 16:38:50.851901 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:50.851600    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bplww\""
Jul 26 16:38:50.870299 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:50.870280    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7652-139656884348944"]
Jul 26 16:38:50.915173 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:50.915153    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jm84\" (UniqueName: \"kubernetes.io/projected/83cf11f6-d90f-4ef7-8b99-9ceae91ddef3-kube-api-access-8jm84\") pod \"test-curl-7652-139656884348944\" (UID: \"83cf11f6-d90f-4ef7-8b99-9ceae91ddef3\") " pod="opendatahub/test-curl-7652-139656884348944"
Jul 26 16:38:51.016212 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:51.016178    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jm84\" (UniqueName: \"kubernetes.io/projected/83cf11f6-d90f-4ef7-8b99-9ceae91ddef3-kube-api-access-8jm84\") pod \"test-curl-7652-139656884348944\" (UID: \"83cf11f6-d90f-4ef7-8b99-9ceae91ddef3\") " pod="opendatahub/test-curl-7652-139656884348944"
Jul 26 16:38:51.041875 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:51.041842    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jm84\" (UniqueName: \"kubernetes.io/projected/83cf11f6-d90f-4ef7-8b99-9ceae91ddef3-kube-api-access-8jm84\") pod \"test-curl-7652-139656884348944\" (UID: \"83cf11f6-d90f-4ef7-8b99-9ceae91ddef3\") " pod="opendatahub/test-curl-7652-139656884348944"
Jul 26 16:38:51.154812 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:51.154755    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884348944"
Jul 26 16:38:51.312580 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:51.312547    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7652-139656884348944"]
Jul 26 16:38:51.313715 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:38:51.313687    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83cf11f6_d90f_4ef7_8b99_9ceae91ddef3.slice/crio-a269bb6f1ef281c60d28eee776590f1014641e9c516227cf84e86ec143ab6150 WatchSource:0}: Error finding container a269bb6f1ef281c60d28eee776590f1014641e9c516227cf84e86ec143ab6150: Status 404 returned error can't find the container with id a269bb6f1ef281c60d28eee776590f1014641e9c516227cf84e86ec143ab6150
Jul 26 16:38:51.528685 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:51.528655    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7652-139656884348944" event={"ID":"83cf11f6-d90f-4ef7-8b99-9ceae91ddef3","Type":"ContainerStarted","Data":"a269bb6f1ef281c60d28eee776590f1014641e9c516227cf84e86ec143ab6150"}
Jul 26 16:38:52.535901 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:52.535870    2556 generic.go:356] "Generic (PLEG): container finished" podID="83cf11f6-d90f-4ef7-8b99-9ceae91ddef3" containerID="d25db1651f36ffdcfed35842f099e26c66735cac4bf7b2d5b5702c46640faec1" exitCode=0
Jul 26 16:38:52.536241 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:52.535908    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7652-139656884348944" event={"ID":"83cf11f6-d90f-4ef7-8b99-9ceae91ddef3","Type":"ContainerDied","Data":"d25db1651f36ffdcfed35842f099e26c66735cac4bf7b2d5b5702c46640faec1"}
Jul 26 16:38:53.679606 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:53.679584    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884348944"
Jul 26 16:38:53.708031 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:53.708006    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7652-139656884348944_83cf11f6-d90f-4ef7-8b99-9ceae91ddef3/test-curl-7652-139656884348944/0.log"
Jul 26 16:38:53.740032 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:53.740009    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jm84\" (UniqueName: \"kubernetes.io/projected/83cf11f6-d90f-4ef7-8b99-9ceae91ddef3-kube-api-access-8jm84\") pod \"83cf11f6-d90f-4ef7-8b99-9ceae91ddef3\" (UID: \"83cf11f6-d90f-4ef7-8b99-9ceae91ddef3\") "
Jul 26 16:38:53.741954 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:53.741933    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83cf11f6-d90f-4ef7-8b99-9ceae91ddef3-kube-api-access-8jm84" (OuterVolumeSpecName: "kube-api-access-8jm84") pod "83cf11f6-d90f-4ef7-8b99-9ceae91ddef3" (UID: "83cf11f6-d90f-4ef7-8b99-9ceae91ddef3"). InnerVolumeSpecName "kube-api-access-8jm84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:38:53.742500 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:53.742480    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7652-139656884348944"]
Jul 26 16:38:53.755248 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:53.755227    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7652-139656884348944"]
Jul 26 16:38:53.840669 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:53.840609    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jm84\" (UniqueName: \"kubernetes.io/projected/83cf11f6-d90f-4ef7-8b99-9ceae91ddef3-kube-api-access-8jm84\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:38:53.878929 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:53.878907    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7652-139656884348944"]
Jul 26 16:38:53.879232 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:53.879220    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83cf11f6-d90f-4ef7-8b99-9ceae91ddef3" containerName="test-curl-7652-139656884348944"
Jul 26 16:38:53.879278 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:53.879234    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="83cf11f6-d90f-4ef7-8b99-9ceae91ddef3" containerName="test-curl-7652-139656884348944"
Jul 26 16:38:53.879314 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:53.879307    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="83cf11f6-d90f-4ef7-8b99-9ceae91ddef3" containerName="test-curl-7652-139656884348944"
Jul 26 16:38:53.882261 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:53.882247    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884348944"
Jul 26 16:38:53.897833 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:53.897808    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7652-139656884348944"]
Jul 26 16:38:53.941730 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:53.941705    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p48b6\" (UniqueName: \"kubernetes.io/projected/d42f33f4-f30d-43ce-a494-de19e1b87004-kube-api-access-p48b6\") pod \"test-curl-7652-139656884348944\" (UID: \"d42f33f4-f30d-43ce-a494-de19e1b87004\") " pod="opendatahub/test-curl-7652-139656884348944"
Jul 26 16:38:54.042789 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:54.042763    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p48b6\" (UniqueName: \"kubernetes.io/projected/d42f33f4-f30d-43ce-a494-de19e1b87004-kube-api-access-p48b6\") pod \"test-curl-7652-139656884348944\" (UID: \"d42f33f4-f30d-43ce-a494-de19e1b87004\") " pod="opendatahub/test-curl-7652-139656884348944"
Jul 26 16:38:54.061138 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:54.061113    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p48b6\" (UniqueName: \"kubernetes.io/projected/d42f33f4-f30d-43ce-a494-de19e1b87004-kube-api-access-p48b6\") pod \"test-curl-7652-139656884348944\" (UID: \"d42f33f4-f30d-43ce-a494-de19e1b87004\") " pod="opendatahub/test-curl-7652-139656884348944"
Jul 26 16:38:54.191353 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:54.191330    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884348944"
Jul 26 16:38:54.217116 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:54.217061    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83cf11f6-d90f-4ef7-8b99-9ceae91ddef3" path="/var/lib/kubelet/pods/83cf11f6-d90f-4ef7-8b99-9ceae91ddef3/volumes"
Jul 26 16:38:54.332143 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:54.332118    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7652-139656884348944"]
Jul 26 16:38:54.333941 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:38:54.333911    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd42f33f4_f30d_43ce_a494_de19e1b87004.slice/crio-987b47668965dfdbc8fc18964c8b2cc6a0818497cdd801c8d328393a7f3cd7cb WatchSource:0}: Error finding container 987b47668965dfdbc8fc18964c8b2cc6a0818497cdd801c8d328393a7f3cd7cb: Status 404 returned error can't find the container with id 987b47668965dfdbc8fc18964c8b2cc6a0818497cdd801c8d328393a7f3cd7cb
Jul 26 16:38:54.549229 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:54.549173    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884348944"
Jul 26 16:38:54.549229 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:54.549209    2556 scope.go:117] "RemoveContainer" containerID="d25db1651f36ffdcfed35842f099e26c66735cac4bf7b2d5b5702c46640faec1"
Jul 26 16:38:54.550344 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:54.550313    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7652-139656884348944" event={"ID":"d42f33f4-f30d-43ce-a494-de19e1b87004","Type":"ContainerStarted","Data":"987b47668965dfdbc8fc18964c8b2cc6a0818497cdd801c8d328393a7f3cd7cb"}
Jul 26 16:38:55.557909 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:55.557873    2556 generic.go:356] "Generic (PLEG): container finished" podID="d42f33f4-f30d-43ce-a494-de19e1b87004" containerID="188ae14879860191192691877127444731260c55fe37f541f4267e7781eafc7f" exitCode=0
Jul 26 16:38:55.558326 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:55.557963    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7652-139656884348944" event={"ID":"d42f33f4-f30d-43ce-a494-de19e1b87004","Type":"ContainerDied","Data":"188ae14879860191192691877127444731260c55fe37f541f4267e7781eafc7f"}
Jul 26 16:38:56.703041 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:56.703013    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884348944"
Jul 26 16:38:56.741098 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:56.741079    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7652-139656884348944_d42f33f4-f30d-43ce-a494-de19e1b87004/test-curl-7652-139656884348944/0.log"
Jul 26 16:38:56.777466 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:56.777442    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p48b6\" (UniqueName: \"kubernetes.io/projected/d42f33f4-f30d-43ce-a494-de19e1b87004-kube-api-access-p48b6\") pod \"d42f33f4-f30d-43ce-a494-de19e1b87004\" (UID: \"d42f33f4-f30d-43ce-a494-de19e1b87004\") "
Jul 26 16:38:56.779409 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:56.779385    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d42f33f4-f30d-43ce-a494-de19e1b87004-kube-api-access-p48b6" (OuterVolumeSpecName: "kube-api-access-p48b6") pod "d42f33f4-f30d-43ce-a494-de19e1b87004" (UID: "d42f33f4-f30d-43ce-a494-de19e1b87004"). InnerVolumeSpecName "kube-api-access-p48b6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:38:56.785039 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:56.785017    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7652-139656884348944"]
Jul 26 16:38:56.794802 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:56.794780    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7652-139656884348944"]
Jul 26 16:38:56.878416 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:56.878363    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p48b6\" (UniqueName: \"kubernetes.io/projected/d42f33f4-f30d-43ce-a494-de19e1b87004-kube-api-access-p48b6\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:38:56.967186 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:56.967162    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7652-139656884349664"]
Jul 26 16:38:56.967527 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:56.967515    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d42f33f4-f30d-43ce-a494-de19e1b87004" containerName="test-curl-7652-139656884348944"
Jul 26 16:38:56.967571 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:56.967529    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d42f33f4-f30d-43ce-a494-de19e1b87004" containerName="test-curl-7652-139656884348944"
Jul 26 16:38:56.967672 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:56.967596    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d42f33f4-f30d-43ce-a494-de19e1b87004" containerName="test-curl-7652-139656884348944"
Jul 26 16:38:56.970548 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:56.970533    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884349664"
Jul 26 16:38:56.987705 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:56.987680    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7652-139656884349664"]
Jul 26 16:38:57.079986 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:57.079957    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx897\" (UniqueName: \"kubernetes.io/projected/32246122-91f2-4eaa-adf6-0043aced1235-kube-api-access-bx897\") pod \"test-curl-7652-139656884349664\" (UID: \"32246122-91f2-4eaa-adf6-0043aced1235\") " pod="opendatahub/test-curl-7652-139656884349664"
Jul 26 16:38:57.181402 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:57.181375    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx897\" (UniqueName: \"kubernetes.io/projected/32246122-91f2-4eaa-adf6-0043aced1235-kube-api-access-bx897\") pod \"test-curl-7652-139656884349664\" (UID: \"32246122-91f2-4eaa-adf6-0043aced1235\") " pod="opendatahub/test-curl-7652-139656884349664"
Jul 26 16:38:57.193285 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:57.193253    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx897\" (UniqueName: \"kubernetes.io/projected/32246122-91f2-4eaa-adf6-0043aced1235-kube-api-access-bx897\") pod \"test-curl-7652-139656884349664\" (UID: \"32246122-91f2-4eaa-adf6-0043aced1235\") " pod="opendatahub/test-curl-7652-139656884349664"
Jul 26 16:38:57.279248 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:57.279229    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884349664"
Jul 26 16:38:57.571745 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:57.571674    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884348944"
Jul 26 16:38:57.571883 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:57.571672    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="987b47668965dfdbc8fc18964c8b2cc6a0818497cdd801c8d328393a7f3cd7cb"
Jul 26 16:38:57.583952 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:38:57.583924    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7652-139656884348944\" is forbidden: User \"system:node:ip-10-0-142-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-224.ec2.internal' and this object" podUID="d42f33f4-f30d-43ce-a494-de19e1b87004" pod="opendatahub/test-curl-7652-139656884348944"
Jul 26 16:38:57.637068 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:57.637046    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7652-139656884349664"]
Jul 26 16:38:57.638674 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:38:57.638647    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32246122_91f2_4eaa_adf6_0043aced1235.slice/crio-b060482052a4170a92f81e3d0df2e04a40190891be148332f6781ba0cb9955ce WatchSource:0}: Error finding container b060482052a4170a92f81e3d0df2e04a40190891be148332f6781ba0cb9955ce: Status 404 returned error can't find the container with id b060482052a4170a92f81e3d0df2e04a40190891be148332f6781ba0cb9955ce
Jul 26 16:38:58.217093 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.216962    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d42f33f4-f30d-43ce-a494-de19e1b87004" path="/var/lib/kubelet/pods/d42f33f4-f30d-43ce-a494-de19e1b87004/volumes"
Jul 26 16:38:58.532601 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.532489    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn" podUID="b5160b86-d906-42de-9a5f-215b1ef15aea" containerName="main" containerID="cri-o://64af3ef5bcbb3afa1b75bb1fe29f6f5bb1d59182d918a83f5178196856e69198" gracePeriod=45
Jul 26 16:38:58.578616 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.578584    2556 generic.go:356] "Generic (PLEG): container finished" podID="32246122-91f2-4eaa-adf6-0043aced1235" containerID="03b8b783692c1d3a28f4dc0124392db46b33902bd4462f9a3246db9a25c024ab" exitCode=0
Jul 26 16:38:58.578726 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.578680    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7652-139656884349664" event={"ID":"32246122-91f2-4eaa-adf6-0043aced1235","Type":"ContainerDied","Data":"03b8b783692c1d3a28f4dc0124392db46b33902bd4462f9a3246db9a25c024ab"}
Jul 26 16:38:58.578726 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.578715    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7652-139656884349664" event={"ID":"32246122-91f2-4eaa-adf6-0043aced1235","Type":"ContainerStarted","Data":"b060482052a4170a92f81e3d0df2e04a40190891be148332f6781ba0cb9955ce"}
Jul 26 16:38:58.793659 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.793591    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:38:58.894724 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.894695    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-dshm\") pod \"b5160b86-d906-42de-9a5f-215b1ef15aea\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") "
Jul 26 16:38:58.894837 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.894750    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl89c\" (UniqueName: \"kubernetes.io/projected/b5160b86-d906-42de-9a5f-215b1ef15aea-kube-api-access-zl89c\") pod \"b5160b86-d906-42de-9a5f-215b1ef15aea\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") "
Jul 26 16:38:58.894837 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.894816    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-tmp-dir\") pod \"b5160b86-d906-42de-9a5f-215b1ef15aea\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") "
Jul 26 16:38:58.894910 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.894847    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5160b86-d906-42de-9a5f-215b1ef15aea-tls-certs\") pod \"b5160b86-d906-42de-9a5f-215b1ef15aea\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") "
Jul 26 16:38:58.894910 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.894889    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-home\") pod \"b5160b86-d906-42de-9a5f-215b1ef15aea\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") "
Jul 26 16:38:58.895011 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.894923    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-model-cache\") pod \"b5160b86-d906-42de-9a5f-215b1ef15aea\" (UID: \"b5160b86-d906-42de-9a5f-215b1ef15aea\") "
Jul 26 16:38:58.895149 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.895119    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b5160b86-d906-42de-9a5f-215b1ef15aea" (UID: "b5160b86-d906-42de-9a5f-215b1ef15aea"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:38:58.895292 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.895255    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-home" (OuterVolumeSpecName: "home") pod "b5160b86-d906-42de-9a5f-215b1ef15aea" (UID: "b5160b86-d906-42de-9a5f-215b1ef15aea"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:38:58.895360 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.895293    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-model-cache" (OuterVolumeSpecName: "model-cache") pod "b5160b86-d906-42de-9a5f-215b1ef15aea" (UID: "b5160b86-d906-42de-9a5f-215b1ef15aea"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:38:58.896966 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.896941    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5160b86-d906-42de-9a5f-215b1ef15aea-kube-api-access-zl89c" (OuterVolumeSpecName: "kube-api-access-zl89c") pod "b5160b86-d906-42de-9a5f-215b1ef15aea" (UID: "b5160b86-d906-42de-9a5f-215b1ef15aea"). InnerVolumeSpecName "kube-api-access-zl89c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:38:58.896966 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.896959    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-dshm" (OuterVolumeSpecName: "dshm") pod "b5160b86-d906-42de-9a5f-215b1ef15aea" (UID: "b5160b86-d906-42de-9a5f-215b1ef15aea"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:38:58.897094 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.896956    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5160b86-d906-42de-9a5f-215b1ef15aea-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b5160b86-d906-42de-9a5f-215b1ef15aea" (UID: "b5160b86-d906-42de-9a5f-215b1ef15aea"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:38:58.995989 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.995956    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-tmp-dir\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:38:58.995989 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.995988    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5160b86-d906-42de-9a5f-215b1ef15aea-tls-certs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:38:58.995989 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.995997    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-home\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:38:58.996154 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.996005    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-model-cache\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:38:58.996154 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.996013    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5160b86-d906-42de-9a5f-215b1ef15aea-dshm\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:38:58.996154 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:58.996021    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl89c\" (UniqueName: \"kubernetes.io/projected/b5160b86-d906-42de-9a5f-215b1ef15aea-kube-api-access-zl89c\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:38:59.586449 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:59.586414    2556 generic.go:356] "Generic (PLEG): container finished" podID="b5160b86-d906-42de-9a5f-215b1ef15aea" containerID="64af3ef5bcbb3afa1b75bb1fe29f6f5bb1d59182d918a83f5178196856e69198" exitCode=0
Jul 26 16:38:59.586878 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:59.586458    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"
Jul 26 16:38:59.586878 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:59.586507    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn" event={"ID":"b5160b86-d906-42de-9a5f-215b1ef15aea","Type":"ContainerDied","Data":"64af3ef5bcbb3afa1b75bb1fe29f6f5bb1d59182d918a83f5178196856e69198"}
Jul 26 16:38:59.586878 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:59.586548    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn" event={"ID":"b5160b86-d906-42de-9a5f-215b1ef15aea","Type":"ContainerDied","Data":"7ecbc2060fdb97357e1121997ff0b0f24bbca17ef1240737b98852e4c69a72c4"}
Jul 26 16:38:59.586878 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:59.586571    2556 scope.go:117] "RemoveContainer" containerID="64af3ef5bcbb3afa1b75bb1fe29f6f5bb1d59182d918a83f5178196856e69198"
Jul 26 16:38:59.596609 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:59.596585    2556 scope.go:117] "RemoveContainer" containerID="64af3ef5bcbb3afa1b75bb1fe29f6f5bb1d59182d918a83f5178196856e69198"
Jul 26 16:38:59.596910 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:38:59.596891    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64af3ef5bcbb3afa1b75bb1fe29f6f5bb1d59182d918a83f5178196856e69198\": container with ID starting with 64af3ef5bcbb3afa1b75bb1fe29f6f5bb1d59182d918a83f5178196856e69198 not found: ID does not exist" containerID="64af3ef5bcbb3afa1b75bb1fe29f6f5bb1d59182d918a83f5178196856e69198"
Jul 26 16:38:59.596963 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:59.596919    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64af3ef5bcbb3afa1b75bb1fe29f6f5bb1d59182d918a83f5178196856e69198"} err="failed to get container status \"64af3ef5bcbb3afa1b75bb1fe29f6f5bb1d59182d918a83f5178196856e69198\": rpc error: code = NotFound desc = could not find container \"64af3ef5bcbb3afa1b75bb1fe29f6f5bb1d59182d918a83f5178196856e69198\": container with ID starting with 64af3ef5bcbb3afa1b75bb1fe29f6f5bb1d59182d918a83f5178196856e69198 not found: ID does not exist"
Jul 26 16:38:59.644807 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:59.644780    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"]
Jul 26 16:38:59.653381 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:59.653353    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-99124e/rate-test-model-99124e-kserve-7498464d99-782sn"]
Jul 26 16:38:59.717771 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:59.717750    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884349664"
Jul 26 16:38:59.761301 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:59.761280    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7652-139656884349664_32246122-91f2-4eaa-adf6-0043aced1235/test-curl-7652-139656884349664/0.log"
Jul 26 16:38:59.801661 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:59.801609    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bx897\" (UniqueName: \"kubernetes.io/projected/32246122-91f2-4eaa-adf6-0043aced1235-kube-api-access-bx897\") pod \"32246122-91f2-4eaa-adf6-0043aced1235\" (UID: \"32246122-91f2-4eaa-adf6-0043aced1235\") "
Jul 26 16:38:59.802942 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:59.802919    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7652-139656884349664"]
Jul 26 16:38:59.803511 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:59.803492    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32246122-91f2-4eaa-adf6-0043aced1235-kube-api-access-bx897" (OuterVolumeSpecName: "kube-api-access-bx897") pod "32246122-91f2-4eaa-adf6-0043aced1235" (UID: "32246122-91f2-4eaa-adf6-0043aced1235"). InnerVolumeSpecName "kube-api-access-bx897". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:38:59.814428 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:59.814407    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7652-139656884349664"]
Jul 26 16:38:59.903282 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:38:59.903231    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bx897\" (UniqueName: \"kubernetes.io/projected/32246122-91f2-4eaa-adf6-0043aced1235-kube-api-access-bx897\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:39:00.216018 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:00.215989    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32246122-91f2-4eaa-adf6-0043aced1235" path="/var/lib/kubelet/pods/32246122-91f2-4eaa-adf6-0043aced1235/volumes"
Jul 26 16:39:00.216397 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:00.216384    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5160b86-d906-42de-9a5f-215b1ef15aea" path="/var/lib/kubelet/pods/b5160b86-d906-42de-9a5f-215b1ef15aea/volumes"
Jul 26 16:39:00.594849 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:00.594770    2556 scope.go:117] "RemoveContainer" containerID="03b8b783692c1d3a28f4dc0124392db46b33902bd4462f9a3246db9a25c024ab"
Jul 26 16:39:00.594849 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:00.594784    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884349664"
Jul 26 16:39:03.788243 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:03.788200    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"]
Jul 26 16:39:03.788762 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:03.788744    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5160b86-d906-42de-9a5f-215b1ef15aea" containerName="main"
Jul 26 16:39:03.788807 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:03.788765    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5160b86-d906-42de-9a5f-215b1ef15aea" containerName="main"
Jul 26 16:39:03.788807 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:03.788778    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32246122-91f2-4eaa-adf6-0043aced1235" containerName="test-curl-7652-139656884349664"
Jul 26 16:39:03.788807 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:03.788787    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="32246122-91f2-4eaa-adf6-0043aced1235" containerName="test-curl-7652-139656884349664"
Jul 26 16:39:03.788930 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:03.788908    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5160b86-d906-42de-9a5f-215b1ef15aea" containerName="main"
Jul 26 16:39:03.788930 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:03.788925    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="32246122-91f2-4eaa-adf6-0043aced1235" containerName="test-curl-7652-139656884349664"
Jul 26 16:39:03.794136 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:03.794109    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:03.798908 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:03.798885    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-bdfbca-openshift-default-dockercfg-5vckf\""
Jul 26 16:39:03.906937 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:03.906910    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"]
Jul 26 16:39:03.937431 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:03.937404    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29tx6\" (UniqueName: \"kubernetes.io/projected/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-kube-api-access-29tx6\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:03.937559 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:03.937438    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-workload-socket\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:03.937559 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:03.937461    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-token\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:03.937559 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:03.937532    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-data\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:03.937703 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:03.937570    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-podinfo\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:03.937703 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:03.937595    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-workload-certs\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:03.937703 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:03.937648    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-envoy\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:03.937703 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:03.937690    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istiod-ca-cert\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:03.937835 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:03.937723    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-credential-socket\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:04.039042 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.038973    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-credential-socket\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:04.039042 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.039011    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29tx6\" (UniqueName: \"kubernetes.io/projected/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-kube-api-access-29tx6\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:04.039042 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.039029    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-workload-socket\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:04.039270 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.039054    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-token\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:04.039270 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.039097    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-data\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:04.039270 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.039140    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-podinfo\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:04.039270 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.039169    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-workload-certs\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:04.039270 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.039218    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-envoy\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:04.039270 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.039243    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istiod-ca-cert\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:04.039659 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.039445    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-credential-socket\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:04.039659 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.039526    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-workload-socket\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:04.039659 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.039571    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-data\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:04.039659 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.039605    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-workload-certs\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:04.039950 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.039932    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istiod-ca-cert\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:04.041572 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.041549    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-envoy\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:04.041831 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.041809    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-podinfo\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:04.052907 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.052884    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29tx6\" (UniqueName: \"kubernetes.io/projected/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-kube-api-access-29tx6\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:04.071903 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.071879    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-token\") pod \"e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") " pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:04.108532 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.108507    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-bdfbca-openshift-default-dockercfg-5vckf\""
Jul 26 16:39:04.116610 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.116592    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:04.308618 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.308594    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"]
Jul 26 16:39:04.310755 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:39:04.310731    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfebe054_ecbc_43c3_8ea3_511cacefe6b6.slice/crio-52b2defed0c98ba0187a163093c7ad4f91e39a99e98bbbb32ab74f0a4c9d718c WatchSource:0}: Error finding container 52b2defed0c98ba0187a163093c7ad4f91e39a99e98bbbb32ab74f0a4c9d718c: Status 404 returned error can't find the container with id 52b2defed0c98ba0187a163093c7ad4f91e39a99e98bbbb32ab74f0a4c9d718c
Jul 26 16:39:04.312791 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.312759    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:39:04.312838 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.312820    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:39:04.312877 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.312849    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:39:04.620325 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.620230    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc" event={"ID":"bfebe054-ecbc-43c3-8ea3-511cacefe6b6","Type":"ContainerStarted","Data":"8a3661d710336aa178b9ecd1446d9f293bf63c3eca7eb8696c351ca1247686a4"}
Jul 26 16:39:04.620325 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.620288    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc" event={"ID":"bfebe054-ecbc-43c3-8ea3-511cacefe6b6","Type":"ContainerStarted","Data":"52b2defed0c98ba0187a163093c7ad4f91e39a99e98bbbb32ab74f0a4c9d718c"}
Jul 26 16:39:04.669755 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:04.669699    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc" podStartSLOduration=1.669679691 podStartE2EDuration="1.669679691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:39:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:39:04.666295236 +0000 UTC m=+2940.884922318" watchObservedRunningTime="2026-07-26 16:39:04.669679691 +0000 UTC m=+2940.888306741"
Jul 26 16:39:05.117217 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:05.117181    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:05.122001 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:05.121980    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:05.625598 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:05.625565    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:05.626322 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:05.626299    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:21.666869 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:21.666825    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 26 16:39:21.667240 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:21.666907    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc" podUID="bfebe054-ecbc-43c3-8ea3-511cacefe6b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 26 16:39:23.730513 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:23.730479    2556 generic.go:356] "Generic (PLEG): container finished" podID="bfebe054-ecbc-43c3-8ea3-511cacefe6b6" containerID="8a3661d710336aa178b9ecd1446d9f293bf63c3eca7eb8696c351ca1247686a4" exitCode=0
Jul 26 16:39:23.730978 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:23.730554    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc" event={"ID":"bfebe054-ecbc-43c3-8ea3-511cacefe6b6","Type":"ContainerDied","Data":"8a3661d710336aa178b9ecd1446d9f293bf63c3eca7eb8696c351ca1247686a4"}
Jul 26 16:39:23.730978 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:23.730958    2556 scope.go:117] "RemoveContainer" containerID="8a3661d710336aa178b9ecd1446d9f293bf63c3eca7eb8696c351ca1247686a4"
Jul 26 16:39:23.731993 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:23.731965    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:39:23.732052 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:23.732036    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:39:23.732097 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:23.732068    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:39:24.737494 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:24.737456    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc" event={"ID":"bfebe054-ecbc-43c3-8ea3-511cacefe6b6","Type":"ContainerStarted","Data":"8d96c901094f296e5b0cb4b51b71a9b7129559952b2353f6b6d11ebdd5d9270e"}
Jul 26 16:39:25.117061 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:25.116972    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:25.117219 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:25.117174    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Jul 26 16:39:25.117270 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:25.117219    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc" podUID="bfebe054-ecbc-43c3-8ea3-511cacefe6b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Jul 26 16:39:26.117624 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:26.117589    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Jul 26 16:39:26.118016 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:26.117671    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc" podUID="bfebe054-ecbc-43c3-8ea3-511cacefe6b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Jul 26 16:39:27.117297 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.117259    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Jul 26 16:39:27.117478 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.117311    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc" podUID="bfebe054-ecbc-43c3-8ea3-511cacefe6b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Jul 26 16:39:27.836186 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.836156    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"]
Jul 26 16:39:27.839900 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.839884    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.845926 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.845902    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-33839d-openshift-default-dockercfg-k4tmp\""
Jul 26 16:39:27.887464 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.887438    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"]
Jul 26 16:39:27.889747 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.889728    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tfc5\" (UniqueName: \"kubernetes.io/projected/b9955432-7851-42bb-8601-2e8461115687-kube-api-access-6tfc5\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.889820 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.889756    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9955432-7851-42bb-8601-2e8461115687-istio-token\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.889820 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.889780    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-istio-envoy\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.889820 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.889804    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9955432-7851-42bb-8601-2e8461115687-istiod-ca-cert\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.889985 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.889910    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-credential-socket\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.889985 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.889965    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-workload-certs\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.890083 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.890016    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9955432-7851-42bb-8601-2e8461115687-istio-podinfo\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.890127 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.890079    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-workload-socket\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.890127 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.890108    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-istio-data\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.991272 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.991233    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-credential-socket\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.991441 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.991292    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-workload-certs\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.991441 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.991324    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9955432-7851-42bb-8601-2e8461115687-istio-podinfo\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.991441 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.991349    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-workload-socket\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.991441 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.991372    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-istio-data\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.991441 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.991423    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tfc5\" (UniqueName: \"kubernetes.io/projected/b9955432-7851-42bb-8601-2e8461115687-kube-api-access-6tfc5\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.991736 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.991443    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9955432-7851-42bb-8601-2e8461115687-istio-token\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.991736 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.991471    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-istio-envoy\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.991736 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.991702    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9955432-7851-42bb-8601-2e8461115687-istiod-ca-cert\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.991915 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.991779    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-credential-socket\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.991915 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.991814    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-istio-data\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.992094 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.992070    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-workload-socket\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.992178 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.992132    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-workload-certs\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.992474 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.992448    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9955432-7851-42bb-8601-2e8461115687-istiod-ca-cert\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.993818 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.993791    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-istio-envoy\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:27.994132 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:27.994111    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9955432-7851-42bb-8601-2e8461115687-istio-podinfo\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:28.006874 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:28.006850    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tfc5\" (UniqueName: \"kubernetes.io/projected/b9955432-7851-42bb-8601-2e8461115687-kube-api-access-6tfc5\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:28.014981 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:28.014957    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9955432-7851-42bb-8601-2e8461115687-istio-token\") pod \"e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") " pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:28.117685 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:28.117608    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused" start-of-body=
Jul 26 16:39:28.117819 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:28.117683    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc" podUID="bfebe054-ecbc-43c3-8ea3-511cacefe6b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.87:15021/healthz/ready\": dial tcp 10.133.0.87:15021: connect: connection refused"
Jul 26 16:39:28.159076 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:28.158863    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:28.326242 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:28.326218    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"]
Jul 26 16:39:28.327455 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:39:28.327429    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9955432_7851_42bb_8601_2e8461115687.slice/crio-29bb6efbe0cf7d0d6033e61ee079a791ec2d85e69376189fa387f4418b220d72 WatchSource:0}: Error finding container 29bb6efbe0cf7d0d6033e61ee079a791ec2d85e69376189fa387f4418b220d72: Status 404 returned error can't find the container with id 29bb6efbe0cf7d0d6033e61ee079a791ec2d85e69376189fa387f4418b220d72
Jul 26 16:39:28.329752 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:28.329718    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:39:28.329848 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:28.329792    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:39:28.329848 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:28.329821    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:39:28.778264 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:28.778231    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn" event={"ID":"b9955432-7851-42bb-8601-2e8461115687","Type":"ContainerStarted","Data":"07a6f56c42420cc70613082b0db1e72472f36bec4315d59545f1bba6d4f151f4"}
Jul 26 16:39:28.778463 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:28.778285    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn" event={"ID":"b9955432-7851-42bb-8601-2e8461115687","Type":"ContainerStarted","Data":"29bb6efbe0cf7d0d6033e61ee079a791ec2d85e69376189fa387f4418b220d72"}
Jul 26 16:39:28.797991 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:28.797940    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn" podStartSLOduration=1.797924658 podStartE2EDuration="1.797924658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:39:28.797140772 +0000 UTC m=+2965.015767842" watchObservedRunningTime="2026-07-26 16:39:28.797924658 +0000 UTC m=+2965.016551707"
Jul 26 16:39:29.120470 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:29.120399    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:29.120868 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:29.120738    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:29.121494 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:29.121473    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:39:29.159178 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:29.159157    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:29.164426 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:29.164406    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:29.784427 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:29.784388    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:29.785096 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:29.785075    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:48.905592 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:48.905515    2556 generic.go:356] "Generic (PLEG): container finished" podID="b9955432-7851-42bb-8601-2e8461115687" containerID="07a6f56c42420cc70613082b0db1e72472f36bec4315d59545f1bba6d4f151f4" exitCode=0
Jul 26 16:39:48.906188 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:48.905597    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn" event={"ID":"b9955432-7851-42bb-8601-2e8461115687","Type":"ContainerDied","Data":"07a6f56c42420cc70613082b0db1e72472f36bec4315d59545f1bba6d4f151f4"}
Jul 26 16:39:48.906188 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:48.906006    2556 scope.go:117] "RemoveContainer" containerID="07a6f56c42420cc70613082b0db1e72472f36bec4315d59545f1bba6d4f151f4"
Jul 26 16:39:48.907042 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:48.907010    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:39:48.907145 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:48.907095    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:39:48.907205 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:48.907147    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:39:49.913102 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:49.913068    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn" event={"ID":"b9955432-7851-42bb-8601-2e8461115687","Type":"ContainerStarted","Data":"25d1c73f103778243b1743ce00808dd7f43e3d400077ed75286a11f8013e12cd"}
Jul 26 16:39:50.159831 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:50.159776    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:50.160659 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:50.160555    2556 patch_prober.go:28] interesting pod/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Jul 26 16:39:50.160882 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:50.160623    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn" podUID="b9955432-7851-42bb-8601-2e8461115687" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Jul 26 16:39:51.159674 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:51.159616    2556 patch_prober.go:28] interesting pod/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Jul 26 16:39:51.160210 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:51.159700    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn" podUID="b9955432-7851-42bb-8601-2e8461115687" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Jul 26 16:39:52.160086 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:52.160047    2556 patch_prober.go:28] interesting pod/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Jul 26 16:39:52.160724 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:52.160679    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn" podUID="b9955432-7851-42bb-8601-2e8461115687" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Jul 26 16:39:53.159476 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:53.159430    2556 patch_prober.go:28] interesting pod/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused" start-of-body=
Jul 26 16:39:53.159712 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:53.159498    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn" podUID="b9955432-7851-42bb-8601-2e8461115687" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.88:15021/healthz/ready\": dial tcp 10.133.0.88:15021: connect: connection refused"
Jul 26 16:39:54.162772 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:54.162740    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:54.163148 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:54.163096    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:39:54.163644 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:39:54.163612    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:40:04.840548 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:40:04.840517    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 16:40:04.852571 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:40:04.852549    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 16:41:06.110674 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.110586    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"]
Jul 26 16:41:06.114124 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.114107    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.116514 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.116495    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-3e477e-openshift-default-dockercfg-qcvzl\""
Jul 26 16:41:06.125094 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.125071    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"]
Jul 26 16:41:06.246579 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.246542    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-credential-socket\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.246579 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.246581    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-podinfo\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.246808 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.246607    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-envoy\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.246808 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.246704    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64ee129b-f3b7-4933-b410-64ddd025eef5-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.246808 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.246803    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-workload-socket\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.246914 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.246829    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-data\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.246914 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.246854    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrqt4\" (UniqueName: \"kubernetes.io/projected/64ee129b-f3b7-4933-b410-64ddd025eef5-kube-api-access-zrqt4\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.246914 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.246872    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-token\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.247011 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.246941    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-workload-certs\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.347927 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.347900    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-envoy\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.348052 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.347935    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64ee129b-f3b7-4933-b410-64ddd025eef5-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.348052 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.347982    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-workload-socket\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.348052 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.348001    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-data\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.348052 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.348023    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrqt4\" (UniqueName: \"kubernetes.io/projected/64ee129b-f3b7-4933-b410-64ddd025eef5-kube-api-access-zrqt4\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.348052 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.348043    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-token\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.348296 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.348086    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-workload-certs\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.348372 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.348351    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-credential-socket\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.348430 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.348384    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-podinfo\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.348430 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.348393    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-data\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.348588 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.348569    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-workload-socket\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.348661 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.348620    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-workload-certs\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.348784 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.348761    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-credential-socket\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.348950 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.348927    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64ee129b-f3b7-4933-b410-64ddd025eef5-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.350282 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.350259    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-envoy\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.350678 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.350661    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-podinfo\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.361942 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.361880    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrqt4\" (UniqueName: \"kubernetes.io/projected/64ee129b-f3b7-4933-b410-64ddd025eef5-kube-api-access-zrqt4\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.362817 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.362793    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-token\") pod \"e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") " pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.424689 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.424663    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:06.566898 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.566873    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"]
Jul 26 16:41:06.569109 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:41:06.569072    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64ee129b_f3b7_4933_b410_64ddd025eef5.slice/crio-f7fa41122d8214e17307272745ac31fdfd9634ed99b752f729b8f1fb4110c5ac WatchSource:0}: Error finding container f7fa41122d8214e17307272745ac31fdfd9634ed99b752f729b8f1fb4110c5ac: Status 404 returned error can't find the container with id f7fa41122d8214e17307272745ac31fdfd9634ed99b752f729b8f1fb4110c5ac
Jul 26 16:41:06.571231 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.571202    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:41:06.571297 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.571269    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:41:06.571339 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:06.571299    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:41:07.390345 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:07.390309    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn" event={"ID":"64ee129b-f3b7-4933-b410-64ddd025eef5","Type":"ContainerStarted","Data":"82c28900aad2be771d3c036690c25f4471a2e8f9d79adbf9bac3b91761ae1c19"}
Jul 26 16:41:07.390711 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:07.390368    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn" event={"ID":"64ee129b-f3b7-4933-b410-64ddd025eef5","Type":"ContainerStarted","Data":"f7fa41122d8214e17307272745ac31fdfd9634ed99b752f729b8f1fb4110c5ac"}
Jul 26 16:41:07.420676 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:07.420604    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn" podStartSLOduration=1.420590353 podStartE2EDuration="1.420590353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:41:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:41:07.419153394 +0000 UTC m=+3063.637780452" watchObservedRunningTime="2026-07-26 16:41:07.420590353 +0000 UTC m=+3063.639217402"
Jul 26 16:41:07.425827 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:07.425810    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:07.430840 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:07.430820    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:08.396715 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:08.396688    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:08.397569 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:08.397546    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:29.521490 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:29.521417    2556 generic.go:356] "Generic (PLEG): container finished" podID="64ee129b-f3b7-4933-b410-64ddd025eef5" containerID="82c28900aad2be771d3c036690c25f4471a2e8f9d79adbf9bac3b91761ae1c19" exitCode=0
Jul 26 16:41:29.521982 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:29.521493    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn" event={"ID":"64ee129b-f3b7-4933-b410-64ddd025eef5","Type":"ContainerDied","Data":"82c28900aad2be771d3c036690c25f4471a2e8f9d79adbf9bac3b91761ae1c19"}
Jul 26 16:41:29.522052 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:29.522012    2556 scope.go:117] "RemoveContainer" containerID="82c28900aad2be771d3c036690c25f4471a2e8f9d79adbf9bac3b91761ae1c19"
Jul 26 16:41:29.523092 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:29.523065    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:41:29.523151 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:29.523132    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:41:29.523187 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:29.523162    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 26 16:41:30.529858 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:30.529820    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn" event={"ID":"64ee129b-f3b7-4933-b410-64ddd025eef5","Type":"ContainerStarted","Data":"043bcd25ad4e7466b0fd48fec6e27c32ae43a3329e5fa199c6f90b43aab9de4f"}
Jul 26 16:41:31.425695 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:31.425659    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:31.425886 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:31.425865    2556 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Jul 26 16:41:31.425933 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:31.425914    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn" podUID="64ee129b-f3b7-4933-b410-64ddd025eef5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Jul 26 16:41:32.425432 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:32.425396    2556 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Jul 26 16:41:32.425854 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:32.425451    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn" podUID="64ee129b-f3b7-4933-b410-64ddd025eef5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Jul 26 16:41:33.425942 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:33.425909    2556 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused" start-of-body=
Jul 26 16:41:33.426310 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:33.425967    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn" podUID="64ee129b-f3b7-4933-b410-64ddd025eef5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.89:15021/healthz/ready\": dial tcp 10.133.0.89:15021: connect: connection refused"
Jul 26 16:41:34.436035 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:34.436003    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:34.436512 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:34.436468    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:41:34.437232 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:41:34.437209    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:42:13.791042 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:13.791008    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"]
Jul 26 16:42:13.791590 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:13.791219    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn" podUID="64ee129b-f3b7-4933-b410-64ddd025eef5" containerName="istio-proxy" containerID="cri-o://043bcd25ad4e7466b0fd48fec6e27c32ae43a3329e5fa199c6f90b43aab9de4f" gracePeriod=30
Jul 26 16:42:19.044029 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.044004    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:42:19.086456 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.086396    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-workload-certs\") pod \"64ee129b-f3b7-4933-b410-64ddd025eef5\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") "
Jul 26 16:42:19.086456 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.086446    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-envoy\") pod \"64ee129b-f3b7-4933-b410-64ddd025eef5\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") "
Jul 26 16:42:19.086663 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.086469    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrqt4\" (UniqueName: \"kubernetes.io/projected/64ee129b-f3b7-4933-b410-64ddd025eef5-kube-api-access-zrqt4\") pod \"64ee129b-f3b7-4933-b410-64ddd025eef5\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") "
Jul 26 16:42:19.086663 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.086517    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-token\") pod \"64ee129b-f3b7-4933-b410-64ddd025eef5\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") "
Jul 26 16:42:19.086663 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.086557    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64ee129b-f3b7-4933-b410-64ddd025eef5-istiod-ca-cert\") pod \"64ee129b-f3b7-4933-b410-64ddd025eef5\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") "
Jul 26 16:42:19.086663 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.086583    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-credential-socket\") pod \"64ee129b-f3b7-4933-b410-64ddd025eef5\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") "
Jul 26 16:42:19.086879 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.086681    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-data\") pod \"64ee129b-f3b7-4933-b410-64ddd025eef5\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") "
Jul 26 16:42:19.086879 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.086690    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "64ee129b-f3b7-4933-b410-64ddd025eef5" (UID: "64ee129b-f3b7-4933-b410-64ddd025eef5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:42:19.086879 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.086765    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-podinfo\") pod \"64ee129b-f3b7-4933-b410-64ddd025eef5\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") "
Jul 26 16:42:19.086879 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.086813    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-workload-socket\") pod \"64ee129b-f3b7-4933-b410-64ddd025eef5\" (UID: \"64ee129b-f3b7-4933-b410-64ddd025eef5\") "
Jul 26 16:42:19.087457 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.087244    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-workload-certs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:42:19.087457 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.087368    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "64ee129b-f3b7-4933-b410-64ddd025eef5" (UID: "64ee129b-f3b7-4933-b410-64ddd025eef5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:42:19.087629 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.087468    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "64ee129b-f3b7-4933-b410-64ddd025eef5" (UID: "64ee129b-f3b7-4933-b410-64ddd025eef5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:42:19.087629 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.087487    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64ee129b-f3b7-4933-b410-64ddd025eef5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "64ee129b-f3b7-4933-b410-64ddd025eef5" (UID: "64ee129b-f3b7-4933-b410-64ddd025eef5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:42:19.088157 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.088126    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-data" (OuterVolumeSpecName: "istio-data") pod "64ee129b-f3b7-4933-b410-64ddd025eef5" (UID: "64ee129b-f3b7-4933-b410-64ddd025eef5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:42:19.089182 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.089149    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "64ee129b-f3b7-4933-b410-64ddd025eef5" (UID: "64ee129b-f3b7-4933-b410-64ddd025eef5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:42:19.089290 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.089219    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64ee129b-f3b7-4933-b410-64ddd025eef5-kube-api-access-zrqt4" (OuterVolumeSpecName: "kube-api-access-zrqt4") pod "64ee129b-f3b7-4933-b410-64ddd025eef5" (UID: "64ee129b-f3b7-4933-b410-64ddd025eef5"). InnerVolumeSpecName "kube-api-access-zrqt4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:42:19.089556 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.089531    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-token" (OuterVolumeSpecName: "istio-token") pod "64ee129b-f3b7-4933-b410-64ddd025eef5" (UID: "64ee129b-f3b7-4933-b410-64ddd025eef5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:42:19.089814 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.089793    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "64ee129b-f3b7-4933-b410-64ddd025eef5" (UID: "64ee129b-f3b7-4933-b410-64ddd025eef5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 16:42:19.188160 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.188130    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-envoy\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:42:19.188160 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.188157    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrqt4\" (UniqueName: \"kubernetes.io/projected/64ee129b-f3b7-4933-b410-64ddd025eef5-kube-api-access-zrqt4\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:42:19.188330 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.188171    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-token\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:42:19.188330 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.188183    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64ee129b-f3b7-4933-b410-64ddd025eef5-istiod-ca-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:42:19.188330 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.188194    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-credential-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:42:19.188330 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.188205    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-data\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:42:19.188330 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.188217    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64ee129b-f3b7-4933-b410-64ddd025eef5-istio-podinfo\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:42:19.188330 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.188229    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64ee129b-f3b7-4933-b410-64ddd025eef5-workload-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:42:19.830487 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.830453    2556 generic.go:356] "Generic (PLEG): container finished" podID="64ee129b-f3b7-4933-b410-64ddd025eef5" containerID="043bcd25ad4e7466b0fd48fec6e27c32ae43a3329e5fa199c6f90b43aab9de4f" exitCode=0
Jul 26 16:42:19.830681 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.830501    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"
Jul 26 16:42:19.830681 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.830547    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn" event={"ID":"64ee129b-f3b7-4933-b410-64ddd025eef5","Type":"ContainerDied","Data":"043bcd25ad4e7466b0fd48fec6e27c32ae43a3329e5fa199c6f90b43aab9de4f"}
Jul 26 16:42:19.830681 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.830609    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn" event={"ID":"64ee129b-f3b7-4933-b410-64ddd025eef5","Type":"ContainerDied","Data":"f7fa41122d8214e17307272745ac31fdfd9634ed99b752f729b8f1fb4110c5ac"}
Jul 26 16:42:19.830681 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.830659    2556 scope.go:117] "RemoveContainer" containerID="043bcd25ad4e7466b0fd48fec6e27c32ae43a3329e5fa199c6f90b43aab9de4f"
Jul 26 16:42:19.841960 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.841941    2556 scope.go:117] "RemoveContainer" containerID="82c28900aad2be771d3c036690c25f4471a2e8f9d79adbf9bac3b91761ae1c19"
Jul 26 16:42:19.851609 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.851595    2556 scope.go:117] "RemoveContainer" containerID="043bcd25ad4e7466b0fd48fec6e27c32ae43a3329e5fa199c6f90b43aab9de4f"
Jul 26 16:42:19.851891 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:42:19.851872    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"043bcd25ad4e7466b0fd48fec6e27c32ae43a3329e5fa199c6f90b43aab9de4f\": container with ID starting with 043bcd25ad4e7466b0fd48fec6e27c32ae43a3329e5fa199c6f90b43aab9de4f not found: ID does not exist" containerID="043bcd25ad4e7466b0fd48fec6e27c32ae43a3329e5fa199c6f90b43aab9de4f"
Jul 26 16:42:19.851934 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.851898    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"043bcd25ad4e7466b0fd48fec6e27c32ae43a3329e5fa199c6f90b43aab9de4f"} err="failed to get container status \"043bcd25ad4e7466b0fd48fec6e27c32ae43a3329e5fa199c6f90b43aab9de4f\": rpc error: code = NotFound desc = could not find container \"043bcd25ad4e7466b0fd48fec6e27c32ae43a3329e5fa199c6f90b43aab9de4f\": container with ID starting with 043bcd25ad4e7466b0fd48fec6e27c32ae43a3329e5fa199c6f90b43aab9de4f not found: ID does not exist"
Jul 26 16:42:19.851934 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.851916    2556 scope.go:117] "RemoveContainer" containerID="82c28900aad2be771d3c036690c25f4471a2e8f9d79adbf9bac3b91761ae1c19"
Jul 26 16:42:19.852172 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:42:19.852156    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82c28900aad2be771d3c036690c25f4471a2e8f9d79adbf9bac3b91761ae1c19\": container with ID starting with 82c28900aad2be771d3c036690c25f4471a2e8f9d79adbf9bac3b91761ae1c19 not found: ID does not exist" containerID="82c28900aad2be771d3c036690c25f4471a2e8f9d79adbf9bac3b91761ae1c19"
Jul 26 16:42:19.852225 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.852175    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82c28900aad2be771d3c036690c25f4471a2e8f9d79adbf9bac3b91761ae1c19"} err="failed to get container status \"82c28900aad2be771d3c036690c25f4471a2e8f9d79adbf9bac3b91761ae1c19\": rpc error: code = NotFound desc = could not find container \"82c28900aad2be771d3c036690c25f4471a2e8f9d79adbf9bac3b91761ae1c19\": container with ID starting with 82c28900aad2be771d3c036690c25f4471a2e8f9d79adbf9bac3b91761ae1c19 not found: ID does not exist"
Jul 26 16:42:19.857120 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.857095    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"]
Jul 26 16:42:19.859696 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:19.859677    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3e477e-openshift-default-6645cd5c98-tpmzn"]
Jul 26 16:42:20.222289 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:42:20.222253    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64ee129b-f3b7-4933-b410-64ddd025eef5" path="/var/lib/kubelet/pods/64ee129b-f3b7-4933-b410-64ddd025eef5/volumes"
Jul 26 16:43:28.365477 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:28.365442    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"]
Jul 26 16:43:28.365933 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:28.365629    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc" podUID="bfebe054-ecbc-43c3-8ea3-511cacefe6b6" containerName="istio-proxy" containerID="cri-o://8d96c901094f296e5b0cb4b51b71a9b7129559952b2353f6b6d11ebdd5d9270e" gracePeriod=30
Jul 26 16:43:29.123696 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:29.123628    2556 patch_prober.go:28] interesting pod/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 26 16:43:29.123920 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:29.123740    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc" podUID="bfebe054-ecbc-43c3-8ea3-511cacefe6b6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 26 16:43:33.617423 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.617396    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:43:33.702067 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.702040    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-token\") pod \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") "
Jul 26 16:43:33.702221 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.702079    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-data\") pod \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") "
Jul 26 16:43:33.702221 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.702101    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-credential-socket\") pod \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") "
Jul 26 16:43:33.702221 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.702124    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-workload-certs\") pod \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") "
Jul 26 16:43:33.702221 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.702145    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-podinfo\") pod \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") "
Jul 26 16:43:33.702221 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.702183    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-envoy\") pod \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") "
Jul 26 16:43:33.702221 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.702213    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29tx6\" (UniqueName: \"kubernetes.io/projected/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-kube-api-access-29tx6\") pod \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") "
Jul 26 16:43:33.702545 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.702278    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istiod-ca-cert\") pod \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") "
Jul 26 16:43:33.702545 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.702366    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-workload-socket\") pod \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\" (UID: \"bfebe054-ecbc-43c3-8ea3-511cacefe6b6\") "
Jul 26 16:43:33.702545 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.702380    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bfebe054-ecbc-43c3-8ea3-511cacefe6b6" (UID: "bfebe054-ecbc-43c3-8ea3-511cacefe6b6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:43:33.702545 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.702409    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bfebe054-ecbc-43c3-8ea3-511cacefe6b6" (UID: "bfebe054-ecbc-43c3-8ea3-511cacefe6b6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:43:33.702792 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.702696    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-credential-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:43:33.702792 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.702717    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-workload-certs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:43:33.702792 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.702694    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bfebe054-ecbc-43c3-8ea3-511cacefe6b6" (UID: "bfebe054-ecbc-43c3-8ea3-511cacefe6b6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:43:33.702792 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.702745    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bfebe054-ecbc-43c3-8ea3-511cacefe6b6" (UID: "bfebe054-ecbc-43c3-8ea3-511cacefe6b6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:43:33.703122 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.703079    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-data" (OuterVolumeSpecName: "istio-data") pod "bfebe054-ecbc-43c3-8ea3-511cacefe6b6" (UID: "bfebe054-ecbc-43c3-8ea3-511cacefe6b6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:43:33.704261 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.704237    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-token" (OuterVolumeSpecName: "istio-token") pod "bfebe054-ecbc-43c3-8ea3-511cacefe6b6" (UID: "bfebe054-ecbc-43c3-8ea3-511cacefe6b6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:43:33.704426 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.704403    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bfebe054-ecbc-43c3-8ea3-511cacefe6b6" (UID: "bfebe054-ecbc-43c3-8ea3-511cacefe6b6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 16:43:33.704426 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.704414    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bfebe054-ecbc-43c3-8ea3-511cacefe6b6" (UID: "bfebe054-ecbc-43c3-8ea3-511cacefe6b6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:43:33.704761 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.704743    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-kube-api-access-29tx6" (OuterVolumeSpecName: "kube-api-access-29tx6") pod "bfebe054-ecbc-43c3-8ea3-511cacefe6b6" (UID: "bfebe054-ecbc-43c3-8ea3-511cacefe6b6"). InnerVolumeSpecName "kube-api-access-29tx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:43:33.804061 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.804037    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-envoy\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:43:33.804061 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.804058    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29tx6\" (UniqueName: \"kubernetes.io/projected/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-kube-api-access-29tx6\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:43:33.804186 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.804069    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istiod-ca-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:43:33.804186 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.804078    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-workload-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:43:33.804186 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.804085    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-token\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:43:33.804186 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.804093    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-data\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:43:33.804186 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:33.804101    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfebe054-ecbc-43c3-8ea3-511cacefe6b6-istio-podinfo\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:43:34.277740 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:34.277710    2556 generic.go:356] "Generic (PLEG): container finished" podID="bfebe054-ecbc-43c3-8ea3-511cacefe6b6" containerID="8d96c901094f296e5b0cb4b51b71a9b7129559952b2353f6b6d11ebdd5d9270e" exitCode=0
Jul 26 16:43:34.277866 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:34.277749    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc" event={"ID":"bfebe054-ecbc-43c3-8ea3-511cacefe6b6","Type":"ContainerDied","Data":"8d96c901094f296e5b0cb4b51b71a9b7129559952b2353f6b6d11ebdd5d9270e"}
Jul 26 16:43:34.277866 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:34.277759    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"
Jul 26 16:43:34.277866 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:34.277786    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc" event={"ID":"bfebe054-ecbc-43c3-8ea3-511cacefe6b6","Type":"ContainerDied","Data":"52b2defed0c98ba0187a163093c7ad4f91e39a99e98bbbb32ab74f0a4c9d718c"}
Jul 26 16:43:34.277866 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:34.277810    2556 scope.go:117] "RemoveContainer" containerID="8d96c901094f296e5b0cb4b51b71a9b7129559952b2353f6b6d11ebdd5d9270e"
Jul 26 16:43:34.290310 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:34.290289    2556 scope.go:117] "RemoveContainer" containerID="8a3661d710336aa178b9ecd1446d9f293bf63c3eca7eb8696c351ca1247686a4"
Jul 26 16:43:34.299421 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:34.299403    2556 scope.go:117] "RemoveContainer" containerID="8d96c901094f296e5b0cb4b51b71a9b7129559952b2353f6b6d11ebdd5d9270e"
Jul 26 16:43:34.299671 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:43:34.299652    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d96c901094f296e5b0cb4b51b71a9b7129559952b2353f6b6d11ebdd5d9270e\": container with ID starting with 8d96c901094f296e5b0cb4b51b71a9b7129559952b2353f6b6d11ebdd5d9270e not found: ID does not exist" containerID="8d96c901094f296e5b0cb4b51b71a9b7129559952b2353f6b6d11ebdd5d9270e"
Jul 26 16:43:34.299730 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:34.299680    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d96c901094f296e5b0cb4b51b71a9b7129559952b2353f6b6d11ebdd5d9270e"} err="failed to get container status \"8d96c901094f296e5b0cb4b51b71a9b7129559952b2353f6b6d11ebdd5d9270e\": rpc error: code = NotFound desc = could not find container \"8d96c901094f296e5b0cb4b51b71a9b7129559952b2353f6b6d11ebdd5d9270e\": container with ID starting with 8d96c901094f296e5b0cb4b51b71a9b7129559952b2353f6b6d11ebdd5d9270e not found: ID does not exist"
Jul 26 16:43:34.299730 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:34.299699    2556 scope.go:117] "RemoveContainer" containerID="8a3661d710336aa178b9ecd1446d9f293bf63c3eca7eb8696c351ca1247686a4"
Jul 26 16:43:34.299935 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:43:34.299920    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a3661d710336aa178b9ecd1446d9f293bf63c3eca7eb8696c351ca1247686a4\": container with ID starting with 8a3661d710336aa178b9ecd1446d9f293bf63c3eca7eb8696c351ca1247686a4 not found: ID does not exist" containerID="8a3661d710336aa178b9ecd1446d9f293bf63c3eca7eb8696c351ca1247686a4"
Jul 26 16:43:34.299987 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:34.299940    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a3661d710336aa178b9ecd1446d9f293bf63c3eca7eb8696c351ca1247686a4"} err="failed to get container status \"8a3661d710336aa178b9ecd1446d9f293bf63c3eca7eb8696c351ca1247686a4\": rpc error: code = NotFound desc = could not find container \"8a3661d710336aa178b9ecd1446d9f293bf63c3eca7eb8696c351ca1247686a4\": container with ID starting with 8a3661d710336aa178b9ecd1446d9f293bf63c3eca7eb8696c351ca1247686a4 not found: ID does not exist"
Jul 26 16:43:34.304465 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:34.304446    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"]
Jul 26 16:43:34.313495 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:34.313476    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-bdfbca-openshift-default-66cd4d699d-k76dc"]
Jul 26 16:43:36.216962 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:36.216923    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfebe054-ecbc-43c3-8ea3-511cacefe6b6" path="/var/lib/kubelet/pods/bfebe054-ecbc-43c3-8ea3-511cacefe6b6/volumes"
Jul 26 16:43:51.185177 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:51.185146    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"]
Jul 26 16:43:51.185555 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:51.185352    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn" podUID="b9955432-7851-42bb-8601-2e8461115687" containerName="istio-proxy" containerID="cri-o://25d1c73f103778243b1743ce00808dd7f43e3d400077ed75286a11f8013e12cd" gracePeriod=30
Jul 26 16:43:51.598501 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:51.598426    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-76272d-vq7zw"]
Jul 26 16:43:51.598839 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:51.598825    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64ee129b-f3b7-4933-b410-64ddd025eef5" containerName="istio-proxy"
Jul 26 16:43:51.598899 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:51.598841    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="64ee129b-f3b7-4933-b410-64ddd025eef5" containerName="istio-proxy"
Jul 26 16:43:51.598899 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:51.598856    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfebe054-ecbc-43c3-8ea3-511cacefe6b6" containerName="istio-proxy"
Jul 26 16:43:51.598899 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:51.598862    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfebe054-ecbc-43c3-8ea3-511cacefe6b6" containerName="istio-proxy"
Jul 26 16:43:51.598899 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:51.598876    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfebe054-ecbc-43c3-8ea3-511cacefe6b6" containerName="istio-proxy"
Jul 26 16:43:51.598899 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:51.598881    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfebe054-ecbc-43c3-8ea3-511cacefe6b6" containerName="istio-proxy"
Jul 26 16:43:51.599056 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:51.598938    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfebe054-ecbc-43c3-8ea3-511cacefe6b6" containerName="istio-proxy"
Jul 26 16:43:51.599056 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:51.598945    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="64ee129b-f3b7-4933-b410-64ddd025eef5" containerName="istio-proxy"
Jul 26 16:43:51.599056 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:51.598953    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfebe054-ecbc-43c3-8ea3-511cacefe6b6" containerName="istio-proxy"
Jul 26 16:43:51.599056 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:51.598960    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="64ee129b-f3b7-4933-b410-64ddd025eef5" containerName="istio-proxy"
Jul 26 16:43:51.602026 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:51.602009    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-76272d-vq7zw"
Jul 26 16:43:51.604779 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:51.604752    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlwwk\""
Jul 26 16:43:51.604911 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:51.604795    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 26 16:43:51.609680 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:51.609658    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-76272d-vq7zw"]
Jul 26 16:43:51.752807 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:51.752778    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da47ce48-246a-4638-9e03-1df6b7c78184-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-76272d-vq7zw\" (UID: \"da47ce48-246a-4638-9e03-1df6b7c78184\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-76272d-vq7zw"
Jul 26 16:43:51.854159 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:51.854101    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da47ce48-246a-4638-9e03-1df6b7c78184-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-76272d-vq7zw\" (UID: \"da47ce48-246a-4638-9e03-1df6b7c78184\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-76272d-vq7zw"
Jul 26 16:43:51.854685 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:51.854663    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da47ce48-246a-4638-9e03-1df6b7c78184-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-76272d-vq7zw\" (UID: \"da47ce48-246a-4638-9e03-1df6b7c78184\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-76272d-vq7zw"
Jul 26 16:43:51.913478 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:51.913454    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-76272d-vq7zw"
Jul 26 16:43:52.048926 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:52.048901    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-76272d-vq7zw"]
Jul 26 16:43:52.050014 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:43:52.049987    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda47ce48_246a_4638_9e03_1df6b7c78184.slice/crio-2e0618f9d2a3e7aba1c6b0ee47efe5118d5274dfc3589ec61b13e1bbe52a9a50 WatchSource:0}: Error finding container 2e0618f9d2a3e7aba1c6b0ee47efe5118d5274dfc3589ec61b13e1bbe52a9a50: Status 404 returned error can't find the container with id 2e0618f9d2a3e7aba1c6b0ee47efe5118d5274dfc3589ec61b13e1bbe52a9a50
Jul 26 16:43:52.379454 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:52.379424    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-76272d-vq7zw" event={"ID":"da47ce48-246a-4638-9e03-1df6b7c78184","Type":"ContainerStarted","Data":"bb65c3f6f707c968d3e1aa597d44dd0ca83bf92076427af84d5bda2a6adf269f"}
Jul 26 16:43:52.379771 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:52.379482    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-76272d-vq7zw" event={"ID":"da47ce48-246a-4638-9e03-1df6b7c78184","Type":"ContainerStarted","Data":"2e0618f9d2a3e7aba1c6b0ee47efe5118d5274dfc3589ec61b13e1bbe52a9a50"}
Jul 26 16:43:52.400237 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:52.400194    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-76272d-vq7zw" podStartSLOduration=1.400179537 podStartE2EDuration="1.400179537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:43:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:43:52.398854096 +0000 UTC m=+3228.617481170" watchObservedRunningTime="2026-07-26 16:43:52.400179537 +0000 UTC m=+3228.618806586"
Jul 26 16:43:53.386812 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:53.386785    2556 generic.go:356] "Generic (PLEG): container finished" podID="da47ce48-246a-4638-9e03-1df6b7c78184" containerID="bb65c3f6f707c968d3e1aa597d44dd0ca83bf92076427af84d5bda2a6adf269f" exitCode=0
Jul 26 16:43:53.387177 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:53.386873    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-76272d-vq7zw" event={"ID":"da47ce48-246a-4638-9e03-1df6b7c78184","Type":"ContainerDied","Data":"bb65c3f6f707c968d3e1aa597d44dd0ca83bf92076427af84d5bda2a6adf269f"}
Jul 26 16:43:54.164956 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:54.164916    2556 patch_prober.go:28] interesting pod/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 26 16:43:54.165123 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:54.164983    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn" podUID="b9955432-7851-42bb-8601-2e8461115687" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 26 16:43:54.523708 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:54.523682    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-76272d-vq7zw"
Jul 26 16:43:54.679934 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:54.679910    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da47ce48-246a-4638-9e03-1df6b7c78184-maas-api-service-ca\") pod \"da47ce48-246a-4638-9e03-1df6b7c78184\" (UID: \"da47ce48-246a-4638-9e03-1df6b7c78184\") "
Jul 26 16:43:54.680286 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:54.680253    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da47ce48-246a-4638-9e03-1df6b7c78184-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "da47ce48-246a-4638-9e03-1df6b7c78184" (UID: "da47ce48-246a-4638-9e03-1df6b7c78184"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:43:54.781373 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:54.781301    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da47ce48-246a-4638-9e03-1df6b7c78184-maas-api-service-ca\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:43:55.399202 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:55.399166    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-76272d-vq7zw" event={"ID":"da47ce48-246a-4638-9e03-1df6b7c78184","Type":"ContainerDied","Data":"2e0618f9d2a3e7aba1c6b0ee47efe5118d5274dfc3589ec61b13e1bbe52a9a50"}
Jul 26 16:43:55.399404 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:55.399220    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e0618f9d2a3e7aba1c6b0ee47efe5118d5274dfc3589ec61b13e1bbe52a9a50"
Jul 26 16:43:55.399404 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:55.399180    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-76272d-vq7zw"
Jul 26 16:43:56.408005 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.407971    2556 generic.go:356] "Generic (PLEG): container finished" podID="b9955432-7851-42bb-8601-2e8461115687" containerID="25d1c73f103778243b1743ce00808dd7f43e3d400077ed75286a11f8013e12cd" exitCode=0
Jul 26 16:43:56.408335 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.408037    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn" event={"ID":"b9955432-7851-42bb-8601-2e8461115687","Type":"ContainerDied","Data":"25d1c73f103778243b1743ce00808dd7f43e3d400077ed75286a11f8013e12cd"}
Jul 26 16:43:56.408335 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.408099    2556 scope.go:117] "RemoveContainer" containerID="07a6f56c42420cc70613082b0db1e72472f36bec4315d59545f1bba6d4f151f4"
Jul 26 16:43:56.440742 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.440724    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:43:56.599060 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.598997    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-workload-certs\") pod \"b9955432-7851-42bb-8601-2e8461115687\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") "
Jul 26 16:43:56.599060 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.599032    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tfc5\" (UniqueName: \"kubernetes.io/projected/b9955432-7851-42bb-8601-2e8461115687-kube-api-access-6tfc5\") pod \"b9955432-7851-42bb-8601-2e8461115687\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") "
Jul 26 16:43:56.599060 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.599048    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-istio-envoy\") pod \"b9955432-7851-42bb-8601-2e8461115687\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") "
Jul 26 16:43:56.599306 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.599069    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-workload-socket\") pod \"b9955432-7851-42bb-8601-2e8461115687\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") "
Jul 26 16:43:56.599306 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.599112    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9955432-7851-42bb-8601-2e8461115687-istiod-ca-cert\") pod \"b9955432-7851-42bb-8601-2e8461115687\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") "
Jul 26 16:43:56.599306 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.599130    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-credential-socket\") pod \"b9955432-7851-42bb-8601-2e8461115687\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") "
Jul 26 16:43:56.599306 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.599193    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-istio-data\") pod \"b9955432-7851-42bb-8601-2e8461115687\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") "
Jul 26 16:43:56.599306 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.599218    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9955432-7851-42bb-8601-2e8461115687-istio-podinfo\") pod \"b9955432-7851-42bb-8601-2e8461115687\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") "
Jul 26 16:43:56.599306 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.599244    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9955432-7851-42bb-8601-2e8461115687-istio-token\") pod \"b9955432-7851-42bb-8601-2e8461115687\" (UID: \"b9955432-7851-42bb-8601-2e8461115687\") "
Jul 26 16:43:56.599306 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.599297    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b9955432-7851-42bb-8601-2e8461115687" (UID: "b9955432-7851-42bb-8601-2e8461115687"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:43:56.599701 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.599533    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b9955432-7851-42bb-8601-2e8461115687" (UID: "b9955432-7851-42bb-8601-2e8461115687"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:43:56.599701 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.599585    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-workload-certs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:43:56.599701 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.599581    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9955432-7851-42bb-8601-2e8461115687-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b9955432-7851-42bb-8601-2e8461115687" (UID: "b9955432-7851-42bb-8601-2e8461115687"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:43:56.599938 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.599787    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b9955432-7851-42bb-8601-2e8461115687" (UID: "b9955432-7851-42bb-8601-2e8461115687"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:43:56.600047 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.600019    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-istio-data" (OuterVolumeSpecName: "istio-data") pod "b9955432-7851-42bb-8601-2e8461115687" (UID: "b9955432-7851-42bb-8601-2e8461115687"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:43:56.601497 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.601473    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b9955432-7851-42bb-8601-2e8461115687-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b9955432-7851-42bb-8601-2e8461115687" (UID: "b9955432-7851-42bb-8601-2e8461115687"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 16:43:56.601595 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.601525    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9955432-7851-42bb-8601-2e8461115687-istio-token" (OuterVolumeSpecName: "istio-token") pod "b9955432-7851-42bb-8601-2e8461115687" (UID: "b9955432-7851-42bb-8601-2e8461115687"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:43:56.601690 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.601609    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b9955432-7851-42bb-8601-2e8461115687" (UID: "b9955432-7851-42bb-8601-2e8461115687"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:43:56.601690 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.601652    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9955432-7851-42bb-8601-2e8461115687-kube-api-access-6tfc5" (OuterVolumeSpecName: "kube-api-access-6tfc5") pod "b9955432-7851-42bb-8601-2e8461115687" (UID: "b9955432-7851-42bb-8601-2e8461115687"). InnerVolumeSpecName "kube-api-access-6tfc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:43:56.700767 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.700742    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-workload-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:43:56.700767 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.700765    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9955432-7851-42bb-8601-2e8461115687-istiod-ca-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:43:56.700895 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.700774    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-credential-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:43:56.700895 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.700784    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-istio-data\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:43:56.700895 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.700792    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9955432-7851-42bb-8601-2e8461115687-istio-podinfo\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:43:56.700895 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.700799    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9955432-7851-42bb-8601-2e8461115687-istio-token\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:43:56.700895 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.700807    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tfc5\" (UniqueName: \"kubernetes.io/projected/b9955432-7851-42bb-8601-2e8461115687-kube-api-access-6tfc5\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:43:56.700895 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:56.700816    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9955432-7851-42bb-8601-2e8461115687-istio-envoy\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:43:57.414482 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:57.414456    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"
Jul 26 16:43:57.414983 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:57.414496    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn" event={"ID":"b9955432-7851-42bb-8601-2e8461115687","Type":"ContainerDied","Data":"29bb6efbe0cf7d0d6033e61ee079a791ec2d85e69376189fa387f4418b220d72"}
Jul 26 16:43:57.414983 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:57.414549    2556 scope.go:117] "RemoveContainer" containerID="25d1c73f103778243b1743ce00808dd7f43e3d400077ed75286a11f8013e12cd"
Jul 26 16:43:57.445705 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:57.445678    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"]
Jul 26 16:43:57.459685 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:57.459664    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-33839d-openshift-default-777449bb7b-c2hcn"]
Jul 26 16:43:58.222088 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:43:58.222055    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9955432-7851-42bb-8601-2e8461115687" path="/var/lib/kubelet/pods/b9955432-7851-42bb-8601-2e8461115687/volumes"
Jul 26 16:44:02.418241 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:02.418204    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-76272d-29751390-dq44s"]
Jul 26 16:44:02.422403 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:02.422379    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-76272d-29751390-dq44s"]
Jul 26 16:44:04.216437 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:04.216402    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4030bd48-e106-489e-86cd-37042537adc5" path="/var/lib/kubelet/pods/4030bd48-e106-489e-86cd-37042537adc5/volumes"
Jul 26 16:44:04.808651 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:04.808604    2556 scope.go:117] "RemoveContainer" containerID="a4cc101103c562d53f6510b3a476c42ca0f2e87068f1ff2a0dc64bcaf9c6d632"
Jul 26 16:44:06.790302 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:06.790269    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-76272d-vq7zw"]
Jul 26 16:44:06.796256 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:06.796232    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-76272d-vq7zw"]
Jul 26 16:44:08.215803 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:08.215769    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da47ce48-246a-4638-9e03-1df6b7c78184" path="/var/lib/kubelet/pods/da47ce48-246a-4638-9e03-1df6b7c78184/volumes"
Jul 26 16:44:14.969220 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:14.969188    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"]
Jul 26 16:44:14.969675 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:14.969431    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg" podUID="bd21a728-a63a-458a-9416-2e7e207df9a9" containerName="istio-proxy" containerID="cri-o://f4f4bbdd3a331419aaed1f6a4c8e4112e54e67739c4d0bc308c7e98571145a97" gracePeriod=30
Jul 26 16:44:15.030613 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:15.030581    2556 patch_prober.go:28] interesting pod/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 26 16:44:15.030754 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:15.030654    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg" podUID="bd21a728-a63a-458a-9416-2e7e207df9a9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 26 16:44:15.328674 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:15.328578    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-99124e-nzgxr"]
Jul 26 16:44:15.328972 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:15.328959    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9955432-7851-42bb-8601-2e8461115687" containerName="istio-proxy"
Jul 26 16:44:15.329019 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:15.328973    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9955432-7851-42bb-8601-2e8461115687" containerName="istio-proxy"
Jul 26 16:44:15.329019 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:15.328983    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da47ce48-246a-4638-9e03-1df6b7c78184" containerName="revoke-keys"
Jul 26 16:44:15.329019 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:15.328988    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="da47ce48-246a-4638-9e03-1df6b7c78184" containerName="revoke-keys"
Jul 26 16:44:15.329019 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:15.328998    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64ee129b-f3b7-4933-b410-64ddd025eef5" containerName="istio-proxy"
Jul 26 16:44:15.329019 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:15.329003    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="64ee129b-f3b7-4933-b410-64ddd025eef5" containerName="istio-proxy"
Jul 26 16:44:15.329220 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:15.329063    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9955432-7851-42bb-8601-2e8461115687" containerName="istio-proxy"
Jul 26 16:44:15.329220 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:15.329071    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9955432-7851-42bb-8601-2e8461115687" containerName="istio-proxy"
Jul 26 16:44:15.329220 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:15.329078    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="da47ce48-246a-4638-9e03-1df6b7c78184" containerName="revoke-keys"
Jul 26 16:44:15.333644 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:15.333617    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-99124e-nzgxr"
Jul 26 16:44:15.336029 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:15.336004    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlwwk\""
Jul 26 16:44:15.338610 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:15.338594    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 26 16:44:15.344490 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:15.344457    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-99124e-nzgxr"]
Jul 26 16:44:15.355938 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:15.355915    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d741ceb-1780-4c70-974e-a54378338c32-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-99124e-nzgxr\" (UID: \"2d741ceb-1780-4c70-974e-a54378338c32\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-99124e-nzgxr"
Jul 26 16:44:15.457313 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:15.457286    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d741ceb-1780-4c70-974e-a54378338c32-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-99124e-nzgxr\" (UID: \"2d741ceb-1780-4c70-974e-a54378338c32\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-99124e-nzgxr"
Jul 26 16:44:15.457924 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:15.457906    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d741ceb-1780-4c70-974e-a54378338c32-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-99124e-nzgxr\" (UID: \"2d741ceb-1780-4c70-974e-a54378338c32\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-99124e-nzgxr"
Jul 26 16:44:15.644767 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:15.644708    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-99124e-nzgxr"
Jul 26 16:44:15.777661 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:15.777619    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-99124e-nzgxr"]
Jul 26 16:44:15.779096 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:44:15.779063    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d741ceb_1780_4c70_974e_a54378338c32.slice/crio-00f674b61da30a1254997b89b875cef94660e1ac1da82125da8fffb311f92aaf WatchSource:0}: Error finding container 00f674b61da30a1254997b89b875cef94660e1ac1da82125da8fffb311f92aaf: Status 404 returned error can't find the container with id 00f674b61da30a1254997b89b875cef94660e1ac1da82125da8fffb311f92aaf
Jul 26 16:44:16.524062 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:16.524025    2556 generic.go:356] "Generic (PLEG): container finished" podID="2d741ceb-1780-4c70-974e-a54378338c32" containerID="1423587fc047df02d4250ec4b030fb984549c2d769cb897f0fc7d1efad9f18cb" exitCode=0
Jul 26 16:44:16.524395 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:16.524111    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-99124e-nzgxr" event={"ID":"2d741ceb-1780-4c70-974e-a54378338c32","Type":"ContainerDied","Data":"1423587fc047df02d4250ec4b030fb984549c2d769cb897f0fc7d1efad9f18cb"}
Jul 26 16:44:16.524395 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:16.524185    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-99124e-nzgxr" event={"ID":"2d741ceb-1780-4c70-974e-a54378338c32","Type":"ContainerStarted","Data":"00f674b61da30a1254997b89b875cef94660e1ac1da82125da8fffb311f92aaf"}
Jul 26 16:44:17.663571 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:17.663547    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-99124e-nzgxr"
Jul 26 16:44:17.779156 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:17.779127    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d741ceb-1780-4c70-974e-a54378338c32-maas-api-service-ca\") pod \"2d741ceb-1780-4c70-974e-a54378338c32\" (UID: \"2d741ceb-1780-4c70-974e-a54378338c32\") "
Jul 26 16:44:17.779442 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:17.779420    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d741ceb-1780-4c70-974e-a54378338c32-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2d741ceb-1780-4c70-974e-a54378338c32" (UID: "2d741ceb-1780-4c70-974e-a54378338c32"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:44:17.880615 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:17.880557    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d741ceb-1780-4c70-974e-a54378338c32-maas-api-service-ca\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:44:18.537182 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:18.537109    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-99124e-nzgxr"
Jul 26 16:44:18.537182 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:18.537115    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-99124e-nzgxr" event={"ID":"2d741ceb-1780-4c70-974e-a54378338c32","Type":"ContainerDied","Data":"00f674b61da30a1254997b89b875cef94660e1ac1da82125da8fffb311f92aaf"}
Jul 26 16:44:18.537182 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:18.537172    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00f674b61da30a1254997b89b875cef94660e1ac1da82125da8fffb311f92aaf"
Jul 26 16:44:20.231397 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.231370    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:44:20.299864 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.299796    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd21a728-a63a-458a-9416-2e7e207df9a9-istiod-ca-cert\") pod \"bd21a728-a63a-458a-9416-2e7e207df9a9\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") "
Jul 26 16:44:20.299864 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.299860    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-envoy\") pod \"bd21a728-a63a-458a-9416-2e7e207df9a9\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") "
Jul 26 16:44:20.300035 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.299875    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-podinfo\") pod \"bd21a728-a63a-458a-9416-2e7e207df9a9\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") "
Jul 26 16:44:20.300075 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.300038    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ct9x\" (UniqueName: \"kubernetes.io/projected/bd21a728-a63a-458a-9416-2e7e207df9a9-kube-api-access-4ct9x\") pod \"bd21a728-a63a-458a-9416-2e7e207df9a9\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") "
Jul 26 16:44:20.300127 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.300078    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-workload-socket\") pod \"bd21a728-a63a-458a-9416-2e7e207df9a9\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") "
Jul 26 16:44:20.300185 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.300126    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-credential-socket\") pod \"bd21a728-a63a-458a-9416-2e7e207df9a9\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") "
Jul 26 16:44:20.300185 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.300159    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-data\") pod \"bd21a728-a63a-458a-9416-2e7e207df9a9\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") "
Jul 26 16:44:20.300302 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.300197    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-workload-certs\") pod \"bd21a728-a63a-458a-9416-2e7e207df9a9\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") "
Jul 26 16:44:20.300302 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.300205    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd21a728-a63a-458a-9416-2e7e207df9a9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bd21a728-a63a-458a-9416-2e7e207df9a9" (UID: "bd21a728-a63a-458a-9416-2e7e207df9a9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:44:20.300302 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.300227    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-token\") pod \"bd21a728-a63a-458a-9416-2e7e207df9a9\" (UID: \"bd21a728-a63a-458a-9416-2e7e207df9a9\") "
Jul 26 16:44:20.300460 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.300403    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bd21a728-a63a-458a-9416-2e7e207df9a9" (UID: "bd21a728-a63a-458a-9416-2e7e207df9a9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:44:20.300460 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.300419    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bd21a728-a63a-458a-9416-2e7e207df9a9" (UID: "bd21a728-a63a-458a-9416-2e7e207df9a9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:44:20.300576 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.300535    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bd21a728-a63a-458a-9416-2e7e207df9a9" (UID: "bd21a728-a63a-458a-9416-2e7e207df9a9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:44:20.300702 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.300680    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-workload-certs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:44:20.300795 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.300705    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd21a728-a63a-458a-9416-2e7e207df9a9-istiod-ca-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:44:20.300795 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.300719    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-workload-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:44:20.300795 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.300732    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-credential-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:44:20.301070 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.301045    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-data" (OuterVolumeSpecName: "istio-data") pod "bd21a728-a63a-458a-9416-2e7e207df9a9" (UID: "bd21a728-a63a-458a-9416-2e7e207df9a9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:44:20.302110 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.302081    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bd21a728-a63a-458a-9416-2e7e207df9a9" (UID: "bd21a728-a63a-458a-9416-2e7e207df9a9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:44:20.302250 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.302236    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd21a728-a63a-458a-9416-2e7e207df9a9-kube-api-access-4ct9x" (OuterVolumeSpecName: "kube-api-access-4ct9x") pod "bd21a728-a63a-458a-9416-2e7e207df9a9" (UID: "bd21a728-a63a-458a-9416-2e7e207df9a9"). InnerVolumeSpecName "kube-api-access-4ct9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:44:20.302308 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.302272    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-token" (OuterVolumeSpecName: "istio-token") pod "bd21a728-a63a-458a-9416-2e7e207df9a9" (UID: "bd21a728-a63a-458a-9416-2e7e207df9a9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:44:20.302887 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.302868    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bd21a728-a63a-458a-9416-2e7e207df9a9" (UID: "bd21a728-a63a-458a-9416-2e7e207df9a9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 16:44:20.401430 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.401403    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-envoy\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:44:20.401430 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.401430    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-podinfo\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:44:20.401603 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.401443    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ct9x\" (UniqueName: \"kubernetes.io/projected/bd21a728-a63a-458a-9416-2e7e207df9a9-kube-api-access-4ct9x\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:44:20.401603 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.401455    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-data\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:44:20.401603 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.401467    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd21a728-a63a-458a-9416-2e7e207df9a9-istio-token\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:44:20.550442 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.550367    2556 generic.go:356] "Generic (PLEG): container finished" podID="bd21a728-a63a-458a-9416-2e7e207df9a9" containerID="f4f4bbdd3a331419aaed1f6a4c8e4112e54e67739c4d0bc308c7e98571145a97" exitCode=0
Jul 26 16:44:20.550442 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.550415    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"
Jul 26 16:44:20.550688 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.550460    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg" event={"ID":"bd21a728-a63a-458a-9416-2e7e207df9a9","Type":"ContainerDied","Data":"f4f4bbdd3a331419aaed1f6a4c8e4112e54e67739c4d0bc308c7e98571145a97"}
Jul 26 16:44:20.550688 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.550521    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg" event={"ID":"bd21a728-a63a-458a-9416-2e7e207df9a9","Type":"ContainerDied","Data":"1ecf19c13e3896b36b1fc60d3094fea030d6476c9d1d8e3c30b24ecd32cb509c"}
Jul 26 16:44:20.550688 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.550553    2556 scope.go:117] "RemoveContainer" containerID="f4f4bbdd3a331419aaed1f6a4c8e4112e54e67739c4d0bc308c7e98571145a97"
Jul 26 16:44:20.560835 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.560820    2556 scope.go:117] "RemoveContainer" containerID="d3a7bee6d67ee564143466361eb024fbff71430ff37f7089804a9b67ce18ef2c"
Jul 26 16:44:20.569060 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.569044    2556 scope.go:117] "RemoveContainer" containerID="f4f4bbdd3a331419aaed1f6a4c8e4112e54e67739c4d0bc308c7e98571145a97"
Jul 26 16:44:20.569304 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:44:20.569286    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4f4bbdd3a331419aaed1f6a4c8e4112e54e67739c4d0bc308c7e98571145a97\": container with ID starting with f4f4bbdd3a331419aaed1f6a4c8e4112e54e67739c4d0bc308c7e98571145a97 not found: ID does not exist" containerID="f4f4bbdd3a331419aaed1f6a4c8e4112e54e67739c4d0bc308c7e98571145a97"
Jul 26 16:44:20.569345 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.569314    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4f4bbdd3a331419aaed1f6a4c8e4112e54e67739c4d0bc308c7e98571145a97"} err="failed to get container status \"f4f4bbdd3a331419aaed1f6a4c8e4112e54e67739c4d0bc308c7e98571145a97\": rpc error: code = NotFound desc = could not find container \"f4f4bbdd3a331419aaed1f6a4c8e4112e54e67739c4d0bc308c7e98571145a97\": container with ID starting with f4f4bbdd3a331419aaed1f6a4c8e4112e54e67739c4d0bc308c7e98571145a97 not found: ID does not exist"
Jul 26 16:44:20.569345 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.569331    2556 scope.go:117] "RemoveContainer" containerID="d3a7bee6d67ee564143466361eb024fbff71430ff37f7089804a9b67ce18ef2c"
Jul 26 16:44:20.569546 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:44:20.569529    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3a7bee6d67ee564143466361eb024fbff71430ff37f7089804a9b67ce18ef2c\": container with ID starting with d3a7bee6d67ee564143466361eb024fbff71430ff37f7089804a9b67ce18ef2c not found: ID does not exist" containerID="d3a7bee6d67ee564143466361eb024fbff71430ff37f7089804a9b67ce18ef2c"
Jul 26 16:44:20.569579 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.569551    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3a7bee6d67ee564143466361eb024fbff71430ff37f7089804a9b67ce18ef2c"} err="failed to get container status \"d3a7bee6d67ee564143466361eb024fbff71430ff37f7089804a9b67ce18ef2c\": rpc error: code = NotFound desc = could not find container \"d3a7bee6d67ee564143466361eb024fbff71430ff37f7089804a9b67ce18ef2c\": container with ID starting with d3a7bee6d67ee564143466361eb024fbff71430ff37f7089804a9b67ce18ef2c not found: ID does not exist"
Jul 26 16:44:20.579909 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.579888    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"]
Jul 26 16:44:20.582921 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:20.582901    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-76272d-openshift-default-7ddf8894bd-s2sbg"]
Jul 26 16:44:22.215656 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:22.215593    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd21a728-a63a-458a-9416-2e7e207df9a9" path="/var/lib/kubelet/pods/bd21a728-a63a-458a-9416-2e7e207df9a9/volumes"
Jul 26 16:44:26.325403 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:26.325368    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-99124e-29751390-nq6b7"]
Jul 26 16:44:26.338807 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:26.338772    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-99124e-29751390-nq6b7"]
Jul 26 16:44:28.215524 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:28.215490    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04ece964-5931-442c-b0d4-69f4011aaf36" path="/var/lib/kubelet/pods/04ece964-5931-442c-b0d4-69f4011aaf36/volumes"
Jul 26 16:44:30.402624 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:30.402591    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-99124e-nzgxr"]
Jul 26 16:44:30.406079 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:30.406051    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-99124e-nzgxr"]
Jul 26 16:44:32.216643 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:32.216606    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d741ceb-1780-4c70-974e-a54378338c32" path="/var/lib/kubelet/pods/2d741ceb-1780-4c70-974e-a54378338c32/volumes"
Jul 26 16:44:37.608577 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:37.608547    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"]
Jul 26 16:44:37.608989 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:37.608816    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q" podUID="da1fa1c5-d7bc-48d9-b455-93b0037fca5f" containerName="istio-proxy" containerID="cri-o://f2228dcbcddd44d030a6025fe186a3553ad29148ee0c2f018639718ea7d48aa4" gracePeriod=30
Jul 26 16:44:42.859276 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.859246    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:44:42.974994 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.974955    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-token\") pod \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") "
Jul 26 16:44:42.975198 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.975002    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-workload-certs\") pod \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") "
Jul 26 16:44:42.975198 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.975041    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istiod-ca-cert\") pod \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") "
Jul 26 16:44:42.975198 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.975076    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-podinfo\") pod \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") "
Jul 26 16:44:42.975198 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.975113    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-credential-socket\") pod \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") "
Jul 26 16:44:42.975198 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.975133    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-envoy\") pod \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") "
Jul 26 16:44:42.975473 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.975214    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpzj8\" (UniqueName: \"kubernetes.io/projected/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-kube-api-access-wpzj8\") pod \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") "
Jul 26 16:44:42.975473 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.975286    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-workload-socket\") pod \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") "
Jul 26 16:44:42.975473 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.975348    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-data\") pod \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\" (UID: \"da1fa1c5-d7bc-48d9-b455-93b0037fca5f\") "
Jul 26 16:44:42.975473 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.975375    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "da1fa1c5-d7bc-48d9-b455-93b0037fca5f" (UID: "da1fa1c5-d7bc-48d9-b455-93b0037fca5f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:44:42.975473 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.975451    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "da1fa1c5-d7bc-48d9-b455-93b0037fca5f" (UID: "da1fa1c5-d7bc-48d9-b455-93b0037fca5f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:44:42.975793 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.975546    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "da1fa1c5-d7bc-48d9-b455-93b0037fca5f" (UID: "da1fa1c5-d7bc-48d9-b455-93b0037fca5f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:44:42.975793 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.975713    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "da1fa1c5-d7bc-48d9-b455-93b0037fca5f" (UID: "da1fa1c5-d7bc-48d9-b455-93b0037fca5f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:44:42.975909 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.975859    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-workload-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:44:42.975909 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.975878    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-workload-certs\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:44:42.975909 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.975892    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istiod-ca-cert\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:44:42.975909 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.975905    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-credential-socket\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:44:42.976446 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.976419    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-data" (OuterVolumeSpecName: "istio-data") pod "da1fa1c5-d7bc-48d9-b455-93b0037fca5f" (UID: "da1fa1c5-d7bc-48d9-b455-93b0037fca5f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:44:42.977328 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.977295    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-kube-api-access-wpzj8" (OuterVolumeSpecName: "kube-api-access-wpzj8") pod "da1fa1c5-d7bc-48d9-b455-93b0037fca5f" (UID: "da1fa1c5-d7bc-48d9-b455-93b0037fca5f"). InnerVolumeSpecName "kube-api-access-wpzj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:44:42.977426 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.977351    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "da1fa1c5-d7bc-48d9-b455-93b0037fca5f" (UID: "da1fa1c5-d7bc-48d9-b455-93b0037fca5f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 16:44:42.977426 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.977380    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-token" (OuterVolumeSpecName: "istio-token") pod "da1fa1c5-d7bc-48d9-b455-93b0037fca5f" (UID: "da1fa1c5-d7bc-48d9-b455-93b0037fca5f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:44:42.977508 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:42.977471    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "da1fa1c5-d7bc-48d9-b455-93b0037fca5f" (UID: "da1fa1c5-d7bc-48d9-b455-93b0037fca5f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:44:43.077124 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:43.077091    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-data\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:44:43.077124 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:43.077119    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-token\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:44:43.077124 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:43.077127    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-podinfo\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:44:43.077364 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:43.077137    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-istio-envoy\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:44:43.077364 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:43.077146    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpzj8\" (UniqueName: \"kubernetes.io/projected/da1fa1c5-d7bc-48d9-b455-93b0037fca5f-kube-api-access-wpzj8\") on node \"ip-10-0-142-224.ec2.internal\" DevicePath \"\""
Jul 26 16:44:43.688283 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:43.688249    2556 generic.go:356] "Generic (PLEG): container finished" podID="da1fa1c5-d7bc-48d9-b455-93b0037fca5f" containerID="f2228dcbcddd44d030a6025fe186a3553ad29148ee0c2f018639718ea7d48aa4" exitCode=0
Jul 26 16:44:43.688473 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:43.688293    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"
Jul 26 16:44:43.688473 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:43.688330    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q" event={"ID":"da1fa1c5-d7bc-48d9-b455-93b0037fca5f","Type":"ContainerDied","Data":"f2228dcbcddd44d030a6025fe186a3553ad29148ee0c2f018639718ea7d48aa4"}
Jul 26 16:44:43.688473 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:43.688387    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q" event={"ID":"da1fa1c5-d7bc-48d9-b455-93b0037fca5f","Type":"ContainerDied","Data":"510b557421eca7f7fe3b0492f0c0a5c6f724ba7e380d04d2e43e38f9764c7483"}
Jul 26 16:44:43.689135 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:43.688416    2556 scope.go:117] "RemoveContainer" containerID="f2228dcbcddd44d030a6025fe186a3553ad29148ee0c2f018639718ea7d48aa4"
Jul 26 16:44:43.698996 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:43.698980    2556 scope.go:117] "RemoveContainer" containerID="67824c68bf6694cbba7c2913505de8a19a34dd29a9d4e3f0b903e59f4e4bdef5"
Jul 26 16:44:43.707314 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:43.707297    2556 scope.go:117] "RemoveContainer" containerID="f2228dcbcddd44d030a6025fe186a3553ad29148ee0c2f018639718ea7d48aa4"
Jul 26 16:44:43.707561 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:44:43.707544    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2228dcbcddd44d030a6025fe186a3553ad29148ee0c2f018639718ea7d48aa4\": container with ID starting with f2228dcbcddd44d030a6025fe186a3553ad29148ee0c2f018639718ea7d48aa4 not found: ID does not exist" containerID="f2228dcbcddd44d030a6025fe186a3553ad29148ee0c2f018639718ea7d48aa4"
Jul 26 16:44:43.707611 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:43.707569    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2228dcbcddd44d030a6025fe186a3553ad29148ee0c2f018639718ea7d48aa4"} err="failed to get container status \"f2228dcbcddd44d030a6025fe186a3553ad29148ee0c2f018639718ea7d48aa4\": rpc error: code = NotFound desc = could not find container \"f2228dcbcddd44d030a6025fe186a3553ad29148ee0c2f018639718ea7d48aa4\": container with ID starting with f2228dcbcddd44d030a6025fe186a3553ad29148ee0c2f018639718ea7d48aa4 not found: ID does not exist"
Jul 26 16:44:43.707611 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:43.707586    2556 scope.go:117] "RemoveContainer" containerID="67824c68bf6694cbba7c2913505de8a19a34dd29a9d4e3f0b903e59f4e4bdef5"
Jul 26 16:44:43.707853 ip-10-0-142-224 kubenswrapper[2556]: E0726 16:44:43.707833    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67824c68bf6694cbba7c2913505de8a19a34dd29a9d4e3f0b903e59f4e4bdef5\": container with ID starting with 67824c68bf6694cbba7c2913505de8a19a34dd29a9d4e3f0b903e59f4e4bdef5 not found: ID does not exist" containerID="67824c68bf6694cbba7c2913505de8a19a34dd29a9d4e3f0b903e59f4e4bdef5"
Jul 26 16:44:43.707904 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:43.707859    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67824c68bf6694cbba7c2913505de8a19a34dd29a9d4e3f0b903e59f4e4bdef5"} err="failed to get container status \"67824c68bf6694cbba7c2913505de8a19a34dd29a9d4e3f0b903e59f4e4bdef5\": rpc error: code = NotFound desc = could not find container \"67824c68bf6694cbba7c2913505de8a19a34dd29a9d4e3f0b903e59f4e4bdef5\": container with ID starting with 67824c68bf6694cbba7c2913505de8a19a34dd29a9d4e3f0b903e59f4e4bdef5 not found: ID does not exist"
Jul 26 16:44:43.725086 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:43.725057    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"]
Jul 26 16:44:43.730748 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:43.730726    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-99124e-openshift-default-84f968b88d-69z5q"]
Jul 26 16:44:44.217747 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:44.217719    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da1fa1c5-d7bc-48d9-b455-93b0037fca5f" path="/var/lib/kubelet/pods/da1fa1c5-d7bc-48d9-b455-93b0037fca5f/volumes"
Jul 26 16:44:44.729942 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:44.729916    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-745bd4f5cc-frtvb_a8211f09-b05e-415a-9831-90a2a00dbb28/copy-manifests/0.log"
Jul 26 16:44:44.743219 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:44.743195    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-745bd4f5cc-frtvb_a8211f09-b05e-415a-9831-90a2a00dbb28/manager/0.log"
Jul 26 16:44:45.576488 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:45.576453    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29751360-lmdpl_75dbe5be-cf40-4d4a-b48a-90c79e22e402/cleanup/0.log"
Jul 26 16:44:45.697146 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:45.697114    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29751375-7zhps_060e8050-752e-4f25-a1c4-1efaf3afded6/cleanup/0.log"
Jul 26 16:44:45.817603 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:45.817572    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29751390-7vqlj_3a8386a3-8fa7-43dd-b101-0107a02aef58/cleanup/0.log"
Jul 26 16:44:46.752344 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:46.752316    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq_b59633d3-22cc-40b2-8c32-fc65e98b3117/util/0.log"
Jul 26 16:44:46.761670 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:46.761646    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq_b59633d3-22cc-40b2-8c32-fc65e98b3117/pull/0.log"
Jul 26 16:44:46.771168 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:46.771111    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq_b59633d3-22cc-40b2-8c32-fc65e98b3117/extract/0.log"
Jul 26 16:44:46.890784 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:46.890747    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2_4c098811-9347-4ed3-a358-71c4d0a897aa/pull/0.log"
Jul 26 16:44:46.902684 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:46.902660    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2_4c098811-9347-4ed3-a358-71c4d0a897aa/extract/0.log"
Jul 26 16:44:46.909714 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:46.909685    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2_4c098811-9347-4ed3-a358-71c4d0a897aa/util/0.log"
Jul 26 16:44:47.033759 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:47.033692    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k_04ab4d29-0afa-40dc-8357-036fa7546c3d/util/0.log"
Jul 26 16:44:47.044543 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:47.044503    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k_04ab4d29-0afa-40dc-8357-036fa7546c3d/pull/0.log"
Jul 26 16:44:47.052138 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:47.052098    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k_04ab4d29-0afa-40dc-8357-036fa7546c3d/extract/0.log"
Jul 26 16:44:47.170897 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:47.170844    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx_6872661b-0123-4227-be44-9d2ed01a38e1/extract/0.log"
Jul 26 16:44:47.178894 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:47.178878    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx_6872661b-0123-4227-be44-9d2ed01a38e1/util/0.log"
Jul 26 16:44:47.196266 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:47.196246    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx_6872661b-0123-4227-be44-9d2ed01a38e1/pull/0.log"
Jul 26 16:44:47.466965 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:47.466922    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-svgpj_164cbe57-419f-427e-9547-b742a7ab7d88/manager/0.log"
Jul 26 16:44:47.589944 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:47.589912    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-t2xm5_2e3a6ac6-d894-41b9-a207-0c4a4db65e2c/manager/0.log"
Jul 26 16:44:47.835746 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:47.835654    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-r75wj_e1e789d4-33c2-41d5-9089-5cac9a911246/registry-server/0.log"
Jul 26 16:44:48.235345 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:48.235320    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lqf2w_6fc36ed8-e14b-4788-970b-68e8d22a685e/manager/0.log"
Jul 26 16:44:48.606867 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:48.606784    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ckltgv_e4e8dc36-8451-4433-a256-6f456b658e80/istio-proxy/0.log"
Jul 26 16:44:49.112603 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:49.112562    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-59pq2_855e112d-785c-45b7-b518-3211bb669afc/istio-proxy/1.log"
Jul 26 16:44:50.125124 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:50.125083    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-rs4dk_b854eea9-79c6-412e-870d-b8704516c0af/main/0.log"
Jul 26 16:44:50.250711 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:50.250682    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhj798_fb2730f2-8cdb-4dba-8d2d-1773b5e6aa33/main/0.log"
Jul 26 16:44:56.637960 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.637927    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5mkcz/must-gather-z5ztt"]
Jul 26 16:44:56.638370 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.638266    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9955432-7851-42bb-8601-2e8461115687" containerName="istio-proxy"
Jul 26 16:44:56.638370 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.638276    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9955432-7851-42bb-8601-2e8461115687" containerName="istio-proxy"
Jul 26 16:44:56.638370 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.638285    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd21a728-a63a-458a-9416-2e7e207df9a9" containerName="istio-proxy"
Jul 26 16:44:56.638370 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.638291    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd21a728-a63a-458a-9416-2e7e207df9a9" containerName="istio-proxy"
Jul 26 16:44:56.638370 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.638301    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d741ceb-1780-4c70-974e-a54378338c32" containerName="revoke-keys"
Jul 26 16:44:56.638370 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.638307    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d741ceb-1780-4c70-974e-a54378338c32" containerName="revoke-keys"
Jul 26 16:44:56.638370 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.638317    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da1fa1c5-d7bc-48d9-b455-93b0037fca5f" containerName="istio-proxy"
Jul 26 16:44:56.638370 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.638322    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="da1fa1c5-d7bc-48d9-b455-93b0037fca5f" containerName="istio-proxy"
Jul 26 16:44:56.638370 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.638335    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da1fa1c5-d7bc-48d9-b455-93b0037fca5f" containerName="istio-proxy"
Jul 26 16:44:56.638370 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.638341    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="da1fa1c5-d7bc-48d9-b455-93b0037fca5f" containerName="istio-proxy"
Jul 26 16:44:56.638772 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.638394    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd21a728-a63a-458a-9416-2e7e207df9a9" containerName="istio-proxy"
Jul 26 16:44:56.638772 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.638402    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d741ceb-1780-4c70-974e-a54378338c32" containerName="revoke-keys"
Jul 26 16:44:56.638772 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.638407    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd21a728-a63a-458a-9416-2e7e207df9a9" containerName="istio-proxy"
Jul 26 16:44:56.638772 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.638414    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="da1fa1c5-d7bc-48d9-b455-93b0037fca5f" containerName="istio-proxy"
Jul 26 16:44:56.638772 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.638482    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd21a728-a63a-458a-9416-2e7e207df9a9" containerName="istio-proxy"
Jul 26 16:44:56.638772 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.638489    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd21a728-a63a-458a-9416-2e7e207df9a9" containerName="istio-proxy"
Jul 26 16:44:56.638772 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.638542    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="da1fa1c5-d7bc-48d9-b455-93b0037fca5f" containerName="istio-proxy"
Jul 26 16:44:56.641641 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.641614    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5mkcz/must-gather-z5ztt"
Jul 26 16:44:56.648218 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.648065    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5mkcz\"/\"kube-root-ca.crt\""
Jul 26 16:44:56.648535 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.648517    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5mkcz\"/\"default-dockercfg-bdkcf\""
Jul 26 16:44:56.648840 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.648818    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5mkcz\"/\"openshift-service-ca.crt\""
Jul 26 16:44:56.666538 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.666514    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5mkcz/must-gather-z5ztt"]
Jul 26 16:44:56.781030 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.781004    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d356fdb6-d209-4a31-b9ec-d364a4f653f3-must-gather-output\") pod \"must-gather-z5ztt\" (UID: \"d356fdb6-d209-4a31-b9ec-d364a4f653f3\") " pod="openshift-must-gather-5mkcz/must-gather-z5ztt"
Jul 26 16:44:56.781138 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.781082    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tksqz\" (UniqueName: \"kubernetes.io/projected/d356fdb6-d209-4a31-b9ec-d364a4f653f3-kube-api-access-tksqz\") pod \"must-gather-z5ztt\" (UID: \"d356fdb6-d209-4a31-b9ec-d364a4f653f3\") " pod="openshift-must-gather-5mkcz/must-gather-z5ztt"
Jul 26 16:44:56.881874 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.881843    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tksqz\" (UniqueName: \"kubernetes.io/projected/d356fdb6-d209-4a31-b9ec-d364a4f653f3-kube-api-access-tksqz\") pod \"must-gather-z5ztt\" (UID: \"d356fdb6-d209-4a31-b9ec-d364a4f653f3\") " pod="openshift-must-gather-5mkcz/must-gather-z5ztt"
Jul 26 16:44:56.882030 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.881885    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d356fdb6-d209-4a31-b9ec-d364a4f653f3-must-gather-output\") pod \"must-gather-z5ztt\" (UID: \"d356fdb6-d209-4a31-b9ec-d364a4f653f3\") " pod="openshift-must-gather-5mkcz/must-gather-z5ztt"
Jul 26 16:44:56.882208 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.882190    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d356fdb6-d209-4a31-b9ec-d364a4f653f3-must-gather-output\") pod \"must-gather-z5ztt\" (UID: \"d356fdb6-d209-4a31-b9ec-d364a4f653f3\") " pod="openshift-must-gather-5mkcz/must-gather-z5ztt"
Jul 26 16:44:56.901769 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.901696    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tksqz\" (UniqueName: \"kubernetes.io/projected/d356fdb6-d209-4a31-b9ec-d364a4f653f3-kube-api-access-tksqz\") pod \"must-gather-z5ztt\" (UID: \"d356fdb6-d209-4a31-b9ec-d364a4f653f3\") " pod="openshift-must-gather-5mkcz/must-gather-z5ztt"
Jul 26 16:44:56.950812 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:56.950788    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5mkcz/must-gather-z5ztt"
Jul 26 16:44:57.098991 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:57.098962    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5mkcz/must-gather-z5ztt"]
Jul 26 16:44:57.101111 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:44:57.101085    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd356fdb6_d209_4a31_b9ec_d364a4f653f3.slice/crio-a038cc177cd7d6e5c2624221802dcab229b4b509e5427ac39b3a4782b0745cad WatchSource:0}: Error finding container a038cc177cd7d6e5c2624221802dcab229b4b509e5427ac39b3a4782b0745cad: Status 404 returned error can't find the container with id a038cc177cd7d6e5c2624221802dcab229b4b509e5427ac39b3a4782b0745cad
Jul 26 16:44:57.102979 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:57.102957    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 16:44:57.768067 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:57.768028    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5mkcz/must-gather-z5ztt" event={"ID":"d356fdb6-d209-4a31-b9ec-d364a4f653f3","Type":"ContainerStarted","Data":"a038cc177cd7d6e5c2624221802dcab229b4b509e5427ac39b3a4782b0745cad"}
Jul 26 16:44:58.778402 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:58.778364    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5mkcz/must-gather-z5ztt" event={"ID":"d356fdb6-d209-4a31-b9ec-d364a4f653f3","Type":"ContainerStarted","Data":"1857c6254093a87e6d47e97024fa07bd9d6640eb976e00663c06d7feffcdaa34"}
Jul 26 16:44:58.778850 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:58.778417    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5mkcz/must-gather-z5ztt" event={"ID":"d356fdb6-d209-4a31-b9ec-d364a4f653f3","Type":"ContainerStarted","Data":"78f11df512610e72c7b141d51ff864cba7b39d3402cdcb8d6f1b11371deb2920"}
Jul 26 16:44:58.804990 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:58.804935    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5mkcz/must-gather-z5ztt" podStartSLOduration=1.961466715 podStartE2EDuration="2.804915963s" totalImagesPullingTime="843.449248ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:44:58.800354726 +0000 UTC m=+3295.018981775" watchObservedRunningTime="2026-07-26 16:44:58.804915963 +0000 UTC m=+3295.023543017"
Jul 26 16:44:59.767932 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:59.767901    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n7rxf_d15f46dd-2ac8-4355-bb37-d19f8837deda/global-pull-secret-syncer/0.log"
Jul 26 16:44:59.879243 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:44:59.879213    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vqkl6_8710b2c4-8507-4879-aa1f-a677175fcd6e/konnectivity-agent/0.log"
Jul 26 16:45:00.034201 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:00.034125    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-224.ec2.internal_d2eb1ec8e8cd2f3930f67ac8058bec51/haproxy/0.log"
Jul 26 16:45:00.149011 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:00.148978    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29751405-6gb6s"]
Jul 26 16:45:00.155609 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:00.155583    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751405-6gb6s"
Jul 26 16:45:00.159194 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:00.159173    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlwwk\""
Jul 26 16:45:00.162162 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:00.162133    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29751405-6gb6s"]
Jul 26 16:45:00.169650 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:00.169616    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751405-6gb6s"
Jul 26 16:45:00.363830 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:00.359011    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29751405-6gb6s"]
Jul 26 16:45:00.795008 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:00.794966    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751405-6gb6s" event={"ID":"aa1c1f42-2cdf-4aec-9c7a-23381803b3d7","Type":"ContainerStarted","Data":"9eeb3365e28fd41125115411dc2aa3cbc426bc4168350b4795c10bdc35efa7e9"}
Jul 26 16:45:00.795185 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:00.795037    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751405-6gb6s" event={"ID":"aa1c1f42-2cdf-4aec-9c7a-23381803b3d7","Type":"ContainerStarted","Data":"584ec15e2be5f039df658e8a2db70bb3301738ea04a0165ceafa1e22921f4232"}
Jul 26 16:45:00.813812 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:00.813739    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751405-6gb6s" podStartSLOduration=0.813718613 podStartE2EDuration="813.718613ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:45:00.813532015 +0000 UTC m=+3297.032159065" watchObservedRunningTime="2026-07-26 16:45:00.813718613 +0000 UTC m=+3297.032345661"
Jul 26 16:45:01.808598 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:01.808556    2556 generic.go:356] "Generic (PLEG): container finished" podID="aa1c1f42-2cdf-4aec-9c7a-23381803b3d7" containerID="9eeb3365e28fd41125115411dc2aa3cbc426bc4168350b4795c10bdc35efa7e9" exitCode=0
Jul 26 16:45:01.809153 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:01.808623    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751405-6gb6s" event={"ID":"aa1c1f42-2cdf-4aec-9c7a-23381803b3d7","Type":"ContainerDied","Data":"9eeb3365e28fd41125115411dc2aa3cbc426bc4168350b4795c10bdc35efa7e9"}
Jul 26 16:45:03.156656 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:03.154027    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751405-6gb6s"
Jul 26 16:45:03.829859 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:03.829829    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751405-6gb6s"
Jul 26 16:45:03.835708 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:03.835674    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751405-6gb6s" event={"ID":"aa1c1f42-2cdf-4aec-9c7a-23381803b3d7","Type":"ContainerDied","Data":"584ec15e2be5f039df658e8a2db70bb3301738ea04a0165ceafa1e22921f4232"}
Jul 26 16:45:03.835873 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:03.835735    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="584ec15e2be5f039df658e8a2db70bb3301738ea04a0165ceafa1e22921f4232"
Jul 26 16:45:03.992425 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:03.992392    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq_b59633d3-22cc-40b2-8c32-fc65e98b3117/extract/0.log"
Jul 26 16:45:04.105494 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:04.105406    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq_b59633d3-22cc-40b2-8c32-fc65e98b3117/util/0.log"
Jul 26 16:45:04.243152 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:04.242007    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759grbxq_b59633d3-22cc-40b2-8c32-fc65e98b3117/pull/0.log"
Jul 26 16:45:04.294147 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:04.294115    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29751360-lmdpl"]
Jul 26 16:45:04.302665 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:04.302615    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29751360-lmdpl"]
Jul 26 16:45:04.318009 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:04.317982    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2_4c098811-9347-4ed3-a358-71c4d0a897aa/extract/0.log"
Jul 26 16:45:04.390344 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:04.390259    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2_4c098811-9347-4ed3-a358-71c4d0a897aa/util/0.log"
Jul 26 16:45:04.420045 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:04.420014    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07hck2_4c098811-9347-4ed3-a358-71c4d0a897aa/pull/0.log"
Jul 26 16:45:04.469594 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:04.469558    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k_04ab4d29-0afa-40dc-8357-036fa7546c3d/extract/0.log"
Jul 26 16:45:04.517973 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:04.517935    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k_04ab4d29-0afa-40dc-8357-036fa7546c3d/util/0.log"
Jul 26 16:45:04.551193 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:04.551162    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73wvj9k_04ab4d29-0afa-40dc-8357-036fa7546c3d/pull/0.log"
Jul 26 16:45:04.611236 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:04.611208    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx_6872661b-0123-4227-be44-9d2ed01a38e1/extract/0.log"
Jul 26 16:45:04.684969 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:04.684936    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx_6872661b-0123-4227-be44-9d2ed01a38e1/util/0.log"
Jul 26 16:45:04.722492 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:04.722425    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vw8fx_6872661b-0123-4227-be44-9d2ed01a38e1/pull/0.log"
Jul 26 16:45:04.845846 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:04.845814    2556 scope.go:117] "RemoveContainer" containerID="755cac44b18b64925590f586697ad9d1f405c9407fc66a5dd6ac6442ff263dc0"
Jul 26 16:45:04.859259 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:04.859230    2556 scope.go:117] "RemoveContainer" containerID="188ae14879860191192691877127444731260c55fe37f541f4267e7781eafc7f"
Jul 26 16:45:04.948836 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:04.948767    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 16:45:04.955924 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:04.955896    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 16:45:05.361977 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:05.361871    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-svgpj_164cbe57-419f-427e-9547-b742a7ab7d88/manager/0.log"
Jul 26 16:45:05.401604 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:05.401569    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-t2xm5_2e3a6ac6-d894-41b9-a207-0c4a4db65e2c/manager/0.log"
Jul 26 16:45:05.491658 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:05.491602    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-r75wj_e1e789d4-33c2-41d5-9089-5cac9a911246/registry-server/0.log"
Jul 26 16:45:05.905084 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:05.904589    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lqf2w_6fc36ed8-e14b-4788-970b-68e8d22a685e/manager/0.log"
Jul 26 16:45:06.219777 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:06.219745    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75dbe5be-cf40-4d4a-b48a-90c79e22e402" path="/var/lib/kubelet/pods/75dbe5be-cf40-4d4a-b48a-90c79e22e402/volumes"
Jul 26 16:45:07.817039 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:07.817013    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5df65dc5f6-2b48q_70ad4440-0d0f-4f94-beef-b9228ec387b1/metrics-server/0.log"
Jul 26 16:45:08.097235 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:08.097144    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wgbxw_fd481fc9-48ca-4d26-8c45-7b13791b10c5/node-exporter/0.log"
Jul 26 16:45:08.123101 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:08.123067    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wgbxw_fd481fc9-48ca-4d26-8c45-7b13791b10c5/kube-rbac-proxy/0.log"
Jul 26 16:45:08.148695 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:08.148660    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wgbxw_fd481fc9-48ca-4d26-8c45-7b13791b10c5/init-textfile/0.log"
Jul 26 16:45:08.196067 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:08.196027    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-knb9r_2e6da54f-9956-44d1-aaf9-17d2b3862808/kube-rbac-proxy-main/0.log"
Jul 26 16:45:08.227313 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:08.227286    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-knb9r_2e6da54f-9956-44d1-aaf9-17d2b3862808/kube-rbac-proxy-self/0.log"
Jul 26 16:45:08.255602 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:08.255565    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-knb9r_2e6da54f-9956-44d1-aaf9-17d2b3862808/openshift-state-metrics/0.log"
Jul 26 16:45:08.583184 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:08.583157    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-l5kkx_9cb4b24e-83a8-4911-91e5-7ebcf5c6e74f/prometheus-operator-admission-webhook/0.log"
Jul 26 16:45:09.444868 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.444825    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"]
Jul 26 16:45:09.446659 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.446618    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa1c1f42-2cdf-4aec-9c7a-23381803b3d7" containerName="cleanup"
Jul 26 16:45:09.446822 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.446810    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa1c1f42-2cdf-4aec-9c7a-23381803b3d7" containerName="cleanup"
Jul 26 16:45:09.447031 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.447019    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa1c1f42-2cdf-4aec-9c7a-23381803b3d7" containerName="cleanup"
Jul 26 16:45:09.454744 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.454710    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"
Jul 26 16:45:09.467042 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.467008    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"]
Jul 26 16:45:09.525065 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.524920    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8dcfc381-148b-46be-b1ce-e258cddad043-proc\") pod \"perf-node-gather-daemonset-whjvj\" (UID: \"8dcfc381-148b-46be-b1ce-e258cddad043\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"
Jul 26 16:45:09.525065 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.524962    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8dcfc381-148b-46be-b1ce-e258cddad043-podres\") pod \"perf-node-gather-daemonset-whjvj\" (UID: \"8dcfc381-148b-46be-b1ce-e258cddad043\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"
Jul 26 16:45:09.525313 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.525076    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8dcfc381-148b-46be-b1ce-e258cddad043-lib-modules\") pod \"perf-node-gather-daemonset-whjvj\" (UID: \"8dcfc381-148b-46be-b1ce-e258cddad043\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"
Jul 26 16:45:09.525313 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.525139    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8dcfc381-148b-46be-b1ce-e258cddad043-sys\") pod \"perf-node-gather-daemonset-whjvj\" (UID: \"8dcfc381-148b-46be-b1ce-e258cddad043\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"
Jul 26 16:45:09.525313 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.525162    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk4d5\" (UniqueName: \"kubernetes.io/projected/8dcfc381-148b-46be-b1ce-e258cddad043-kube-api-access-qk4d5\") pod \"perf-node-gather-daemonset-whjvj\" (UID: \"8dcfc381-148b-46be-b1ce-e258cddad043\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"
Jul 26 16:45:09.626685 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.626643    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8dcfc381-148b-46be-b1ce-e258cddad043-sys\") pod \"perf-node-gather-daemonset-whjvj\" (UID: \"8dcfc381-148b-46be-b1ce-e258cddad043\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"
Jul 26 16:45:09.626945 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.626922    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk4d5\" (UniqueName: \"kubernetes.io/projected/8dcfc381-148b-46be-b1ce-e258cddad043-kube-api-access-qk4d5\") pod \"perf-node-gather-daemonset-whjvj\" (UID: \"8dcfc381-148b-46be-b1ce-e258cddad043\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"
Jul 26 16:45:09.627133 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.627115    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8dcfc381-148b-46be-b1ce-e258cddad043-proc\") pod \"perf-node-gather-daemonset-whjvj\" (UID: \"8dcfc381-148b-46be-b1ce-e258cddad043\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"
Jul 26 16:45:09.627260 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.627247    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8dcfc381-148b-46be-b1ce-e258cddad043-podres\") pod \"perf-node-gather-daemonset-whjvj\" (UID: \"8dcfc381-148b-46be-b1ce-e258cddad043\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"
Jul 26 16:45:09.627380 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.627358    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8dcfc381-148b-46be-b1ce-e258cddad043-proc\") pod \"perf-node-gather-daemonset-whjvj\" (UID: \"8dcfc381-148b-46be-b1ce-e258cddad043\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"
Jul 26 16:45:09.627551 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.627426    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8dcfc381-148b-46be-b1ce-e258cddad043-lib-modules\") pod \"perf-node-gather-daemonset-whjvj\" (UID: \"8dcfc381-148b-46be-b1ce-e258cddad043\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"
Jul 26 16:45:09.627741 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.627557    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8dcfc381-148b-46be-b1ce-e258cddad043-lib-modules\") pod \"perf-node-gather-daemonset-whjvj\" (UID: \"8dcfc381-148b-46be-b1ce-e258cddad043\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"
Jul 26 16:45:09.627855 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.627622    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8dcfc381-148b-46be-b1ce-e258cddad043-podres\") pod \"perf-node-gather-daemonset-whjvj\" (UID: \"8dcfc381-148b-46be-b1ce-e258cddad043\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"
Jul 26 16:45:09.627946 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.626752    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8dcfc381-148b-46be-b1ce-e258cddad043-sys\") pod \"perf-node-gather-daemonset-whjvj\" (UID: \"8dcfc381-148b-46be-b1ce-e258cddad043\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"
Jul 26 16:45:09.645702 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.645674    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk4d5\" (UniqueName: \"kubernetes.io/projected/8dcfc381-148b-46be-b1ce-e258cddad043-kube-api-access-qk4d5\") pod \"perf-node-gather-daemonset-whjvj\" (UID: \"8dcfc381-148b-46be-b1ce-e258cddad043\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"
Jul 26 16:45:09.769469 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.769388    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"
Jul 26 16:45:09.969894 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:09.967442    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"]
Jul 26 16:45:09.978445 ip-10-0-142-224 kubenswrapper[2556]: W0726 16:45:09.978386    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8dcfc381_148b_46be_b1ce_e258cddad043.slice/crio-7f700bc74274db501aa0656d097324f803c2e2c977e56c07fe18bb3ff4620c88 WatchSource:0}: Error finding container 7f700bc74274db501aa0656d097324f803c2e2c977e56c07fe18bb3ff4620c88: Status 404 returned error can't find the container with id 7f700bc74274db501aa0656d097324f803c2e2c977e56c07fe18bb3ff4620c88
Jul 26 16:45:10.066542 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:10.066518    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-v8n2s_a22e8189-a58c-45ac-ba41-90287a24e285/networking-console-plugin/0.log"
Jul 26 16:45:10.687239 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:10.687204    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/1.log"
Jul 26 16:45:10.694964 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:10.694940    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-l6wf6_236dfe0e-0806-441e-8059-3ddde7696714/console-operator/2.log"
Jul 26 16:45:10.891775 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:10.891740    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj" event={"ID":"8dcfc381-148b-46be-b1ce-e258cddad043","Type":"ContainerStarted","Data":"1e74c8d237c900f1cdabfcb10babde99e046c0b92bbf0a112eb37b8e74577813"}
Jul 26 16:45:10.892084 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:10.892039    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"
Jul 26 16:45:10.892278 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:10.892252    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj" event={"ID":"8dcfc381-148b-46be-b1ce-e258cddad043","Type":"ContainerStarted","Data":"7f700bc74274db501aa0656d097324f803c2e2c977e56c07fe18bb3ff4620c88"}
Jul 26 16:45:10.913410 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:10.913366    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj" podStartSLOduration=1.9133544869999999 podStartE2EDuration="1.913354487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 16:45:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:45:10.912806277 +0000 UTC m=+3307.131433326" watchObservedRunningTime="2026-07-26 16:45:10.913354487 +0000 UTC m=+3307.131981536"
Jul 26 16:45:11.198047 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:11.198014    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65b99cfb6c-2dj4m_ad9b0273-d6ff-4a7c-9e4a-e058318994b5/console/0.log"
Jul 26 16:45:11.892751 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:11.892713    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-v6msr_5f18633e-f0a8-494c-8f26-6ba7f55ebf6c/volume-data-source-validator/0.log"
Jul 26 16:45:13.295316 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:13.295284    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pp2wf_7dea8064-f342-461c-b4e9-ad71f3c7b9dc/dns/0.log"
Jul 26 16:45:13.330419 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:13.330388    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pp2wf_7dea8064-f342-461c-b4e9-ad71f3c7b9dc/kube-rbac-proxy/0.log"
Jul 26 16:45:13.464136 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:13.464107    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xcj2r_8ff4109f-26ad-4a48-94d2-05f67fb8bbc2/dns-node-resolver/0.log"
Jul 26 16:45:14.237897 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:14.237868    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tp5k8_e2c0e7ad-45f1-4542-9a7e-272eb322c490/node-ca/0.log"
Jul 26 16:45:15.336038 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:15.336001    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ckltgv_e4e8dc36-8451-4433-a256-6f456b658e80/istio-proxy/0.log"
Jul 26 16:45:15.574769 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:15.574743    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-59pq2_855e112d-785c-45b7-b518-3211bb669afc/istio-proxy/0.log"
Jul 26 16:45:15.606444 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:15.606383    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-59pq2_855e112d-785c-45b7-b518-3211bb669afc/istio-proxy/1.log"
Jul 26 16:45:16.565578 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:16.565554    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b9nfk_456fcf29-3214-47fa-b012-dd304048b677/serve-healthcheck-canary/0.log"
Jul 26 16:45:17.364799 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:17.364771    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xrhpg_2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd/kube-rbac-proxy/0.log"
Jul 26 16:45:17.398220 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:17.398194    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xrhpg_2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd/exporter/0.log"
Jul 26 16:45:17.433973 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:17.433942    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xrhpg_2e4d7be9-efb0-4a11-bf8b-5e59dfb920bd/extractor/0.log"
Jul 26 16:45:17.924036 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:17.924005    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-whjvj"
Jul 26 16:45:19.529443 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:19.529366    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ckltgv_e4e8dc36-8451-4433-a256-6f456b658e80/istio-proxy/0.log"
Jul 26 16:45:19.732425 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:19.732389    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-59pq2_855e112d-785c-45b7-b518-3211bb669afc/istio-proxy/0.log"
Jul 26 16:45:19.770378 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:19.770346    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-59pq2_855e112d-785c-45b7-b518-3211bb669afc/istio-proxy/1.log"
Jul 26 16:45:20.473544 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:20.473518    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-745bd4f5cc-frtvb_a8211f09-b05e-415a-9831-90a2a00dbb28/manager/0.log"
Jul 26 16:45:20.500508 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:20.500475    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-745bd4f5cc-frtvb_a8211f09-b05e-415a-9831-90a2a00dbb28/copy-manifests/0.log"
Jul 26 16:45:21.307694 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:21.307662    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ckltgv_e4e8dc36-8451-4433-a256-6f456b658e80/istio-proxy/0.log"
Jul 26 16:45:21.508900 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:21.508871    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-59pq2_855e112d-785c-45b7-b518-3211bb669afc/istio-proxy/0.log"
Jul 26 16:45:21.545428 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:21.545402    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-59pq2_855e112d-785c-45b7-b518-3211bb669afc/istio-proxy/1.log"
Jul 26 16:45:21.996873 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:21.996816    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-868c8c7ff4-qv5kf_ecced7e1-e9ce-4521-a921-cc97ef311f63/manager/0.log"
Jul 26 16:45:27.331979 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:27.331945    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l_8f82c6eb-6828-438d-88d9-2104fea4f62f/kube-storage-version-migrator-operator/1.log"
Jul 26 16:45:27.332834 ip-10-0-142-224 kubenswrapper[2556]: I0726 16:45:27.332788    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-4qc4l_8f82c6eb-6828-438d-88d9-2104fea4f62f/kube-storage-version-migrator-operator/0.log"