Jul 23 19:18:00.721687 ip-10-0-141-53 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 23 19:18:00.721702 ip-10-0-141-53 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 23 19:18:00.721712 ip-10-0-141-53 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 23 19:18:00.722014 ip-10-0-141-53 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 23 19:18:10.293851 ip-10-0-141-53 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 23 19:18:10.293865 ip-10-0-141-53 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6adeb581ca6e472f98e8823b113eeee5 --
Jul 23 19:19:59.052605 ip-10-0-141-53 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 19:19:59.555735 ip-10-0-141-53 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 19:19:59.555735 ip-10-0-141-53 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 19:19:59.555735 ip-10-0-141-53 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 19:19:59.555735 ip-10-0-141-53 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 19:19:59.555735 ip-10-0-141-53 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 19:19:59.555735 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.414434    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 19:19:59.555735 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.418974    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 19:19:59.555735 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.418985    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 19:19:59.555735 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.418989    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 19:19:59.555735 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.418992    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 19:19:59.555735 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.418995    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 19:19:59.555735 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.418998    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 19:19:59.555735 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419001    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 19:19:59.555735 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419003    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 19:19:59.485180 ip-10-0-141-53 systemd[1]: Started Kubernetes Kubelet.
Jul 23 19:19:59.557920 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419006    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 19:19:59.557920 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419009    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 19:19:59.557920 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419011    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 19:19:59.557920 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419014    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 19:19:59.557920 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419017    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 19:19:59.557920 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419025    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 19:19:59.557920 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419030    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 19:19:59.557920 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419033    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 19:19:59.557920 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419035    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 19:19:59.557920 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419038    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 19:19:59.557920 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419041    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 19:19:59.557920 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419044    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 19:19:59.557920 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419047    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 19:19:59.557920 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419049    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 19:19:59.557920 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419052    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 19:19:59.557920 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419055    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 19:19:59.557920 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419057    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 19:19:59.557920 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419060    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 19:19:59.557920 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419062    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 19:19:59.557920 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419065    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 19:19:59.560471 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419068    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 19:19:59.560471 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419070    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 19:19:59.560471 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419073    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 19:19:59.560471 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419076    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 19:19:59.560471 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419079    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 19:19:59.560471 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419082    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 19:19:59.560471 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419085    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 19:19:59.560471 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419088    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 19:19:59.560471 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419090    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 19:19:59.560471 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419093    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 19:19:59.560471 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419095    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 19:19:59.560471 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419098    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 19:19:59.560471 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419101    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 19:19:59.560471 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419103    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 19:19:59.560471 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419107    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 19:19:59.560471 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419109    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 19:19:59.560471 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419112    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 19:19:59.560471 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419115    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 19:19:59.560471 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419118    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 19:19:59.560471 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419120    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 19:19:59.583331 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419123    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 19:19:59.583331 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419125    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 19:19:59.583331 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419128    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 19:19:59.583331 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419132    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 19:19:59.583331 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419136    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 19:19:59.583331 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419139    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 19:19:59.583331 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419142    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 19:19:59.583331 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419145    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 19:19:59.583331 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419148    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 19:19:59.583331 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419151    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 19:19:59.583331 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419154    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 19:19:59.583331 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419158    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 19:19:59.583331 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419162    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 19:19:59.583331 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419165    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 19:19:59.583331 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419168    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 19:19:59.583331 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419171    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 19:19:59.583331 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419174    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 19:19:59.583331 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419177    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 19:19:59.583331 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419180    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 19:19:59.584082 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419182    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 19:19:59.584082 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419185    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 19:19:59.584082 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419187    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 19:19:59.584082 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419190    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 19:19:59.584082 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419192    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 19:19:59.584082 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419195    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 19:19:59.584082 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419198    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 19:19:59.584082 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419200    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 19:19:59.584082 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419203    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 19:19:59.584082 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419206    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 19:19:59.584082 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419209    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 19:19:59.584082 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419211    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 19:19:59.584082 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419220    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 19:19:59.584082 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419222    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 19:19:59.584082 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419225    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 19:19:59.584082 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419228    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 19:19:59.584082 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419231    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 19:19:59.584082 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419233    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 19:19:59.584082 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419236    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 19:19:59.584082 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419240    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 19:19:59.603546 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419244    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 19:19:59.603546 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419258    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 19:19:59.603546 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419261    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 19:19:59.603546 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419264    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 19:19:59.603546 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419266    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 19:19:59.603546 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419269    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 19:19:59.603546 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419272    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 19:19:59.603546 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419274    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 19:19:59.603546 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419277    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 19:19:59.603546 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419279    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 19:19:59.603546 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419282    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 19:19:59.603546 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419285    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 19:19:59.603546 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419947    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 19:19:59.603546 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419955    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 19:19:59.603546 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419959    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 19:19:59.603546 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419962    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 19:19:59.603546 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419966    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 19:19:59.603546 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419969    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 19:19:59.603546 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419973    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 19:19:59.604227 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419976    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 19:19:59.604227 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419979    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 19:19:59.604227 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419982    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 19:19:59.604227 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419985    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 19:19:59.604227 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419988    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 19:19:59.604227 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419990    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 19:19:59.604227 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419994    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 19:19:59.604227 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.419997    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 19:19:59.604227 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420000    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 19:19:59.604227 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420002    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 19:19:59.604227 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420005    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 19:19:59.604227 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420008    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 19:19:59.604227 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420010    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 19:19:59.604227 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420013    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 19:19:59.604227 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420017    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 19:19:59.604227 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420020    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 19:19:59.604227 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420023    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 19:19:59.604227 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420025    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 19:19:59.604227 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420028    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 19:19:59.604227 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420030    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 19:19:59.604875 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420033    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 19:19:59.604875 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420035    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 19:19:59.604875 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420038    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 19:19:59.604875 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420041    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 19:19:59.604875 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420043    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 19:19:59.604875 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420046    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 19:19:59.604875 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420049    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 19:19:59.604875 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420051    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 19:19:59.604875 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420055    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 19:19:59.604875 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420059    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 19:19:59.604875 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420062    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 19:19:59.604875 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420065    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 19:19:59.604875 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420068    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 19:19:59.604875 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420072    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 19:19:59.604875 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420075    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 19:19:59.604875 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420078    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 19:19:59.604875 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420081    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 19:19:59.604875 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420083    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 19:19:59.604875 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420088    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 19:19:59.604875 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420091    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 19:19:59.605521 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420093    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 19:19:59.605521 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420096    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 19:19:59.605521 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420099    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 19:19:59.605521 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420101    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 19:19:59.605521 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420116    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 19:19:59.605521 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420119    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 19:19:59.605521 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420122    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 19:19:59.605521 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420124    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 19:19:59.605521 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420127    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 19:19:59.605521 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420129    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 19:19:59.605521 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420132    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 19:19:59.605521 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420134    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 19:19:59.605521 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420137    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 19:19:59.605521 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420139    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 19:19:59.605521 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420142    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 19:19:59.605521 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420144    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 19:19:59.605521 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420147    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 19:19:59.605521 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420150    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 19:19:59.605521 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420152    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 19:19:59.605521 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420155    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 19:19:59.606113 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420157    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 19:19:59.606113 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420160    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 19:19:59.606113 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420162    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 19:19:59.606113 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420165    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 19:19:59.606113 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420167    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 19:19:59.606113 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420172    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 19:19:59.606113 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420175    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 19:19:59.606113 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420177    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 19:19:59.606113 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420181    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 19:19:59.606113 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420183    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 19:19:59.606113 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420187    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 19:19:59.606113 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420190    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 19:19:59.606113 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420193    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 19:19:59.606113 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420196    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 19:19:59.606113 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420198    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 19:19:59.606113 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420201    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 19:19:59.606113 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420203    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 19:19:59.606113 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420206    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 19:19:59.606113 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420208    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 19:19:59.606767 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420211    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 19:19:59.606767 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420213    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 19:19:59.606767 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420216    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 19:19:59.606767 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420218    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 19:19:59.606767 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420221    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 19:19:59.606767 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420223    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 19:19:59.606767 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420226    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 19:19:59.606767 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420228    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 19:19:59.606767 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420231    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 19:19:59.606767 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420233    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 19:19:59.606767 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420236    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 19:19:59.606767 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420239    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 19:19:59.606767 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420241    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 19:19:59.606767 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420598    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 19:19:59.606767 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420603    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 19:19:59.606767 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420606    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 19:19:59.606767 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420608    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 19:19:59.606767 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420612    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 19:19:59.606767 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420616    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 19:19:59.606767 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420619    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 19:19:59.607365 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420621    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 19:19:59.607365 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420624    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 19:19:59.607365 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420627    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 19:19:59.607365 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420630    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 19:19:59.607365 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420633    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 19:19:59.607365 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420636    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 19:19:59.607365 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420639    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 19:19:59.607365 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420641    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 19:19:59.607365 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420644    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 19:19:59.607365 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420647    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 19:19:59.607365 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420649    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 19:19:59.607365 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420652    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 19:19:59.607365 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420654    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 19:19:59.607365 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420657    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 19:19:59.607365 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420659    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 19:19:59.607365 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420662    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 19:19:59.607365 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420664    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 19:19:59.607365 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420666    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 19:19:59.607365 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420669    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 19:19:59.607365 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420672    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 19:19:59.607978 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420674    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 19:19:59.607978 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420677    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 19:19:59.607978 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420679    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 19:19:59.607978 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420682    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 19:19:59.607978 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420685    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 19:19:59.607978 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420687    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 19:19:59.607978 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420690    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 19:19:59.607978 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420692    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 19:19:59.607978 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420695    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 19:19:59.607978 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420697    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 19:19:59.607978 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420701    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 19:19:59.607978 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420703    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 19:19:59.607978 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420708    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 19:19:59.607978 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420712    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 19:19:59.607978 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420715    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 19:19:59.607978 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420719    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 19:19:59.607978 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420722    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 19:19:59.607978 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420725    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 19:19:59.607978 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420728    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 19:19:59.607978 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420731    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 19:19:59.608661 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420733    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 19:19:59.608661 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420736    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 19:19:59.608661 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420738    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 19:19:59.608661 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420741    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 19:19:59.608661 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420743    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 19:19:59.608661 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420746    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 19:19:59.608661 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420748    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 19:19:59.608661 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420751    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 19:19:59.608661 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420753    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 19:19:59.608661 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420756    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 19:19:59.608661 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420758    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 19:19:59.608661 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420761    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 19:19:59.608661 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420763    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 19:19:59.608661 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420766    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 19:19:59.608661 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420769    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 19:19:59.608661 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420771    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 19:19:59.608661 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420774    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 19:19:59.608661 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420776    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 19:19:59.608661 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420779    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 19:19:59.608661 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420781    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 19:19:59.609221 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420784    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 19:19:59.609221 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420786    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 19:19:59.609221 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420790    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 19:19:59.609221 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420793    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 19:19:59.609221 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420795    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 19:19:59.609221 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420798    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 19:19:59.609221 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420800    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 19:19:59.609221 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420804    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 19:19:59.609221 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420807    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 19:19:59.609221 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420809    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 19:19:59.609221 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420813    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 19:19:59.609221 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420817    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 19:19:59.609221 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420820    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 19:19:59.609221 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420823    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 19:19:59.609221 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420825    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 19:19:59.609221 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420829    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 19:19:59.609221 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420831    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 19:19:59.609221 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420834    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 19:19:59.609221 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420837    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 19:19:59.609732 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420839    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 19:19:59.609732 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420843    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 19:19:59.609732 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420846    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 19:19:59.609732 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420849    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 19:19:59.609732 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420852    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 19:19:59.609732 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420855    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 19:19:59.609732 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420857    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 19:19:59.609732 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420860    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 19:19:59.609732 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420862    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 19:19:59.609732 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420865    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 19:19:59.609732 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420867    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 19:19:59.609732 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420870    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 19:19:59.609732 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.420872    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 19:19:59.609732 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.420940    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 19:19:59.609732 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.420946    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 19:19:59.609732 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.420955    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 19:19:59.609732 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.420959    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 19:19:59.609732 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.420964    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 19:19:59.609732 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.420967    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 19:19:59.609732 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.420971    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 19:19:59.609732 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.420976    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.420980    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.420983    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.420986    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.420989    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.420993    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.420996    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.420999    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421002    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421004    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421007    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421011    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421014    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421017    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421020    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421023    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421027    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421030    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421033    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421036    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421039    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421042    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421045    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421048    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 19:19:59.610333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421051    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421055    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421058    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421062    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421065    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421068    2578 flags.go:64] FLAG: --enable-server="true"
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421071    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421075    2578 flags.go:64] FLAG: --event-burst="100"
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421079    2578 flags.go:64] FLAG: --event-qps="50"
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421082    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421085    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421088    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421092    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421095    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421098    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421102    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421104    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421107    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421110    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421113    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421116    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421119    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421121    2578 flags.go:64] FLAG: --feature-gates=""
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421125    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421128    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 19:19:59.610929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421131    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421134    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421137    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421140    2578 flags.go:64] FLAG: --help="false"
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421143    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-141-53.ec2.internal"
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421146    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421149    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421152    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421155    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421158    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421163    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421166    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421169    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421171    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421174    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421178    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421181    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421184    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421187    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421190    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421193    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421196    2578 flags.go:64] FLAG: --lock-file=""
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421199    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421202    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 19:19:59.611680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421205    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421211    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421213    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421216    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421219    2578 flags.go:64] FLAG: --logging-format="text"
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421222    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421225    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421228    2578 flags.go:64] FLAG: --manifest-url=""
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421231    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421235    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421238    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421242    2578 flags.go:64] FLAG: --max-pods="110"
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421244    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421260    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421263    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421266    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421269    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421272    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421276    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421282    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421286    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421289    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421292    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 23 19:19:59.612354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421297    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421302    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421305    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421308    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421312    2578 flags.go:64] FLAG: --port="10250"
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421315    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421318    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-056a9c4fee2733976"
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421321    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421324    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421327    2578 flags.go:64] FLAG: --register-node="true"
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421331    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421334    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421337    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421339    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421342    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421346    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421349    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421352    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421355    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421357    2578 flags.go:64] FLAG: --runonce="false"
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421360    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421363    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421366    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421369    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421371    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421374    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 19:19:59.612998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421377    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421382    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421384    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421387    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421390    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421393    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421395    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421400    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421402    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421407    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421410    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421413    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421417    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421420    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421423    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421426    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421429    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421432    2578 flags.go:64] FLAG: --v="2"
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421436    2578 flags.go:64] FLAG: --version="false"
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421439    2578 flags.go:64] FLAG: --vmodule=""
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421443    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.421446    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421576    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421581    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 19:19:59.613705 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421584    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 19:19:59.787621 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421587    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 19:19:59.787621 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421590    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 19:19:59.787621 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421593    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 19:19:59.787621 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421596    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 19:19:59.787621 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421599    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 19:19:59.787621 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421602    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 19:19:59.787621 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421605    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 19:19:59.787621 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421608    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 19:19:59.787621 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421611    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 19:19:59.787621 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421614    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 19:19:59.787621 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421617    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 19:19:59.787621 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421619    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 19:19:59.787621 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421622    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 19:19:59.787621 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421624    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 19:19:59.787621 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421628    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 19:19:59.787621 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421630    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 19:19:59.787621 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421633    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 19:19:59.787621 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421636    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 19:19:59.787621 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421638    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 19:19:59.787621 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421641    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 19:19:59.788388 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421643    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 19:19:59.788388 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421646    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 19:19:59.788388 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421648    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 19:19:59.788388 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421652    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 19:19:59.788388 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421654    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 19:19:59.788388 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421657    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 19:19:59.788388 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421659    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 19:19:59.788388 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421662    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 19:19:59.788388 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421664    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 19:19:59.788388 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421667    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 19:19:59.788388 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421669    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 19:19:59.788388 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421672    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 19:19:59.788388 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421674    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 19:19:59.788388 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421677    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 19:19:59.788388 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421679    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 19:19:59.788388 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421682    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 19:19:59.788388 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421684    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 19:19:59.788388 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421688    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 19:19:59.788388 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421691    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 19:19:59.788388 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421694    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 19:19:59.788986 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421699    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 19:19:59.788986 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421702    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 19:19:59.788986 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421705    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 19:19:59.788986 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421708    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 19:19:59.788986 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421710    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 19:19:59.788986 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421713    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 19:19:59.788986 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421717    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 19:19:59.788986 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421720    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 19:19:59.788986 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421722    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 19:19:59.788986 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421725    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 19:19:59.788986 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421728    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 19:19:59.788986 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421730    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 19:19:59.788986 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421733    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 19:19:59.788986 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421735    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 19:19:59.788986 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421738    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 19:19:59.788986 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421741    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 19:19:59.788986 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421744    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 19:19:59.788986 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421746    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 19:19:59.788986 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421749    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 19:19:59.789937 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421751    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 19:19:59.789937 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421754    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 19:19:59.789937 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421756    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 19:19:59.789937 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421759    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 19:19:59.789937 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421761    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 19:19:59.789937 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421764    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 19:19:59.789937 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421766    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 19:19:59.789937 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421768    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 19:19:59.789937 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421771    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 19:19:59.789937 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421773    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 19:19:59.789937 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421776    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 19:19:59.789937 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421778    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 19:19:59.789937 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421781    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 19:19:59.789937 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421785    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 19:19:59.789937 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421787    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 19:19:59.789937 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421791    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 19:19:59.789937 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421794    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 19:19:59.789937 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421797    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 19:19:59.789937 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421800    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 19:19:59.790505 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421803    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 19:19:59.790505 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421806    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 19:19:59.790505 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421809    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 19:19:59.790505 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421811    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 19:19:59.790505 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421814    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 19:19:59.790505 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421816    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 19:19:59.790505 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421819    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 19:19:59.790505 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421821    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 19:19:59.790505 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421824    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 19:19:59.790505 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421826    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 19:19:59.790505 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421829    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 19:19:59.790505 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421832    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 19:19:59.790505 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421835    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 19:19:59.790505 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421837    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 19:19:59.790505 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421841    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 19:19:59.790505 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421845    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 19:19:59.790505 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421848    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 19:19:59.790505 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.421851    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 19:19:59.958095 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.422296    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 19:19:59.958095 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.429586    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 19:19:59.958095 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.429603    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 19:19:59.958095 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.429619    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 19:19:59.958095 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.429627    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 19:19:59.958095 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429725    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 19:19:59.958095 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429732    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 19:19:59.958095 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429737    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 19:19:59.958095 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429741    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 19:19:59.958095 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429745    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 19:19:59.958095 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429749    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 19:19:59.958095 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429753    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 19:19:59.958095 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429757    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 19:19:59.958095 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429761    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 19:19:59.958095 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429765    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 19:19:59.959102 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429769    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 19:19:59.959102 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429773    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 19:19:59.959102 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429777    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 19:19:59.959102 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429781    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 19:19:59.959102 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429785    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 19:19:59.959102 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429788    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 19:19:59.959102 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429792    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 19:19:59.959102 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429797    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 19:19:59.959102 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429801    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 19:19:59.959102 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429804    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 19:19:59.959102 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429810    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 19:19:59.959102 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429815    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 19:19:59.959102 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429820    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 19:19:59.959102 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429824    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 19:19:59.959102 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429828    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 19:19:59.959102 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429833    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 19:19:59.959102 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429837    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 19:19:59.959102 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429841    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 19:19:59.959102 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429846    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 19:19:59.959706 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429850    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 19:19:59.959706 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429854    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 19:19:59.959706 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429858    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 19:19:59.959706 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429862    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 19:19:59.959706 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429865    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 19:19:59.959706 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429869    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 19:19:59.959706 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429873    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 19:19:59.959706 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429877    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 19:19:59.959706 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429881    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 19:19:59.959706 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429885    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 19:19:59.959706 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429888    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 19:19:59.959706 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429892    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 19:19:59.959706 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429896    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 19:19:59.959706 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429903    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 19:19:59.959706 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429907    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 19:19:59.959706 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429911    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 19:19:59.959706 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429915    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 19:19:59.959706 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429919    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 19:19:59.959706 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429923    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 19:19:59.959706 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429926    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 19:19:59.960327 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429931    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 19:19:59.960327 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429934    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 19:19:59.960327 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429938    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 19:19:59.960327 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429941    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 19:19:59.960327 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429946    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 19:19:59.960327 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429950    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 19:19:59.960327 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429955    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 19:19:59.960327 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429961    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 19:19:59.960327 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429966    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 19:19:59.960327 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429970    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 19:19:59.960327 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429975    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 19:19:59.960327 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429979    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 19:19:59.960327 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429983    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 19:19:59.960327 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429987    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 19:19:59.960327 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429991    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 19:19:59.960327 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429995    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 19:19:59.960327 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.429999    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 19:19:59.960327 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430024    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 19:19:59.960327 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430030    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 19:19:59.960848 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430035    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 19:19:59.960848 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430039    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 19:19:59.960848 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430043    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 19:19:59.960848 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430047    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 19:19:59.960848 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430051    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 19:19:59.960848 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430055    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 19:19:59.960848 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430061    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 19:19:59.960848 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430067    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 19:19:59.960848 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430070    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 19:19:59.960848 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430074    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 19:19:59.960848 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430078    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 19:19:59.960848 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430082    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 19:19:59.960848 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430086    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 19:19:59.960848 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430090    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 19:19:59.960848 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430094    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 19:19:59.960848 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430098    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 19:19:59.960848 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430101    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 19:19:59.960848 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430105    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 19:19:59.960848 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430109    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 19:19:59.960848 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430113    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 19:19:59.961428 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430116    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 19:19:59.961428 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430120    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 19:19:59.961428 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430124    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 19:19:59.961428 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430128    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 19:19:59.961428 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430132    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 19:19:59.961428 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430138    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 19:19:59.961428 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430143    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 19:19:59.961428 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430147    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 19:19:59.961428 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430151    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 19:19:59.961428 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430154    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 19:19:59.961428 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430158    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 19:19:59.961428 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.430165    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 19:19:59.961428 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430336    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 19:19:59.961428 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430343    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 19:19:59.961428 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430348    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 19:19:59.961837 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430352    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 19:19:59.961837 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430356    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 19:19:59.961837 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430359    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 19:19:59.961837 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430366    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 19:19:59.961837 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430370    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 19:19:59.961837 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430375    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 19:19:59.961837 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430379    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 19:19:59.961837 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430383    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 19:19:59.961837 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430388    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 19:19:59.961837 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430392    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 19:19:59.961837 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430396    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 19:19:59.961837 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430400    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 19:19:59.961837 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430404    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 19:19:59.961837 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430407    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 19:19:59.961837 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430411    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 19:19:59.961837 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430415    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 19:19:59.961837 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430418    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 19:19:59.961837 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430422    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 19:19:59.961837 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430426    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 19:19:59.961837 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430430    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 19:19:59.962429 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430434    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 19:19:59.962429 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430438    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 19:19:59.962429 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430441    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 19:19:59.962429 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430445    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 19:19:59.962429 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430449    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 19:19:59.962429 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430453    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 19:19:59.962429 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430457    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 19:19:59.962429 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430460    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 19:19:59.962429 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430464    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 19:19:59.962429 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430470    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 19:19:59.962429 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430475    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 19:19:59.962429 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430479    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 19:19:59.962429 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430485    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 19:19:59.962429 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430490    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 19:19:59.962429 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430495    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 19:19:59.962429 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430501    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 19:19:59.962429 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430505    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 19:19:59.962429 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430510    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 19:19:59.962429 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430514    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 19:19:59.962936 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430518    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 19:19:59.962936 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430522    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 19:19:59.962936 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430527    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 19:19:59.962936 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430531    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 19:19:59.962936 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430536    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 19:19:59.962936 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430539    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 19:19:59.962936 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430543    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 19:19:59.962936 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430547    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 19:19:59.962936 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430551    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 19:19:59.962936 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430554    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 19:19:59.962936 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430558    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 19:19:59.962936 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430562    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 19:19:59.962936 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430566    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 19:19:59.962936 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430570    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 19:19:59.962936 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430574    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 19:19:59.962936 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430578    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 19:19:59.962936 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430582    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 19:19:59.962936 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430585    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 19:19:59.962936 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430589    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 19:19:59.962936 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430592    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 19:19:59.963496 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430596    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 19:19:59.963496 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430601    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 19:19:59.963496 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430605    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 19:19:59.963496 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430609    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 19:19:59.963496 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430613    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 19:19:59.963496 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430616    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 19:19:59.963496 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430620    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 19:19:59.963496 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430624    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 19:19:59.963496 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430629    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 19:19:59.963496 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430632    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 19:19:59.963496 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430637    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 19:19:59.963496 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430641    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 19:19:59.963496 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430646    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 19:19:59.963496 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430649    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 19:19:59.963496 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430653    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 19:19:59.963496 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430658    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 19:19:59.963496 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430662    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 19:19:59.963496 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430666    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 19:19:59.963496 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430670    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 19:19:59.963496 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430674    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 19:19:59.964023 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430678    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 19:19:59.964023 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430682    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 19:19:59.964023 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430687    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 19:19:59.964023 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430692    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 19:19:59.964023 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430697    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 19:19:59.964023 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430701    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 19:19:59.964023 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430705    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 19:19:59.964023 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430709    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 19:19:59.964023 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430713    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 19:19:59.964023 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430717    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 19:19:59.964023 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430721    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 19:19:59.964023 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430725    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 19:19:59.964023 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430729    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 19:19:59.964023 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430733    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 19:19:59.964023 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430736    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 19:19:59.964023 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430740    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 19:19:59.964023 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:19:59.430744    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 19:19:59.964545 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.430751    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 19:19:59.964545 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.430883    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 19:19:59.964545 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.433218    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 19:19:59.964545 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.434438    2578 server.go:1019] "Starting client certificate rotation"
Jul 23 19:19:59.964545 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.434533    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 19:19:59.964545 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.434567    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 19:19:59.964545 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.437207    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 19:19:59.964545 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.438748    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 19:19:59.964545 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.448202    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 23 19:19:59.964545 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.452304    2578 log.go:25] "Validated CRI v1 image API"
Jul 23 19:19:59.964545 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.453783    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 19:19:59.964545 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.455901    2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 986d3ce9-c5ea-47d1-aae3-a3195c5b6cd1:/dev/nvme0n1p4 bf59fdcc-c380-48e0-838e-8dbf7389e42c:/dev/nvme0n1p3]
Jul 23 19:19:59.964900 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.455918    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 19:19:59.965001 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.463563    2578 manager.go:216] Machine: {Timestamp:2026-07-23 19:19:59.462204212 +0000 UTC m=+0.299210932 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099956 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d4ce8a2dc8c4dabe77972b119e167 SystemUUID:ec2d4ce8-a2dc-8c4d-abe7-7972b119e167 BootID:6adeb581-ca6e-472f-98e8-823b113eeee5 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fa:90:72:f9:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fa:90:72:f9:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:09:ed:ff:83:d4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 19:19:59.965001 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.463696    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 19:19:59.965001 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.463794    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 19:19:59.965001 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.467053    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 19:19:59.965001 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.467086    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-53.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 19:19:59.965001 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.467752    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 19:19:59.965001 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.467762    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 19:19:59.965001 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.467770    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.468531    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.469059    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.469718    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.472516    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.472639    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.472667    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.472682    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.472699    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.472708    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.472717    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.473022    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.473036    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.475385    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.477181    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.477208    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.478182    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.478195    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.478201    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.478207    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.478216    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.478222    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.478230    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.478234    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.478241    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.478246    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.478276    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.478282    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.479678    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.479687    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.483057    2578 server.go:1268] "Started kubelet"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.483154    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.483241    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.483357    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.484875    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.487183    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.487271    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-53.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:19:59.488002    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-53.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:19:59.488010    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 19:19:59.965309 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:19:59.490751    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:19:59.489912    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-53.ec2.internal.18c5016e0c155a6c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-53.ec2.internal,UID:ip-10-0-141-53.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-53.ec2.internal,},FirstTimestamp:2026-07-23 19:19:59.483026028 +0000 UTC m=+0.320032726,LastTimestamp:2026-07-23 19:19:59.483026028 +0000 UTC m=+0.320032726,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-53.ec2.internal,}"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.491380    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.491396    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:19:59.491625    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-53.ec2.internal\" not found"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.491994    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.492448    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.491992    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.492713    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.492744    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.492921    2578 factory.go:55] Registering systemd factory
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.492937    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:19:59.494218    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:19:59.494331    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-53.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.495329    2578 factory.go:153] Registering CRI-O factory
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.495345    2578 factory.go:223] Registration of the crio container factory successfully
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.495400    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.495631    2578 factory.go:103] Registering Raw factory
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.495653    2578 manager.go:1196] Started watching for new ooms in manager
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.496059    2578 manager.go:349] Starting recovery of all containers
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.503355    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.505066    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pb9kp"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.507133    2578 manager.go:354] Recovery completed
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.511632    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.513435    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.513470    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.513484    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeHasSufficientPID"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.514061    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.514070    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.514086    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.514123    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.515326    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.515350    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 19:19:59.966398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.515359    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeHasSufficientPID"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.515620    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pb9kp"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.515715    2578 policy_none.go:49] "None policy: Start"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.515729    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.515739    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:19:59.516130    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-53.ec2.internal.18c5016e0de5a243  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-53.ec2.internal,UID:ip-10-0-141-53.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-53.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-53.ec2.internal,},FirstTimestamp:2026-07-23 19:19:59.513453123 +0000 UTC m=+0.350459821,LastTimestamp:2026-07-23 19:19:59.513453123 +0000 UTC m=+0.350459821,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-53.ec2.internal,}"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.517914    2578 policy_none.go:47] "Start"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.551826    2578 manager.go:337] "Starting Device Plugin manager"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:19:59.551854    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.551864    2578 server.go:87] "Starting device plugin registration server"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.552121    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.552134    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.552226    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.552323    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.552333    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:19:59.552814    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:19:59.552870    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-53.ec2.internal\" not found"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.645069    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.645236    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.645265    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:19:59.645299    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.647755    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.652520    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.654789    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.654819    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.654829    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeHasSufficientPID"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.654851    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-53.ec2.internal"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.664098    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-53.ec2.internal"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:19:59.664149    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-53.ec2.internal\": node \"ip-10-0-141-53.ec2.internal\" not found"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:19:59.692092    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-53.ec2.internal\" not found"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.745715    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-53.ec2.internal"]
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.746394    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 19:19:59.967236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.748665    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.748689    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.748698    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeHasSufficientPID"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.749891    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.750003    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.750042    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.757421    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.757441    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.757456    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeHasSufficientPID"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.758085    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.758106    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.758116    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeHasSufficientPID"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.759295    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-53.ec2.internal"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.759318    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.760024    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.760049    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.760061    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeHasSufficientPID"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:19:59.792793    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-53.ec2.internal\" not found"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:19:59.792977    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-53.ec2.internal\" not found" node="ip-10-0-141-53.ec2.internal"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.793442    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e6a766f128fe58a47aa95c2312516db4-config\") pod \"kube-apiserver-proxy-ip-10-0-141-53.ec2.internal\" (UID: \"e6a766f128fe58a47aa95c2312516db4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-53.ec2.internal"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.793463    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c17e13ee47288c74c89439e877763463-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal\" (UID: \"c17e13ee47288c74c89439e877763463\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.793480    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c17e13ee47288c74c89439e877763463-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal\" (UID: \"c17e13ee47288c74c89439e877763463\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:19:59.797105    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-53.ec2.internal\" not found" node="ip-10-0-141-53.ec2.internal"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:19:59.893275    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-53.ec2.internal\" not found"
Jul 23 19:19:59.968151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.893566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c17e13ee47288c74c89439e877763463-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal\" (UID: \"c17e13ee47288c74c89439e877763463\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal"
Jul 23 19:19:59.968833 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.893586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e6a766f128fe58a47aa95c2312516db4-config\") pod \"kube-apiserver-proxy-ip-10-0-141-53.ec2.internal\" (UID: \"e6a766f128fe58a47aa95c2312516db4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-53.ec2.internal"
Jul 23 19:19:59.968833 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.893602    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c17e13ee47288c74c89439e877763463-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal\" (UID: \"c17e13ee47288c74c89439e877763463\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal"
Jul 23 19:19:59.968833 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.893644    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c17e13ee47288c74c89439e877763463-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal\" (UID: \"c17e13ee47288c74c89439e877763463\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal"
Jul 23 19:19:59.968833 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.893659    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c17e13ee47288c74c89439e877763463-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal\" (UID: \"c17e13ee47288c74c89439e877763463\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal"
Jul 23 19:19:59.968833 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:19:59.893674    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e6a766f128fe58a47aa95c2312516db4-config\") pod \"kube-apiserver-proxy-ip-10-0-141-53.ec2.internal\" (UID: \"e6a766f128fe58a47aa95c2312516db4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-53.ec2.internal"
Jul 23 19:20:00.155220 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:19:59.994361    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-53.ec2.internal\" not found"
Jul 23 19:20:00.155220 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:00.099661    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal"
Jul 23 19:20:00.155220 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:00.099685    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-53.ec2.internal"
Jul 23 19:20:00.155220 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:00.099697    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-53.ec2.internal\" not found"
Jul 23 19:20:00.398846 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:00.200085    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-53.ec2.internal\" not found"
Jul 23 19:20:00.398846 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:00.301216    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-53.ec2.internal\" not found"
Jul 23 19:20:00.629242 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:00.402418    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-53.ec2.internal\" not found"
Jul 23 19:20:00.629242 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:00.436094    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 19:20:00.629242 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:00.436241    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 19:20:00.629242 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:00.494363    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 19:20:00.629242 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:00.503492    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-53.ec2.internal\" not found"
Jul 23 19:20:00.629242 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:00.519781    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 19:15:00 +0000 UTC" deadline="2028-03-06 12:01:12.906179037 +0000 UTC"
Jul 23 19:20:00.629242 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:00.519822    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14200h41m12.386360427s"
Jul 23 19:20:00.629242 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:00.604154    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-53.ec2.internal\" not found"
Jul 23 19:20:00.879723 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:00.705267    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-53.ec2.internal\" not found"
Jul 23 19:20:00.879723 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:20:00.722602    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc17e13ee47288c74c89439e877763463.slice/crio-6fe7078ac47192b1e5b786c612dd86184af5740a1927cb0b74894c5f93f70ba1 WatchSource:0}: Error finding container 6fe7078ac47192b1e5b786c612dd86184af5740a1927cb0b74894c5f93f70ba1: Status 404 returned error can't find the container with id 6fe7078ac47192b1e5b786c612dd86184af5740a1927cb0b74894c5f93f70ba1
Jul 23 19:20:00.879723 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:00.724246    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 19:20:00.879723 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:00.727659    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 19:20:00.879723 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:00.793897    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 19:20:01.155342 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:00.892282    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal"
Jul 23 19:20:01.155342 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:00.905004    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 19:20:01.155342 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:00.905906    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-53.ec2.internal"
Jul 23 19:20:01.155342 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:00.916434    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 19:20:01.436309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.429882    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.476726    2578 apiserver.go:52] "Watching apiserver"
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.485020    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.485608    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-rh6dh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal","openshift-multus/multus-additional-cni-plugins-vhxwq","openshift-multus/multus-rs8x2","openshift-multus/network-metrics-daemon-6tnmv","openshift-network-diagnostics/network-check-target-sqm5t","openshift-network-operator/iptables-alerter-wj5wl","openshift-ovn-kubernetes/ovnkube-node-7zbxp","kube-system/global-pull-secret-syncer-bq6sp","kube-system/konnectivity-agent-kt2wc","kube-system/kube-apiserver-proxy-ip-10-0-141-53.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk","openshift-cluster-node-tuning-operator/tuned-nsxhl","openshift-dns/node-resolver-hk9xx"]
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.487304    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wj5wl"
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.490710    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xhsrl\""
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.490823    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.491019    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.491040    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.491756    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.492874    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.495109    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.496462    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.497011    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.497698    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:01.497776    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tnmv" podUID="f2581039-af56-444f-8229-7221e36f10a2"
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.498058    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.499041    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:01.499110    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqm5t" podUID="ea281e35-6304-4075-9745-baf75e10b7b9"
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.499603    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.499678    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.499854    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.499885    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vtkgp\""
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.499968    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.500029    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 19:20:01.511079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.500455    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:01.512573 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:01.500521    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bq6sp" podUID="eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf"
Jul 23 19:20:01.512573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.500898    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pchw8\""
Jul 23 19:20:01.512573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.502335    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mvkpp\""
Jul 23 19:20:01.512573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.502833    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rh6dh"
Jul 23 19:20:01.512573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.503004    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 19:20:01.512573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.504132    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hk9xx"
Jul 23 19:20:01.512573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.505402    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kt2wc"
Jul 23 19:20:01.512573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.506871    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 19:20:01.512573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507225    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.512573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507416    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z4l5\" (UniqueName: \"kubernetes.io/projected/42d866a9-07dc-48fb-9f64-c83b4cab71b7-kube-api-access-6z4l5\") pod \"iptables-alerter-wj5wl\" (UID: \"42d866a9-07dc-48fb-9f64-c83b4cab71b7\") " pod="openshift-network-operator/iptables-alerter-wj5wl"
Jul 23 19:20:01.512573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507450    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-etc-sysconfig\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.512573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507471    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-etc-sysctl-conf\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.512573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507493    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-run\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.512573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507516    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r84q8\" (UniqueName: \"kubernetes.io/projected/84174bca-c9df-4cc5-973c-02e209309a9d-kube-api-access-r84q8\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.512573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507540    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/42d866a9-07dc-48fb-9f64-c83b4cab71b7-iptables-alerter-script\") pod \"iptables-alerter-wj5wl\" (UID: \"42d866a9-07dc-48fb-9f64-c83b4cab71b7\") " pod="openshift-network-operator/iptables-alerter-wj5wl"
Jul 23 19:20:01.512573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507560    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-etc-sysctl-d\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.512573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507586    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-lib-modules\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.512573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507605    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-host\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.514179 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507627    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84174bca-c9df-4cc5-973c-02e209309a9d-system-cni-dir\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.514179 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84174bca-c9df-4cc5-973c-02e209309a9d-os-release\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.514179 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507666    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/84174bca-c9df-4cc5-973c-02e209309a9d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.514179 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507687    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-etc-modprobe-d\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.514179 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507712    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-etc-kubernetes\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.514179 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507730    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-sys\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.514179 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507756    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6clrm\" (UniqueName: \"kubernetes.io/projected/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-kube-api-access-6clrm\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.514179 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507776    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84174bca-c9df-4cc5-973c-02e209309a9d-cnibin\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.514179 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507799    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84174bca-c9df-4cc5-973c-02e209309a9d-cni-binary-copy\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.514179 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507823    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/84174bca-c9df-4cc5-973c-02e209309a9d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.514179 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507847    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42d866a9-07dc-48fb-9f64-c83b4cab71b7-host-slash\") pod \"iptables-alerter-wj5wl\" (UID: \"42d866a9-07dc-48fb-9f64-c83b4cab71b7\") " pod="openshift-network-operator/iptables-alerter-wj5wl"
Jul 23 19:20:01.514179 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507872    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-etc-systemd\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.514179 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507899    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-var-lib-kubelet\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507919    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-etc-tuned\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507940    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-tmp\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.507966    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84174bca-c9df-4cc5-973c-02e209309a9d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.508628    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.508662    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.508814    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.508932    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.508999    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-b8l8k\""
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.509104    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mf6rp\""
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.509146    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.509165    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v5v2x\""
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.509005    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.509272    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.511633    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.511689    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.511822    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.511943    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.511969    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.512172    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lvbpx\""
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.512444    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.513621    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.514191    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.514563    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 19:20:01.517776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.514840    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hg5hf\""
Jul 23 19:20:01.520341 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.519684    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 19:20:01.614711 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.575011    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hvjhp"
Jul 23 19:20:01.614711 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.592301    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hvjhp"
Jul 23 19:20:01.614711 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.593781    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 19:20:01.614711 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608204    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84174bca-c9df-4cc5-973c-02e209309a9d-system-cni-dir\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.614711 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608239    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-host-kubelet\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.614711 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608279    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-ovn-node-metrics-cert\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.614711 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608305    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f4c27c31-3176-42eb-bfad-18e0d1c99c2c-hosts-file\") pod \"node-resolver-hk9xx\" (UID: \"f4c27c31-3176-42eb-bfad-18e0d1c99c2c\") " pod="openshift-dns/node-resolver-hk9xx"
Jul 23 19:20:01.614711 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84174bca-c9df-4cc5-973c-02e209309a9d-cnibin\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.614711 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608373    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-system-cni-dir\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.614711 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608396    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-kubelet-config\") pod \"global-pull-secret-syncer-bq6sp\" (UID: \"eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf\") " pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:01.614711 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608421    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-etc-systemd\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.614711 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608493    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84174bca-c9df-4cc5-973c-02e209309a9d-system-cni-dir\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.614711 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-tmp\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.614711 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608550    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-host-slash\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.614711 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608573    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-env-overrides\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.614711 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608595    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-os-release\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.616371 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608617    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-etc-kubernetes\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.616371 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608709    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-node-log\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.616371 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608733    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-ovnkube-config\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.616371 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608759    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-multus-cni-dir\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.616371 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608785    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-host\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.616371 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608793    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-etc-systemd\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.616371 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608808    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84174bca-c9df-4cc5-973c-02e209309a9d-os-release\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.616371 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608840    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-run-systemd\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.616371 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608875    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-host-var-lib-cni-multus\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.616371 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608900    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84174bca-c9df-4cc5-973c-02e209309a9d-os-release\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.616371 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608905    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-hostroot\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.616371 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.608983    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret\") pod \"global-pull-secret-syncer-bq6sp\" (UID: \"eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf\") " pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:01.616371 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609014    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svkjb\" (UniqueName: \"kubernetes.io/projected/f4c27c31-3176-42eb-bfad-18e0d1c99c2c-kube-api-access-svkjb\") pod \"node-resolver-hk9xx\" (UID: \"f4c27c31-3176-42eb-bfad-18e0d1c99c2c\") " pod="openshift-dns/node-resolver-hk9xx"
Jul 23 19:20:01.616371 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609045    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-sys\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.617278 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609074    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/abed38b6-bcb9-4908-be37-fa10a5d2dd81-registration-dir\") pod \"aws-ebs-csi-driver-node-5ktlk\" (UID: \"abed38b6-bcb9-4908-be37-fa10a5d2dd81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.617278 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609092    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/abed38b6-bcb9-4908-be37-fa10a5d2dd81-etc-selinux\") pod \"aws-ebs-csi-driver-node-5ktlk\" (UID: \"abed38b6-bcb9-4908-be37-fa10a5d2dd81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.617278 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609109    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-host-run-k8s-cni-cncf-io\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.617278 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609129    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdbl4\" (UniqueName: \"kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4\") pod \"network-check-target-sqm5t\" (UID: \"ea281e35-6304-4075-9745-baf75e10b7b9\") " pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:01.617278 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609161    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 19:20:01.617278 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609202    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4c27c31-3176-42eb-bfad-18e0d1c99c2c-tmp-dir\") pod \"node-resolver-hk9xx\" (UID: \"f4c27c31-3176-42eb-bfad-18e0d1c99c2c\") " pod="openshift-dns/node-resolver-hk9xx"
Jul 23 19:20:01.617278 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609246    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-host\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.617278 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609243    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-etc-tuned\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.617278 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609276    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd32cdc1-4e4a-4115-a2f7-63375ec6d511-konnectivity-ca\") pod \"konnectivity-agent-kt2wc\" (UID: \"bd32cdc1-4e4a-4115-a2f7-63375ec6d511\") " pod="kube-system/konnectivity-agent-kt2wc"
Jul 23 19:20:01.617278 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609210    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-sys\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.617278 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609343    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-cni-binary-copy\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.617278 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609368    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-etc-sysctl-conf\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.617278 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-run-openvswitch\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.617278 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609423    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-run-ovn\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.622243 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609449    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-host-var-lib-kubelet\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.622243 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609477    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwj8c\" (UniqueName: \"kubernetes.io/projected/e3da6f91-7977-4b04-9075-c77edf499350-kube-api-access-wwj8c\") pod \"node-ca-rh6dh\" (UID: \"e3da6f91-7977-4b04-9075-c77edf499350\") " pod="openshift-image-registry/node-ca-rh6dh"
Jul 23 19:20:01.622243 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609545    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84174bca-c9df-4cc5-973c-02e209309a9d-cnibin\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.622243 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-etc-sysctl-d\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.622243 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-lib-modules\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.622243 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609647    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-etc-sysctl-conf\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.622243 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609657    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r84q8\" (UniqueName: \"kubernetes.io/projected/84174bca-c9df-4cc5-973c-02e209309a9d-kube-api-access-r84q8\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.622243 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609701    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82x8w\" (UniqueName: \"kubernetes.io/projected/f2581039-af56-444f-8229-7221e36f10a2-kube-api-access-82x8w\") pod \"network-metrics-daemon-6tnmv\" (UID: \"f2581039-af56-444f-8229-7221e36f10a2\") " pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:01.622243 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609727    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-host-run-netns\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.622243 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-var-lib-openvswitch\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.622243 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609777    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-etc-openvswitch\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.622243 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609802    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-etc-sysctl-d\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.622243 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609817    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-log-socket\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.622243 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609844    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-etc-kubernetes\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.623516 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609891    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-lib-modules\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.623516 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84174bca-c9df-4cc5-973c-02e209309a9d-cni-binary-copy\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.623516 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609925    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd32cdc1-4e4a-4115-a2f7-63375ec6d511-agent-certs\") pod \"konnectivity-agent-kt2wc\" (UID: \"bd32cdc1-4e4a-4115-a2f7-63375ec6d511\") " pod="kube-system/konnectivity-agent-kt2wc"
Jul 23 19:20:01.623516 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.609949    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.623516 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.610040    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/abed38b6-bcb9-4908-be37-fa10a5d2dd81-sys-fs\") pod \"aws-ebs-csi-driver-node-5ktlk\" (UID: \"abed38b6-bcb9-4908-be37-fa10a5d2dd81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.623516 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.610075    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr4w4\" (UniqueName: \"kubernetes.io/projected/abed38b6-bcb9-4908-be37-fa10a5d2dd81-kube-api-access-nr4w4\") pod \"aws-ebs-csi-driver-node-5ktlk\" (UID: \"abed38b6-bcb9-4908-be37-fa10a5d2dd81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.623516 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.610437    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-multus-conf-dir\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.623516 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.610481    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42d866a9-07dc-48fb-9f64-c83b4cab71b7-host-slash\") pod \"iptables-alerter-wj5wl\" (UID: \"42d866a9-07dc-48fb-9f64-c83b4cab71b7\") " pod="openshift-network-operator/iptables-alerter-wj5wl"
Jul 23 19:20:01.623516 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.610517    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-var-lib-kubelet\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.623516 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.610703    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84174bca-c9df-4cc5-973c-02e209309a9d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.623516 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.610732    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfrkc\" (UniqueName: \"kubernetes.io/projected/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-kube-api-access-qfrkc\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.623516 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.610763    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-run\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.623516 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.610947    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.623516 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.610979    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-cnibin\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.626798 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.616903    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-tmp\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.626798 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.617633    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-host-run-netns\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.626798 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.617665    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3da6f91-7977-4b04-9075-c77edf499350-serviceca\") pod \"node-ca-rh6dh\" (UID: \"e3da6f91-7977-4b04-9075-c77edf499350\") " pod="openshift-image-registry/node-ca-rh6dh"
Jul 23 19:20:01.626798 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.617716    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/84174bca-c9df-4cc5-973c-02e209309a9d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.626798 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.617752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-systemd-units\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.626798 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.617784    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-ovnkube-script-lib\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.626798 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.617815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/abed38b6-bcb9-4908-be37-fa10a5d2dd81-socket-dir\") pod \"aws-ebs-csi-driver-node-5ktlk\" (UID: \"abed38b6-bcb9-4908-be37-fa10a5d2dd81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.626798 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.617841    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/abed38b6-bcb9-4908-be37-fa10a5d2dd81-device-dir\") pod \"aws-ebs-csi-driver-node-5ktlk\" (UID: \"abed38b6-bcb9-4908-be37-fa10a5d2dd81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.626798 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.617870    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-dbus\") pod \"global-pull-secret-syncer-bq6sp\" (UID: \"eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf\") " pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:01.626798 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.617902    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3da6f91-7977-4b04-9075-c77edf499350-host\") pod \"node-ca-rh6dh\" (UID: \"e3da6f91-7977-4b04-9075-c77edf499350\") " pod="openshift-image-registry/node-ca-rh6dh"
Jul 23 19:20:01.626798 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.617939    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-etc-modprobe-d\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.626798 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.617972    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6clrm\" (UniqueName: \"kubernetes.io/projected/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-kube-api-access-6clrm\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.626798 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.617999    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/84174bca-c9df-4cc5-973c-02e209309a9d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.626798 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.618033    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-host-cni-bin\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.628673 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.618074    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/abed38b6-bcb9-4908-be37-fa10a5d2dd81-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5ktlk\" (UID: \"abed38b6-bcb9-4908-be37-fa10a5d2dd81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.628673 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.618108    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tlhw\" (UniqueName: \"kubernetes.io/projected/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-kube-api-access-8tlhw\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.628673 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.618142    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs\") pod \"network-metrics-daemon-6tnmv\" (UID: \"f2581039-af56-444f-8229-7221e36f10a2\") " pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:01.628673 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.618174    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-host-cni-netd\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.628673 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.618359    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-multus-socket-dir-parent\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.628673 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.618387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-host-run-multus-certs\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.628673 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.618422    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z4l5\" (UniqueName: \"kubernetes.io/projected/42d866a9-07dc-48fb-9f64-c83b4cab71b7-kube-api-access-6z4l5\") pod \"iptables-alerter-wj5wl\" (UID: \"42d866a9-07dc-48fb-9f64-c83b4cab71b7\") " pod="openshift-network-operator/iptables-alerter-wj5wl"
Jul 23 19:20:01.628673 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.618458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-etc-sysconfig\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.628673 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.618488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-host-var-lib-cni-bin\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.628673 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.618515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-multus-daemon-config\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.628673 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.618548    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/42d866a9-07dc-48fb-9f64-c83b4cab71b7-iptables-alerter-script\") pod \"iptables-alerter-wj5wl\" (UID: \"42d866a9-07dc-48fb-9f64-c83b4cab71b7\") " pod="openshift-network-operator/iptables-alerter-wj5wl"
Jul 23 19:20:01.628673 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.619176    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/42d866a9-07dc-48fb-9f64-c83b4cab71b7-iptables-alerter-script\") pod \"iptables-alerter-wj5wl\" (UID: \"42d866a9-07dc-48fb-9f64-c83b4cab71b7\") " pod="openshift-network-operator/iptables-alerter-wj5wl"
Jul 23 19:20:01.628673 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.619300    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-etc-kubernetes\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.628673 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.620210    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-var-lib-kubelet\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.631912 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.620279    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42d866a9-07dc-48fb-9f64-c83b4cab71b7-host-slash\") pod \"iptables-alerter-wj5wl\" (UID: \"42d866a9-07dc-48fb-9f64-c83b4cab71b7\") " pod="openshift-network-operator/iptables-alerter-wj5wl"
Jul 23 19:20:01.631912 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.620381    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-run\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.631912 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.620566    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-etc-tuned\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.631912 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.620733    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84174bca-c9df-4cc5-973c-02e209309a9d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.631912 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.621219    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-etc-modprobe-d\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.631912 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.622489    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-etc-sysconfig\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.631912 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.624503    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/84174bca-c9df-4cc5-973c-02e209309a9d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.631912 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.624548    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/84174bca-c9df-4cc5-973c-02e209309a9d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.631912 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.624572    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84174bca-c9df-4cc5-973c-02e209309a9d-cni-binary-copy\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.636081 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.633897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r84q8\" (UniqueName: \"kubernetes.io/projected/84174bca-c9df-4cc5-973c-02e209309a9d-kube-api-access-r84q8\") pod \"multus-additional-cni-plugins-vhxwq\" (UID: \"84174bca-c9df-4cc5-973c-02e209309a9d\") " pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.639121 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.638199    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6clrm\" (UniqueName: \"kubernetes.io/projected/7f327dc2-a00f-4955-a0fc-ec87fc7f16be-kube-api-access-6clrm\") pod \"tuned-nsxhl\" (UID: \"7f327dc2-a00f-4955-a0fc-ec87fc7f16be\") " pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.642429 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.640457    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z4l5\" (UniqueName: \"kubernetes.io/projected/42d866a9-07dc-48fb-9f64-c83b4cab71b7-kube-api-access-6z4l5\") pod \"iptables-alerter-wj5wl\" (UID: \"42d866a9-07dc-48fb-9f64-c83b4cab71b7\") " pod="openshift-network-operator/iptables-alerter-wj5wl"
Jul 23 19:20:01.726195 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.666192    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal" event={"ID":"c17e13ee47288c74c89439e877763463","Type":"ContainerStarted","Data":"6fe7078ac47192b1e5b786c612dd86184af5740a1927cb0b74894c5f93f70ba1"}
Jul 23 19:20:01.726195 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.668209    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-53.ec2.internal" event={"ID":"e6a766f128fe58a47aa95c2312516db4","Type":"ContainerStarted","Data":"4206b8e9525261e135e6ec6a728bfec65c18f25079a8dc1c6bf243e25b8d8c92"}
Jul 23 19:20:01.726195 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.719474    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-host-kubelet\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.726195 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.719509    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-ovn-node-metrics-cert\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.726195 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.719626    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-host-kubelet\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.726195 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.719673    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f4c27c31-3176-42eb-bfad-18e0d1c99c2c-hosts-file\") pod \"node-resolver-hk9xx\" (UID: \"f4c27c31-3176-42eb-bfad-18e0d1c99c2c\") " pod="openshift-dns/node-resolver-hk9xx"
Jul 23 19:20:01.726195 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.719710    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-system-cni-dir\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.726195 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.719736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-kubelet-config\") pod \"global-pull-secret-syncer-bq6sp\" (UID: \"eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf\") " pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:01.726195 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.719765    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-host-slash\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.726195 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.719779    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f4c27c31-3176-42eb-bfad-18e0d1c99c2c-hosts-file\") pod \"node-resolver-hk9xx\" (UID: \"f4c27c31-3176-42eb-bfad-18e0d1c99c2c\") " pod="openshift-dns/node-resolver-hk9xx"
Jul 23 19:20:01.726195 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.719795    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-env-overrides\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.726195 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.719811    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-system-cni-dir\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.726195 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.719819    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-os-release\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.726195 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.719844    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-etc-kubernetes\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.726195 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.719864    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-host-slash\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.730190 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.719868    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-node-log\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.730190 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.719904    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-ovnkube-config\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.730190 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.719930    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-multus-cni-dir\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.730190 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.719976    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-run-systemd\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.730190 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.719999    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-host-var-lib-cni-multus\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.730190 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-hostroot\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.730190 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720045    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret\") pod \"global-pull-secret-syncer-bq6sp\" (UID: \"eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf\") " pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:01.730190 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720071    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svkjb\" (UniqueName: \"kubernetes.io/projected/f4c27c31-3176-42eb-bfad-18e0d1c99c2c-kube-api-access-svkjb\") pod \"node-resolver-hk9xx\" (UID: \"f4c27c31-3176-42eb-bfad-18e0d1c99c2c\") " pod="openshift-dns/node-resolver-hk9xx"
Jul 23 19:20:01.730190 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720099    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/abed38b6-bcb9-4908-be37-fa10a5d2dd81-registration-dir\") pod \"aws-ebs-csi-driver-node-5ktlk\" (UID: \"abed38b6-bcb9-4908-be37-fa10a5d2dd81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.730190 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/abed38b6-bcb9-4908-be37-fa10a5d2dd81-etc-selinux\") pod \"aws-ebs-csi-driver-node-5ktlk\" (UID: \"abed38b6-bcb9-4908-be37-fa10a5d2dd81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.730190 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720150    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-host-run-k8s-cni-cncf-io\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.730190 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720177    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdbl4\" (UniqueName: \"kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4\") pod \"network-check-target-sqm5t\" (UID: \"ea281e35-6304-4075-9745-baf75e10b7b9\") " pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:01.730190 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720203    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4c27c31-3176-42eb-bfad-18e0d1c99c2c-tmp-dir\") pod \"node-resolver-hk9xx\" (UID: \"f4c27c31-3176-42eb-bfad-18e0d1c99c2c\") " pod="openshift-dns/node-resolver-hk9xx"
Jul 23 19:20:01.730190 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720227    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd32cdc1-4e4a-4115-a2f7-63375ec6d511-konnectivity-ca\") pod \"konnectivity-agent-kt2wc\" (UID: \"bd32cdc1-4e4a-4115-a2f7-63375ec6d511\") " pod="kube-system/konnectivity-agent-kt2wc"
Jul 23 19:20:01.731375 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720253    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-cni-binary-copy\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.731375 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720278    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-run-openvswitch\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.731375 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720333    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-run-ovn\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.731375 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720360    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-host-var-lib-kubelet\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.731375 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720385    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwj8c\" (UniqueName: \"kubernetes.io/projected/e3da6f91-7977-4b04-9075-c77edf499350-kube-api-access-wwj8c\") pod \"node-ca-rh6dh\" (UID: \"e3da6f91-7977-4b04-9075-c77edf499350\") " pod="openshift-image-registry/node-ca-rh6dh"
Jul 23 19:20:01.731375 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720446    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82x8w\" (UniqueName: \"kubernetes.io/projected/f2581039-af56-444f-8229-7221e36f10a2-kube-api-access-82x8w\") pod \"network-metrics-daemon-6tnmv\" (UID: \"f2581039-af56-444f-8229-7221e36f10a2\") " pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:01.731375 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720465    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-env-overrides\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.731375 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720471    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-host-run-netns\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.731375 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720516    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-var-lib-openvswitch\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.731375 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-etc-openvswitch\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.731375 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720566    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-os-release\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.731375 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720568    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-log-socket\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.731375 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720636    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-log-socket\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.731375 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720641    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd32cdc1-4e4a-4115-a2f7-63375ec6d511-agent-certs\") pod \"konnectivity-agent-kt2wc\" (UID: \"bd32cdc1-4e4a-4115-a2f7-63375ec6d511\") " pod="kube-system/konnectivity-agent-kt2wc"
Jul 23 19:20:01.731375 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720675    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.734431 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720705    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/abed38b6-bcb9-4908-be37-fa10a5d2dd81-sys-fs\") pod \"aws-ebs-csi-driver-node-5ktlk\" (UID: \"abed38b6-bcb9-4908-be37-fa10a5d2dd81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.734431 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720734    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr4w4\" (UniqueName: \"kubernetes.io/projected/abed38b6-bcb9-4908-be37-fa10a5d2dd81-kube-api-access-nr4w4\") pod \"aws-ebs-csi-driver-node-5ktlk\" (UID: \"abed38b6-bcb9-4908-be37-fa10a5d2dd81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.734431 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720762    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-multus-conf-dir\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.734431 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfrkc\" (UniqueName: \"kubernetes.io/projected/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-kube-api-access-qfrkc\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.734431 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720826    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.734431 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720852    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-cnibin\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.734431 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720876    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-host-run-netns\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.734431 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720900    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3da6f91-7977-4b04-9075-c77edf499350-serviceca\") pod \"node-ca-rh6dh\" (UID: \"e3da6f91-7977-4b04-9075-c77edf499350\") " pod="openshift-image-registry/node-ca-rh6dh"
Jul 23 19:20:01.734431 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.720948    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-run-openvswitch\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.734431 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721000    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-systemd-units\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.734431 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721026    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-ovnkube-script-lib\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.734431 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721047    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-etc-openvswitch\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.734431 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721075    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-hostroot\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.734431 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721122    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/abed38b6-bcb9-4908-be37-fa10a5d2dd81-etc-selinux\") pod \"aws-ebs-csi-driver-node-5ktlk\" (UID: \"abed38b6-bcb9-4908-be37-fa10a5d2dd81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.734431 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721168    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-host-run-k8s-cni-cncf-io\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.735416 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721170    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-multus-cni-dir\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.735416 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721180    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/abed38b6-bcb9-4908-be37-fa10a5d2dd81-socket-dir\") pod \"aws-ebs-csi-driver-node-5ktlk\" (UID: \"abed38b6-bcb9-4908-be37-fa10a5d2dd81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.735416 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:01.721174    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:01.735416 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721234    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/abed38b6-bcb9-4908-be37-fa10a5d2dd81-registration-dir\") pod \"aws-ebs-csi-driver-node-5ktlk\" (UID: \"abed38b6-bcb9-4908-be37-fa10a5d2dd81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.735416 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:01.721281    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret podName:eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf nodeName:}" failed. No retries permitted until 2026-07-23 19:20:02.221235943 +0000 UTC m=+3.058242655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret") pod "global-pull-secret-syncer-bq6sp" (UID: "eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf") : object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:01.735416 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721351    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-kubelet-config\") pod \"global-pull-secret-syncer-bq6sp\" (UID: \"eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf\") " pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:01.735416 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721400    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-node-log\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.735416 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721410    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3da6f91-7977-4b04-9075-c77edf499350-serviceca\") pod \"node-ca-rh6dh\" (UID: \"e3da6f91-7977-4b04-9075-c77edf499350\") " pod="openshift-image-registry/node-ca-rh6dh"
Jul 23 19:20:01.735416 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721453    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-host-var-lib-cni-multus\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.735416 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721554    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-host-run-netns\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.735416 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721609    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-run-ovn\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.735416 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721617    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-var-lib-openvswitch\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.735416 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721054    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/abed38b6-bcb9-4908-be37-fa10a5d2dd81-socket-dir\") pod \"aws-ebs-csi-driver-node-5ktlk\" (UID: \"abed38b6-bcb9-4908-be37-fa10a5d2dd81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.735416 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721663    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/abed38b6-bcb9-4908-be37-fa10a5d2dd81-device-dir\") pod \"aws-ebs-csi-driver-node-5ktlk\" (UID: \"abed38b6-bcb9-4908-be37-fa10a5d2dd81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.739275 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721670    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.739275 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721691    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-dbus\") pod \"global-pull-secret-syncer-bq6sp\" (UID: \"eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf\") " pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:01.739275 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721718    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3da6f91-7977-4b04-9075-c77edf499350-host\") pod \"node-ca-rh6dh\" (UID: \"e3da6f91-7977-4b04-9075-c77edf499350\") " pod="openshift-image-registry/node-ca-rh6dh"
Jul 23 19:20:01.739275 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721734    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd32cdc1-4e4a-4115-a2f7-63375ec6d511-konnectivity-ca\") pod \"konnectivity-agent-kt2wc\" (UID: \"bd32cdc1-4e4a-4115-a2f7-63375ec6d511\") " pod="kube-system/konnectivity-agent-kt2wc"
Jul 23 19:20:01.739275 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721735    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/abed38b6-bcb9-4908-be37-fa10a5d2dd81-sys-fs\") pod \"aws-ebs-csi-driver-node-5ktlk\" (UID: \"abed38b6-bcb9-4908-be37-fa10a5d2dd81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.739275 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-host-cni-bin\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.739275 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721807    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/abed38b6-bcb9-4908-be37-fa10a5d2dd81-device-dir\") pod \"aws-ebs-csi-driver-node-5ktlk\" (UID: \"abed38b6-bcb9-4908-be37-fa10a5d2dd81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.739275 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721829    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/abed38b6-bcb9-4908-be37-fa10a5d2dd81-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5ktlk\" (UID: \"abed38b6-bcb9-4908-be37-fa10a5d2dd81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.739275 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tlhw\" (UniqueName: \"kubernetes.io/projected/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-kube-api-access-8tlhw\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.739275 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721862    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-dbus\") pod \"global-pull-secret-syncer-bq6sp\" (UID: \"eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf\") " pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:01.739275 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721895    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4c27c31-3176-42eb-bfad-18e0d1c99c2c-tmp-dir\") pod \"node-resolver-hk9xx\" (UID: \"f4c27c31-3176-42eb-bfad-18e0d1c99c2c\") " pod="openshift-dns/node-resolver-hk9xx"
Jul 23 19:20:01.739275 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721904    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3da6f91-7977-4b04-9075-c77edf499350-host\") pod \"node-ca-rh6dh\" (UID: \"e3da6f91-7977-4b04-9075-c77edf499350\") " pod="openshift-image-registry/node-ca-rh6dh"
Jul 23 19:20:01.739275 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721905    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs\") pod \"network-metrics-daemon-6tnmv\" (UID: \"f2581039-af56-444f-8229-7221e36f10a2\") " pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:01.739275 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721944    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-host-cni-netd\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.739275 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721961    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-host-var-lib-kubelet\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.743532 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721972    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-multus-socket-dir-parent\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.743532 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721986    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-ovnkube-config\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.743532 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.721999    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-host-run-multus-certs\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.743532 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.722037    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-host-run-multus-certs\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.743532 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.722043    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-run-systemd\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.743532 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:01.721974    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:01.743532 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:01.722123    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs podName:f2581039-af56-444f-8229-7221e36f10a2 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:02.222107133 +0000 UTC m=+3.059113824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs") pod "network-metrics-daemon-6tnmv" (UID: "f2581039-af56-444f-8229-7221e36f10a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:01.743532 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.722037    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-host-var-lib-cni-bin\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.743532 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.722156    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-multus-daemon-config\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.743532 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.722233    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-multus-conf-dir\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.743532 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.722321    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-systemd-units\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.743532 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.722481    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.743532 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.722566    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-ovn-node-metrics-cert\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.743532 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.722646    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-host-cni-bin\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.747246 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.722700    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-etc-kubernetes\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.747246 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.722741    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-host-var-lib-cni-bin\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.747246 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.722747    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-cni-binary-copy\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.747246 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.722756    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-multus-daemon-config\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.747246 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.722759    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/abed38b6-bcb9-4908-be37-fa10a5d2dd81-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5ktlk\" (UID: \"abed38b6-bcb9-4908-be37-fa10a5d2dd81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.747246 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.722565    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-cnibin\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.747246 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.722816    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-host-cni-netd\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.747246 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.722896    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-host-run-netns\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.747246 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.722951    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-multus-socket-dir-parent\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.747246 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.725035    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-ovnkube-script-lib\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.747246 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.726461    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd32cdc1-4e4a-4115-a2f7-63375ec6d511-agent-certs\") pod \"konnectivity-agent-kt2wc\" (UID: \"bd32cdc1-4e4a-4115-a2f7-63375ec6d511\") " pod="kube-system/konnectivity-agent-kt2wc"
Jul 23 19:20:01.747246 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.731283    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82x8w\" (UniqueName: \"kubernetes.io/projected/f2581039-af56-444f-8229-7221e36f10a2-kube-api-access-82x8w\") pod \"network-metrics-daemon-6tnmv\" (UID: \"f2581039-af56-444f-8229-7221e36f10a2\") " pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:01.747246 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.732639    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr4w4\" (UniqueName: \"kubernetes.io/projected/abed38b6-bcb9-4908-be37-fa10a5d2dd81-kube-api-access-nr4w4\") pod \"aws-ebs-csi-driver-node-5ktlk\" (UID: \"abed38b6-bcb9-4908-be37-fa10a5d2dd81\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.747246 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.732976    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svkjb\" (UniqueName: \"kubernetes.io/projected/f4c27c31-3176-42eb-bfad-18e0d1c99c2c-kube-api-access-svkjb\") pod \"node-resolver-hk9xx\" (UID: \"f4c27c31-3176-42eb-bfad-18e0d1c99c2c\") " pod="openshift-dns/node-resolver-hk9xx"
Jul 23 19:20:01.747246 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:01.738228    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 19:20:01.747246 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:01.738249    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 19:20:01.748165 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:01.738263    2578 projected.go:196] Error preparing data for projected volume kube-api-access-pdbl4 for pod openshift-network-diagnostics/network-check-target-sqm5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:01.748165 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:01.738339    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4 podName:ea281e35-6304-4075-9745-baf75e10b7b9 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:02.238321933 +0000 UTC m=+3.075328646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pdbl4" (UniqueName: "kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4") pod "network-check-target-sqm5t" (UID: "ea281e35-6304-4075-9745-baf75e10b7b9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:01.748165 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.739211    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tlhw\" (UniqueName: \"kubernetes.io/projected/b5b1384d-9df9-4eb1-92d9-7f4e82400a82-kube-api-access-8tlhw\") pod \"multus-rs8x2\" (UID: \"b5b1384d-9df9-4eb1-92d9-7f4e82400a82\") " pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.748165 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.742669    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwj8c\" (UniqueName: \"kubernetes.io/projected/e3da6f91-7977-4b04-9075-c77edf499350-kube-api-access-wwj8c\") pod \"node-ca-rh6dh\" (UID: \"e3da6f91-7977-4b04-9075-c77edf499350\") " pod="openshift-image-registry/node-ca-rh6dh"
Jul 23 19:20:01.748165 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.743203    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfrkc\" (UniqueName: \"kubernetes.io/projected/54d8d144-8dfd-43cb-9286-0e0faf09f2aa-kube-api-access-qfrkc\") pod \"ovnkube-node-7zbxp\" (UID: \"54d8d144-8dfd-43cb-9286-0e0faf09f2aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.953696 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.891249    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wj5wl"
Jul 23 19:20:01.953696 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:20:01.906060    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d866a9_07dc_48fb_9f64_c83b4cab71b7.slice/crio-76152740aff5d3ddcb655482f18fb797039cbf9d2bdbdd9a439a54b590846e7d WatchSource:0}: Error finding container 76152740aff5d3ddcb655482f18fb797039cbf9d2bdbdd9a439a54b590846e7d: Status 404 returned error can't find the container with id 76152740aff5d3ddcb655482f18fb797039cbf9d2bdbdd9a439a54b590846e7d
Jul 23 19:20:01.953696 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.908852    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nsxhl"
Jul 23 19:20:01.953696 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.929562    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vhxwq"
Jul 23 19:20:01.953696 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:20:01.930660    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f327dc2_a00f_4955_a0fc_ec87fc7f16be.slice/crio-c8106663669d852ea06a2569deb109bd185be6e1635455914dacf8f8603e6083 WatchSource:0}: Error finding container c8106663669d852ea06a2569deb109bd185be6e1635455914dacf8f8603e6083: Status 404 returned error can't find the container with id c8106663669d852ea06a2569deb109bd185be6e1635455914dacf8f8603e6083
Jul 23 19:20:01.953696 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:20:01.941353    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84174bca_c9df_4cc5_973c_02e209309a9d.slice/crio-3c07c90c74ebbc2ff38262ee356ef64c5349d4c487df847c7215df017f4034fb WatchSource:0}: Error finding container 3c07c90c74ebbc2ff38262ee356ef64c5349d4c487df847c7215df017f4034fb: Status 404 returned error can't find the container with id 3c07c90c74ebbc2ff38262ee356ef64c5349d4c487df847c7215df017f4034fb
Jul 23 19:20:01.953696 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.948786    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rs8x2"
Jul 23 19:20:01.955794 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.955767    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rh6dh"
Jul 23 19:20:01.961415 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:20:01.961382    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b1384d_9df9_4eb1_92d9_7f4e82400a82.slice/crio-0f3a4f7db54ab76bc462b6c0becd1fcd292d14934092844569bdda1f9cb31a2e WatchSource:0}: Error finding container 0f3a4f7db54ab76bc462b6c0becd1fcd292d14934092844569bdda1f9cb31a2e: Status 404 returned error can't find the container with id 0f3a4f7db54ab76bc462b6c0becd1fcd292d14934092844569bdda1f9cb31a2e
Jul 23 19:20:01.962154 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.962130    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hk9xx"
Jul 23 19:20:01.970501 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:20:01.970473    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3da6f91_7977_4b04_9075_c77edf499350.slice/crio-4a7ea1868cc19730e5c3b6fd1d4037f8377074896b5993b85e9ae10ca501982d WatchSource:0}: Error finding container 4a7ea1868cc19730e5c3b6fd1d4037f8377074896b5993b85e9ae10ca501982d: Status 404 returned error can't find the container with id 4a7ea1868cc19730e5c3b6fd1d4037f8377074896b5993b85e9ae10ca501982d
Jul 23 19:20:01.971355 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.971335    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kt2wc"
Jul 23 19:20:01.974877 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:20:01.974844    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c27c31_3176_42eb_bfad_18e0d1c99c2c.slice/crio-6eaf54f6993923e9726e9172013d8bce84db045f4631bb3ea2acf4605e61edda WatchSource:0}: Error finding container 6eaf54f6993923e9726e9172013d8bce84db045f4631bb3ea2acf4605e61edda: Status 404 returned error can't find the container with id 6eaf54f6993923e9726e9172013d8bce84db045f4631bb3ea2acf4605e61edda
Jul 23 19:20:01.980172 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:20:01.980149    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd32cdc1_4e4a_4115_a2f7_63375ec6d511.slice/crio-960d54ca48057dc8371501b6fa3d0536c7cd65d3d56cf0971672468005aa9756 WatchSource:0}: Error finding container 960d54ca48057dc8371501b6fa3d0536c7cd65d3d56cf0971672468005aa9756: Status 404 returned error can't find the container with id 960d54ca48057dc8371501b6fa3d0536c7cd65d3d56cf0971672468005aa9756
Jul 23 19:20:01.981824 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.981805    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:01.991494 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:01.991467    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk"
Jul 23 19:20:01.991767 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:20:01.991740    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d8d144_8dfd_43cb_9286_0e0faf09f2aa.slice/crio-dfd29829916446e8a325dfc8432b2744dc60321736904481aab07cd0e586e018 WatchSource:0}: Error finding container dfd29829916446e8a325dfc8432b2744dc60321736904481aab07cd0e586e018: Status 404 returned error can't find the container with id dfd29829916446e8a325dfc8432b2744dc60321736904481aab07cd0e586e018
Jul 23 19:20:02.005538 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:20:02.005509    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabed38b6_bcb9_4908_be37_fa10a5d2dd81.slice/crio-779f3910ab6e31699697d927af971eed83572c7a51db7f61f08e0cefd4194910 WatchSource:0}: Error finding container 779f3910ab6e31699697d927af971eed83572c7a51db7f61f08e0cefd4194910: Status 404 returned error can't find the container with id 779f3910ab6e31699697d927af971eed83572c7a51db7f61f08e0cefd4194910
Jul 23 19:20:02.225472 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:02.225433    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs\") pod \"network-metrics-daemon-6tnmv\" (UID: \"f2581039-af56-444f-8229-7221e36f10a2\") " pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:02.225659 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:02.225499    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret\") pod \"global-pull-secret-syncer-bq6sp\" (UID: \"eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf\") " pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:02.225659 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:02.225596    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:02.225791 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:02.225653    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:02.225791 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:02.225681    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs podName:f2581039-af56-444f-8229-7221e36f10a2 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:03.225660499 +0000 UTC m=+4.062667200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs") pod "network-metrics-daemon-6tnmv" (UID: "f2581039-af56-444f-8229-7221e36f10a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:02.225791 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:02.225713    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret podName:eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf nodeName:}" failed. No retries permitted until 2026-07-23 19:20:03.225699422 +0000 UTC m=+4.062706112 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret") pod "global-pull-secret-syncer-bq6sp" (UID: "eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf") : object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:02.326972 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:02.326880    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdbl4\" (UniqueName: \"kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4\") pod \"network-check-target-sqm5t\" (UID: \"ea281e35-6304-4075-9745-baf75e10b7b9\") " pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:02.327121 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:02.327060    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 19:20:02.327121 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:02.327088    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 19:20:02.327121 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:02.327101    2578 projected.go:196] Error preparing data for projected volume kube-api-access-pdbl4 for pod openshift-network-diagnostics/network-check-target-sqm5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:02.327295 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:02.327172    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4 podName:ea281e35-6304-4075-9745-baf75e10b7b9 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:03.327151793 +0000 UTC m=+4.164158503 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdbl4" (UniqueName: "kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4") pod "network-check-target-sqm5t" (UID: "ea281e35-6304-4075-9745-baf75e10b7b9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:02.595608 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:02.595473    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 19:15:02 +0000 UTC" deadline="2028-02-04 14:08:23.080216217 +0000 UTC"
Jul 23 19:20:02.595608 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:02.595552    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13458h48m20.484668821s"
Jul 23 19:20:02.671479 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:02.671440    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kt2wc" event={"ID":"bd32cdc1-4e4a-4115-a2f7-63375ec6d511","Type":"ContainerStarted","Data":"960d54ca48057dc8371501b6fa3d0536c7cd65d3d56cf0971672468005aa9756"}
Jul 23 19:20:02.673026 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:02.672994    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hk9xx" event={"ID":"f4c27c31-3176-42eb-bfad-18e0d1c99c2c","Type":"ContainerStarted","Data":"6eaf54f6993923e9726e9172013d8bce84db045f4631bb3ea2acf4605e61edda"}
Jul 23 19:20:02.674631 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:02.674604    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rs8x2" event={"ID":"b5b1384d-9df9-4eb1-92d9-7f4e82400a82","Type":"ContainerStarted","Data":"0f3a4f7db54ab76bc462b6c0becd1fcd292d14934092844569bdda1f9cb31a2e"}
Jul 23 19:20:02.675957 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:02.675905    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhxwq" event={"ID":"84174bca-c9df-4cc5-973c-02e209309a9d","Type":"ContainerStarted","Data":"3c07c90c74ebbc2ff38262ee356ef64c5349d4c487df847c7215df017f4034fb"}
Jul 23 19:20:02.677357 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:02.677331    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wj5wl" event={"ID":"42d866a9-07dc-48fb-9f64-c83b4cab71b7","Type":"ContainerStarted","Data":"76152740aff5d3ddcb655482f18fb797039cbf9d2bdbdd9a439a54b590846e7d"}
Jul 23 19:20:02.678622 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:02.678562    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk" event={"ID":"abed38b6-bcb9-4908-be37-fa10a5d2dd81","Type":"ContainerStarted","Data":"779f3910ab6e31699697d927af971eed83572c7a51db7f61f08e0cefd4194910"}
Jul 23 19:20:02.680356 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:02.679823    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp" event={"ID":"54d8d144-8dfd-43cb-9286-0e0faf09f2aa","Type":"ContainerStarted","Data":"dfd29829916446e8a325dfc8432b2744dc60321736904481aab07cd0e586e018"}
Jul 23 19:20:02.681626 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:02.681581    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rh6dh" event={"ID":"e3da6f91-7977-4b04-9075-c77edf499350","Type":"ContainerStarted","Data":"4a7ea1868cc19730e5c3b6fd1d4037f8377074896b5993b85e9ae10ca501982d"}
Jul 23 19:20:02.682984 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:02.682959    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nsxhl" event={"ID":"7f327dc2-a00f-4955-a0fc-ec87fc7f16be","Type":"ContainerStarted","Data":"c8106663669d852ea06a2569deb109bd185be6e1635455914dacf8f8603e6083"}
Jul 23 19:20:03.235382 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:03.235342    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs\") pod \"network-metrics-daemon-6tnmv\" (UID: \"f2581039-af56-444f-8229-7221e36f10a2\") " pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:03.235565 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:03.235416    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret\") pod \"global-pull-secret-syncer-bq6sp\" (UID: \"eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf\") " pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:03.235641 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:03.235573    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:03.235641 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:03.235637    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret podName:eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf nodeName:}" failed. No retries permitted until 2026-07-23 19:20:05.235618625 +0000 UTC m=+6.072625315 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret") pod "global-pull-secret-syncer-bq6sp" (UID: "eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf") : object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:03.236089 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:03.236045    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:03.236152 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:03.236106    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs podName:f2581039-af56-444f-8229-7221e36f10a2 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:05.236085849 +0000 UTC m=+6.073092537 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs") pod "network-metrics-daemon-6tnmv" (UID: "f2581039-af56-444f-8229-7221e36f10a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:03.335821 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:03.335783    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdbl4\" (UniqueName: \"kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4\") pod \"network-check-target-sqm5t\" (UID: \"ea281e35-6304-4075-9745-baf75e10b7b9\") " pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:03.336019 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:03.335938    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 19:20:03.336019 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:03.335963    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 19:20:03.336019 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:03.335977    2578 projected.go:196] Error preparing data for projected volume kube-api-access-pdbl4 for pod openshift-network-diagnostics/network-check-target-sqm5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:03.336183 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:03.336040    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4 podName:ea281e35-6304-4075-9745-baf75e10b7b9 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:05.336018798 +0000 UTC m=+6.173025484 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdbl4" (UniqueName: "kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4") pod "network-check-target-sqm5t" (UID: "ea281e35-6304-4075-9745-baf75e10b7b9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:03.596980 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:03.596571    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 19:15:02 +0000 UTC" deadline="2028-03-23 02:05:23.191713406 +0000 UTC"
Jul 23 19:20:03.596980 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:03.596610    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14598h45m19.595108843s"
Jul 23 19:20:03.649498 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:03.648757    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:03.649498 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:03.649063    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqm5t" podUID="ea281e35-6304-4075-9745-baf75e10b7b9"
Jul 23 19:20:03.649498 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:03.649146    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:03.649498 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:03.649267    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bq6sp" podUID="eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf"
Jul 23 19:20:03.649498 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:03.649364    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:03.649498 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:03.649474    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tnmv" podUID="f2581039-af56-444f-8229-7221e36f10a2"
Jul 23 19:20:03.698087 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:03.698049    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-53.ec2.internal" event={"ID":"e6a766f128fe58a47aa95c2312516db4","Type":"ContainerStarted","Data":"408d1b19f0eecafe8ab3422097f6f155dc31695330a4995733de2e5b86972b82"}
Jul 23 19:20:04.730675 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:04.730121    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal" event={"ID":"c17e13ee47288c74c89439e877763463","Type":"ContainerStarted","Data":"b70874993473e49ca367adaaa0aa8c3e782f3fb6a8eaba7339fde34156b5c9e3"}
Jul 23 19:20:04.750963 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:04.750905    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-53.ec2.internal" podStartSLOduration=3.7508838410000003 podStartE2EDuration="3.750883841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:03.716522109 +0000 UTC m=+4.553528821" watchObservedRunningTime="2026-07-23 19:20:04.750883841 +0000 UTC m=+5.587890554"
Jul 23 19:20:05.249896 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:05.249855    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret\") pod \"global-pull-secret-syncer-bq6sp\" (UID: \"eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf\") " pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:05.250079 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:05.249959    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs\") pod \"network-metrics-daemon-6tnmv\" (UID: \"f2581039-af56-444f-8229-7221e36f10a2\") " pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:05.250145 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:05.250097    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:05.250220 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:05.250165    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs podName:f2581039-af56-444f-8229-7221e36f10a2 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:09.25014529 +0000 UTC m=+10.087151997 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs") pod "network-metrics-daemon-6tnmv" (UID: "f2581039-af56-444f-8229-7221e36f10a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:05.250689 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:05.250596    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:05.250689 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:05.250655    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret podName:eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf nodeName:}" failed. No retries permitted until 2026-07-23 19:20:09.250639202 +0000 UTC m=+10.087645891 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret") pod "global-pull-secret-syncer-bq6sp" (UID: "eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf") : object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:05.351024 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:05.350393    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdbl4\" (UniqueName: \"kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4\") pod \"network-check-target-sqm5t\" (UID: \"ea281e35-6304-4075-9745-baf75e10b7b9\") " pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:05.351024 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:05.350567    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 19:20:05.351024 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:05.350590    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 19:20:05.351024 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:05.350605    2578 projected.go:196] Error preparing data for projected volume kube-api-access-pdbl4 for pod openshift-network-diagnostics/network-check-target-sqm5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:05.351024 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:05.350671    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4 podName:ea281e35-6304-4075-9745-baf75e10b7b9 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:09.350648898 +0000 UTC m=+10.187655600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdbl4" (UniqueName: "kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4") pod "network-check-target-sqm5t" (UID: "ea281e35-6304-4075-9745-baf75e10b7b9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:05.647348 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:05.646419    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:05.647348 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:05.646580    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tnmv" podUID="f2581039-af56-444f-8229-7221e36f10a2"
Jul 23 19:20:05.647348 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:05.647003    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:05.647348 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:05.647107    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bq6sp" podUID="eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf"
Jul 23 19:20:05.647348 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:05.647166    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:05.647348 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:05.647237    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqm5t" podUID="ea281e35-6304-4075-9745-baf75e10b7b9"
Jul 23 19:20:07.646437 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:07.646402    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:07.646901 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:07.646546    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqm5t" podUID="ea281e35-6304-4075-9745-baf75e10b7b9"
Jul 23 19:20:07.646987 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:07.646957    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:07.647100 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:07.647081    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bq6sp" podUID="eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf"
Jul 23 19:20:07.647157 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:07.647137    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:07.647239 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:07.647221    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tnmv" podUID="f2581039-af56-444f-8229-7221e36f10a2"
Jul 23 19:20:07.740070 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:07.739401    2578 generic.go:356] "Generic (PLEG): container finished" podID="c17e13ee47288c74c89439e877763463" containerID="b70874993473e49ca367adaaa0aa8c3e782f3fb6a8eaba7339fde34156b5c9e3" exitCode=0
Jul 23 19:20:07.740070 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:07.739456    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal" event={"ID":"c17e13ee47288c74c89439e877763463","Type":"ContainerDied","Data":"b70874993473e49ca367adaaa0aa8c3e782f3fb6a8eaba7339fde34156b5c9e3"}
Jul 23 19:20:09.289290 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:09.289231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs\") pod \"network-metrics-daemon-6tnmv\" (UID: \"f2581039-af56-444f-8229-7221e36f10a2\") " pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:09.289800 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:09.289327    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret\") pod \"global-pull-secret-syncer-bq6sp\" (UID: \"eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf\") " pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:09.289800 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:09.289491    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:09.289800 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:09.289574    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret podName:eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf nodeName:}" failed. No retries permitted until 2026-07-23 19:20:17.289554371 +0000 UTC m=+18.126561083 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret") pod "global-pull-secret-syncer-bq6sp" (UID: "eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf") : object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:09.290026 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:09.290004    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:09.290096 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:09.290058    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs podName:f2581039-af56-444f-8229-7221e36f10a2 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:17.290044749 +0000 UTC m=+18.127051436 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs") pod "network-metrics-daemon-6tnmv" (UID: "f2581039-af56-444f-8229-7221e36f10a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:09.390213 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:09.390168    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdbl4\" (UniqueName: \"kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4\") pod \"network-check-target-sqm5t\" (UID: \"ea281e35-6304-4075-9745-baf75e10b7b9\") " pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:09.390441 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:09.390415    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 19:20:09.390441 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:09.390447    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 19:20:09.390654 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:09.390461    2578 projected.go:196] Error preparing data for projected volume kube-api-access-pdbl4 for pod openshift-network-diagnostics/network-check-target-sqm5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:09.390654 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:09.390532    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4 podName:ea281e35-6304-4075-9745-baf75e10b7b9 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:17.390511167 +0000 UTC m=+18.227517940 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdbl4" (UniqueName: "kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4") pod "network-check-target-sqm5t" (UID: "ea281e35-6304-4075-9745-baf75e10b7b9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:09.647628 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:09.647553    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:09.647628 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:09.647583    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:09.647837 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:09.647553    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:09.647837 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:09.647684    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqm5t" podUID="ea281e35-6304-4075-9745-baf75e10b7b9"
Jul 23 19:20:09.647837 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:09.647747    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bq6sp" podUID="eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf"
Jul 23 19:20:09.647837 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:09.647829    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tnmv" podUID="f2581039-af56-444f-8229-7221e36f10a2"
Jul 23 19:20:11.646500 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:11.646438    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:11.646933 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:11.646438    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:11.646933 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:11.646564    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bq6sp" podUID="eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf"
Jul 23 19:20:11.646933 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:11.646596    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:11.646933 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:11.646714    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tnmv" podUID="f2581039-af56-444f-8229-7221e36f10a2"
Jul 23 19:20:11.646933 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:11.646792    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqm5t" podUID="ea281e35-6304-4075-9745-baf75e10b7b9"
Jul 23 19:20:13.646321 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:13.646284    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:13.646794 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:13.646284    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:13.646794 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:13.646412    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqm5t" podUID="ea281e35-6304-4075-9745-baf75e10b7b9"
Jul 23 19:20:13.646794 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:13.646284    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:13.646794 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:13.646553    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bq6sp" podUID="eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf"
Jul 23 19:20:13.646794 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:13.646660    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tnmv" podUID="f2581039-af56-444f-8229-7221e36f10a2"
Jul 23 19:20:15.646366 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:15.646325    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:15.646786 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:15.646325    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:15.646786 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:15.646471    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bq6sp" podUID="eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf"
Jul 23 19:20:15.646786 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:15.646487    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqm5t" podUID="ea281e35-6304-4075-9745-baf75e10b7b9"
Jul 23 19:20:15.646786 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:15.646345    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:15.646786 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:15.646577    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tnmv" podUID="f2581039-af56-444f-8229-7221e36f10a2"
Jul 23 19:20:17.348973 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:17.348940    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret\") pod \"global-pull-secret-syncer-bq6sp\" (UID: \"eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf\") " pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:17.349466 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:17.349028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs\") pod \"network-metrics-daemon-6tnmv\" (UID: \"f2581039-af56-444f-8229-7221e36f10a2\") " pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:17.349466 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:17.349122    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:17.349466 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:17.349182    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:17.349466 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:17.349204    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret podName:eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf nodeName:}" failed. No retries permitted until 2026-07-23 19:20:33.349181407 +0000 UTC m=+34.186188107 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret") pod "global-pull-secret-syncer-bq6sp" (UID: "eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf") : object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:17.349466 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:17.349242    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs podName:f2581039-af56-444f-8229-7221e36f10a2 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:33.349225332 +0000 UTC m=+34.186232020 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs") pod "network-metrics-daemon-6tnmv" (UID: "f2581039-af56-444f-8229-7221e36f10a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:17.449631 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:17.449592    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdbl4\" (UniqueName: \"kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4\") pod \"network-check-target-sqm5t\" (UID: \"ea281e35-6304-4075-9745-baf75e10b7b9\") " pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:17.449823 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:17.449786    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 19:20:17.449823 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:17.449809    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 19:20:17.449823 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:17.449821    2578 projected.go:196] Error preparing data for projected volume kube-api-access-pdbl4 for pod openshift-network-diagnostics/network-check-target-sqm5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:17.449970 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:17.449871    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4 podName:ea281e35-6304-4075-9745-baf75e10b7b9 nodeName:}" failed. No retries permitted until 2026-07-23 19:20:33.449856451 +0000 UTC m=+34.286863141 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdbl4" (UniqueName: "kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4") pod "network-check-target-sqm5t" (UID: "ea281e35-6304-4075-9745-baf75e10b7b9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:17.645965 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:17.645865    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:17.646126 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:17.645865    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:17.646126 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:17.646027    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bq6sp" podUID="eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf"
Jul 23 19:20:17.646126 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:17.646062    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:17.646290 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:17.646185    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqm5t" podUID="ea281e35-6304-4075-9745-baf75e10b7b9"
Jul 23 19:20:17.646345 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:17.646303    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tnmv" podUID="f2581039-af56-444f-8229-7221e36f10a2"
Jul 23 19:20:19.646820 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:19.646791    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:19.647246 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:19.646885    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bq6sp" podUID="eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf"
Jul 23 19:20:19.647246 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:19.646981    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:19.647246 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:19.647105    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tnmv" podUID="f2581039-af56-444f-8229-7221e36f10a2"
Jul 23 19:20:19.647246 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:19.647152    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:19.647433 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:19.647241    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqm5t" podUID="ea281e35-6304-4075-9745-baf75e10b7b9"
Jul 23 19:20:21.648425 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:21.648092    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:21.648425 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:21.648218    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tnmv" podUID="f2581039-af56-444f-8229-7221e36f10a2"
Jul 23 19:20:21.648856 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:21.648582    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:21.648856 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:21.648675    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqm5t" podUID="ea281e35-6304-4075-9745-baf75e10b7b9"
Jul 23 19:20:21.648856 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:21.648751    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:21.648856 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:21.648823    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bq6sp" podUID="eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf"
Jul 23 19:20:21.768877 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:21.768791    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp" event={"ID":"54d8d144-8dfd-43cb-9286-0e0faf09f2aa","Type":"ContainerStarted","Data":"0ec23f1ee985cd6f23f0c4d3c66e08b19af630c79a7c94b47f88f23ce3f5c47a"}
Jul 23 19:20:21.772105 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:21.770595    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rh6dh" event={"ID":"e3da6f91-7977-4b04-9075-c77edf499350","Type":"ContainerStarted","Data":"49593a8db24adab7cbb043f60f9c47d685bdf8cb7c5753e8bd5c64e1665518ca"}
Jul 23 19:20:21.773461 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:21.773391    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nsxhl" event={"ID":"7f327dc2-a00f-4955-a0fc-ec87fc7f16be","Type":"ContainerStarted","Data":"aaea59e5daf52d1dd797a664365808a24b0293df559aa3d6eaec69cd74b18501"}
Jul 23 19:20:21.775130 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:21.775110    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kt2wc" event={"ID":"bd32cdc1-4e4a-4115-a2f7-63375ec6d511","Type":"ContainerStarted","Data":"37db4f1a895692b24678f92c77aac394d3387c46e18d8f3f60e1c93d1668109f"}
Jul 23 19:20:21.776594 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:21.776575    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hk9xx" event={"ID":"f4c27c31-3176-42eb-bfad-18e0d1c99c2c","Type":"ContainerStarted","Data":"e991fe9cd4160373c7a5d85bcb996ebad610d31c44df0a1e24cc9454348981ad"}
Jul 23 19:20:21.777913 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:21.777874    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rs8x2" event={"ID":"b5b1384d-9df9-4eb1-92d9-7f4e82400a82","Type":"ContainerStarted","Data":"211576706d7ef66e2e604d0f1a0b2010ace0fe15e7f67b934cd152b5c24bdfc0"}
Jul 23 19:20:21.779110 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:21.779080    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhxwq" event={"ID":"84174bca-c9df-4cc5-973c-02e209309a9d","Type":"ContainerStarted","Data":"25816cc67d8f41484077fe5ea4a2ef2e8e62713f0cb13c9f72eed743848f9e08"}
Jul 23 19:20:21.780743 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:21.780722    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal" event={"ID":"c17e13ee47288c74c89439e877763463","Type":"ContainerStarted","Data":"16528ac843ff99007a1ea7636d316fbbf562acc06a889da92537279916cfabfe"}
Jul 23 19:20:21.781970 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:21.781951    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk" event={"ID":"abed38b6-bcb9-4908-be37-fa10a5d2dd81","Type":"ContainerStarted","Data":"7df7ce0282703ed36ca9966261f45d59999ae056a2a43eadf430166c2672840b"}
Jul 23 19:20:21.786725 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:21.786688    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rh6dh" podStartSLOduration=2.273732712 podStartE2EDuration="21.786675162s" totalImagesPullingTime="19.51294245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:21.786408883 +0000 UTC m=+22.623415591" watchObservedRunningTime="2026-07-23 19:20:21.786675162 +0000 UTC m=+22.623681937"
Jul 23 19:20:21.803748 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:21.803711    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kt2wc" podStartSLOduration=2.300001441 podStartE2EDuration="21.803697751s" totalImagesPullingTime="19.50369631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:21.80349812 +0000 UTC m=+22.640504820" watchObservedRunningTime="2026-07-23 19:20:21.803697751 +0000 UTC m=+22.640704457"
Jul 23 19:20:21.819074 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:21.819038    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-53.ec2.internal" podStartSLOduration=20.819028031 podStartE2EDuration="20.819028031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:21.818539806 +0000 UTC m=+22.655546533" watchObservedRunningTime="2026-07-23 19:20:21.819028031 +0000 UTC m=+22.656034739"
Jul 23 19:20:21.836991 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:21.836951    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nsxhl" podStartSLOduration=2.274647775 podStartE2EDuration="21.836934861s" totalImagesPullingTime="19.562287086s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:21.836553622 +0000 UTC m=+22.673560320" watchObservedRunningTime="2026-07-23 19:20:21.836934861 +0000 UTC m=+22.673941581"
Jul 23 19:20:21.856397 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:21.854416    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rs8x2" podStartSLOduration=2.291208494 podStartE2EDuration="21.85439701s" totalImagesPullingTime="19.563188516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:21.853999245 +0000 UTC m=+22.691005949" watchObservedRunningTime="2026-07-23 19:20:21.85439701 +0000 UTC m=+22.691403718"
Jul 23 19:20:21.893370 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:21.893242    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hk9xx" podStartSLOduration=2.384119251 podStartE2EDuration="21.8932264s" totalImagesPullingTime="19.509107149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:21.892642092 +0000 UTC m=+22.729648820" watchObservedRunningTime="2026-07-23 19:20:21.8932264 +0000 UTC m=+22.730233107"
Jul 23 19:20:22.786346 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:22.786311    2578 generic.go:356] "Generic (PLEG): container finished" podID="84174bca-c9df-4cc5-973c-02e209309a9d" containerID="25816cc67d8f41484077fe5ea4a2ef2e8e62713f0cb13c9f72eed743848f9e08" exitCode=0
Jul 23 19:20:22.787314 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:22.786394    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhxwq" event={"ID":"84174bca-c9df-4cc5-973c-02e209309a9d","Type":"ContainerDied","Data":"25816cc67d8f41484077fe5ea4a2ef2e8e62713f0cb13c9f72eed743848f9e08"}
Jul 23 19:20:22.789777 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:22.789731    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp" event={"ID":"54d8d144-8dfd-43cb-9286-0e0faf09f2aa","Type":"ContainerStarted","Data":"2ec4f13ab649519edd9e67c9af6abf252b9f73b5a868fc9b12acb145ec5e0fe8"}
Jul 23 19:20:22.789890 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:22.789817    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp" event={"ID":"54d8d144-8dfd-43cb-9286-0e0faf09f2aa","Type":"ContainerStarted","Data":"4430a7ae4e6a7ac871fe3aa982b3133ce7b79d035c47ef4570d0a1e68e45abca"}
Jul 23 19:20:22.789890 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:22.789852    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp" event={"ID":"54d8d144-8dfd-43cb-9286-0e0faf09f2aa","Type":"ContainerStarted","Data":"750f9175c8fe4983f014c5088af154f4f6592bb619e6cda5575b50890a0f84be"}
Jul 23 19:20:22.790008 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:22.789894    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp" event={"ID":"54d8d144-8dfd-43cb-9286-0e0faf09f2aa","Type":"ContainerStarted","Data":"d88cbad090426c4729b33c06c711d9445ae1c8f7910d04286f89c21f3d2483b8"}
Jul 23 19:20:22.790008 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:22.789925    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp" event={"ID":"54d8d144-8dfd-43cb-9286-0e0faf09f2aa","Type":"ContainerStarted","Data":"b8b7a05688521d805a01b74f057cb971e7532915ed322b0c550a7e34c578a70d"}
Jul 23 19:20:23.302354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:23.302328    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 19:20:23.563909 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:23.563798    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T19:20:23.302346292Z","UUID":"39f95e47-de2b-4654-a095-d8cbb8f7a440","Handler":null,"Name":"","Endpoint":""}
Jul 23 19:20:23.565462 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:23.565440    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 19:20:23.565579 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:23.565483    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 19:20:23.646128 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:23.646091    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:23.646331 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:23.646091    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:23.646331 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:23.646242    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bq6sp" podUID="eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf"
Jul 23 19:20:23.646435 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:23.646346    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tnmv" podUID="f2581039-af56-444f-8229-7221e36f10a2"
Jul 23 19:20:23.646435 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:23.646383    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:23.646507 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:23.646433    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqm5t" podUID="ea281e35-6304-4075-9745-baf75e10b7b9"
Jul 23 19:20:23.793751 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:23.793713    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk" event={"ID":"abed38b6-bcb9-4908-be37-fa10a5d2dd81","Type":"ContainerStarted","Data":"d9a782e76599a1ef7637b2fdabdc7fee86ca2c369cb4d54ee1d9df8df7ded163"}
Jul 23 19:20:23.795265 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:23.795218    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wj5wl" event={"ID":"42d866a9-07dc-48fb-9f64-c83b4cab71b7","Type":"ContainerStarted","Data":"277f0833ce127af74dac016df203416cba18b6bf20d62e7ba35c5fc3aa2826f5"}
Jul 23 19:20:23.812948 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:23.812912    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wj5wl" podStartSLOduration=8.982412737 podStartE2EDuration="23.812899385s" totalImagesPullingTime="14.830486648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:23.812408013 +0000 UTC m=+24.649414719" watchObservedRunningTime="2026-07-23 19:20:23.812899385 +0000 UTC m=+24.649906091"
Jul 23 19:20:24.799977 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:24.799750    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk" event={"ID":"abed38b6-bcb9-4908-be37-fa10a5d2dd81","Type":"ContainerStarted","Data":"1da0550baaa7b00939315d716cac6ad84a1832e1c9f7d1b5ec7c8c2a170113c5"}
Jul 23 19:20:24.803330 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:24.803296    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp" event={"ID":"54d8d144-8dfd-43cb-9286-0e0faf09f2aa","Type":"ContainerStarted","Data":"b9f9eefc678a0aed9510d7563dc526398d31b150ed59b6d54805cd681be062d0"}
Jul 23 19:20:24.821762 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:24.821718    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ktlk" podStartSLOduration=2.5855034420000003 podStartE2EDuration="24.821696644s" totalImagesPullingTime="22.236193202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:24.821495056 +0000 UTC m=+25.658501799" watchObservedRunningTime="2026-07-23 19:20:24.821696644 +0000 UTC m=+25.658703350"
Jul 23 19:20:25.617136 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:25.617097    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kt2wc"
Jul 23 19:20:25.617748 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:25.617723    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kt2wc"
Jul 23 19:20:25.646122 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:25.646097    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:25.646241 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:25.646101    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:25.646241 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:25.646219    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tnmv" podUID="f2581039-af56-444f-8229-7221e36f10a2"
Jul 23 19:20:25.646355 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:25.646105    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:25.646355 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:25.646279    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqm5t" podUID="ea281e35-6304-4075-9745-baf75e10b7b9"
Jul 23 19:20:25.646355 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:25.646332    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bq6sp" podUID="eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf"
Jul 23 19:20:25.805858 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:25.805822    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kt2wc"
Jul 23 19:20:25.806555 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:25.806319    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kt2wc"
Jul 23 19:20:27.646565 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:27.646405    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:27.647106 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:27.646410    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:27.647106 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:27.646639    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tnmv" podUID="f2581039-af56-444f-8229-7221e36f10a2"
Jul 23 19:20:27.647106 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:27.646725    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqm5t" podUID="ea281e35-6304-4075-9745-baf75e10b7b9"
Jul 23 19:20:27.647106 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:27.646446    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:27.647106 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:27.646821    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bq6sp" podUID="eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf"
Jul 23 19:20:27.811683 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:27.811600    2578 generic.go:356] "Generic (PLEG): container finished" podID="84174bca-c9df-4cc5-973c-02e209309a9d" containerID="9bb6cb70cc7641ab5f5f077cf35a4f95d4f23f46cdac45a261b454cb267bceaf" exitCode=0
Jul 23 19:20:27.811839 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:27.811694    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhxwq" event={"ID":"84174bca-c9df-4cc5-973c-02e209309a9d","Type":"ContainerDied","Data":"9bb6cb70cc7641ab5f5f077cf35a4f95d4f23f46cdac45a261b454cb267bceaf"}
Jul 23 19:20:27.815622 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:27.815596    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp" event={"ID":"54d8d144-8dfd-43cb-9286-0e0faf09f2aa","Type":"ContainerStarted","Data":"3afb99f74c3f008e46a2e08488e5dad9820ae857efcc26a78d2dc949be3465ef"}
Jul 23 19:20:27.815870 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:27.815842    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:27.815965 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:27.815919    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:27.815965 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:27.815962    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:27.831528 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:27.831502    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:27.831743 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:27.831727    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:20:27.858545 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:27.858497    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp" podStartSLOduration=8.256671327 podStartE2EDuration="27.858483304s" totalImagesPullingTime="19.601811977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:27.858091909 +0000 UTC m=+28.695098615" watchObservedRunningTime="2026-07-23 19:20:27.858483304 +0000 UTC m=+28.695490010"
Jul 23 19:20:29.380889 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:29.380699    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bq6sp"]
Jul 23 19:20:29.381320 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:29.381012    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:29.381320 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:29.381102    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bq6sp" podUID="eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf"
Jul 23 19:20:29.383818 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:29.383796    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6tnmv"]
Jul 23 19:20:29.383918 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:29.383908    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:29.384052 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:29.384018    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tnmv" podUID="f2581039-af56-444f-8229-7221e36f10a2"
Jul 23 19:20:29.384505 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:29.384485    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sqm5t"]
Jul 23 19:20:29.384579 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:29.384567    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:29.384678 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:29.384657    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqm5t" podUID="ea281e35-6304-4075-9745-baf75e10b7b9"
Jul 23 19:20:29.822240 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:29.822208    2578 generic.go:356] "Generic (PLEG): container finished" podID="84174bca-c9df-4cc5-973c-02e209309a9d" containerID="4370aec8a09aba57244cc182bee561d806a78967525904812ad087bee0961878" exitCode=0
Jul 23 19:20:29.822415 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:29.822292    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhxwq" event={"ID":"84174bca-c9df-4cc5-973c-02e209309a9d","Type":"ContainerDied","Data":"4370aec8a09aba57244cc182bee561d806a78967525904812ad087bee0961878"}
Jul 23 19:20:30.645654 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:30.645622    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:30.646100 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:30.645745    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tnmv" podUID="f2581039-af56-444f-8229-7221e36f10a2"
Jul 23 19:20:31.645702 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:31.645621    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:31.646194 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:31.645722    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqm5t" podUID="ea281e35-6304-4075-9745-baf75e10b7b9"
Jul 23 19:20:31.646194 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:31.645781    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:31.646194 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:31.645887    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bq6sp" podUID="eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf"
Jul 23 19:20:31.828486 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:31.828452    2578 generic.go:356] "Generic (PLEG): container finished" podID="84174bca-c9df-4cc5-973c-02e209309a9d" containerID="eae77e8527d55019493513e5c877bc8e2d1345f5fbb04bf72253a9650e0af558" exitCode=0
Jul 23 19:20:31.828635 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:31.828494    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhxwq" event={"ID":"84174bca-c9df-4cc5-973c-02e209309a9d","Type":"ContainerDied","Data":"eae77e8527d55019493513e5c877bc8e2d1345f5fbb04bf72253a9650e0af558"}
Jul 23 19:20:32.646174 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:32.646141    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:32.646730 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:32.646272    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6tnmv" podUID="f2581039-af56-444f-8229-7221e36f10a2"
Jul 23 19:20:33.369529 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:33.369489    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret\") pod \"global-pull-secret-syncer-bq6sp\" (UID: \"eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf\") " pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:33.369707 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:33.369580    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs\") pod \"network-metrics-daemon-6tnmv\" (UID: \"f2581039-af56-444f-8229-7221e36f10a2\") " pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:33.369707 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:33.369649    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:33.369707 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:33.369689    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:33.369815 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:33.369725    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret podName:eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf nodeName:}" failed. No retries permitted until 2026-07-23 19:21:05.369703537 +0000 UTC m=+66.206710236 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret") pod "global-pull-secret-syncer-bq6sp" (UID: "eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf") : object "kube-system"/"original-pull-secret" not registered
Jul 23 19:20:33.369815 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:33.369747    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs podName:f2581039-af56-444f-8229-7221e36f10a2 nodeName:}" failed. No retries permitted until 2026-07-23 19:21:05.369735894 +0000 UTC m=+66.206742586 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs") pod "network-metrics-daemon-6tnmv" (UID: "f2581039-af56-444f-8229-7221e36f10a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 19:20:33.470585 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:33.470546    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdbl4\" (UniqueName: \"kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4\") pod \"network-check-target-sqm5t\" (UID: \"ea281e35-6304-4075-9745-baf75e10b7b9\") " pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:33.470755 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:33.470687    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 19:20:33.470755 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:33.470718    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 19:20:33.470755 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:33.470727    2578 projected.go:196] Error preparing data for projected volume kube-api-access-pdbl4 for pod openshift-network-diagnostics/network-check-target-sqm5t: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:33.470933 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:33.470816    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4 podName:ea281e35-6304-4075-9745-baf75e10b7b9 nodeName:}" failed. No retries permitted until 2026-07-23 19:21:05.470802322 +0000 UTC m=+66.307809007 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdbl4" (UniqueName: "kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4") pod "network-check-target-sqm5t" (UID: "ea281e35-6304-4075-9745-baf75e10b7b9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 19:20:33.646069 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:33.645998    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:33.646240 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:33.646001    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:33.646240 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:33.646110    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqm5t" podUID="ea281e35-6304-4075-9745-baf75e10b7b9"
Jul 23 19:20:33.646240 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:33.646193    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bq6sp" podUID="eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf"
Jul 23 19:20:34.443189 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.443124    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-53.ec2.internal" event="NodeReady"
Jul 23 19:20:34.443379 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.443242    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 19:20:34.488027 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.487997    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-568cd74d5f-lf4zc"]
Jul 23 19:20:34.490807 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.490788    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.493660 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.493634    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 19:20:34.493835 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.493815    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 19:20:34.494127 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.494107    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zfpwt\""
Jul 23 19:20:34.494239 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.494131    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 19:20:34.500722 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.500692    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 19:20:34.512177 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.512159    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vb527"]
Jul 23 19:20:34.514520 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.514501    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cwqmz"]
Jul 23 19:20:34.514647 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.514628    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vb527"
Jul 23 19:20:34.516309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.516290    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-568cd74d5f-lf4zc"]
Jul 23 19:20:34.516391 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.516372    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cwqmz"
Jul 23 19:20:34.516786 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.516767    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j4csw\""
Jul 23 19:20:34.519390 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.519271    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 19:20:34.519485 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.519445    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 19:20:34.519547 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.519485    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n4phc\""
Jul 23 19:20:34.519547 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.519530    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 19:20:34.519993 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.519974    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 19:20:34.520077 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.519983    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 19:20:34.534028 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.534008    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vb527"]
Jul 23 19:20:34.537326 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.537305    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cwqmz"]
Jul 23 19:20:34.578644 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.578616    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxc6r\" (UniqueName: \"kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-kube-api-access-gxc6r\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.578786 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.578691    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-ca-trust-extracted\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.578786 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.578731    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-bound-sa-token\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.578786 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.578756    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-certificates\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.578953 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.578839    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-image-registry-private-configuration\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.578953 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.578873    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-installation-pull-secrets\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.578953 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.578911    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-tls\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.578953 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.578932    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-trusted-ca\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.646005 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.645976    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:20:34.648673 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.648652    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 19:20:34.649050 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.648801    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k9tbr\""
Jul 23 19:20:34.680139 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.680111    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-image-registry-private-configuration\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.680292 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.680144    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-installation-pull-secrets\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.680292 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.680169    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-tls\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.680292 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.680193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-trusted-ca\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.680292 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.680219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxc6r\" (UniqueName: \"kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-kube-api-access-gxc6r\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.680292 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.680267    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a42456f-2357-4731-a2ea-e5f2078eb05d-tmp-dir\") pod \"dns-default-vb527\" (UID: \"2a42456f-2357-4731-a2ea-e5f2078eb05d\") " pod="openshift-dns/dns-default-vb527"
Jul 23 19:20:34.680561 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:34.680296    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 19:20:34.680561 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:34.680315    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-568cd74d5f-lf4zc: secret "image-registry-tls" not found
Jul 23 19:20:34.680561 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.680321    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfc02285-5ead-4883-9edc-09564c3c2cf9-cert\") pod \"ingress-canary-cwqmz\" (UID: \"cfc02285-5ead-4883-9edc-09564c3c2cf9\") " pod="openshift-ingress-canary/ingress-canary-cwqmz"
Jul 23 19:20:34.680561 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.680346    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2a42456f-2357-4731-a2ea-e5f2078eb05d-config-volume\") pod \"dns-default-vb527\" (UID: \"2a42456f-2357-4731-a2ea-e5f2078eb05d\") " pod="openshift-dns/dns-default-vb527"
Jul 23 19:20:34.680561 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.680378    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-ca-trust-extracted\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.680561 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:34.680419    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-tls podName:e7738bad-49dc-4adc-a379-0a24f5c7ef0d nodeName:}" failed. No retries permitted until 2026-07-23 19:20:35.180397811 +0000 UTC m=+36.017404516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-tls") pod "image-registry-568cd74d5f-lf4zc" (UID: "e7738bad-49dc-4adc-a379-0a24f5c7ef0d") : secret "image-registry-tls" not found
Jul 23 19:20:34.680561 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.680457    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4gk5\" (UniqueName: \"kubernetes.io/projected/cfc02285-5ead-4883-9edc-09564c3c2cf9-kube-api-access-k4gk5\") pod \"ingress-canary-cwqmz\" (UID: \"cfc02285-5ead-4883-9edc-09564c3c2cf9\") " pod="openshift-ingress-canary/ingress-canary-cwqmz"
Jul 23 19:20:34.680561 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.680493    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-bound-sa-token\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.680561 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.680518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a42456f-2357-4731-a2ea-e5f2078eb05d-metrics-tls\") pod \"dns-default-vb527\" (UID: \"2a42456f-2357-4731-a2ea-e5f2078eb05d\") " pod="openshift-dns/dns-default-vb527"
Jul 23 19:20:34.680561 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.680545    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62sbf\" (UniqueName: \"kubernetes.io/projected/2a42456f-2357-4731-a2ea-e5f2078eb05d-kube-api-access-62sbf\") pod \"dns-default-vb527\" (UID: \"2a42456f-2357-4731-a2ea-e5f2078eb05d\") " pod="openshift-dns/dns-default-vb527"
Jul 23 19:20:34.680990 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.680576    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-certificates\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.680990 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.680707    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-ca-trust-extracted\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.681279 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.681231    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-certificates\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.681935 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.681915    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-trusted-ca\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.685170 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.685031    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-installation-pull-secrets\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.685282 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.685077    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-image-registry-private-configuration\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.691515 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.691478    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxc6r\" (UniqueName: \"kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-kube-api-access-gxc6r\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.691742 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.691725    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-bound-sa-token\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:34.781620 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.781583    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4gk5\" (UniqueName: \"kubernetes.io/projected/cfc02285-5ead-4883-9edc-09564c3c2cf9-kube-api-access-k4gk5\") pod \"ingress-canary-cwqmz\" (UID: \"cfc02285-5ead-4883-9edc-09564c3c2cf9\") " pod="openshift-ingress-canary/ingress-canary-cwqmz"
Jul 23 19:20:34.781822 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.781632    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a42456f-2357-4731-a2ea-e5f2078eb05d-metrics-tls\") pod \"dns-default-vb527\" (UID: \"2a42456f-2357-4731-a2ea-e5f2078eb05d\") " pod="openshift-dns/dns-default-vb527"
Jul 23 19:20:34.781822 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.781656    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62sbf\" (UniqueName: \"kubernetes.io/projected/2a42456f-2357-4731-a2ea-e5f2078eb05d-kube-api-access-62sbf\") pod \"dns-default-vb527\" (UID: \"2a42456f-2357-4731-a2ea-e5f2078eb05d\") " pod="openshift-dns/dns-default-vb527"
Jul 23 19:20:34.781822 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.781733    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a42456f-2357-4731-a2ea-e5f2078eb05d-tmp-dir\") pod \"dns-default-vb527\" (UID: \"2a42456f-2357-4731-a2ea-e5f2078eb05d\") " pod="openshift-dns/dns-default-vb527"
Jul 23 19:20:34.781822 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:34.781749    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 19:20:34.781822 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.781781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfc02285-5ead-4883-9edc-09564c3c2cf9-cert\") pod \"ingress-canary-cwqmz\" (UID: \"cfc02285-5ead-4883-9edc-09564c3c2cf9\") " pod="openshift-ingress-canary/ingress-canary-cwqmz"
Jul 23 19:20:34.781822 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.781806    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2a42456f-2357-4731-a2ea-e5f2078eb05d-config-volume\") pod \"dns-default-vb527\" (UID: \"2a42456f-2357-4731-a2ea-e5f2078eb05d\") " pod="openshift-dns/dns-default-vb527"
Jul 23 19:20:34.782139 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:34.781845    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a42456f-2357-4731-a2ea-e5f2078eb05d-metrics-tls podName:2a42456f-2357-4731-a2ea-e5f2078eb05d nodeName:}" failed. No retries permitted until 2026-07-23 19:20:35.281820623 +0000 UTC m=+36.118827332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a42456f-2357-4731-a2ea-e5f2078eb05d-metrics-tls") pod "dns-default-vb527" (UID: "2a42456f-2357-4731-a2ea-e5f2078eb05d") : secret "dns-default-metrics-tls" not found
Jul 23 19:20:34.782273 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.782233    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a42456f-2357-4731-a2ea-e5f2078eb05d-tmp-dir\") pod \"dns-default-vb527\" (UID: \"2a42456f-2357-4731-a2ea-e5f2078eb05d\") " pod="openshift-dns/dns-default-vb527"
Jul 23 19:20:34.782464 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.782433    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2a42456f-2357-4731-a2ea-e5f2078eb05d-config-volume\") pod \"dns-default-vb527\" (UID: \"2a42456f-2357-4731-a2ea-e5f2078eb05d\") " pod="openshift-dns/dns-default-vb527"
Jul 23 19:20:34.785535 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.785509    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfc02285-5ead-4883-9edc-09564c3c2cf9-cert\") pod \"ingress-canary-cwqmz\" (UID: \"cfc02285-5ead-4883-9edc-09564c3c2cf9\") " pod="openshift-ingress-canary/ingress-canary-cwqmz"
Jul 23 19:20:34.791170 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.791152    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62sbf\" (UniqueName: \"kubernetes.io/projected/2a42456f-2357-4731-a2ea-e5f2078eb05d-kube-api-access-62sbf\") pod \"dns-default-vb527\" (UID: \"2a42456f-2357-4731-a2ea-e5f2078eb05d\") " pod="openshift-dns/dns-default-vb527"
Jul 23 19:20:34.791282 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.791192    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4gk5\" (UniqueName: \"kubernetes.io/projected/cfc02285-5ead-4883-9edc-09564c3c2cf9-kube-api-access-k4gk5\") pod \"ingress-canary-cwqmz\" (UID: \"cfc02285-5ead-4883-9edc-09564c3c2cf9\") " pod="openshift-ingress-canary/ingress-canary-cwqmz"
Jul 23 19:20:34.831423 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:34.831390    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cwqmz"
Jul 23 19:20:35.186087 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.185963    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-tls\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:35.186240 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:35.186112    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 19:20:35.186240 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:35.186128    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-568cd74d5f-lf4zc: secret "image-registry-tls" not found
Jul 23 19:20:35.186240 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:35.186193    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-tls podName:e7738bad-49dc-4adc-a379-0a24f5c7ef0d nodeName:}" failed. No retries permitted until 2026-07-23 19:20:36.186173395 +0000 UTC m=+37.023180085 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-tls") pod "image-registry-568cd74d5f-lf4zc" (UID: "e7738bad-49dc-4adc-a379-0a24f5c7ef0d") : secret "image-registry-tls" not found
Jul 23 19:20:35.287060 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.287023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a42456f-2357-4731-a2ea-e5f2078eb05d-metrics-tls\") pod \"dns-default-vb527\" (UID: \"2a42456f-2357-4731-a2ea-e5f2078eb05d\") " pod="openshift-dns/dns-default-vb527"
Jul 23 19:20:35.287245 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:35.287154    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 19:20:35.287245 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:35.287209    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a42456f-2357-4731-a2ea-e5f2078eb05d-metrics-tls podName:2a42456f-2357-4731-a2ea-e5f2078eb05d nodeName:}" failed. No retries permitted until 2026-07-23 19:20:36.287195533 +0000 UTC m=+37.124202218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a42456f-2357-4731-a2ea-e5f2078eb05d-metrics-tls") pod "dns-default-vb527" (UID: "2a42456f-2357-4731-a2ea-e5f2078eb05d") : secret "dns-default-metrics-tls" not found
Jul 23 19:20:35.415049 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.415011    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fvqj9"]
Jul 23 19:20:35.417437 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.417399    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:35.420816 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.420785    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 19:20:35.421554 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.421532    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 19:20:35.422334 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.421924    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 19:20:35.422334 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.422156    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v89gs\""
Jul 23 19:20:35.422505 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.422389    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 19:20:35.433511 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.433490    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fvqj9"]
Jul 23 19:20:35.547999 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.546603    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9bd9v"]
Jul 23 19:20:35.549827 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.549796    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9bd9v"
Jul 23 19:20:35.552375 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.552356    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-cvscs\""
Jul 23 19:20:35.552574 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.552554    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 23 19:20:35.552655 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.552555    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 23 19:20:35.559459 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.559438    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9bd9v"]
Jul 23 19:20:35.589278 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.589224    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09653eed-2296-4cb5-a06b-0f4b37981feb-data-volume\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:35.589443 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.589294    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chgvw\" (UniqueName: \"kubernetes.io/projected/09653eed-2296-4cb5-a06b-0f4b37981feb-kube-api-access-chgvw\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:35.589443 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.589361    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09653eed-2296-4cb5-a06b-0f4b37981feb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:35.589443 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.589400    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09653eed-2296-4cb5-a06b-0f4b37981feb-crio-socket\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:35.589593 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.589526    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09653eed-2296-4cb5-a06b-0f4b37981feb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:35.646270 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.646191    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:20:35.646270 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.646224    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:20:35.649500 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.649242    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 19:20:35.649500 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.649304    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 19:20:35.649500 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.649323    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 19:20:35.649500 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.649242    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t9qhx\""
Jul 23 19:20:35.690106 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.690076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chgvw\" (UniqueName: \"kubernetes.io/projected/09653eed-2296-4cb5-a06b-0f4b37981feb-kube-api-access-chgvw\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:35.690278 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.690126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09653eed-2296-4cb5-a06b-0f4b37981feb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:35.690278 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.690161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09653eed-2296-4cb5-a06b-0f4b37981feb-crio-socket\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:35.690278 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.690225    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqrsv\" (UniqueName: \"kubernetes.io/projected/07ec9ea6-8b34-4909-9fbb-9740c883b858-kube-api-access-jqrsv\") pod \"migrator-7cc9c7ffd7-9bd9v\" (UID: \"07ec9ea6-8b34-4909-9fbb-9740c883b858\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9bd9v"
Jul 23 19:20:35.690435 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.690309    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09653eed-2296-4cb5-a06b-0f4b37981feb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:35.690435 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:35.690321    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 19:20:35.690435 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.690359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09653eed-2296-4cb5-a06b-0f4b37981feb-data-volume\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:35.690435 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:35.690411    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09653eed-2296-4cb5-a06b-0f4b37981feb-kube-rbac-proxy-cm podName:09653eed-2296-4cb5-a06b-0f4b37981feb nodeName:}" failed. No retries permitted until 2026-07-23 19:20:36.190388329 +0000 UTC m=+37.027395033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09653eed-2296-4cb5-a06b-0f4b37981feb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fvqj9" (UID: "09653eed-2296-4cb5-a06b-0f4b37981feb") : configmap "kube-rbac-proxy" not found
Jul 23 19:20:35.690435 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:35.690427    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 19:20:35.690659 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.690441    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/09653eed-2296-4cb5-a06b-0f4b37981feb-crio-socket\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:35.690659 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:35.690490    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09653eed-2296-4cb5-a06b-0f4b37981feb-insights-runtime-extractor-tls podName:09653eed-2296-4cb5-a06b-0f4b37981feb nodeName:}" failed. No retries permitted until 2026-07-23 19:20:36.190472272 +0000 UTC m=+37.027478972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09653eed-2296-4cb5-a06b-0f4b37981feb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fvqj9" (UID: "09653eed-2296-4cb5-a06b-0f4b37981feb") : secret "insights-runtime-extractor-tls" not found
Jul 23 19:20:35.690659 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.690630    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/09653eed-2296-4cb5-a06b-0f4b37981feb-data-volume\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:35.710022 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.709989    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chgvw\" (UniqueName: \"kubernetes.io/projected/09653eed-2296-4cb5-a06b-0f4b37981feb-kube-api-access-chgvw\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:35.791159 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.791130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqrsv\" (UniqueName: \"kubernetes.io/projected/07ec9ea6-8b34-4909-9fbb-9740c883b858-kube-api-access-jqrsv\") pod \"migrator-7cc9c7ffd7-9bd9v\" (UID: \"07ec9ea6-8b34-4909-9fbb-9740c883b858\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9bd9v"
Jul 23 19:20:35.804245 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.804183    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqrsv\" (UniqueName: \"kubernetes.io/projected/07ec9ea6-8b34-4909-9fbb-9740c883b858-kube-api-access-jqrsv\") pod \"migrator-7cc9c7ffd7-9bd9v\" (UID: \"07ec9ea6-8b34-4909-9fbb-9740c883b858\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9bd9v"
Jul 23 19:20:35.861380 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:35.861352    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9bd9v"
Jul 23 19:20:36.093601 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:36.093543    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9bd9v"]
Jul 23 19:20:36.095901 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:36.095882    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cwqmz"]
Jul 23 19:20:36.097999 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:20:36.097978    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07ec9ea6_8b34_4909_9fbb_9740c883b858.slice/crio-6536e4ea1c79e4af4c8f14bceca98ef9fdf66b11d108c499405563d37fbd89d9 WatchSource:0}: Error finding container 6536e4ea1c79e4af4c8f14bceca98ef9fdf66b11d108c499405563d37fbd89d9: Status 404 returned error can't find the container with id 6536e4ea1c79e4af4c8f14bceca98ef9fdf66b11d108c499405563d37fbd89d9
Jul 23 19:20:36.099158 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:20:36.099139    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfc02285_5ead_4883_9edc_09564c3c2cf9.slice/crio-68265acb89e9f5440d5416db7dd2df5ee69c9ecf6cd92c9a5040fd138c8184dd WatchSource:0}: Error finding container 68265acb89e9f5440d5416db7dd2df5ee69c9ecf6cd92c9a5040fd138c8184dd: Status 404 returned error can't find the container with id 68265acb89e9f5440d5416db7dd2df5ee69c9ecf6cd92c9a5040fd138c8184dd
Jul 23 19:20:36.195734 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:36.195711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-tls\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:36.195857 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:36.195766    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09653eed-2296-4cb5-a06b-0f4b37981feb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:36.195857 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:36.195850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09653eed-2296-4cb5-a06b-0f4b37981feb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:36.195968 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:36.195887    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 19:20:36.195968 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:36.195909    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-568cd74d5f-lf4zc: secret "image-registry-tls" not found
Jul 23 19:20:36.195968 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:36.195952    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 19:20:36.196090 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:36.195972    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-tls podName:e7738bad-49dc-4adc-a379-0a24f5c7ef0d nodeName:}" failed. No retries permitted until 2026-07-23 19:20:38.19595124 +0000 UTC m=+39.032957938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-tls") pod "image-registry-568cd74d5f-lf4zc" (UID: "e7738bad-49dc-4adc-a379-0a24f5c7ef0d") : secret "image-registry-tls" not found
Jul 23 19:20:36.196090 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:36.196012    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09653eed-2296-4cb5-a06b-0f4b37981feb-kube-rbac-proxy-cm podName:09653eed-2296-4cb5-a06b-0f4b37981feb nodeName:}" failed. No retries permitted until 2026-07-23 19:20:37.195994554 +0000 UTC m=+38.033001261 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09653eed-2296-4cb5-a06b-0f4b37981feb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fvqj9" (UID: "09653eed-2296-4cb5-a06b-0f4b37981feb") : configmap "kube-rbac-proxy" not found
Jul 23 19:20:36.196090 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:36.196011    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 19:20:36.196090 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:36.196053    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09653eed-2296-4cb5-a06b-0f4b37981feb-insights-runtime-extractor-tls podName:09653eed-2296-4cb5-a06b-0f4b37981feb nodeName:}" failed. No retries permitted until 2026-07-23 19:20:37.196042954 +0000 UTC m=+38.033049642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09653eed-2296-4cb5-a06b-0f4b37981feb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fvqj9" (UID: "09653eed-2296-4cb5-a06b-0f4b37981feb") : secret "insights-runtime-extractor-tls" not found
Jul 23 19:20:36.296955 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:36.296924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a42456f-2357-4731-a2ea-e5f2078eb05d-metrics-tls\") pod \"dns-default-vb527\" (UID: \"2a42456f-2357-4731-a2ea-e5f2078eb05d\") " pod="openshift-dns/dns-default-vb527"
Jul 23 19:20:36.297079 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:36.297043    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 19:20:36.297112 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:36.297099    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a42456f-2357-4731-a2ea-e5f2078eb05d-metrics-tls podName:2a42456f-2357-4731-a2ea-e5f2078eb05d nodeName:}" failed. No retries permitted until 2026-07-23 19:20:38.297083933 +0000 UTC m=+39.134090625 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a42456f-2357-4731-a2ea-e5f2078eb05d-metrics-tls") pod "dns-default-vb527" (UID: "2a42456f-2357-4731-a2ea-e5f2078eb05d") : secret "dns-default-metrics-tls" not found
Jul 23 19:20:36.844829 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:36.844795    2578 generic.go:356] "Generic (PLEG): container finished" podID="84174bca-c9df-4cc5-973c-02e209309a9d" containerID="536f1233a5e136aa6cce74849d688bae2f9123e01b51ed78eecc4208e82a7dec" exitCode=0
Jul 23 19:20:36.845300 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:36.844888    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhxwq" event={"ID":"84174bca-c9df-4cc5-973c-02e209309a9d","Type":"ContainerDied","Data":"536f1233a5e136aa6cce74849d688bae2f9123e01b51ed78eecc4208e82a7dec"}
Jul 23 19:20:36.846760 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:36.846703    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cwqmz" event={"ID":"cfc02285-5ead-4883-9edc-09564c3c2cf9","Type":"ContainerStarted","Data":"68265acb89e9f5440d5416db7dd2df5ee69c9ecf6cd92c9a5040fd138c8184dd"}
Jul 23 19:20:36.848153 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:36.848076    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9bd9v" event={"ID":"07ec9ea6-8b34-4909-9fbb-9740c883b858","Type":"ContainerStarted","Data":"6536e4ea1c79e4af4c8f14bceca98ef9fdf66b11d108c499405563d37fbd89d9"}
Jul 23 19:20:36.997838 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:36.997817    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hk9xx_f4c27c31-3176-42eb-bfad-18e0d1c99c2c/dns-node-resolver/0.log"
Jul 23 19:20:37.205626 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:37.205552    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09653eed-2296-4cb5-a06b-0f4b37981feb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:37.205626 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:37.205622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09653eed-2296-4cb5-a06b-0f4b37981feb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:37.205823 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:37.205727    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 19:20:37.205823 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:37.205785    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09653eed-2296-4cb5-a06b-0f4b37981feb-insights-runtime-extractor-tls podName:09653eed-2296-4cb5-a06b-0f4b37981feb nodeName:}" failed. No retries permitted until 2026-07-23 19:20:39.205771847 +0000 UTC m=+40.042778545 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09653eed-2296-4cb5-a06b-0f4b37981feb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fvqj9" (UID: "09653eed-2296-4cb5-a06b-0f4b37981feb") : secret "insights-runtime-extractor-tls" not found
Jul 23 19:20:37.205968 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:37.205722    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 19:20:37.206081 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:37.206014    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09653eed-2296-4cb5-a06b-0f4b37981feb-kube-rbac-proxy-cm podName:09653eed-2296-4cb5-a06b-0f4b37981feb nodeName:}" failed. No retries permitted until 2026-07-23 19:20:39.205996079 +0000 UTC m=+40.043002775 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09653eed-2296-4cb5-a06b-0f4b37981feb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fvqj9" (UID: "09653eed-2296-4cb5-a06b-0f4b37981feb") : configmap "kube-rbac-proxy" not found
Jul 23 19:20:37.853131 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:37.853058    2578 generic.go:356] "Generic (PLEG): container finished" podID="84174bca-c9df-4cc5-973c-02e209309a9d" containerID="74e18be63e7da624495535bd645db65ad63321f33bc7904f40f288199050bf98" exitCode=0
Jul 23 19:20:37.853651 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:37.853134    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhxwq" event={"ID":"84174bca-c9df-4cc5-973c-02e209309a9d","Type":"ContainerDied","Data":"74e18be63e7da624495535bd645db65ad63321f33bc7904f40f288199050bf98"}
Jul 23 19:20:37.854828 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:37.854805    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9bd9v" event={"ID":"07ec9ea6-8b34-4909-9fbb-9740c883b858","Type":"ContainerStarted","Data":"482f18914b31585cfa14f30c5dd2697bfcfb91b5e12b74f3902dc53086bfb379"}
Jul 23 19:20:37.854907 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:37.854852    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9bd9v" event={"ID":"07ec9ea6-8b34-4909-9fbb-9740c883b858","Type":"ContainerStarted","Data":"3d96d34014cf7fcbb6f6462696363664ea7a5f557040039bffe890851230f8aa"}
Jul 23 19:20:37.912121 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:37.912076    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9bd9v" podStartSLOduration=1.473782081 podStartE2EDuration="2.912060064s" totalImagesPullingTime="1.438277983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:20:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:37.910958788 +0000 UTC m=+38.747965521" watchObservedRunningTime="2026-07-23 19:20:37.912060064 +0000 UTC m=+38.749066770"
Jul 23 19:20:38.189857 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:38.189784    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rh6dh_e3da6f91-7977-4b04-9075-c77edf499350/node-ca/0.log"
Jul 23 19:20:38.213137 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:38.213110    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-tls\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:38.213298 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:38.213281    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 19:20:38.213358 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:38.213301    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-568cd74d5f-lf4zc: secret "image-registry-tls" not found
Jul 23 19:20:38.213394 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:38.213365    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-tls podName:e7738bad-49dc-4adc-a379-0a24f5c7ef0d nodeName:}" failed. No retries permitted until 2026-07-23 19:20:42.213347863 +0000 UTC m=+43.050354548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-tls") pod "image-registry-568cd74d5f-lf4zc" (UID: "e7738bad-49dc-4adc-a379-0a24f5c7ef0d") : secret "image-registry-tls" not found
Jul 23 19:20:38.314322 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:38.314278    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a42456f-2357-4731-a2ea-e5f2078eb05d-metrics-tls\") pod \"dns-default-vb527\" (UID: \"2a42456f-2357-4731-a2ea-e5f2078eb05d\") " pod="openshift-dns/dns-default-vb527"
Jul 23 19:20:38.314479 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:38.314452    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 19:20:38.314547 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:38.314528    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a42456f-2357-4731-a2ea-e5f2078eb05d-metrics-tls podName:2a42456f-2357-4731-a2ea-e5f2078eb05d nodeName:}" failed. No retries permitted until 2026-07-23 19:20:42.314507096 +0000 UTC m=+43.151513782 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a42456f-2357-4731-a2ea-e5f2078eb05d-metrics-tls") pod "dns-default-vb527" (UID: "2a42456f-2357-4731-a2ea-e5f2078eb05d") : secret "dns-default-metrics-tls" not found
Jul 23 19:20:38.860042 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:38.860005    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vhxwq" event={"ID":"84174bca-c9df-4cc5-973c-02e209309a9d","Type":"ContainerStarted","Data":"fd827a97a6a69eaa937cf9ee6e40028fca8e31c36fc4eec73227dedfa813a4a9"}
Jul 23 19:20:38.885954 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:38.885794    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vhxwq" podStartSLOduration=8.229449266 podStartE2EDuration="38.885779422s" totalImagesPullingTime="30.656330156s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:38.885528773 +0000 UTC m=+39.722535542" watchObservedRunningTime="2026-07-23 19:20:38.885779422 +0000 UTC m=+39.722786108"
Jul 23 19:20:39.223178 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:39.223151    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09653eed-2296-4cb5-a06b-0f4b37981feb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:39.223295 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:39.223204    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09653eed-2296-4cb5-a06b-0f4b37981feb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:39.223295 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:39.223270    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 19:20:39.223375 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:39.223295    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 19:20:39.223375 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:39.223326    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09653eed-2296-4cb5-a06b-0f4b37981feb-insights-runtime-extractor-tls podName:09653eed-2296-4cb5-a06b-0f4b37981feb nodeName:}" failed. No retries permitted until 2026-07-23 19:20:43.22331187 +0000 UTC m=+44.060318555 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09653eed-2296-4cb5-a06b-0f4b37981feb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fvqj9" (UID: "09653eed-2296-4cb5-a06b-0f4b37981feb") : secret "insights-runtime-extractor-tls" not found
Jul 23 19:20:39.223375 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:39.223340    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09653eed-2296-4cb5-a06b-0f4b37981feb-kube-rbac-proxy-cm podName:09653eed-2296-4cb5-a06b-0f4b37981feb nodeName:}" failed. No retries permitted until 2026-07-23 19:20:43.223334317 +0000 UTC m=+44.060341002 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09653eed-2296-4cb5-a06b-0f4b37981feb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fvqj9" (UID: "09653eed-2296-4cb5-a06b-0f4b37981feb") : configmap "kube-rbac-proxy" not found
Jul 23 19:20:39.863579 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:39.863544    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cwqmz" event={"ID":"cfc02285-5ead-4883-9edc-09564c3c2cf9","Type":"ContainerStarted","Data":"d13606f7e85cf29d14dcb622c49fc7063fbf916aa8705ed3ef59461a82521b17"}
Jul 23 19:20:39.883745 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:39.883692    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cwqmz" podStartSLOduration=2.830205381 podStartE2EDuration="5.883675838s" totalImagesPullingTime="3.053470457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:39.883436216 +0000 UTC m=+40.720442924" watchObservedRunningTime="2026-07-23 19:20:39.883675838 +0000 UTC m=+40.720682585"
Jul 23 19:20:42.246724 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:42.246682    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-tls\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:42.247076 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:42.246847    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 19:20:42.247076 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:42.246867    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-568cd74d5f-lf4zc: secret "image-registry-tls" not found
Jul 23 19:20:42.247076 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:42.246926    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-tls podName:e7738bad-49dc-4adc-a379-0a24f5c7ef0d nodeName:}" failed. No retries permitted until 2026-07-23 19:20:50.246908573 +0000 UTC m=+51.083915272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-tls") pod "image-registry-568cd74d5f-lf4zc" (UID: "e7738bad-49dc-4adc-a379-0a24f5c7ef0d") : secret "image-registry-tls" not found
Jul 23 19:20:42.347428 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:42.347392    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a42456f-2357-4731-a2ea-e5f2078eb05d-metrics-tls\") pod \"dns-default-vb527\" (UID: \"2a42456f-2357-4731-a2ea-e5f2078eb05d\") " pod="openshift-dns/dns-default-vb527"
Jul 23 19:20:42.347603 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:42.347509    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 19:20:42.347603 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:42.347561    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a42456f-2357-4731-a2ea-e5f2078eb05d-metrics-tls podName:2a42456f-2357-4731-a2ea-e5f2078eb05d nodeName:}" failed. No retries permitted until 2026-07-23 19:20:50.347546968 +0000 UTC m=+51.184553656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2a42456f-2357-4731-a2ea-e5f2078eb05d-metrics-tls") pod "dns-default-vb527" (UID: "2a42456f-2357-4731-a2ea-e5f2078eb05d") : secret "dns-default-metrics-tls" not found
Jul 23 19:20:43.254327 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:43.254284    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09653eed-2296-4cb5-a06b-0f4b37981feb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:43.254778 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:43.254392    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09653eed-2296-4cb5-a06b-0f4b37981feb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:43.254778 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:43.254408    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 19:20:43.254778 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:43.254469    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/09653eed-2296-4cb5-a06b-0f4b37981feb-kube-rbac-proxy-cm podName:09653eed-2296-4cb5-a06b-0f4b37981feb nodeName:}" failed. No retries permitted until 2026-07-23 19:20:51.254454626 +0000 UTC m=+52.091461310 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/09653eed-2296-4cb5-a06b-0f4b37981feb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fvqj9" (UID: "09653eed-2296-4cb5-a06b-0f4b37981feb") : configmap "kube-rbac-proxy" not found
Jul 23 19:20:43.254778 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:43.254524    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 19:20:43.254778 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:20:43.254581    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09653eed-2296-4cb5-a06b-0f4b37981feb-insights-runtime-extractor-tls podName:09653eed-2296-4cb5-a06b-0f4b37981feb nodeName:}" failed. No retries permitted until 2026-07-23 19:20:51.254565312 +0000 UTC m=+52.091572003 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/09653eed-2296-4cb5-a06b-0f4b37981feb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fvqj9" (UID: "09653eed-2296-4cb5-a06b-0f4b37981feb") : secret "insights-runtime-extractor-tls" not found
Jul 23 19:20:50.312323 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:50.312272    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-tls\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:50.316101 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:50.316076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-tls\") pod \"image-registry-568cd74d5f-lf4zc\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") " pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:50.401935 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:50.401897    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:50.413023 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:50.413001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a42456f-2357-4731-a2ea-e5f2078eb05d-metrics-tls\") pod \"dns-default-vb527\" (UID: \"2a42456f-2357-4731-a2ea-e5f2078eb05d\") " pod="openshift-dns/dns-default-vb527"
Jul 23 19:20:50.415327 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:50.415308    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a42456f-2357-4731-a2ea-e5f2078eb05d-metrics-tls\") pod \"dns-default-vb527\" (UID: \"2a42456f-2357-4731-a2ea-e5f2078eb05d\") " pod="openshift-dns/dns-default-vb527"
Jul 23 19:20:50.425377 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:50.425353    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vb527"
Jul 23 19:20:50.552697 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:50.552665    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-568cd74d5f-lf4zc"]
Jul 23 19:20:50.556349 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:20:50.556321    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7738bad_49dc_4adc_a379_0a24f5c7ef0d.slice/crio-d36ac60fcab06b24ee5773449d197b83d699556c97cbaf2496624f6a0e9fdd61 WatchSource:0}: Error finding container d36ac60fcab06b24ee5773449d197b83d699556c97cbaf2496624f6a0e9fdd61: Status 404 returned error can't find the container with id d36ac60fcab06b24ee5773449d197b83d699556c97cbaf2496624f6a0e9fdd61
Jul 23 19:20:50.566988 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:50.566929    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vb527"]
Jul 23 19:20:50.570080 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:20:50.570048    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a42456f_2357_4731_a2ea_e5f2078eb05d.slice/crio-b96af832cb9c9354ea594d687ade185fda594b074f56fd978d1ce7c5cdfd6a1a WatchSource:0}: Error finding container b96af832cb9c9354ea594d687ade185fda594b074f56fd978d1ce7c5cdfd6a1a: Status 404 returned error can't find the container with id b96af832cb9c9354ea594d687ade185fda594b074f56fd978d1ce7c5cdfd6a1a
Jul 23 19:20:50.889324 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:50.889204    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc" event={"ID":"e7738bad-49dc-4adc-a379-0a24f5c7ef0d","Type":"ContainerStarted","Data":"ab9dbba7531e682f48d579e4ce9a88349c27c15080c3fa0fdfad061ff85e18ed"}
Jul 23 19:20:50.889324 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:50.889321    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc" event={"ID":"e7738bad-49dc-4adc-a379-0a24f5c7ef0d","Type":"ContainerStarted","Data":"d36ac60fcab06b24ee5773449d197b83d699556c97cbaf2496624f6a0e9fdd61"}
Jul 23 19:20:50.889524 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:50.889345    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:20:50.890584 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:50.890556    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vb527" event={"ID":"2a42456f-2357-4731-a2ea-e5f2078eb05d","Type":"ContainerStarted","Data":"b96af832cb9c9354ea594d687ade185fda594b074f56fd978d1ce7c5cdfd6a1a"}
Jul 23 19:20:50.909112 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:50.909064    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc" podStartSLOduration=22.909048248 podStartE2EDuration="22.909048248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:20:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:50.908803246 +0000 UTC m=+51.745809977" watchObservedRunningTime="2026-07-23 19:20:50.909048248 +0000 UTC m=+51.746054946"
Jul 23 19:20:51.321504 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:51.321467    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09653eed-2296-4cb5-a06b-0f4b37981feb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:51.321896 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:51.321563    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09653eed-2296-4cb5-a06b-0f4b37981feb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:51.322072 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:51.322045    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/09653eed-2296-4cb5-a06b-0f4b37981feb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:51.323780 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:51.323763    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/09653eed-2296-4cb5-a06b-0f4b37981feb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fvqj9\" (UID: \"09653eed-2296-4cb5-a06b-0f4b37981feb\") " pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:51.328790 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:51.328766    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fvqj9"
Jul 23 19:20:51.483067 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:51.483030    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fvqj9"]
Jul 23 19:20:51.485918 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:20:51.485890    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09653eed_2296_4cb5_a06b_0f4b37981feb.slice/crio-c5808228df05d7b11c9bbf36022e90b9e2e78e1d53b9e47f1cdad36d071d99ce WatchSource:0}: Error finding container c5808228df05d7b11c9bbf36022e90b9e2e78e1d53b9e47f1cdad36d071d99ce: Status 404 returned error can't find the container with id c5808228df05d7b11c9bbf36022e90b9e2e78e1d53b9e47f1cdad36d071d99ce
Jul 23 19:20:51.895240 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:51.895196    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fvqj9" event={"ID":"09653eed-2296-4cb5-a06b-0f4b37981feb","Type":"ContainerStarted","Data":"c5808228df05d7b11c9bbf36022e90b9e2e78e1d53b9e47f1cdad36d071d99ce"}
Jul 23 19:20:53.903202 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:53.903166    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vb527" event={"ID":"2a42456f-2357-4731-a2ea-e5f2078eb05d","Type":"ContainerStarted","Data":"05b407165ae99da26f29c4da41fdb37c1ef2561bdde6af4fd93b54a6739845b6"}
Jul 23 19:20:53.903686 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:53.903226    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vb527" event={"ID":"2a42456f-2357-4731-a2ea-e5f2078eb05d","Type":"ContainerStarted","Data":"5c5d312a3260a26670a912e919e7204432f994c61ff2c60aed3ab762b1c6afe7"}
Jul 23 19:20:53.903686 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:53.903303    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vb527"
Jul 23 19:20:53.921403 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:53.921362    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vb527" podStartSLOduration=17.277759696 podStartE2EDuration="19.921344572s" totalImagesPullingTime="2.643584876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:53.920263515 +0000 UTC m=+54.757270238" watchObservedRunningTime="2026-07-23 19:20:53.921344572 +0000 UTC m=+54.758351280"
Jul 23 19:20:56.813802 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.813764    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-ffc5db658-p2959"]
Jul 23 19:20:56.815735 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.815706    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7945549f9d-x5289"]
Jul 23 19:20:56.815865 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.815831    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ffc5db658-p2959"
Jul 23 19:20:56.817657 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.817635    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7945549f9d-x5289"
Jul 23 19:20:56.817772 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.817710    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"]
Jul 23 19:20:56.819681 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.819661    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"
Jul 23 19:20:56.820696 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.820676    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 23 19:20:56.820802 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.820724    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 23 19:20:56.820802 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.820759    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dmctv\""
Jul 23 19:20:56.820802 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.820787    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 23 19:20:56.821019 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.820683    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 23 19:20:56.821203 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.821186    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 23 19:20:56.823103 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.823085    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 23 19:20:56.823186 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.823105    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 23 19:20:56.823702 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.823686    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 23 19:20:56.824597 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.824581    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 23 19:20:56.835129 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.835102    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-ffc5db658-p2959"]
Jul 23 19:20:56.835825 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.835782    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7945549f9d-x5289"]
Jul 23 19:20:56.838136 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.838114    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"]
Jul 23 19:20:56.845491 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.845470    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-568cd74d5f-lf4zc"]
Jul 23 19:20:56.866118 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.866087    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1f297c12-520c-4b87-a3ef-3125173d7683-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76498698b9-d5rbl\" (UID: \"1f297c12-520c-4b87-a3ef-3125173d7683\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"
Jul 23 19:20:56.866271 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.866143    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bbe4cfeb-d24d-42ff-841b-3183a7460fa3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7945549f9d-x5289\" (UID: \"bbe4cfeb-d24d-42ff-841b-3183a7460fa3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7945549f9d-x5289"
Jul 23 19:20:56.866271 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.866195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bc3e659-b555-4a52-a5f9-5b31351a896d-tmp\") pod \"klusterlet-addon-workmgr-ffc5db658-p2959\" (UID: \"7bc3e659-b555-4a52-a5f9-5b31351a896d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ffc5db658-p2959"
Jul 23 19:20:56.866271 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.866221    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1f297c12-520c-4b87-a3ef-3125173d7683-hub\") pod \"cluster-proxy-proxy-agent-76498698b9-d5rbl\" (UID: \"1f297c12-520c-4b87-a3ef-3125173d7683\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"
Jul 23 19:20:56.866419 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.866283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdn4f\" (UniqueName: \"kubernetes.io/projected/7bc3e659-b555-4a52-a5f9-5b31351a896d-kube-api-access-bdn4f\") pod \"klusterlet-addon-workmgr-ffc5db658-p2959\" (UID: \"7bc3e659-b555-4a52-a5f9-5b31351a896d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ffc5db658-p2959"
Jul 23 19:20:56.866419 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.866311    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1f297c12-520c-4b87-a3ef-3125173d7683-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76498698b9-d5rbl\" (UID: \"1f297c12-520c-4b87-a3ef-3125173d7683\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"
Jul 23 19:20:56.866419 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.866332    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1f297c12-520c-4b87-a3ef-3125173d7683-ca\") pod \"cluster-proxy-proxy-agent-76498698b9-d5rbl\" (UID: \"1f297c12-520c-4b87-a3ef-3125173d7683\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"
Jul 23 19:20:56.866419 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.866349    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjtss\" (UniqueName: \"kubernetes.io/projected/1f297c12-520c-4b87-a3ef-3125173d7683-kube-api-access-xjtss\") pod \"cluster-proxy-proxy-agent-76498698b9-d5rbl\" (UID: \"1f297c12-520c-4b87-a3ef-3125173d7683\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"
Jul 23 19:20:56.866419 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.866406    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7bc3e659-b555-4a52-a5f9-5b31351a896d-klusterlet-config\") pod \"klusterlet-addon-workmgr-ffc5db658-p2959\" (UID: \"7bc3e659-b555-4a52-a5f9-5b31351a896d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ffc5db658-p2959"
Jul 23 19:20:56.866569 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.866484    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f297c12-520c-4b87-a3ef-3125173d7683-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76498698b9-d5rbl\" (UID: \"1f297c12-520c-4b87-a3ef-3125173d7683\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"
Jul 23 19:20:56.866569 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.866501    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnfz4\" (UniqueName: \"kubernetes.io/projected/bbe4cfeb-d24d-42ff-841b-3183a7460fa3-kube-api-access-gnfz4\") pod \"managed-serviceaccount-addon-agent-7945549f9d-x5289\" (UID: \"bbe4cfeb-d24d-42ff-841b-3183a7460fa3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7945549f9d-x5289"
Jul 23 19:20:56.908944 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.908866    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f956744d9-wvnnl"]
Jul 23 19:20:56.911646 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.911620    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:56.916469 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.916440    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fvqj9" event={"ID":"09653eed-2296-4cb5-a06b-0f4b37981feb","Type":"ContainerStarted","Data":"83d20edd8ea1784f76be25cb210199ea6db300a9ad2c91f7122608011ab87651"}
Jul 23 19:20:56.936273 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.936219    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f956744d9-wvnnl"]
Jul 23 19:20:56.967523 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.967491    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1f297c12-520c-4b87-a3ef-3125173d7683-ca\") pod \"cluster-proxy-proxy-agent-76498698b9-d5rbl\" (UID: \"1f297c12-520c-4b87-a3ef-3125173d7683\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"
Jul 23 19:20:56.967523 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.967526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjtss\" (UniqueName: \"kubernetes.io/projected/1f297c12-520c-4b87-a3ef-3125173d7683-kube-api-access-xjtss\") pod \"cluster-proxy-proxy-agent-76498698b9-d5rbl\" (UID: \"1f297c12-520c-4b87-a3ef-3125173d7683\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"
Jul 23 19:20:56.967748 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.967546    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7bc3e659-b555-4a52-a5f9-5b31351a896d-klusterlet-config\") pod \"klusterlet-addon-workmgr-ffc5db658-p2959\" (UID: \"7bc3e659-b555-4a52-a5f9-5b31351a896d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ffc5db658-p2959"
Jul 23 19:20:56.967805 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.967741    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3d15f0f-d987-406a-9d7d-b2edf1317358-installation-pull-secrets\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:56.967805 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.967793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f297c12-520c-4b87-a3ef-3125173d7683-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76498698b9-d5rbl\" (UID: \"1f297c12-520c-4b87-a3ef-3125173d7683\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"
Jul 23 19:20:56.967908 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.967819    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnfz4\" (UniqueName: \"kubernetes.io/projected/bbe4cfeb-d24d-42ff-841b-3183a7460fa3-kube-api-access-gnfz4\") pod \"managed-serviceaccount-addon-agent-7945549f9d-x5289\" (UID: \"bbe4cfeb-d24d-42ff-841b-3183a7460fa3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7945549f9d-x5289"
Jul 23 19:20:56.967908 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.967857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw5tt\" (UniqueName: \"kubernetes.io/projected/f3d15f0f-d987-406a-9d7d-b2edf1317358-kube-api-access-zw5tt\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:56.967908 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.967883    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3d15f0f-d987-406a-9d7d-b2edf1317358-ca-trust-extracted\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:56.968034 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.967937    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3d15f0f-d987-406a-9d7d-b2edf1317358-bound-sa-token\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:56.968034 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.967974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1f297c12-520c-4b87-a3ef-3125173d7683-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76498698b9-d5rbl\" (UID: \"1f297c12-520c-4b87-a3ef-3125173d7683\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"
Jul 23 19:20:56.968034 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.968008    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3d15f0f-d987-406a-9d7d-b2edf1317358-image-registry-private-configuration\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:56.968225 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.968038    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3d15f0f-d987-406a-9d7d-b2edf1317358-registry-certificates\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:56.968225 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.968064    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3d15f0f-d987-406a-9d7d-b2edf1317358-trusted-ca\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:56.968225 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.968116    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bbe4cfeb-d24d-42ff-841b-3183a7460fa3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7945549f9d-x5289\" (UID: \"bbe4cfeb-d24d-42ff-841b-3183a7460fa3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7945549f9d-x5289"
Jul 23 19:20:56.968225 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.968161    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3d15f0f-d987-406a-9d7d-b2edf1317358-registry-tls\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:56.968225 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.968194    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bc3e659-b555-4a52-a5f9-5b31351a896d-tmp\") pod \"klusterlet-addon-workmgr-ffc5db658-p2959\" (UID: \"7bc3e659-b555-4a52-a5f9-5b31351a896d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ffc5db658-p2959"
Jul 23 19:20:56.968225 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.968219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1f297c12-520c-4b87-a3ef-3125173d7683-hub\") pod \"cluster-proxy-proxy-agent-76498698b9-d5rbl\" (UID: \"1f297c12-520c-4b87-a3ef-3125173d7683\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"
Jul 23 19:20:56.968540 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.968264    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdn4f\" (UniqueName: \"kubernetes.io/projected/7bc3e659-b555-4a52-a5f9-5b31351a896d-kube-api-access-bdn4f\") pod \"klusterlet-addon-workmgr-ffc5db658-p2959\" (UID: \"7bc3e659-b555-4a52-a5f9-5b31351a896d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ffc5db658-p2959"
Jul 23 19:20:56.968540 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.968295    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1f297c12-520c-4b87-a3ef-3125173d7683-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76498698b9-d5rbl\" (UID: \"1f297c12-520c-4b87-a3ef-3125173d7683\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"
Jul 23 19:20:56.968540 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.968512    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f297c12-520c-4b87-a3ef-3125173d7683-additional-service-ca\") pod \"cluster-proxy-proxy-agent-76498698b9-d5rbl\" (UID: \"1f297c12-520c-4b87-a3ef-3125173d7683\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"
Jul 23 19:20:56.968758 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.968733    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bc3e659-b555-4a52-a5f9-5b31351a896d-tmp\") pod \"klusterlet-addon-workmgr-ffc5db658-p2959\" (UID: \"7bc3e659-b555-4a52-a5f9-5b31351a896d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ffc5db658-p2959"
Jul 23 19:20:56.970574 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.970545    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7bc3e659-b555-4a52-a5f9-5b31351a896d-klusterlet-config\") pod \"klusterlet-addon-workmgr-ffc5db658-p2959\" (UID: \"7bc3e659-b555-4a52-a5f9-5b31351a896d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ffc5db658-p2959"
Jul 23 19:20:56.970676 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.970590    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1f297c12-520c-4b87-a3ef-3125173d7683-ca\") pod \"cluster-proxy-proxy-agent-76498698b9-d5rbl\" (UID: \"1f297c12-520c-4b87-a3ef-3125173d7683\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"
Jul 23 19:20:56.970919 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.970892    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bbe4cfeb-d24d-42ff-841b-3183a7460fa3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7945549f9d-x5289\" (UID: \"bbe4cfeb-d24d-42ff-841b-3183a7460fa3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7945549f9d-x5289"
Jul 23 19:20:56.971015 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.970994    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1f297c12-520c-4b87-a3ef-3125173d7683-hub\") pod \"cluster-proxy-proxy-agent-76498698b9-d5rbl\" (UID: \"1f297c12-520c-4b87-a3ef-3125173d7683\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"
Jul 23 19:20:56.971051 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.971029    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1f297c12-520c-4b87-a3ef-3125173d7683-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-76498698b9-d5rbl\" (UID: \"1f297c12-520c-4b87-a3ef-3125173d7683\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"
Jul 23 19:20:56.971244 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.971229    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1f297c12-520c-4b87-a3ef-3125173d7683-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-76498698b9-d5rbl\" (UID: \"1f297c12-520c-4b87-a3ef-3125173d7683\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"
Jul 23 19:20:56.980544 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.980517    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdn4f\" (UniqueName: \"kubernetes.io/projected/7bc3e659-b555-4a52-a5f9-5b31351a896d-kube-api-access-bdn4f\") pod \"klusterlet-addon-workmgr-ffc5db658-p2959\" (UID: \"7bc3e659-b555-4a52-a5f9-5b31351a896d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ffc5db658-p2959"
Jul 23 19:20:56.980671 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.980651    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnfz4\" (UniqueName: \"kubernetes.io/projected/bbe4cfeb-d24d-42ff-841b-3183a7460fa3-kube-api-access-gnfz4\") pod \"managed-serviceaccount-addon-agent-7945549f9d-x5289\" (UID: \"bbe4cfeb-d24d-42ff-841b-3183a7460fa3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7945549f9d-x5289"
Jul 23 19:20:56.989710 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:56.989688    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjtss\" (UniqueName: \"kubernetes.io/projected/1f297c12-520c-4b87-a3ef-3125173d7683-kube-api-access-xjtss\") pod \"cluster-proxy-proxy-agent-76498698b9-d5rbl\" (UID: \"1f297c12-520c-4b87-a3ef-3125173d7683\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"
Jul 23 19:20:57.069040 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.069007    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3d15f0f-d987-406a-9d7d-b2edf1317358-installation-pull-secrets\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:57.069187 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.069052    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw5tt\" (UniqueName: \"kubernetes.io/projected/f3d15f0f-d987-406a-9d7d-b2edf1317358-kube-api-access-zw5tt\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:57.069187 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.069068    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3d15f0f-d987-406a-9d7d-b2edf1317358-ca-trust-extracted\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:57.069341 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.069177    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3d15f0f-d987-406a-9d7d-b2edf1317358-bound-sa-token\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:57.069341 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.069213    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3d15f0f-d987-406a-9d7d-b2edf1317358-image-registry-private-configuration\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:57.069341 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.069232    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3d15f0f-d987-406a-9d7d-b2edf1317358-registry-certificates\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:57.069341 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.069280    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3d15f0f-d987-406a-9d7d-b2edf1317358-trusted-ca\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:57.069341 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.069336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3d15f0f-d987-406a-9d7d-b2edf1317358-registry-tls\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:57.069634 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.069616    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3d15f0f-d987-406a-9d7d-b2edf1317358-ca-trust-extracted\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:57.070117 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.070091    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3d15f0f-d987-406a-9d7d-b2edf1317358-registry-certificates\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:57.070337 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.070320    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3d15f0f-d987-406a-9d7d-b2edf1317358-trusted-ca\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:57.071521 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.071503    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3d15f0f-d987-406a-9d7d-b2edf1317358-installation-pull-secrets\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:57.071682 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.071659    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3d15f0f-d987-406a-9d7d-b2edf1317358-image-registry-private-configuration\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:57.071757 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.071744    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3d15f0f-d987-406a-9d7d-b2edf1317358-registry-tls\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:57.088298 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.088276    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3d15f0f-d987-406a-9d7d-b2edf1317358-bound-sa-token\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:57.088629 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.088605    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw5tt\" (UniqueName: \"kubernetes.io/projected/f3d15f0f-d987-406a-9d7d-b2edf1317358-kube-api-access-zw5tt\") pod \"image-registry-5f956744d9-wvnnl\" (UID: \"f3d15f0f-d987-406a-9d7d-b2edf1317358\") " pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:57.127879 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.127843    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ffc5db658-p2959"
Jul 23 19:20:57.141996 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.141966    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7945549f9d-x5289"
Jul 23 19:20:57.146979 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.146755    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"
Jul 23 19:20:57.242321 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.242226    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:57.321338 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.321033    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-ffc5db658-p2959"]
Jul 23 19:20:57.332897 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:20:57.332855    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bc3e659_b555_4a52_a5f9_5b31351a896d.slice/crio-4f2f1c943925da1c7db18f775acc3fbfd427c065b3c62ecc313fcfe61ae6bcd7 WatchSource:0}: Error finding container 4f2f1c943925da1c7db18f775acc3fbfd427c065b3c62ecc313fcfe61ae6bcd7: Status 404 returned error can't find the container with id 4f2f1c943925da1c7db18f775acc3fbfd427c065b3c62ecc313fcfe61ae6bcd7
Jul 23 19:20:57.350309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.348617    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7945549f9d-x5289"]
Jul 23 19:20:57.350309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.350229    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl"]
Jul 23 19:20:57.435439 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.435402    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f956744d9-wvnnl"]
Jul 23 19:20:57.438855 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:20:57.438827    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3d15f0f_d987_406a_9d7d_b2edf1317358.slice/crio-7f92e6bbab1324013c73da36a4eb8c701caa35125cf9dbfe2932adfe8d338208 WatchSource:0}: Error finding container 7f92e6bbab1324013c73da36a4eb8c701caa35125cf9dbfe2932adfe8d338208: Status 404 returned error can't find the container with id 7f92e6bbab1324013c73da36a4eb8c701caa35125cf9dbfe2932adfe8d338208
Jul 23 19:20:57.925584 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.924333    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f956744d9-wvnnl" event={"ID":"f3d15f0f-d987-406a-9d7d-b2edf1317358","Type":"ContainerStarted","Data":"e629c45783c06f7f8be8e3b01279d3b9d64dd9c8f30b8f50c84369dd6227190f"}
Jul 23 19:20:57.925584 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.924438    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f956744d9-wvnnl" event={"ID":"f3d15f0f-d987-406a-9d7d-b2edf1317358","Type":"ContainerStarted","Data":"7f92e6bbab1324013c73da36a4eb8c701caa35125cf9dbfe2932adfe8d338208"}
Jul 23 19:20:57.925584 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.925481    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:20:57.930977 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.930946    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl" event={"ID":"1f297c12-520c-4b87-a3ef-3125173d7683","Type":"ContainerStarted","Data":"963c52bfe35145ebdaf1a21cd519af7980c39f20b92d14cda7d71371ca7a7b99"}
Jul 23 19:20:57.932849 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.932816    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ffc5db658-p2959" event={"ID":"7bc3e659-b555-4a52-a5f9-5b31351a896d","Type":"ContainerStarted","Data":"4f2f1c943925da1c7db18f775acc3fbfd427c065b3c62ecc313fcfe61ae6bcd7"}
Jul 23 19:20:57.934652 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.934625    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7945549f9d-x5289" event={"ID":"bbe4cfeb-d24d-42ff-841b-3183a7460fa3","Type":"ContainerStarted","Data":"b9a4298bb863a3a6deab5f048710df19dc6263069aa55ec1ca6dc5265fd06a11"}
Jul 23 19:20:57.946819 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:57.946175    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f956744d9-wvnnl" podStartSLOduration=1.946151725 podStartE2EDuration="1.946151725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:20:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:20:57.944388608 +0000 UTC m=+58.781395344" watchObservedRunningTime="2026-07-23 19:20:57.946151725 +0000 UTC m=+58.783158434"
Jul 23 19:20:59.837300 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:20:59.837236    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7zbxp"
Jul 23 19:21:03.908359 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:03.908322    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vb527"
Jul 23 19:21:04.977830 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:04.977601    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl" event={"ID":"1f297c12-520c-4b87-a3ef-3125173d7683","Type":"ContainerStarted","Data":"cac871e1a33da62acc5707a89fa918963f7058c5278649dbf825d5940af957df"}
Jul 23 19:21:04.981690 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:04.980354    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fvqj9" event={"ID":"09653eed-2296-4cb5-a06b-0f4b37981feb","Type":"ContainerStarted","Data":"2c9e4cc95e62da5250e114bbac607f265d5239753d898511fda11c534e5a0057"}
Jul 23 19:21:04.982591 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:04.982544    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ffc5db658-p2959" event={"ID":"7bc3e659-b555-4a52-a5f9-5b31351a896d","Type":"ContainerStarted","Data":"ce1e6e63c637dd5d733f7133d8dfc66293f49fd85a7e9499f0745579c1244fa3"}
Jul 23 19:21:04.983083 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:04.983053    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ffc5db658-p2959"
Jul 23 19:21:04.984748 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:04.984710    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ffc5db658-p2959" podUID="7bc3e659-b555-4a52-a5f9-5b31351a896d" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.11:8000/readyz\": dial tcp 10.133.0.11:8000: connect: connection refused"
Jul 23 19:21:04.987434 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:04.987412    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7945549f9d-x5289" event={"ID":"bbe4cfeb-d24d-42ff-841b-3183a7460fa3","Type":"ContainerStarted","Data":"7f4ef8cfc7311d41b6287b09f7daf37938125259e3d14d4d3d147955cb9ad5c1"}
Jul 23 19:21:05.002840 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.002737    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ffc5db658-p2959" podStartSLOduration=1.475558788 podStartE2EDuration="9.002701463s" totalImagesPullingTime="7.527142675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:05.001086538 +0000 UTC m=+65.838093279" watchObservedRunningTime="2026-07-23 19:21:05.002701463 +0000 UTC m=+65.839708172"
Jul 23 19:21:05.021085 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.021035    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7945549f9d-x5289" podStartSLOduration=1.5049690230000001 podStartE2EDuration="9.021017022s" totalImagesPullingTime="7.516047999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:05.020498895 +0000 UTC m=+65.857505602" watchObservedRunningTime="2026-07-23 19:21:05.021017022 +0000 UTC m=+65.858023728"
Jul 23 19:21:05.448636 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.448534    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs\") pod \"network-metrics-daemon-6tnmv\" (UID: \"f2581039-af56-444f-8229-7221e36f10a2\") " pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:21:05.448958 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.448649    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret\") pod \"global-pull-secret-syncer-bq6sp\" (UID: \"eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf\") " pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:21:05.451205 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.451166    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 19:21:05.451332 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.451166    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 19:21:05.462202 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.462173    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf-original-pull-secret\") pod \"global-pull-secret-syncer-bq6sp\" (UID: \"eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf\") " pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:21:05.462202 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.462189    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2581039-af56-444f-8229-7221e36f10a2-metrics-certs\") pod \"network-metrics-daemon-6tnmv\" (UID: \"f2581039-af56-444f-8229-7221e36f10a2\") " pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:21:05.549857 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.549813    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdbl4\" (UniqueName: \"kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4\") pod \"network-check-target-sqm5t\" (UID: \"ea281e35-6304-4075-9745-baf75e10b7b9\") " pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:21:05.552682 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.552657    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 19:21:05.557951 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.557925    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k9tbr\""
Jul 23 19:21:05.563126 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.563105    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 19:21:05.566443 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.566410    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6tnmv"
Jul 23 19:21:05.574820 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.574779    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdbl4\" (UniqueName: \"kubernetes.io/projected/ea281e35-6304-4075-9745-baf75e10b7b9-kube-api-access-pdbl4\") pod \"network-check-target-sqm5t\" (UID: \"ea281e35-6304-4075-9745-baf75e10b7b9\") " pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:21:05.660909 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.660879    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t9qhx\""
Jul 23 19:21:05.663998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.663962    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bq6sp"
Jul 23 19:21:05.669108 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.669085    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:21:05.721243 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.721157    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6tnmv"]
Jul 23 19:21:05.726297 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:21:05.726212    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2581039_af56_444f_8229_7221e36f10a2.slice/crio-d44f2db20857e53193509efe5ac9be2022dbed9680d4c9f0650fe1a5b592776a WatchSource:0}: Error finding container d44f2db20857e53193509efe5ac9be2022dbed9680d4c9f0650fe1a5b592776a: Status 404 returned error can't find the container with id d44f2db20857e53193509efe5ac9be2022dbed9680d4c9f0650fe1a5b592776a
Jul 23 19:21:05.852653 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.852577    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bq6sp"]
Jul 23 19:21:05.855938 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:21:05.855907    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb46c3e_ed2a_4ae2_90bf_da9d75c24cbf.slice/crio-aa30e8edc67fd9826ba40de609978de9cbfed3828aff94f5684e9c41c2021069 WatchSource:0}: Error finding container aa30e8edc67fd9826ba40de609978de9cbfed3828aff94f5684e9c41c2021069: Status 404 returned error can't find the container with id aa30e8edc67fd9826ba40de609978de9cbfed3828aff94f5684e9c41c2021069
Jul 23 19:21:05.884584 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.884549    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sqm5t"]
Jul 23 19:21:05.888621 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:21:05.888586    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea281e35_6304_4075_9745_baf75e10b7b9.slice/crio-8696ee668f698d5cd92fdfc1cabbdab2b2dd92332777b609ec0081d29f406118 WatchSource:0}: Error finding container 8696ee668f698d5cd92fdfc1cabbdab2b2dd92332777b609ec0081d29f406118: Status 404 returned error can't find the container with id 8696ee668f698d5cd92fdfc1cabbdab2b2dd92332777b609ec0081d29f406118
Jul 23 19:21:05.997287 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.997174    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6tnmv" event={"ID":"f2581039-af56-444f-8229-7221e36f10a2","Type":"ContainerStarted","Data":"d44f2db20857e53193509efe5ac9be2022dbed9680d4c9f0650fe1a5b592776a"}
Jul 23 19:21:05.999617 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.999580    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl" event={"ID":"1f297c12-520c-4b87-a3ef-3125173d7683","Type":"ContainerStarted","Data":"ca4b70be66afb4335b0ddbf169241fd8227f85ba199e3157e3d68cb4e79d8026"}
Jul 23 19:21:05.999764 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:05.999619    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl" event={"ID":"1f297c12-520c-4b87-a3ef-3125173d7683","Type":"ContainerStarted","Data":"5bf5c628a1afba6bed20d7fece26606a0d7ecb80f39aedd1cd6338d0f347af62"}
Jul 23 19:21:06.000972 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:06.000946    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bq6sp" event={"ID":"eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf","Type":"ContainerStarted","Data":"aa30e8edc67fd9826ba40de609978de9cbfed3828aff94f5684e9c41c2021069"}
Jul 23 19:21:06.002298 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:06.002273    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sqm5t" event={"ID":"ea281e35-6304-4075-9745-baf75e10b7b9","Type":"ContainerStarted","Data":"8696ee668f698d5cd92fdfc1cabbdab2b2dd92332777b609ec0081d29f406118"}
Jul 23 19:21:06.003618 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:06.003597    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-ffc5db658-p2959"
Jul 23 19:21:06.019920 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:06.019726    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-76498698b9-d5rbl" podStartSLOduration=2.5134880429999997 podStartE2EDuration="10.019704859s" totalImagesPullingTime="7.506216816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:06.019692575 +0000 UTC m=+66.856699283" watchObservedRunningTime="2026-07-23 19:21:06.019704859 +0000 UTC m=+66.856711569"
Jul 23 19:21:06.854986 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:06.854952    2578 patch_prober.go:28] interesting pod/image-registry-568cd74d5f-lf4zc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 19:21:06.855156 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:06.855016    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc" podUID="e7738bad-49dc-4adc-a379-0a24f5c7ef0d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 19:21:08.012429 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:08.012360    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6tnmv" event={"ID":"f2581039-af56-444f-8229-7221e36f10a2","Type":"ContainerStarted","Data":"79d7120816659154f3a5ab6670bebf519066d257ae5c253103ab5a29020771ba"}
Jul 23 19:21:12.029450 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:12.029408    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6tnmv" event={"ID":"f2581039-af56-444f-8229-7221e36f10a2","Type":"ContainerStarted","Data":"11c9b8fc923fa4d7634125663af081d3ae38eaaf0cbfc4d6adb38c7749940f16"}
Jul 23 19:21:12.034835 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:12.034798    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bq6sp" event={"ID":"eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf","Type":"ContainerStarted","Data":"4b13d1b9bfd2a13d6a1278cccb3c2028649122d4f8205466e32ccfad9dd17bd5"}
Jul 23 19:21:12.036753 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:12.036729    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fvqj9" event={"ID":"09653eed-2296-4cb5-a06b-0f4b37981feb","Type":"ContainerStarted","Data":"775ef1474faad8cbcbfa5472ba9adb9ebc9e863e66871049b22b4fc879c0d5c7"}
Jul 23 19:21:12.038210 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:12.038188    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sqm5t" event={"ID":"ea281e35-6304-4075-9745-baf75e10b7b9","Type":"ContainerStarted","Data":"4cbabd3ea665146daa5450cbfd6da98c7c4c0fbfc1431b19d6da5cf0ab5ce192"}
Jul 23 19:21:12.038325 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:12.038304    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:21:12.047483 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:12.047444    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6tnmv" podStartSLOduration=70.73349115 podStartE2EDuration="1m12.047433287s" totalImagesPullingTime="1.313942137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:12.04600312 +0000 UTC m=+72.883009819" watchObservedRunningTime="2026-07-23 19:21:12.047433287 +0000 UTC m=+72.884439994"
Jul 23 19:21:12.060436 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:12.060400    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sqm5t" podStartSLOduration=66.329366998 podStartE2EDuration="1m12.060388102s" totalImagesPullingTime="5.731021104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:12.059853949 +0000 UTC m=+72.896860666" watchObservedRunningTime="2026-07-23 19:21:12.060388102 +0000 UTC m=+72.897394833"
Jul 23 19:21:12.076667 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:12.076624    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bq6sp" podStartSLOduration=66.312526957 podStartE2EDuration="1m12.076609423s" totalImagesPullingTime="5.764082466s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:12.076299889 +0000 UTC m=+72.913306597" watchObservedRunningTime="2026-07-23 19:21:12.076609423 +0000 UTC m=+72.913616133"
Jul 23 19:21:12.095829 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:12.095797    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fvqj9" podStartSLOduration=17.122159364 podStartE2EDuration="37.095786397s" totalImagesPullingTime="19.973627033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:20:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:12.095087445 +0000 UTC m=+72.932094174" watchObservedRunningTime="2026-07-23 19:21:12.095786397 +0000 UTC m=+72.932793104"
Jul 23 19:21:16.851057 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:16.851028    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:21:19.956828 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:19.956794    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f956744d9-wvnnl"
Jul 23 19:21:21.864892 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:21.864756    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc" podUID="e7738bad-49dc-4adc-a379-0a24f5c7ef0d" containerName="registry" containerID="cri-o://ab9dbba7531e682f48d579e4ce9a88349c27c15080c3fa0fdfad061ff85e18ed" gracePeriod=30
Jul 23 19:21:22.069995 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.069963    2578 generic.go:356] "Generic (PLEG): container finished" podID="e7738bad-49dc-4adc-a379-0a24f5c7ef0d" containerID="ab9dbba7531e682f48d579e4ce9a88349c27c15080c3fa0fdfad061ff85e18ed" exitCode=0
Jul 23 19:21:22.070120 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.070021    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc" event={"ID":"e7738bad-49dc-4adc-a379-0a24f5c7ef0d","Type":"ContainerDied","Data":"ab9dbba7531e682f48d579e4ce9a88349c27c15080c3fa0fdfad061ff85e18ed"}
Jul 23 19:21:22.103805 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.103787    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:21:22.179314 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.179236    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxc6r\" (UniqueName: \"kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-kube-api-access-gxc6r\") pod \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") "
Jul 23 19:21:22.179314 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.179289    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-ca-trust-extracted\") pod \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") "
Jul 23 19:21:22.179314 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.179314    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-trusted-ca\") pod \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") "
Jul 23 19:21:22.179524 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.179340    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-tls\") pod \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") "
Jul 23 19:21:22.179524 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.179370    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-installation-pull-secrets\") pod \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") "
Jul 23 19:21:22.179524 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.179387    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-image-registry-private-configuration\") pod \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") "
Jul 23 19:21:22.179524 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.179414    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-bound-sa-token\") pod \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") "
Jul 23 19:21:22.179524 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.179444    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-certificates\") pod \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\" (UID: \"e7738bad-49dc-4adc-a379-0a24f5c7ef0d\") "
Jul 23 19:21:22.179921 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.179862    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e7738bad-49dc-4adc-a379-0a24f5c7ef0d" (UID: "e7738bad-49dc-4adc-a379-0a24f5c7ef0d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:21:22.179921 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.179882    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e7738bad-49dc-4adc-a379-0a24f5c7ef0d" (UID: "e7738bad-49dc-4adc-a379-0a24f5c7ef0d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:21:22.181859 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.181823    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-kube-api-access-gxc6r" (OuterVolumeSpecName: "kube-api-access-gxc6r") pod "e7738bad-49dc-4adc-a379-0a24f5c7ef0d" (UID: "e7738bad-49dc-4adc-a379-0a24f5c7ef0d"). InnerVolumeSpecName "kube-api-access-gxc6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:21:22.181986 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.181962    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e7738bad-49dc-4adc-a379-0a24f5c7ef0d" (UID: "e7738bad-49dc-4adc-a379-0a24f5c7ef0d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:21:22.182180 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.182154    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e7738bad-49dc-4adc-a379-0a24f5c7ef0d" (UID: "e7738bad-49dc-4adc-a379-0a24f5c7ef0d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:21:22.182244 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.182228    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e7738bad-49dc-4adc-a379-0a24f5c7ef0d" (UID: "e7738bad-49dc-4adc-a379-0a24f5c7ef0d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:21:22.182312 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.182230    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e7738bad-49dc-4adc-a379-0a24f5c7ef0d" (UID: "e7738bad-49dc-4adc-a379-0a24f5c7ef0d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:21:22.188557 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.188532    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e7738bad-49dc-4adc-a379-0a24f5c7ef0d" (UID: "e7738bad-49dc-4adc-a379-0a24f5c7ef0d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:21:22.280607 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.280584    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-installation-pull-secrets\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:21:22.280607 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.280607    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-image-registry-private-configuration\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:21:22.280727 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.280618    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-bound-sa-token\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:21:22.280727 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.280627    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-certificates\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:21:22.280727 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.280635    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxc6r\" (UniqueName: \"kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-kube-api-access-gxc6r\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:21:22.280727 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.280643    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-ca-trust-extracted\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:21:22.280727 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.280651    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-trusted-ca\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:21:22.280727 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:22.280659    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7738bad-49dc-4adc-a379-0a24f5c7ef0d-registry-tls\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:21:23.074221 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:23.074195    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc"
Jul 23 19:21:23.074221 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:23.074199    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-568cd74d5f-lf4zc" event={"ID":"e7738bad-49dc-4adc-a379-0a24f5c7ef0d","Type":"ContainerDied","Data":"d36ac60fcab06b24ee5773449d197b83d699556c97cbaf2496624f6a0e9fdd61"}
Jul 23 19:21:23.074660 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:23.074277    2578 scope.go:117] "RemoveContainer" containerID="ab9dbba7531e682f48d579e4ce9a88349c27c15080c3fa0fdfad061ff85e18ed"
Jul 23 19:21:23.101664 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:23.101640    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-568cd74d5f-lf4zc"]
Jul 23 19:21:23.106845 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:23.106822    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-568cd74d5f-lf4zc"]
Jul 23 19:21:23.649609 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:23.649573    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7738bad-49dc-4adc-a379-0a24f5c7ef0d" path="/var/lib/kubelet/pods/e7738bad-49dc-4adc-a379-0a24f5c7ef0d/volumes"
Jul 23 19:21:25.495146 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.495113    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bhk9f"]
Jul 23 19:21:25.495533 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.495341    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7738bad-49dc-4adc-a379-0a24f5c7ef0d" containerName="registry"
Jul 23 19:21:25.495533 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.495351    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7738bad-49dc-4adc-a379-0a24f5c7ef0d" containerName="registry"
Jul 23 19:21:25.495533 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.495403    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7738bad-49dc-4adc-a379-0a24f5c7ef0d" containerName="registry"
Jul 23 19:21:25.498809 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.498793    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.501561 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.501536    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 19:21:25.501561 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.501550    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 19:21:25.502245 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.502229    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 19:21:25.502464 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.502449    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 19:21:25.502546 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.502470    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 19:21:25.502703 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.502685    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 19:21:25.502781 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.502718    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q9wn7\""
Jul 23 19:21:25.601547 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.601512    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb868267-1dbb-43b8-b876-39a9018d0e90-node-exporter-tls\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.601702 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.601561    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrxvh\" (UniqueName: \"kubernetes.io/projected/bb868267-1dbb-43b8-b876-39a9018d0e90-kube-api-access-jrxvh\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.601702 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.601594    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bb868267-1dbb-43b8-b876-39a9018d0e90-root\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.601702 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.601624    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb868267-1dbb-43b8-b876-39a9018d0e90-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.601702 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.601644    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bb868267-1dbb-43b8-b876-39a9018d0e90-node-exporter-textfile\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.601702 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.601664    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb868267-1dbb-43b8-b876-39a9018d0e90-sys\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.601702 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.601697    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bb868267-1dbb-43b8-b876-39a9018d0e90-node-exporter-wtmp\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.601895 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.601725    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bb868267-1dbb-43b8-b876-39a9018d0e90-node-exporter-accelerators-collector-config\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.601895 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.601743    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb868267-1dbb-43b8-b876-39a9018d0e90-metrics-client-ca\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.702317 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.702286    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb868267-1dbb-43b8-b876-39a9018d0e90-node-exporter-tls\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.702317 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.702319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrxvh\" (UniqueName: \"kubernetes.io/projected/bb868267-1dbb-43b8-b876-39a9018d0e90-kube-api-access-jrxvh\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.702501 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.702338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bb868267-1dbb-43b8-b876-39a9018d0e90-root\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.702501 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.702390    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bb868267-1dbb-43b8-b876-39a9018d0e90-root\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.702501 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.702462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb868267-1dbb-43b8-b876-39a9018d0e90-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.702696 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.702503    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bb868267-1dbb-43b8-b876-39a9018d0e90-node-exporter-textfile\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.702696 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.702530    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb868267-1dbb-43b8-b876-39a9018d0e90-sys\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.702696 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.702577    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bb868267-1dbb-43b8-b876-39a9018d0e90-node-exporter-wtmp\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.702696 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.702602    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bb868267-1dbb-43b8-b876-39a9018d0e90-node-exporter-accelerators-collector-config\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.702696 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.702631    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb868267-1dbb-43b8-b876-39a9018d0e90-metrics-client-ca\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.702696 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.702687    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb868267-1dbb-43b8-b876-39a9018d0e90-sys\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.702987 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.702762    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bb868267-1dbb-43b8-b876-39a9018d0e90-node-exporter-wtmp\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.702987 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.702859    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bb868267-1dbb-43b8-b876-39a9018d0e90-node-exporter-textfile\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.703142 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.703122    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb868267-1dbb-43b8-b876-39a9018d0e90-metrics-client-ca\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.703142 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.703134    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bb868267-1dbb-43b8-b876-39a9018d0e90-node-exporter-accelerators-collector-config\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.704648 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.704628    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb868267-1dbb-43b8-b876-39a9018d0e90-node-exporter-tls\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.704740 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.704728    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb868267-1dbb-43b8-b876-39a9018d0e90-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.713959 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.713936    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrxvh\" (UniqueName: \"kubernetes.io/projected/bb868267-1dbb-43b8-b876-39a9018d0e90-kube-api-access-jrxvh\") pod \"node-exporter-bhk9f\" (UID: \"bb868267-1dbb-43b8-b876-39a9018d0e90\") " pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.809444 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:25.809367    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bhk9f"
Jul 23 19:21:25.818990 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:21:25.818962    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb868267_1dbb_43b8_b876_39a9018d0e90.slice/crio-e2f4f2dc2709f42656e31be9bfe823cf46569f42da1444a0047c44aa059a0f6f WatchSource:0}: Error finding container e2f4f2dc2709f42656e31be9bfe823cf46569f42da1444a0047c44aa059a0f6f: Status 404 returned error can't find the container with id e2f4f2dc2709f42656e31be9bfe823cf46569f42da1444a0047c44aa059a0f6f
Jul 23 19:21:26.086216 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:26.086139    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bhk9f" event={"ID":"bb868267-1dbb-43b8-b876-39a9018d0e90","Type":"ContainerStarted","Data":"e2f4f2dc2709f42656e31be9bfe823cf46569f42da1444a0047c44aa059a0f6f"}
Jul 23 19:21:27.090687 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:27.090657    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bhk9f" event={"ID":"bb868267-1dbb-43b8-b876-39a9018d0e90","Type":"ContainerStarted","Data":"adebd8ce7e6c89740c11e4822b857310f2496ae9c8fe7f7f7511aa51b70c5ad6"}
Jul 23 19:21:28.095238 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:28.095200    2578 generic.go:356] "Generic (PLEG): container finished" podID="bb868267-1dbb-43b8-b876-39a9018d0e90" containerID="adebd8ce7e6c89740c11e4822b857310f2496ae9c8fe7f7f7511aa51b70c5ad6" exitCode=0
Jul 23 19:21:28.095799 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:28.095301    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bhk9f" event={"ID":"bb868267-1dbb-43b8-b876-39a9018d0e90","Type":"ContainerDied","Data":"adebd8ce7e6c89740c11e4822b857310f2496ae9c8fe7f7f7511aa51b70c5ad6"}
Jul 23 19:21:29.100220 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:29.100186    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bhk9f" event={"ID":"bb868267-1dbb-43b8-b876-39a9018d0e90","Type":"ContainerStarted","Data":"2dd2eaba3a77dae8686d9b034549a64854c1854f66ff2e922433508cd8040f03"}
Jul 23 19:21:29.100590 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:29.100285    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bhk9f" event={"ID":"bb868267-1dbb-43b8-b876-39a9018d0e90","Type":"ContainerStarted","Data":"80c7253ea650252a3266052d35cafc0a18f9cd778e70d482bead73bff5ed7718"}
Jul 23 19:21:29.127918 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:29.127869    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bhk9f" podStartSLOduration=2.948235951 podStartE2EDuration="4.127852167s" totalImagesPullingTime="1.081165507s" totalInitContainerRuntime="98.450709ms" isStatefulPod=true podCreationTimestamp="2026-07-23 19:21:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:21:29.126804113 +0000 UTC m=+89.963810821" watchObservedRunningTime="2026-07-23 19:21:29.127852167 +0000 UTC m=+89.964858874"
Jul 23 19:21:41.209542 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:41.209506    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cwqmz_cfc02285-5ead-4883-9edc-09564c3c2cf9/serve-healthcheck-canary/0.log"
Jul 23 19:21:43.043983 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:21:43.043957    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sqm5t"
Jul 23 19:24:59.509655 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:24:59.509619    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 19:25:52.759716 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.759641    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"]
Jul 23 19:25:52.762120 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.762104    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"
Jul 23 19:25:52.765799 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.765780    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 19:25:52.765799 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.765791    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 19:25:52.765971 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.765782    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 19:25:52.766223 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.766207    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rtrs9\""
Jul 23 19:25:52.766286 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.766246    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 19:25:52.807047 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.807019    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"]
Jul 23 19:25:52.839497 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.839465    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bfb58184-a3bd-46cd-b823-1cf79ded9dc5-manifests\") pod \"opendatahub-operator-controller-manager-559f567dc-btqjt\" (UID: \"bfb58184-a3bd-46cd-b823-1cf79ded9dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"
Jul 23 19:25:52.839636 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.839500    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bfb58184-a3bd-46cd-b823-1cf79ded9dc5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-559f567dc-btqjt\" (UID: \"bfb58184-a3bd-46cd-b823-1cf79ded9dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"
Jul 23 19:25:52.839636 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.839528    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4pn6\" (UniqueName: \"kubernetes.io/projected/bfb58184-a3bd-46cd-b823-1cf79ded9dc5-kube-api-access-l4pn6\") pod \"opendatahub-operator-controller-manager-559f567dc-btqjt\" (UID: \"bfb58184-a3bd-46cd-b823-1cf79ded9dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"
Jul 23 19:25:52.839636 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.839571    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfb58184-a3bd-46cd-b823-1cf79ded9dc5-tmp\") pod \"opendatahub-operator-controller-manager-559f567dc-btqjt\" (UID: \"bfb58184-a3bd-46cd-b823-1cf79ded9dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"
Jul 23 19:25:52.839761 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.839666    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfb58184-a3bd-46cd-b823-1cf79ded9dc5-webhook-cert\") pod \"opendatahub-operator-controller-manager-559f567dc-btqjt\" (UID: \"bfb58184-a3bd-46cd-b823-1cf79ded9dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"
Jul 23 19:25:52.941019 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.940987    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bfb58184-a3bd-46cd-b823-1cf79ded9dc5-manifests\") pod \"opendatahub-operator-controller-manager-559f567dc-btqjt\" (UID: \"bfb58184-a3bd-46cd-b823-1cf79ded9dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"
Jul 23 19:25:52.941019 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.941020    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bfb58184-a3bd-46cd-b823-1cf79ded9dc5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-559f567dc-btqjt\" (UID: \"bfb58184-a3bd-46cd-b823-1cf79ded9dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"
Jul 23 19:25:52.941210 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.941148    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4pn6\" (UniqueName: \"kubernetes.io/projected/bfb58184-a3bd-46cd-b823-1cf79ded9dc5-kube-api-access-l4pn6\") pod \"opendatahub-operator-controller-manager-559f567dc-btqjt\" (UID: \"bfb58184-a3bd-46cd-b823-1cf79ded9dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"
Jul 23 19:25:52.941210 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.941179    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfb58184-a3bd-46cd-b823-1cf79ded9dc5-tmp\") pod \"opendatahub-operator-controller-manager-559f567dc-btqjt\" (UID: \"bfb58184-a3bd-46cd-b823-1cf79ded9dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"
Jul 23 19:25:52.941210 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.941199    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfb58184-a3bd-46cd-b823-1cf79ded9dc5-webhook-cert\") pod \"opendatahub-operator-controller-manager-559f567dc-btqjt\" (UID: \"bfb58184-a3bd-46cd-b823-1cf79ded9dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"
Jul 23 19:25:52.941500 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.941477    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bfb58184-a3bd-46cd-b823-1cf79ded9dc5-manifests\") pod \"opendatahub-operator-controller-manager-559f567dc-btqjt\" (UID: \"bfb58184-a3bd-46cd-b823-1cf79ded9dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"
Jul 23 19:25:52.943505 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.943485    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bfb58184-a3bd-46cd-b823-1cf79ded9dc5-tmp\") pod \"opendatahub-operator-controller-manager-559f567dc-btqjt\" (UID: \"bfb58184-a3bd-46cd-b823-1cf79ded9dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"
Jul 23 19:25:52.943588 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.943520    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bfb58184-a3bd-46cd-b823-1cf79ded9dc5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-559f567dc-btqjt\" (UID: \"bfb58184-a3bd-46cd-b823-1cf79ded9dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"
Jul 23 19:25:52.943628 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.943618    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfb58184-a3bd-46cd-b823-1cf79ded9dc5-webhook-cert\") pod \"opendatahub-operator-controller-manager-559f567dc-btqjt\" (UID: \"bfb58184-a3bd-46cd-b823-1cf79ded9dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"
Jul 23 19:25:52.952295 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:52.952272    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4pn6\" (UniqueName: \"kubernetes.io/projected/bfb58184-a3bd-46cd-b823-1cf79ded9dc5-kube-api-access-l4pn6\") pod \"opendatahub-operator-controller-manager-559f567dc-btqjt\" (UID: \"bfb58184-a3bd-46cd-b823-1cf79ded9dc5\") " pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"
Jul 23 19:25:53.072326 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:53.072243    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"
Jul 23 19:25:53.201537 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:53.201508    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"]
Jul 23 19:25:53.204106 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:25:53.204079    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfb58184_a3bd_46cd_b823_1cf79ded9dc5.slice/crio-98bb52984a7d08f0542326868115ede53114473c048f001d66217e5707ca53c2 WatchSource:0}: Error finding container 98bb52984a7d08f0542326868115ede53114473c048f001d66217e5707ca53c2: Status 404 returned error can't find the container with id 98bb52984a7d08f0542326868115ede53114473c048f001d66217e5707ca53c2
Jul 23 19:25:53.205868 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:53.205846    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 19:25:53.929836 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:53.929804    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt" event={"ID":"bfb58184-a3bd-46cd-b823-1cf79ded9dc5","Type":"ContainerStarted","Data":"98bb52984a7d08f0542326868115ede53114473c048f001d66217e5707ca53c2"}
Jul 23 19:25:56.943171 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:56.943131    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt" event={"ID":"bfb58184-a3bd-46cd-b823-1cf79ded9dc5","Type":"ContainerStarted","Data":"c7281b064e3973aa0171fe94db114051b8e4c7aa93adbdaad95c57b691417409"}
Jul 23 19:25:57.948293 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:57.948242    2578 generic.go:356] "Generic (PLEG): container finished" podID="bfb58184-a3bd-46cd-b823-1cf79ded9dc5" containerID="c7281b064e3973aa0171fe94db114051b8e4c7aa93adbdaad95c57b691417409" exitCode=0
Jul 23 19:25:57.948293 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:57.948281    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt" event={"ID":"bfb58184-a3bd-46cd-b823-1cf79ded9dc5","Type":"ContainerDied","Data":"c7281b064e3973aa0171fe94db114051b8e4c7aa93adbdaad95c57b691417409"}
Jul 23 19:25:58.953866 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:58.953831    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt" event={"ID":"bfb58184-a3bd-46cd-b823-1cf79ded9dc5","Type":"ContainerStarted","Data":"558007768d8b6a98126a05ee2d3265c71c0cdaa84d0e3069329b2e5786c9c6b6"}
Jul 23 19:25:58.954335 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:58.953999    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"
Jul 23 19:25:58.981322 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:25:58.981275    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt" podStartSLOduration=2.5196309660000002 podStartE2EDuration="6.98123564s" totalImagesPullingTime="3.414225733s" totalInitContainerRuntime="1.047378941s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:25:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:25:58.980055065 +0000 UTC m=+359.817061785" watchObservedRunningTime="2026-07-23 19:25:58.98123564 +0000 UTC m=+359.818242347"
Jul 23 19:26:09.960387 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:09.960355    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-559f567dc-btqjt"
Jul 23 19:26:19.705782 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:19.705746    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd"]
Jul 23 19:26:19.717993 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:19.717964    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd"
Jul 23 19:26:19.722440 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:19.722409    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 19:26:19.723134 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:19.723109    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 23 19:26:19.723238 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:19.723120    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-c7ht5\""
Jul 23 19:26:19.723392 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:19.723375    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 19:26:19.723738 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:19.723711    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 23 19:26:19.724155 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:19.724131    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 23 19:26:19.725119 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:19.725097    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd"]
Jul 23 19:26:19.838801 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:19.838758    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn6sd\" (UniqueName: \"kubernetes.io/projected/d1ddd8e6-15b9-418a-8f16-399bf48c1e48-kube-api-access-tn6sd\") pod \"lws-controller-manager-84c9b5-zl6gd\" (UID: \"d1ddd8e6-15b9-418a-8f16-399bf48c1e48\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd"
Jul 23 19:26:19.838801 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:19.838801    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1ddd8e6-15b9-418a-8f16-399bf48c1e48-cert\") pod \"lws-controller-manager-84c9b5-zl6gd\" (UID: \"d1ddd8e6-15b9-418a-8f16-399bf48c1e48\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd"
Jul 23 19:26:19.839018 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:19.838839    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d1ddd8e6-15b9-418a-8f16-399bf48c1e48-metrics-cert\") pod \"lws-controller-manager-84c9b5-zl6gd\" (UID: \"d1ddd8e6-15b9-418a-8f16-399bf48c1e48\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd"
Jul 23 19:26:19.839018 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:19.838880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d1ddd8e6-15b9-418a-8f16-399bf48c1e48-manager-config\") pod \"lws-controller-manager-84c9b5-zl6gd\" (UID: \"d1ddd8e6-15b9-418a-8f16-399bf48c1e48\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd"
Jul 23 19:26:19.939909 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:19.939872    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d1ddd8e6-15b9-418a-8f16-399bf48c1e48-manager-config\") pod \"lws-controller-manager-84c9b5-zl6gd\" (UID: \"d1ddd8e6-15b9-418a-8f16-399bf48c1e48\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd"
Jul 23 19:26:19.940053 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:19.939917    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn6sd\" (UniqueName: \"kubernetes.io/projected/d1ddd8e6-15b9-418a-8f16-399bf48c1e48-kube-api-access-tn6sd\") pod \"lws-controller-manager-84c9b5-zl6gd\" (UID: \"d1ddd8e6-15b9-418a-8f16-399bf48c1e48\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd"
Jul 23 19:26:19.940053 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:19.939941    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1ddd8e6-15b9-418a-8f16-399bf48c1e48-cert\") pod \"lws-controller-manager-84c9b5-zl6gd\" (UID: \"d1ddd8e6-15b9-418a-8f16-399bf48c1e48\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd"
Jul 23 19:26:19.940053 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:19.939967    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d1ddd8e6-15b9-418a-8f16-399bf48c1e48-metrics-cert\") pod \"lws-controller-manager-84c9b5-zl6gd\" (UID: \"d1ddd8e6-15b9-418a-8f16-399bf48c1e48\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd"
Jul 23 19:26:19.940624 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:19.940598    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d1ddd8e6-15b9-418a-8f16-399bf48c1e48-manager-config\") pod \"lws-controller-manager-84c9b5-zl6gd\" (UID: \"d1ddd8e6-15b9-418a-8f16-399bf48c1e48\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd"
Jul 23 19:26:19.942468 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:19.942449    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d1ddd8e6-15b9-418a-8f16-399bf48c1e48-metrics-cert\") pod \"lws-controller-manager-84c9b5-zl6gd\" (UID: \"d1ddd8e6-15b9-418a-8f16-399bf48c1e48\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd"
Jul 23 19:26:19.942528 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:19.942512    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d1ddd8e6-15b9-418a-8f16-399bf48c1e48-cert\") pod \"lws-controller-manager-84c9b5-zl6gd\" (UID: \"d1ddd8e6-15b9-418a-8f16-399bf48c1e48\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd"
Jul 23 19:26:19.954050 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:19.954021    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn6sd\" (UniqueName: \"kubernetes.io/projected/d1ddd8e6-15b9-418a-8f16-399bf48c1e48-kube-api-access-tn6sd\") pod \"lws-controller-manager-84c9b5-zl6gd\" (UID: \"d1ddd8e6-15b9-418a-8f16-399bf48c1e48\") " pod="openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd"
Jul 23 19:26:20.027908 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:20.027876    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd"
Jul 23 19:26:20.170552 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:20.170516    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd"]
Jul 23 19:26:20.175525 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:26:20.175500    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ddd8e6_15b9_418a_8f16_399bf48c1e48.slice/crio-3fdc2166189eaea5fa6210fbb5c6d0df28d6124da2eb2cecb0da74bce635cb49 WatchSource:0}: Error finding container 3fdc2166189eaea5fa6210fbb5c6d0df28d6124da2eb2cecb0da74bce635cb49: Status 404 returned error can't find the container with id 3fdc2166189eaea5fa6210fbb5c6d0df28d6124da2eb2cecb0da74bce635cb49
Jul 23 19:26:21.034021 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:21.033911    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd" event={"ID":"d1ddd8e6-15b9-418a-8f16-399bf48c1e48","Type":"ContainerStarted","Data":"3fdc2166189eaea5fa6210fbb5c6d0df28d6124da2eb2cecb0da74bce635cb49"}
Jul 23 19:26:23.042647 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:23.042616    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd" event={"ID":"d1ddd8e6-15b9-418a-8f16-399bf48c1e48","Type":"ContainerStarted","Data":"c83fafe927a622b26fd67aa1e2d6a18c6f4ef162c2be3a95b40ad75d65e21e4c"}
Jul 23 19:26:23.043013 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:23.042682    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd"
Jul 23 19:26:34.047223 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.047192    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd"
Jul 23 19:26:34.065488 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.065439    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-84c9b5-zl6gd" podStartSLOduration=12.794326015 podStartE2EDuration="15.065426923s" totalImagesPullingTime="2.271100908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:26:23.073233571 +0000 UTC m=+383.910240302" watchObservedRunningTime="2026-07-23 19:26:34.065426923 +0000 UTC m=+394.902433629"
Jul 23 19:26:34.551093 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.551063    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"]
Jul 23 19:26:34.555700 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.555675    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.558661 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.558637    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 19:26:34.558891 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.558654    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 19:26:34.558891 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.558696    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-k8vz4\""
Jul 23 19:26:34.559703 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.559690    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 19:26:34.568903 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.568880    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"]
Jul 23 19:26:34.642741 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.642711    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.642867 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.642744    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.642867 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.642775    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.642867 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.642835    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.642971 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.642866    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6zld\" (UniqueName: \"kubernetes.io/projected/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-kube-api-access-h6zld\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.642971 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.642884    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.642971 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.642898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.643061 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.642981    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.643061 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.643010    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.744201 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.744165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.744411 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.744213    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6zld\" (UniqueName: \"kubernetes.io/projected/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-kube-api-access-h6zld\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.744411 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.744239    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.744411 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.744282    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.744411 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.744319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.744411 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.744345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.744411 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.744382    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.744723 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.744413    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.744723 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.744470    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.744819 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.744763    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.744905 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.744877    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.744984 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.744958    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.745033 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.744979    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.745199 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.745175    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.746568 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.746550    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.746714 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.746697    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.752470 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.752444    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.753902 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.753880    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6zld\" (UniqueName: \"kubernetes.io/projected/15c3a29e-d89e-4c8a-b6ea-2de0145430ae-kube-api-access-h6zld\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4jjcpr\" (UID: \"15c3a29e-d89e-4c8a-b6ea-2de0145430ae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.866009 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.865903    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:34.998457 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:34.998426    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"]
Jul 23 19:26:35.001661 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:26:35.001635    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c3a29e_d89e_4c8a_b6ea_2de0145430ae.slice/crio-4380de3b0bfcc434511a4f16cc1ef4842191cb1cb9adb5901f90a53930f5082e WatchSource:0}: Error finding container 4380de3b0bfcc434511a4f16cc1ef4842191cb1cb9adb5901f90a53930f5082e: Status 404 returned error can't find the container with id 4380de3b0bfcc434511a4f16cc1ef4842191cb1cb9adb5901f90a53930f5082e
Jul 23 19:26:35.083498 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:35.083470    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr" event={"ID":"15c3a29e-d89e-4c8a-b6ea-2de0145430ae","Type":"ContainerStarted","Data":"4380de3b0bfcc434511a4f16cc1ef4842191cb1cb9adb5901f90a53930f5082e"}
Jul 23 19:26:37.803062 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:37.803023    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:26:37.803443 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:37.803113    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:26:37.803443 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:37.803161    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:26:38.097674 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:38.097593    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr" event={"ID":"15c3a29e-d89e-4c8a-b6ea-2de0145430ae","Type":"ContainerStarted","Data":"a472360bcba5c04c35ffc35d9c124c5061e6735e53d1164609ab7979d9a69f8b"}
Jul 23 19:26:38.135180 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:38.135125    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr" podStartSLOduration=1.335933042 podStartE2EDuration="4.13511012s" totalImagesPullingTime="2.799177078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:26:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:26:38.134725623 +0000 UTC m=+398.971732330" watchObservedRunningTime="2026-07-23 19:26:38.13511012 +0000 UTC m=+398.972116826"
Jul 23 19:26:38.866585 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:38.866553    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:38.871617 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:38.871594    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:39.101281 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:39.101237    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:26:39.102178 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:26:39.102156    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4jjcpr"
Jul 23 19:27:13.497281 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:13.497234    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lkxk4"]
Jul 23 19:27:13.505999 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:13.505976    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lkxk4"
Jul 23 19:27:13.508433 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:13.508412    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 19:27:13.509135 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:13.509116    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 19:27:13.509135 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:13.509127    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-ht576\""
Jul 23 19:27:13.511811 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:13.511787    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lkxk4"]
Jul 23 19:27:13.519990 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:13.519964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpmkn\" (UniqueName: \"kubernetes.io/projected/43913790-85d8-47c1-bcb4-70a39cba078a-kube-api-access-bpmkn\") pod \"kuadrant-operator-catalog-lkxk4\" (UID: \"43913790-85d8-47c1-bcb4-70a39cba078a\") " pod="kuadrant-system/kuadrant-operator-catalog-lkxk4"
Jul 23 19:27:13.620873 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:13.620842    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpmkn\" (UniqueName: \"kubernetes.io/projected/43913790-85d8-47c1-bcb4-70a39cba078a-kube-api-access-bpmkn\") pod \"kuadrant-operator-catalog-lkxk4\" (UID: \"43913790-85d8-47c1-bcb4-70a39cba078a\") " pod="kuadrant-system/kuadrant-operator-catalog-lkxk4"
Jul 23 19:27:13.629265 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:13.629221    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpmkn\" (UniqueName: \"kubernetes.io/projected/43913790-85d8-47c1-bcb4-70a39cba078a-kube-api-access-bpmkn\") pod \"kuadrant-operator-catalog-lkxk4\" (UID: \"43913790-85d8-47c1-bcb4-70a39cba078a\") " pod="kuadrant-system/kuadrant-operator-catalog-lkxk4"
Jul 23 19:27:13.817035 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:13.816957    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lkxk4"
Jul 23 19:27:13.864209 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:13.864172    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lkxk4"]
Jul 23 19:27:13.938960 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:13.938935    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lkxk4"]
Jul 23 19:27:13.941479 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:27:13.941455    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43913790_85d8_47c1_bcb4_70a39cba078a.slice/crio-594f04e9a54494f8f2b017df6e7fea3b9318e79676f42e11b70afd109b3a0019 WatchSource:0}: Error finding container 594f04e9a54494f8f2b017df6e7fea3b9318e79676f42e11b70afd109b3a0019: Status 404 returned error can't find the container with id 594f04e9a54494f8f2b017df6e7fea3b9318e79676f42e11b70afd109b3a0019
Jul 23 19:27:14.071854 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:14.071789    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6dfxc"]
Jul 23 19:27:14.074637 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:14.074622    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6dfxc"
Jul 23 19:27:14.082962 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:14.082940    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6dfxc"]
Jul 23 19:27:14.124017 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:14.123994    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84chf\" (UniqueName: \"kubernetes.io/projected/8ba1a77a-23e3-416f-a73a-a8deef6a712b-kube-api-access-84chf\") pod \"kuadrant-operator-catalog-6dfxc\" (UID: \"8ba1a77a-23e3-416f-a73a-a8deef6a712b\") " pod="kuadrant-system/kuadrant-operator-catalog-6dfxc"
Jul 23 19:27:14.222228 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:14.222193    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lkxk4" event={"ID":"43913790-85d8-47c1-bcb4-70a39cba078a","Type":"ContainerStarted","Data":"594f04e9a54494f8f2b017df6e7fea3b9318e79676f42e11b70afd109b3a0019"}
Jul 23 19:27:14.224513 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:14.224494    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84chf\" (UniqueName: \"kubernetes.io/projected/8ba1a77a-23e3-416f-a73a-a8deef6a712b-kube-api-access-84chf\") pod \"kuadrant-operator-catalog-6dfxc\" (UID: \"8ba1a77a-23e3-416f-a73a-a8deef6a712b\") " pod="kuadrant-system/kuadrant-operator-catalog-6dfxc"
Jul 23 19:27:14.233320 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:14.233301    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84chf\" (UniqueName: \"kubernetes.io/projected/8ba1a77a-23e3-416f-a73a-a8deef6a712b-kube-api-access-84chf\") pod \"kuadrant-operator-catalog-6dfxc\" (UID: \"8ba1a77a-23e3-416f-a73a-a8deef6a712b\") " pod="kuadrant-system/kuadrant-operator-catalog-6dfxc"
Jul 23 19:27:14.384085 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:14.383999    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6dfxc"
Jul 23 19:27:14.512420 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:14.512398    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6dfxc"]
Jul 23 19:27:14.514618 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:27:14.514588    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba1a77a_23e3_416f_a73a_a8deef6a712b.slice/crio-9388c662daade8d6ae13ab3f3f6c972ec66cdee06f208c37dab1a760659b3dda WatchSource:0}: Error finding container 9388c662daade8d6ae13ab3f3f6c972ec66cdee06f208c37dab1a760659b3dda: Status 404 returned error can't find the container with id 9388c662daade8d6ae13ab3f3f6c972ec66cdee06f208c37dab1a760659b3dda
Jul 23 19:27:15.228240 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:15.228207    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6dfxc" event={"ID":"8ba1a77a-23e3-416f-a73a-a8deef6a712b","Type":"ContainerStarted","Data":"9388c662daade8d6ae13ab3f3f6c972ec66cdee06f208c37dab1a760659b3dda"}
Jul 23 19:27:17.236348 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:17.236311    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lkxk4" event={"ID":"43913790-85d8-47c1-bcb4-70a39cba078a","Type":"ContainerStarted","Data":"b63494126a53bd4e1d8bde246808ff81bd86528b7415c3d36d90a9307808490f"}
Jul 23 19:27:17.236783 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:17.236366    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-lkxk4" podUID="43913790-85d8-47c1-bcb4-70a39cba078a" containerName="registry-server" containerID="cri-o://b63494126a53bd4e1d8bde246808ff81bd86528b7415c3d36d90a9307808490f" gracePeriod=2
Jul 23 19:27:17.237886 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:17.237860    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6dfxc" event={"ID":"8ba1a77a-23e3-416f-a73a-a8deef6a712b","Type":"ContainerStarted","Data":"c45ded2587069435ec40612af88236859de591ffd9651fc594df2c0cc9f133a3"}
Jul 23 19:27:17.282774 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:17.282730    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lkxk4" podStartSLOduration=2.052803307 podStartE2EDuration="4.282714288s" totalImagesPullingTime="2.229910981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:27:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:27:17.262643051 +0000 UTC m=+438.099649758" watchObservedRunningTime="2026-07-23 19:27:17.282714288 +0000 UTC m=+438.119720995"
Jul 23 19:27:17.282894 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:17.282804    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6dfxc" podStartSLOduration=1.6082616029999999 podStartE2EDuration="3.282800835s" totalImagesPullingTime="1.674539232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:27:17.280988903 +0000 UTC m=+438.117995612" watchObservedRunningTime="2026-07-23 19:27:17.282800835 +0000 UTC m=+438.119807542"
Jul 23 19:27:17.471467 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:17.471443    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lkxk4"
Jul 23 19:27:17.552270 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:17.552191    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpmkn\" (UniqueName: \"kubernetes.io/projected/43913790-85d8-47c1-bcb4-70a39cba078a-kube-api-access-bpmkn\") pod \"43913790-85d8-47c1-bcb4-70a39cba078a\" (UID: \"43913790-85d8-47c1-bcb4-70a39cba078a\") "
Jul 23 19:27:17.554246 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:17.554216    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43913790-85d8-47c1-bcb4-70a39cba078a-kube-api-access-bpmkn" (OuterVolumeSpecName: "kube-api-access-bpmkn") pod "43913790-85d8-47c1-bcb4-70a39cba078a" (UID: "43913790-85d8-47c1-bcb4-70a39cba078a"). InnerVolumeSpecName "kube-api-access-bpmkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:27:17.653156 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:17.653127    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpmkn\" (UniqueName: \"kubernetes.io/projected/43913790-85d8-47c1-bcb4-70a39cba078a-kube-api-access-bpmkn\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:27:18.243499 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:18.243466    2578 generic.go:356] "Generic (PLEG): container finished" podID="43913790-85d8-47c1-bcb4-70a39cba078a" containerID="b63494126a53bd4e1d8bde246808ff81bd86528b7415c3d36d90a9307808490f" exitCode=0
Jul 23 19:27:18.243904 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:18.243504    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lkxk4"
Jul 23 19:27:18.243904 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:18.243545    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lkxk4" event={"ID":"43913790-85d8-47c1-bcb4-70a39cba078a","Type":"ContainerDied","Data":"b63494126a53bd4e1d8bde246808ff81bd86528b7415c3d36d90a9307808490f"}
Jul 23 19:27:18.243904 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:18.243593    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lkxk4" event={"ID":"43913790-85d8-47c1-bcb4-70a39cba078a","Type":"ContainerDied","Data":"594f04e9a54494f8f2b017df6e7fea3b9318e79676f42e11b70afd109b3a0019"}
Jul 23 19:27:18.243904 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:18.243612    2578 scope.go:117] "RemoveContainer" containerID="b63494126a53bd4e1d8bde246808ff81bd86528b7415c3d36d90a9307808490f"
Jul 23 19:27:18.252014 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:18.251988    2578 scope.go:117] "RemoveContainer" containerID="b63494126a53bd4e1d8bde246808ff81bd86528b7415c3d36d90a9307808490f"
Jul 23 19:27:18.252294 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:27:18.252273    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b63494126a53bd4e1d8bde246808ff81bd86528b7415c3d36d90a9307808490f\": container with ID starting with b63494126a53bd4e1d8bde246808ff81bd86528b7415c3d36d90a9307808490f not found: ID does not exist" containerID="b63494126a53bd4e1d8bde246808ff81bd86528b7415c3d36d90a9307808490f"
Jul 23 19:27:18.252346 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:18.252302    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b63494126a53bd4e1d8bde246808ff81bd86528b7415c3d36d90a9307808490f"} err="failed to get container status \"b63494126a53bd4e1d8bde246808ff81bd86528b7415c3d36d90a9307808490f\": rpc error: code = NotFound desc = could not find container \"b63494126a53bd4e1d8bde246808ff81bd86528b7415c3d36d90a9307808490f\": container with ID starting with b63494126a53bd4e1d8bde246808ff81bd86528b7415c3d36d90a9307808490f not found: ID does not exist"
Jul 23 19:27:18.258774 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:18.258756    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lkxk4"]
Jul 23 19:27:18.262925 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:18.262902    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lkxk4"]
Jul 23 19:27:19.651139 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:19.651099    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43913790-85d8-47c1-bcb4-70a39cba078a" path="/var/lib/kubelet/pods/43913790-85d8-47c1-bcb4-70a39cba078a/volumes"
Jul 23 19:27:24.384920 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:24.384845    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-6dfxc"
Jul 23 19:27:24.385296 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:24.384916    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-6dfxc"
Jul 23 19:27:24.407544 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:24.407520    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-6dfxc"
Jul 23 19:27:25.288806 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:25.288780    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-6dfxc"
Jul 23 19:27:44.424117 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:44.424087    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2nvbw"]
Jul 23 19:27:44.424618 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:44.424379    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43913790-85d8-47c1-bcb4-70a39cba078a" containerName="registry-server"
Jul 23 19:27:44.424618 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:44.424390    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="43913790-85d8-47c1-bcb4-70a39cba078a" containerName="registry-server"
Jul 23 19:27:44.424618 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:44.424442    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="43913790-85d8-47c1-bcb4-70a39cba078a" containerName="registry-server"
Jul 23 19:27:44.426179 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:44.426163    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2nvbw"
Jul 23 19:27:44.428587 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:44.428568    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-tjrq2\""
Jul 23 19:27:44.428701 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:44.428629    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 23 19:27:44.445223 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:44.445194    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2nvbw"]
Jul 23 19:27:44.540451 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:44.540414    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjvs4\" (UniqueName: \"kubernetes.io/projected/8ca212e8-2df0-46b8-8616-e18c3cd0acec-kube-api-access-rjvs4\") pod \"dns-operator-controller-manager-864dd78c4c-2nvbw\" (UID: \"8ca212e8-2df0-46b8-8616-e18c3cd0acec\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2nvbw"
Jul 23 19:27:44.641271 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:44.641213    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjvs4\" (UniqueName: \"kubernetes.io/projected/8ca212e8-2df0-46b8-8616-e18c3cd0acec-kube-api-access-rjvs4\") pod \"dns-operator-controller-manager-864dd78c4c-2nvbw\" (UID: \"8ca212e8-2df0-46b8-8616-e18c3cd0acec\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2nvbw"
Jul 23 19:27:44.652447 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:44.652424    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjvs4\" (UniqueName: \"kubernetes.io/projected/8ca212e8-2df0-46b8-8616-e18c3cd0acec-kube-api-access-rjvs4\") pod \"dns-operator-controller-manager-864dd78c4c-2nvbw\" (UID: \"8ca212e8-2df0-46b8-8616-e18c3cd0acec\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2nvbw"
Jul 23 19:27:44.735396 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:44.735353    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2nvbw"
Jul 23 19:27:44.867317 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:44.867262    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2nvbw"]
Jul 23 19:27:44.869613 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:27:44.869586    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ca212e8_2df0_46b8_8616_e18c3cd0acec.slice/crio-9a515728d71bb0746661c02ef172196bcd029a90e410f7d8030014c3f74d50ae WatchSource:0}: Error finding container 9a515728d71bb0746661c02ef172196bcd029a90e410f7d8030014c3f74d50ae: Status 404 returned error can't find the container with id 9a515728d71bb0746661c02ef172196bcd029a90e410f7d8030014c3f74d50ae
Jul 23 19:27:45.335946 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:45.335910    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2nvbw" event={"ID":"8ca212e8-2df0-46b8-8616-e18c3cd0acec","Type":"ContainerStarted","Data":"9a515728d71bb0746661c02ef172196bcd029a90e410f7d8030014c3f74d50ae"}
Jul 23 19:27:47.344428 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:47.344386    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2nvbw" event={"ID":"8ca212e8-2df0-46b8-8616-e18c3cd0acec","Type":"ContainerStarted","Data":"db713aed576c3909a20fba1d1b3a33975744eda4cf66fa3236080f976a0f64a0"}
Jul 23 19:27:47.344848 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:47.344472    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2nvbw"
Jul 23 19:27:47.363223 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:47.363179    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2nvbw" podStartSLOduration=1.397726471 podStartE2EDuration="3.363165868s" totalImagesPullingTime="1.965439397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:27:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:27:47.362031609 +0000 UTC m=+468.199038317" watchObservedRunningTime="2026-07-23 19:27:47.363165868 +0000 UTC m=+468.200172575"
Jul 23 19:27:47.754644 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:47.754606    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g"]
Jul 23 19:27:47.756796 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:47.756775    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g"
Jul 23 19:27:47.759541 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:47.759523    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-cfdqx\""
Jul 23 19:27:47.767333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:47.767313    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g"]
Jul 23 19:27:47.864085 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:47.864042    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gtgt\" (UniqueName: \"kubernetes.io/projected/490fc8cc-eefb-4234-b232-cb19a5aff7d1-kube-api-access-6gtgt\") pod \"limitador-operator-controller-manager-859d7b78bd-kwd7g\" (UID: \"490fc8cc-eefb-4234-b232-cb19a5aff7d1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g"
Jul 23 19:27:47.965298 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:47.965240    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gtgt\" (UniqueName: \"kubernetes.io/projected/490fc8cc-eefb-4234-b232-cb19a5aff7d1-kube-api-access-6gtgt\") pod \"limitador-operator-controller-manager-859d7b78bd-kwd7g\" (UID: \"490fc8cc-eefb-4234-b232-cb19a5aff7d1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g"
Jul 23 19:27:47.979590 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:47.979560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gtgt\" (UniqueName: \"kubernetes.io/projected/490fc8cc-eefb-4234-b232-cb19a5aff7d1-kube-api-access-6gtgt\") pod \"limitador-operator-controller-manager-859d7b78bd-kwd7g\" (UID: \"490fc8cc-eefb-4234-b232-cb19a5aff7d1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g"
Jul 23 19:27:48.066686 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:48.066603    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g"
Jul 23 19:27:48.216521 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:48.216497    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g"]
Jul 23 19:27:48.218423 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:27:48.218387    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod490fc8cc_eefb_4234_b232_cb19a5aff7d1.slice/crio-f3ecd921926b302de6e859e00137b8761c8522656c6262a20e2f280cd130e8f6 WatchSource:0}: Error finding container f3ecd921926b302de6e859e00137b8761c8522656c6262a20e2f280cd130e8f6: Status 404 returned error can't find the container with id f3ecd921926b302de6e859e00137b8761c8522656c6262a20e2f280cd130e8f6
Jul 23 19:27:48.349177 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:48.349107    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g" event={"ID":"490fc8cc-eefb-4234-b232-cb19a5aff7d1","Type":"ContainerStarted","Data":"f3ecd921926b302de6e859e00137b8761c8522656c6262a20e2f280cd130e8f6"}
Jul 23 19:27:50.358714 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:50.358679    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g" event={"ID":"490fc8cc-eefb-4234-b232-cb19a5aff7d1","Type":"ContainerStarted","Data":"ab34b3a95b6c0d09b69220f7bc59627c928f0c2b20f903b6210d772d3f98a6da"}
Jul 23 19:27:50.359147 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:50.358748    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g"
Jul 23 19:27:50.399049 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:50.399004    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g" podStartSLOduration=1.819467462 podStartE2EDuration="3.398988759s" totalImagesPullingTime="1.579521297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:27:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:27:50.396302378 +0000 UTC m=+471.233309084" watchObservedRunningTime="2026-07-23 19:27:50.398988759 +0000 UTC m=+471.235995466"
Jul 23 19:27:58.351760 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:27:58.351728    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2nvbw"
Jul 23 19:28:01.364974 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:01.364936    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g"
Jul 23 19:28:02.092538 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:02.092506    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-k7m6d"]
Jul 23 19:28:02.095721 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:02.095704    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k7m6d"
Jul 23 19:28:02.098533 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:02.098509    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mcgx7\""
Jul 23 19:28:02.099512 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:02.099497    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 23 19:28:02.100219 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:02.100204    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 23 19:28:02.108413 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:02.108393    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-k7m6d"]
Jul 23 19:28:02.171999 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:02.171965    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfl7d\" (UniqueName: \"kubernetes.io/projected/eeb58892-a871-4c92-b643-87cb9fec136c-kube-api-access-vfl7d\") pod \"kuadrant-console-plugin-66b5774985-k7m6d\" (UID: \"eeb58892-a871-4c92-b643-87cb9fec136c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k7m6d"
Jul 23 19:28:02.171999 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:02.172002    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eeb58892-a871-4c92-b643-87cb9fec136c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-k7m6d\" (UID: \"eeb58892-a871-4c92-b643-87cb9fec136c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k7m6d"
Jul 23 19:28:02.172184 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:02.172046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eeb58892-a871-4c92-b643-87cb9fec136c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-k7m6d\" (UID: \"eeb58892-a871-4c92-b643-87cb9fec136c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k7m6d"
Jul 23 19:28:02.273403 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:02.273370    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfl7d\" (UniqueName: \"kubernetes.io/projected/eeb58892-a871-4c92-b643-87cb9fec136c-kube-api-access-vfl7d\") pod \"kuadrant-console-plugin-66b5774985-k7m6d\" (UID: \"eeb58892-a871-4c92-b643-87cb9fec136c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k7m6d"
Jul 23 19:28:02.273403 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:02.273405    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eeb58892-a871-4c92-b643-87cb9fec136c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-k7m6d\" (UID: \"eeb58892-a871-4c92-b643-87cb9fec136c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k7m6d"
Jul 23 19:28:02.273597 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:28:02.273506    2578 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 23 19:28:02.273597 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:02.273527    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eeb58892-a871-4c92-b643-87cb9fec136c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-k7m6d\" (UID: \"eeb58892-a871-4c92-b643-87cb9fec136c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k7m6d"
Jul 23 19:28:02.273597 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:28:02.273555    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeb58892-a871-4c92-b643-87cb9fec136c-plugin-serving-cert podName:eeb58892-a871-4c92-b643-87cb9fec136c nodeName:}" failed. No retries permitted until 2026-07-23 19:28:02.773539976 +0000 UTC m=+483.610546661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/eeb58892-a871-4c92-b643-87cb9fec136c-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-k7m6d" (UID: "eeb58892-a871-4c92-b643-87cb9fec136c") : secret "plugin-serving-cert" not found
Jul 23 19:28:02.274066 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:02.274047    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/eeb58892-a871-4c92-b643-87cb9fec136c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-k7m6d\" (UID: \"eeb58892-a871-4c92-b643-87cb9fec136c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k7m6d"
Jul 23 19:28:02.290872 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:02.290846    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfl7d\" (UniqueName: \"kubernetes.io/projected/eeb58892-a871-4c92-b643-87cb9fec136c-kube-api-access-vfl7d\") pod \"kuadrant-console-plugin-66b5774985-k7m6d\" (UID: \"eeb58892-a871-4c92-b643-87cb9fec136c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k7m6d"
Jul 23 19:28:02.777911 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:02.777871    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eeb58892-a871-4c92-b643-87cb9fec136c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-k7m6d\" (UID: \"eeb58892-a871-4c92-b643-87cb9fec136c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k7m6d"
Jul 23 19:28:02.780445 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:02.780419    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/eeb58892-a871-4c92-b643-87cb9fec136c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-k7m6d\" (UID: \"eeb58892-a871-4c92-b643-87cb9fec136c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k7m6d"
Jul 23 19:28:03.004481 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:03.004440    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k7m6d"
Jul 23 19:28:03.143433 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:03.143400    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-k7m6d"]
Jul 23 19:28:03.146288 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:28:03.146240    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeeb58892_a871_4c92_b643_87cb9fec136c.slice/crio-b8fc744c7dbe0f962bb527b85de5dde0cb1fda29e93114a122fe334261d17e23 WatchSource:0}: Error finding container b8fc744c7dbe0f962bb527b85de5dde0cb1fda29e93114a122fe334261d17e23: Status 404 returned error can't find the container with id b8fc744c7dbe0f962bb527b85de5dde0cb1fda29e93114a122fe334261d17e23
Jul 23 19:28:03.415837 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:03.415749    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k7m6d" event={"ID":"eeb58892-a871-4c92-b643-87cb9fec136c","Type":"ContainerStarted","Data":"b8fc744c7dbe0f962bb527b85de5dde0cb1fda29e93114a122fe334261d17e23"}
Jul 23 19:28:12.903238 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:12.903202    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g"]
Jul 23 19:28:12.903723 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:12.903460    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g" podUID="490fc8cc-eefb-4234-b232-cb19a5aff7d1" containerName="manager" containerID="cri-o://ab34b3a95b6c0d09b69220f7bc59627c928f0c2b20f903b6210d772d3f98a6da" gracePeriod=2
Jul 23 19:28:12.911596 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:12.911567    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g"]
Jul 23 19:28:12.964105 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:12.964051    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmb6n"]
Jul 23 19:28:12.964400 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:12.964384    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="490fc8cc-eefb-4234-b232-cb19a5aff7d1" containerName="manager"
Jul 23 19:28:12.964400 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:12.964401    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="490fc8cc-eefb-4234-b232-cb19a5aff7d1" containerName="manager"
Jul 23 19:28:12.964559 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:12.964456    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="490fc8cc-eefb-4234-b232-cb19a5aff7d1" containerName="manager"
Jul 23 19:28:12.967527 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:12.967507    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmb6n"
Jul 23 19:28:13.007867 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:13.007819    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmb6n"]
Jul 23 19:28:13.037748 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:28:13.037707    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kwd7g\" is forbidden: User \"system:node:ip-10-0-141-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-53.ec2.internal' and this object" podUID="490fc8cc-eefb-4234-b232-cb19a5aff7d1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g"
Jul 23 19:28:13.068713 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:13.068671    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs8dc\" (UniqueName: \"kubernetes.io/projected/b3e9ab8b-b605-474b-aae1-d8303dd4e488-kube-api-access-fs8dc\") pod \"limitador-operator-controller-manager-859d7b78bd-jmb6n\" (UID: \"b3e9ab8b-b605-474b-aae1-d8303dd4e488\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmb6n"
Jul 23 19:28:13.169864 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:13.169780    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs8dc\" (UniqueName: \"kubernetes.io/projected/b3e9ab8b-b605-474b-aae1-d8303dd4e488-kube-api-access-fs8dc\") pod \"limitador-operator-controller-manager-859d7b78bd-jmb6n\" (UID: \"b3e9ab8b-b605-474b-aae1-d8303dd4e488\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmb6n"
Jul 23 19:28:13.184973 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:13.184941    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs8dc\" (UniqueName: \"kubernetes.io/projected/b3e9ab8b-b605-474b-aae1-d8303dd4e488-kube-api-access-fs8dc\") pod \"limitador-operator-controller-manager-859d7b78bd-jmb6n\" (UID: \"b3e9ab8b-b605-474b-aae1-d8303dd4e488\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmb6n"
Jul 23 19:28:13.300095 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:13.300049    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmb6n"
Jul 23 19:28:13.356415 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:13.356382    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn"]
Jul 23 19:28:13.361088 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:13.361067    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn"
Jul 23 19:28:13.365385 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:13.365359    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-44wf7\""
Jul 23 19:28:13.416502 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:13.416471    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn"]
Jul 23 19:28:13.455783 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:28:13.455676    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kwd7g\" is forbidden: User \"system:node:ip-10-0-141-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-53.ec2.internal' and this object" podUID="490fc8cc-eefb-4234-b232-cb19a5aff7d1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g"
Jul 23 19:28:13.473568 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:13.473532    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjnjm\" (UniqueName: \"kubernetes.io/projected/16da2f4c-c9cc-41a6-b065-a224fcae6840-kube-api-access-gjnjm\") pod \"kuadrant-operator-controller-manager-86878c769f-5ntvn\" (UID: \"16da2f4c-c9cc-41a6-b065-a224fcae6840\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn"
Jul 23 19:28:13.473729 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:13.473650    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16da2f4c-c9cc-41a6-b065-a224fcae6840-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5ntvn\" (UID: \"16da2f4c-c9cc-41a6-b065-a224fcae6840\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn"
Jul 23 19:28:13.574099 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:13.574058    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjnjm\" (UniqueName: \"kubernetes.io/projected/16da2f4c-c9cc-41a6-b065-a224fcae6840-kube-api-access-gjnjm\") pod \"kuadrant-operator-controller-manager-86878c769f-5ntvn\" (UID: \"16da2f4c-c9cc-41a6-b065-a224fcae6840\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn"
Jul 23 19:28:13.574277 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:13.574128    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16da2f4c-c9cc-41a6-b065-a224fcae6840-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5ntvn\" (UID: \"16da2f4c-c9cc-41a6-b065-a224fcae6840\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn"
Jul 23 19:28:13.574533 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:13.574510    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16da2f4c-c9cc-41a6-b065-a224fcae6840-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5ntvn\" (UID: \"16da2f4c-c9cc-41a6-b065-a224fcae6840\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn"
Jul 23 19:28:13.590788 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:13.590761    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjnjm\" (UniqueName: \"kubernetes.io/projected/16da2f4c-c9cc-41a6-b065-a224fcae6840-kube-api-access-gjnjm\") pod \"kuadrant-operator-controller-manager-86878c769f-5ntvn\" (UID: \"16da2f4c-c9cc-41a6-b065-a224fcae6840\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn"
Jul 23 19:28:13.673346 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:13.673316    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn"
Jul 23 19:28:24.867862 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:24.867697    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g"
Jul 23 19:28:24.870908 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:28:24.870864    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kwd7g\" is forbidden: User \"system:node:ip-10-0-141-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-53.ec2.internal' and this object" podUID="490fc8cc-eefb-4234-b232-cb19a5aff7d1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g"
Jul 23 19:28:24.880158 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:24.880124    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gtgt\" (UniqueName: \"kubernetes.io/projected/490fc8cc-eefb-4234-b232-cb19a5aff7d1-kube-api-access-6gtgt\") pod \"490fc8cc-eefb-4234-b232-cb19a5aff7d1\" (UID: \"490fc8cc-eefb-4234-b232-cb19a5aff7d1\") "
Jul 23 19:28:24.882765 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:24.882732    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/490fc8cc-eefb-4234-b232-cb19a5aff7d1-kube-api-access-6gtgt" (OuterVolumeSpecName: "kube-api-access-6gtgt") pod "490fc8cc-eefb-4234-b232-cb19a5aff7d1" (UID: "490fc8cc-eefb-4234-b232-cb19a5aff7d1"). InnerVolumeSpecName "kube-api-access-6gtgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:28:24.904555 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:24.904529    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn"]
Jul 23 19:28:24.907374 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:28:24.907350    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16da2f4c_c9cc_41a6_b065_a224fcae6840.slice/crio-d46c1a2c1f7f38772ffe385de3c0b81a824ba25f851c11ae3c259fbddc96b826 WatchSource:0}: Error finding container d46c1a2c1f7f38772ffe385de3c0b81a824ba25f851c11ae3c259fbddc96b826: Status 404 returned error can't find the container with id d46c1a2c1f7f38772ffe385de3c0b81a824ba25f851c11ae3c259fbddc96b826
Jul 23 19:28:24.923091 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:24.923071    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmb6n"]
Jul 23 19:28:24.924816 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:28:24.924794    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e9ab8b_b605_474b_aae1_d8303dd4e488.slice/crio-12e368300e83e876da33703b30452c54e61774a32dbedcecd7c63713a9ec26c3 WatchSource:0}: Error finding container 12e368300e83e876da33703b30452c54e61774a32dbedcecd7c63713a9ec26c3: Status 404 returned error can't find the container with id 12e368300e83e876da33703b30452c54e61774a32dbedcecd7c63713a9ec26c3
Jul 23 19:28:24.980866 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:24.980847    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gtgt\" (UniqueName: \"kubernetes.io/projected/490fc8cc-eefb-4234-b232-cb19a5aff7d1-kube-api-access-6gtgt\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:28:25.524972 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:25.524935    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn" event={"ID":"16da2f4c-c9cc-41a6-b065-a224fcae6840","Type":"ContainerStarted","Data":"d46c1a2c1f7f38772ffe385de3c0b81a824ba25f851c11ae3c259fbddc96b826"}
Jul 23 19:28:25.526465 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:25.526433    2578 generic.go:356] "Generic (PLEG): container finished" podID="490fc8cc-eefb-4234-b232-cb19a5aff7d1" containerID="ab34b3a95b6c0d09b69220f7bc59627c928f0c2b20f903b6210d772d3f98a6da" exitCode=0
Jul 23 19:28:25.526598 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:25.526493    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g"
Jul 23 19:28:25.526598 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:25.526522    2578 scope.go:117] "RemoveContainer" containerID="ab34b3a95b6c0d09b69220f7bc59627c928f0c2b20f903b6210d772d3f98a6da"
Jul 23 19:28:25.528635 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:25.528606    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmb6n" event={"ID":"b3e9ab8b-b605-474b-aae1-d8303dd4e488","Type":"ContainerStarted","Data":"a87d1e172557cc5b158fae1964aabae15295c87e94e9cbfe1b457c7e0920e885"}
Jul 23 19:28:25.528768 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:25.528658    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmb6n" event={"ID":"b3e9ab8b-b605-474b-aae1-d8303dd4e488","Type":"ContainerStarted","Data":"12e368300e83e876da33703b30452c54e61774a32dbedcecd7c63713a9ec26c3"}
Jul 23 19:28:25.528919 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:25.528898    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmb6n"
Jul 23 19:28:25.529191 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:28:25.529160    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kwd7g\" is forbidden: User \"system:node:ip-10-0-141-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-53.ec2.internal' and this object" podUID="490fc8cc-eefb-4234-b232-cb19a5aff7d1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g"
Jul 23 19:28:25.531290 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:25.531239    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k7m6d" event={"ID":"eeb58892-a871-4c92-b643-87cb9fec136c","Type":"ContainerStarted","Data":"309791b192d963609b6fe641de50bcdca6253454f438fec76f640ea4b2daf054"}
Jul 23 19:28:25.537370 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:25.537339    2578 scope.go:117] "RemoveContainer" containerID="ab34b3a95b6c0d09b69220f7bc59627c928f0c2b20f903b6210d772d3f98a6da"
Jul 23 19:28:25.537642 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:28:25.537621    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab34b3a95b6c0d09b69220f7bc59627c928f0c2b20f903b6210d772d3f98a6da\": container with ID starting with ab34b3a95b6c0d09b69220f7bc59627c928f0c2b20f903b6210d772d3f98a6da not found: ID does not exist" containerID="ab34b3a95b6c0d09b69220f7bc59627c928f0c2b20f903b6210d772d3f98a6da"
Jul 23 19:28:25.537701 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:25.537648    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab34b3a95b6c0d09b69220f7bc59627c928f0c2b20f903b6210d772d3f98a6da"} err="failed to get container status \"ab34b3a95b6c0d09b69220f7bc59627c928f0c2b20f903b6210d772d3f98a6da\": rpc error: code = NotFound desc = could not find container \"ab34b3a95b6c0d09b69220f7bc59627c928f0c2b20f903b6210d772d3f98a6da\": container with ID starting with ab34b3a95b6c0d09b69220f7bc59627c928f0c2b20f903b6210d772d3f98a6da not found: ID does not exist"
Jul 23 19:28:25.552266 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:25.552211    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmb6n" podStartSLOduration=13.552194434 podStartE2EDuration="13.552194434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:28:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:28:25.550728208 +0000 UTC m=+506.387734914" watchObservedRunningTime="2026-07-23 19:28:25.552194434 +0000 UTC m=+506.389201142"
Jul 23 19:28:25.552832 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:28:25.552808    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kwd7g\" is forbidden: User \"system:node:ip-10-0-141-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-53.ec2.internal' and this object" podUID="490fc8cc-eefb-4234-b232-cb19a5aff7d1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g"
Jul 23 19:28:25.574773 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:25.574725    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k7m6d" podStartSLOduration=1.904754825 podStartE2EDuration="23.574707948s" totalImagesPullingTime="21.669953123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:28:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:28:25.572983549 +0000 UTC m=+506.409990255" watchObservedRunningTime="2026-07-23 19:28:25.574707948 +0000 UTC m=+506.411714657"
Jul 23 19:28:25.575763 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:28:25.575733    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kwd7g\" is forbidden: User \"system:node:ip-10-0-141-53.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-53.ec2.internal' and this object" podUID="490fc8cc-eefb-4234-b232-cb19a5aff7d1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kwd7g"
Jul 23 19:28:25.654129 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:25.654099    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="490fc8cc-eefb-4234-b232-cb19a5aff7d1" path="/var/lib/kubelet/pods/490fc8cc-eefb-4234-b232-cb19a5aff7d1/volumes"
Jul 23 19:28:29.549938 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:29.549904    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn" event={"ID":"16da2f4c-c9cc-41a6-b065-a224fcae6840","Type":"ContainerStarted","Data":"9a9c195b39473d4ab4c1cb8ba6f9da810bd5b78b72e404b51184c56cc6fbc615"}
Jul 23 19:28:29.550354 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:29.550175    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn"
Jul 23 19:28:29.577048 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:29.577008    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn" podStartSLOduration=12.405240585 podStartE2EDuration="16.576995493s" totalImagesPullingTime="4.171754908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:28:29.574742155 +0000 UTC m=+510.411748859" watchObservedRunningTime="2026-07-23 19:28:29.576995493 +0000 UTC m=+510.414002201"
Jul 23 19:28:36.538859 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:36.538829    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmb6n"
Jul 23 19:28:40.556944 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:28:40.556917    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn"
Jul 23 19:29:03.228870 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:03.228835    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-d96xq"]
Jul 23 19:29:03.260559 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:03.260521    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-d96xq"]
Jul 23 19:29:03.260714 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:03.260613    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-d96xq"
Jul 23 19:29:03.264561 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:03.264540    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rwdhb\""
Jul 23 19:29:03.376753 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:03.376718    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbxdq\" (UniqueName: \"kubernetes.io/projected/b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1-kube-api-access-bbxdq\") pod \"authorino-58cd955675-d96xq\" (UID: \"b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1\") " pod="kuadrant-system/authorino-58cd955675-d96xq"
Jul 23 19:29:03.477345 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:03.477307    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbxdq\" (UniqueName: \"kubernetes.io/projected/b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1-kube-api-access-bbxdq\") pod \"authorino-58cd955675-d96xq\" (UID: \"b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1\") " pod="kuadrant-system/authorino-58cd955675-d96xq"
Jul 23 19:29:03.489589 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:03.489516    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbxdq\" (UniqueName: \"kubernetes.io/projected/b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1-kube-api-access-bbxdq\") pod \"authorino-58cd955675-d96xq\" (UID: \"b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1\") " pod="kuadrant-system/authorino-58cd955675-d96xq"
Jul 23 19:29:03.568958 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:03.568931    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-d96xq"
Jul 23 19:29:03.705031 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:03.705005    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-d96xq"]
Jul 23 19:29:03.707497 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:29:03.707469    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2f3c239_8ad8_4d05_96ca_7a3cd28fdaa1.slice/crio-26d9898c74f932e83e0d9a11e81aaefef6e4f2a4007f62a0b543416458698237 WatchSource:0}: Error finding container 26d9898c74f932e83e0d9a11e81aaefef6e4f2a4007f62a0b543416458698237: Status 404 returned error can't find the container with id 26d9898c74f932e83e0d9a11e81aaefef6e4f2a4007f62a0b543416458698237
Jul 23 19:29:04.695003 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:04.694941    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-d96xq" event={"ID":"b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1","Type":"ContainerStarted","Data":"26d9898c74f932e83e0d9a11e81aaefef6e4f2a4007f62a0b543416458698237"}
Jul 23 19:29:07.236347 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:07.236311    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-d96xq"]
Jul 23 19:29:07.708471 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:07.708382    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-d96xq" event={"ID":"b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1","Type":"ContainerStarted","Data":"ae3a7981ef02871f2cd49e7de4ceab14296818ba7182965fa933d81f156c5924"}
Jul 23 19:29:07.734201 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:07.734145    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-d96xq" podStartSLOduration=1.625724712 podStartE2EDuration="4.734130835s" totalImagesPullingTime="3.108406123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:29:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:29:07.732984837 +0000 UTC m=+548.569991543" watchObservedRunningTime="2026-07-23 19:29:07.734130835 +0000 UTC m=+548.571137542"
Jul 23 19:29:08.712878 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:08.712832    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-d96xq" podUID="b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1" containerName="authorino" containerID="cri-o://ae3a7981ef02871f2cd49e7de4ceab14296818ba7182965fa933d81f156c5924" gracePeriod=30
Jul 23 19:29:08.958660 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:08.958641    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-d96xq"
Jul 23 19:29:09.026092 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:09.026065    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbxdq\" (UniqueName: \"kubernetes.io/projected/b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1-kube-api-access-bbxdq\") pod \"b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1\" (UID: \"b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1\") "
Jul 23 19:29:09.028068 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:09.028035    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1-kube-api-access-bbxdq" (OuterVolumeSpecName: "kube-api-access-bbxdq") pod "b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1" (UID: "b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1"). InnerVolumeSpecName "kube-api-access-bbxdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:29:09.127443 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:09.127411    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbxdq\" (UniqueName: \"kubernetes.io/projected/b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1-kube-api-access-bbxdq\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:29:09.717303 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:09.717270    2578 generic.go:356] "Generic (PLEG): container finished" podID="b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1" containerID="ae3a7981ef02871f2cd49e7de4ceab14296818ba7182965fa933d81f156c5924" exitCode=0
Jul 23 19:29:09.717303 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:09.717304    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-d96xq"
Jul 23 19:29:09.717714 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:09.717349    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-d96xq" event={"ID":"b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1","Type":"ContainerDied","Data":"ae3a7981ef02871f2cd49e7de4ceab14296818ba7182965fa933d81f156c5924"}
Jul 23 19:29:09.717714 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:09.717386    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-d96xq" event={"ID":"b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1","Type":"ContainerDied","Data":"26d9898c74f932e83e0d9a11e81aaefef6e4f2a4007f62a0b543416458698237"}
Jul 23 19:29:09.717714 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:09.717402    2578 scope.go:117] "RemoveContainer" containerID="ae3a7981ef02871f2cd49e7de4ceab14296818ba7182965fa933d81f156c5924"
Jul 23 19:29:09.725081 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:09.725065    2578 scope.go:117] "RemoveContainer" containerID="ae3a7981ef02871f2cd49e7de4ceab14296818ba7182965fa933d81f156c5924"
Jul 23 19:29:09.725341 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:29:09.725322    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae3a7981ef02871f2cd49e7de4ceab14296818ba7182965fa933d81f156c5924\": container with ID starting with ae3a7981ef02871f2cd49e7de4ceab14296818ba7182965fa933d81f156c5924 not found: ID does not exist" containerID="ae3a7981ef02871f2cd49e7de4ceab14296818ba7182965fa933d81f156c5924"
Jul 23 19:29:09.725414 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:09.725348    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae3a7981ef02871f2cd49e7de4ceab14296818ba7182965fa933d81f156c5924"} err="failed to get container status \"ae3a7981ef02871f2cd49e7de4ceab14296818ba7182965fa933d81f156c5924\": rpc error: code = NotFound desc = could not find container \"ae3a7981ef02871f2cd49e7de4ceab14296818ba7182965fa933d81f156c5924\": container with ID starting with ae3a7981ef02871f2cd49e7de4ceab14296818ba7182965fa933d81f156c5924 not found: ID does not exist"
Jul 23 19:29:09.737219 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:09.737196    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-d96xq"]
Jul 23 19:29:09.742743 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:09.742721    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-d96xq"]
Jul 23 19:29:11.650881 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:11.650849    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1" path="/var/lib/kubelet/pods/b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1/volumes"
Jul 23 19:29:31.861144 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:31.861110    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qw899"]
Jul 23 19:29:31.861540 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:31.861388    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1" containerName="authorino"
Jul 23 19:29:31.861540 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:31.861399    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1" containerName="authorino"
Jul 23 19:29:31.861540 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:31.861522    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2f3c239-8ad8-4d05-96ca-7a3cd28fdaa1" containerName="authorino"
Jul 23 19:29:31.864433 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:31.864416    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qw899"
Jul 23 19:29:31.866807 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:31.866786    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rwdhb\""
Jul 23 19:29:31.873175 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:31.873151    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qw899"]
Jul 23 19:29:31.997226 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:31.997186    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4qjl\" (UniqueName: \"kubernetes.io/projected/51f9c644-717f-41e4-a11f-4445b3b1ee88-kube-api-access-x4qjl\") pod \"authorino-5d4b67c446-qw899\" (UID: \"51f9c644-717f-41e4-a11f-4445b3b1ee88\") " pod="kuadrant-system/authorino-5d4b67c446-qw899"
Jul 23 19:29:32.097615 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:32.097580    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4qjl\" (UniqueName: \"kubernetes.io/projected/51f9c644-717f-41e4-a11f-4445b3b1ee88-kube-api-access-x4qjl\") pod \"authorino-5d4b67c446-qw899\" (UID: \"51f9c644-717f-41e4-a11f-4445b3b1ee88\") " pod="kuadrant-system/authorino-5d4b67c446-qw899"
Jul 23 19:29:32.106281 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:32.106234    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qw899"]
Jul 23 19:29:32.106454 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:29:32.106435    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-x4qjl], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-qw899" podUID="51f9c644-717f-41e4-a11f-4445b3b1ee88"
Jul 23 19:29:32.108521 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:32.108501    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4qjl\" (UniqueName: \"kubernetes.io/projected/51f9c644-717f-41e4-a11f-4445b3b1ee88-kube-api-access-x4qjl\") pod \"authorino-5d4b67c446-qw899\" (UID: \"51f9c644-717f-41e4-a11f-4445b3b1ee88\") " pod="kuadrant-system/authorino-5d4b67c446-qw899"
Jul 23 19:29:32.813672 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:32.813642    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qw899"
Jul 23 19:29:32.821189 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:32.821165    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qw899"
Jul 23 19:29:33.003768 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:33.003720    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4qjl\" (UniqueName: \"kubernetes.io/projected/51f9c644-717f-41e4-a11f-4445b3b1ee88-kube-api-access-x4qjl\") pod \"51f9c644-717f-41e4-a11f-4445b3b1ee88\" (UID: \"51f9c644-717f-41e4-a11f-4445b3b1ee88\") "
Jul 23 19:29:33.005902 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:33.005874    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51f9c644-717f-41e4-a11f-4445b3b1ee88-kube-api-access-x4qjl" (OuterVolumeSpecName: "kube-api-access-x4qjl") pod "51f9c644-717f-41e4-a11f-4445b3b1ee88" (UID: "51f9c644-717f-41e4-a11f-4445b3b1ee88"). InnerVolumeSpecName "kube-api-access-x4qjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:29:33.105171 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:33.105105    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4qjl\" (UniqueName: \"kubernetes.io/projected/51f9c644-717f-41e4-a11f-4445b3b1ee88-kube-api-access-x4qjl\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:29:33.822300 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:33.822268    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qw899"
Jul 23 19:29:33.850517 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:33.850487    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qw899"]
Jul 23 19:29:33.856794 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:33.856767    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qw899"]
Jul 23 19:29:35.651378 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:35.651336    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51f9c644-717f-41e4-a11f-4445b3b1ee88" path="/var/lib/kubelet/pods/51f9c644-717f-41e4-a11f-4445b3b1ee88/volumes"
Jul 23 19:29:41.285055 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:41.285021    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56d6ccb556-6752j"]
Jul 23 19:29:41.289631 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:41.289609    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56d6ccb556-6752j"
Jul 23 19:29:41.293567 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:41.293547    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 19:29:41.294472 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:41.294458    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 19:29:41.294523 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:41.294487    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nsblt\""
Jul 23 19:29:41.300305 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:41.300280    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56d6ccb556-6752j"]
Jul 23 19:29:41.373173 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:41.373139    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k55g6\" (UniqueName: \"kubernetes.io/projected/ec0ec77d-bb13-462a-bbd7-9c45d9f430e8-kube-api-access-k55g6\") pod \"maas-controller-56d6ccb556-6752j\" (UID: \"ec0ec77d-bb13-462a-bbd7-9c45d9f430e8\") " pod="opendatahub/maas-controller-56d6ccb556-6752j"
Jul 23 19:29:41.373336 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:41.373195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec0ec77d-bb13-462a-bbd7-9c45d9f430e8-webhook-cert\") pod \"maas-controller-56d6ccb556-6752j\" (UID: \"ec0ec77d-bb13-462a-bbd7-9c45d9f430e8\") " pod="opendatahub/maas-controller-56d6ccb556-6752j"
Jul 23 19:29:41.473624 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:41.473595    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec0ec77d-bb13-462a-bbd7-9c45d9f430e8-webhook-cert\") pod \"maas-controller-56d6ccb556-6752j\" (UID: \"ec0ec77d-bb13-462a-bbd7-9c45d9f430e8\") " pod="opendatahub/maas-controller-56d6ccb556-6752j"
Jul 23 19:29:41.473759 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:41.473645    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k55g6\" (UniqueName: \"kubernetes.io/projected/ec0ec77d-bb13-462a-bbd7-9c45d9f430e8-kube-api-access-k55g6\") pod \"maas-controller-56d6ccb556-6752j\" (UID: \"ec0ec77d-bb13-462a-bbd7-9c45d9f430e8\") " pod="opendatahub/maas-controller-56d6ccb556-6752j"
Jul 23 19:29:41.476033 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:41.476002    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec0ec77d-bb13-462a-bbd7-9c45d9f430e8-webhook-cert\") pod \"maas-controller-56d6ccb556-6752j\" (UID: \"ec0ec77d-bb13-462a-bbd7-9c45d9f430e8\") " pod="opendatahub/maas-controller-56d6ccb556-6752j"
Jul 23 19:29:41.486733 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:41.486709    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k55g6\" (UniqueName: \"kubernetes.io/projected/ec0ec77d-bb13-462a-bbd7-9c45d9f430e8-kube-api-access-k55g6\") pod \"maas-controller-56d6ccb556-6752j\" (UID: \"ec0ec77d-bb13-462a-bbd7-9c45d9f430e8\") " pod="opendatahub/maas-controller-56d6ccb556-6752j"
Jul 23 19:29:41.600233 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:41.600179    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56d6ccb556-6752j"
Jul 23 19:29:41.936446 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:41.936421    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56d6ccb556-6752j"]
Jul 23 19:29:41.938608 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:29:41.938582    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec0ec77d_bb13_462a_bbd7_9c45d9f430e8.slice/crio-463538f6e5935ef1e08920caf77f2b3eb7cbe1d45c33b30adf9598ffc5e63ad0 WatchSource:0}: Error finding container 463538f6e5935ef1e08920caf77f2b3eb7cbe1d45c33b30adf9598ffc5e63ad0: Status 404 returned error can't find the container with id 463538f6e5935ef1e08920caf77f2b3eb7cbe1d45c33b30adf9598ffc5e63ad0
Jul 23 19:29:42.860372 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:42.860332    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56d6ccb556-6752j" event={"ID":"ec0ec77d-bb13-462a-bbd7-9c45d9f430e8","Type":"ContainerStarted","Data":"463538f6e5935ef1e08920caf77f2b3eb7cbe1d45c33b30adf9598ffc5e63ad0"}
Jul 23 19:29:44.870504 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:44.870469    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56d6ccb556-6752j" event={"ID":"ec0ec77d-bb13-462a-bbd7-9c45d9f430e8","Type":"ContainerStarted","Data":"f9123fd02d135875b76b4f2ae0a4f16e029ec6c6c595ebf2cafe0ac38642af96"}
Jul 23 19:29:44.870911 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:44.870591    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56d6ccb556-6752j"
Jul 23 19:29:44.891495 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:44.891447    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56d6ccb556-6752j" podStartSLOduration=1.89975967 podStartE2EDuration="3.891432806s" totalImagesPullingTime="1.991673136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:29:44.890736878 +0000 UTC m=+585.727743597" watchObservedRunningTime="2026-07-23 19:29:44.891432806 +0000 UTC m=+585.728439512"
Jul 23 19:29:55.877060 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:29:55.877026    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56d6ccb556-6752j"
Jul 23 19:30:15.767848 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:15.767814    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-76bbd449ff-fz5z7"]
Jul 23 19:30:15.774651 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:15.774627    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-76bbd449ff-fz5z7"
Jul 23 19:30:15.777216 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:15.777197    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 19:30:15.778538 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:15.778510    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 19:30:15.778671 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:15.778517    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7m48c\""
Jul 23 19:30:15.778923 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:15.778898    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 23 19:30:15.789527 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:15.789503    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-76bbd449ff-fz5z7"]
Jul 23 19:30:15.854115 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:15.854087    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42bb3ed8-a7c3-498f-8898-5a2ebd4958c9-openshift-service-ca\") pod \"maas-api-76bbd449ff-fz5z7\" (UID: \"42bb3ed8-a7c3-498f-8898-5a2ebd4958c9\") " pod="odh-ai-gateway-infra/maas-api-76bbd449ff-fz5z7"
Jul 23 19:30:15.854288 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:15.854125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42bb3ed8-a7c3-498f-8898-5a2ebd4958c9-maas-api-tls\") pod \"maas-api-76bbd449ff-fz5z7\" (UID: \"42bb3ed8-a7c3-498f-8898-5a2ebd4958c9\") " pod="odh-ai-gateway-infra/maas-api-76bbd449ff-fz5z7"
Jul 23 19:30:15.854288 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:15.854147    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qpz4\" (UniqueName: \"kubernetes.io/projected/42bb3ed8-a7c3-498f-8898-5a2ebd4958c9-kube-api-access-5qpz4\") pod \"maas-api-76bbd449ff-fz5z7\" (UID: \"42bb3ed8-a7c3-498f-8898-5a2ebd4958c9\") " pod="odh-ai-gateway-infra/maas-api-76bbd449ff-fz5z7"
Jul 23 19:30:15.955416 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:15.955381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42bb3ed8-a7c3-498f-8898-5a2ebd4958c9-openshift-service-ca\") pod \"maas-api-76bbd449ff-fz5z7\" (UID: \"42bb3ed8-a7c3-498f-8898-5a2ebd4958c9\") " pod="odh-ai-gateway-infra/maas-api-76bbd449ff-fz5z7"
Jul 23 19:30:15.955571 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:15.955425    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42bb3ed8-a7c3-498f-8898-5a2ebd4958c9-maas-api-tls\") pod \"maas-api-76bbd449ff-fz5z7\" (UID: \"42bb3ed8-a7c3-498f-8898-5a2ebd4958c9\") " pod="odh-ai-gateway-infra/maas-api-76bbd449ff-fz5z7"
Jul 23 19:30:15.955571 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:15.955442    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qpz4\" (UniqueName: \"kubernetes.io/projected/42bb3ed8-a7c3-498f-8898-5a2ebd4958c9-kube-api-access-5qpz4\") pod \"maas-api-76bbd449ff-fz5z7\" (UID: \"42bb3ed8-a7c3-498f-8898-5a2ebd4958c9\") " pod="odh-ai-gateway-infra/maas-api-76bbd449ff-fz5z7"
Jul 23 19:30:15.955999 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:15.955979    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42bb3ed8-a7c3-498f-8898-5a2ebd4958c9-openshift-service-ca\") pod \"maas-api-76bbd449ff-fz5z7\" (UID: \"42bb3ed8-a7c3-498f-8898-5a2ebd4958c9\") " pod="odh-ai-gateway-infra/maas-api-76bbd449ff-fz5z7"
Jul 23 19:30:15.957850 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:15.957834    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42bb3ed8-a7c3-498f-8898-5a2ebd4958c9-maas-api-tls\") pod \"maas-api-76bbd449ff-fz5z7\" (UID: \"42bb3ed8-a7c3-498f-8898-5a2ebd4958c9\") " pod="odh-ai-gateway-infra/maas-api-76bbd449ff-fz5z7"
Jul 23 19:30:16.002769 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:16.002740    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qpz4\" (UniqueName: \"kubernetes.io/projected/42bb3ed8-a7c3-498f-8898-5a2ebd4958c9-kube-api-access-5qpz4\") pod \"maas-api-76bbd449ff-fz5z7\" (UID: \"42bb3ed8-a7c3-498f-8898-5a2ebd4958c9\") " pod="odh-ai-gateway-infra/maas-api-76bbd449ff-fz5z7"
Jul 23 19:30:16.089939 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:16.089852    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-76bbd449ff-fz5z7"
Jul 23 19:30:16.231701 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:16.231670    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-76bbd449ff-fz5z7"]
Jul 23 19:30:16.233419 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:30:16.233394    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42bb3ed8_a7c3_498f_8898_5a2ebd4958c9.slice/crio-8e614767cde98647a06d248dd0ad2bc1d0857f4ac27deaeb99b4e75b27f97c2d WatchSource:0}: Error finding container 8e614767cde98647a06d248dd0ad2bc1d0857f4ac27deaeb99b4e75b27f97c2d: Status 404 returned error can't find the container with id 8e614767cde98647a06d248dd0ad2bc1d0857f4ac27deaeb99b4e75b27f97c2d
Jul 23 19:30:17.003185 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:17.003145    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-76bbd449ff-fz5z7" event={"ID":"42bb3ed8-a7c3-498f-8898-5a2ebd4958c9","Type":"ContainerStarted","Data":"8e614767cde98647a06d248dd0ad2bc1d0857f4ac27deaeb99b4e75b27f97c2d"}
Jul 23 19:30:18.008860 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:18.008826    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-76bbd449ff-fz5z7" event={"ID":"42bb3ed8-a7c3-498f-8898-5a2ebd4958c9","Type":"ContainerStarted","Data":"823fb74a41fe806e8cfe3f8612819baeec9c027a077c875a066fe5ee71cc368a"}
Jul 23 19:30:18.009283 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:18.008933    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-76bbd449ff-fz5z7"
Jul 23 19:30:18.033408 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:18.033356    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-76bbd449ff-fz5z7" podStartSLOduration=1.470307102 podStartE2EDuration="3.033341797s" totalImagesPullingTime="1.563034695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:30:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:30:18.031770473 +0000 UTC m=+618.868777197" watchObservedRunningTime="2026-07-23 19:30:18.033341797 +0000 UTC m=+618.870348504"
Jul 23 19:30:24.018487 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:24.018416    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-76bbd449ff-fz5z7"
Jul 23 19:30:46.618644 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.618607    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"]
Jul 23 19:30:46.623364 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.623344    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:46.627368 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.627347    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 19:30:46.628203 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.628183    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tbbll\""
Jul 23 19:30:46.628327 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.628209    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 23 19:30:46.628327 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.628218    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 19:30:46.633036 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.633016    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"]
Jul 23 19:30:46.703133 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.703104    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17f9ca16-90de-46d8-8e2e-210cb836ad6c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b\" (UID: \"17f9ca16-90de-46d8-8e2e-210cb836ad6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:46.703324 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.703136    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17f9ca16-90de-46d8-8e2e-210cb836ad6c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b\" (UID: \"17f9ca16-90de-46d8-8e2e-210cb836ad6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:46.703324 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.703186    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17f9ca16-90de-46d8-8e2e-210cb836ad6c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b\" (UID: \"17f9ca16-90de-46d8-8e2e-210cb836ad6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:46.703324 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.703301    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cmjs\" (UniqueName: \"kubernetes.io/projected/17f9ca16-90de-46d8-8e2e-210cb836ad6c-kube-api-access-4cmjs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b\" (UID: \"17f9ca16-90de-46d8-8e2e-210cb836ad6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:46.703467 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.703350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17f9ca16-90de-46d8-8e2e-210cb836ad6c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b\" (UID: \"17f9ca16-90de-46d8-8e2e-210cb836ad6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:46.703467 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.703373    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17f9ca16-90de-46d8-8e2e-210cb836ad6c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b\" (UID: \"17f9ca16-90de-46d8-8e2e-210cb836ad6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:46.804076 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.804042    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cmjs\" (UniqueName: \"kubernetes.io/projected/17f9ca16-90de-46d8-8e2e-210cb836ad6c-kube-api-access-4cmjs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b\" (UID: \"17f9ca16-90de-46d8-8e2e-210cb836ad6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:46.804240 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.804083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17f9ca16-90de-46d8-8e2e-210cb836ad6c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b\" (UID: \"17f9ca16-90de-46d8-8e2e-210cb836ad6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:46.804240 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.804110    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17f9ca16-90de-46d8-8e2e-210cb836ad6c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b\" (UID: \"17f9ca16-90de-46d8-8e2e-210cb836ad6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:46.804240 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.804165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17f9ca16-90de-46d8-8e2e-210cb836ad6c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b\" (UID: \"17f9ca16-90de-46d8-8e2e-210cb836ad6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:46.804240 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.804189    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17f9ca16-90de-46d8-8e2e-210cb836ad6c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b\" (UID: \"17f9ca16-90de-46d8-8e2e-210cb836ad6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:46.804240 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.804238    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17f9ca16-90de-46d8-8e2e-210cb836ad6c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b\" (UID: \"17f9ca16-90de-46d8-8e2e-210cb836ad6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:46.804525 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.804458    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17f9ca16-90de-46d8-8e2e-210cb836ad6c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b\" (UID: \"17f9ca16-90de-46d8-8e2e-210cb836ad6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:46.804581 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.804556    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17f9ca16-90de-46d8-8e2e-210cb836ad6c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b\" (UID: \"17f9ca16-90de-46d8-8e2e-210cb836ad6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:46.804625 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.804578    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17f9ca16-90de-46d8-8e2e-210cb836ad6c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b\" (UID: \"17f9ca16-90de-46d8-8e2e-210cb836ad6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:46.806483 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.806461    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17f9ca16-90de-46d8-8e2e-210cb836ad6c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b\" (UID: \"17f9ca16-90de-46d8-8e2e-210cb836ad6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:46.806705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.806689    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17f9ca16-90de-46d8-8e2e-210cb836ad6c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b\" (UID: \"17f9ca16-90de-46d8-8e2e-210cb836ad6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:46.812864 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.812830    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cmjs\" (UniqueName: \"kubernetes.io/projected/17f9ca16-90de-46d8-8e2e-210cb836ad6c-kube-api-access-4cmjs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b\" (UID: \"17f9ca16-90de-46d8-8e2e-210cb836ad6c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:46.934193 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:46.934102    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:47.068324 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:47.068233    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"]
Jul 23 19:30:47.070691 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:30:47.070661    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f9ca16_90de_46d8_8e2e_210cb836ad6c.slice/crio-06476f4b5de409f0a955f5a26e79281bafbcef1f5066469b1bed822c745d8ee8 WatchSource:0}: Error finding container 06476f4b5de409f0a955f5a26e79281bafbcef1f5066469b1bed822c745d8ee8: Status 404 returned error can't find the container with id 06476f4b5de409f0a955f5a26e79281bafbcef1f5066469b1bed822c745d8ee8
Jul 23 19:30:47.127172 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:47.127147    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b" event={"ID":"17f9ca16-90de-46d8-8e2e-210cb836ad6c","Type":"ContainerStarted","Data":"06476f4b5de409f0a955f5a26e79281bafbcef1f5066469b1bed822c745d8ee8"}
Jul 23 19:30:49.138433 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:49.138397    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b" event={"ID":"17f9ca16-90de-46d8-8e2e-210cb836ad6c","Type":"ContainerStarted","Data":"4f7769f48f3e1c173be4dbd97c512623f5857cec4010a12acfb95577db81d168"}
Jul 23 19:30:49.160583 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:49.160535    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b" podStartSLOduration=1.9577170069999998 podStartE2EDuration="3.16052177s" totalImagesPullingTime="1.202804763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:30:49.15877727 +0000 UTC m=+649.995784005" watchObservedRunningTime="2026-07-23 19:30:49.16052177 +0000 UTC m=+649.997528477"
Jul 23 19:30:56.934379 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:56.934345    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:56.934901 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:56.934403    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:56.946647 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:56.946624    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:30:57.182298 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:30:57.182265    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b"
Jul 23 19:31:16.114137 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.114102    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"]
Jul 23 19:31:16.116869 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.116852    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:16.119742 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.119717    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 23 19:31:16.128510 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.128488    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"]
Jul 23 19:31:16.258544 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.258510    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83a9d8c9-4726-4175-bc22-38c1e39bfe51-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-z4nvw\" (UID: \"83a9d8c9-4726-4175-bc22-38c1e39bfe51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:16.258705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.258562    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83a9d8c9-4726-4175-bc22-38c1e39bfe51-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-z4nvw\" (UID: \"83a9d8c9-4726-4175-bc22-38c1e39bfe51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:16.258705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.258620    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83a9d8c9-4726-4175-bc22-38c1e39bfe51-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-z4nvw\" (UID: \"83a9d8c9-4726-4175-bc22-38c1e39bfe51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:16.258705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.258648    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83a9d8c9-4726-4175-bc22-38c1e39bfe51-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-z4nvw\" (UID: \"83a9d8c9-4726-4175-bc22-38c1e39bfe51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:16.258705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.258692    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg2bn\" (UniqueName: \"kubernetes.io/projected/83a9d8c9-4726-4175-bc22-38c1e39bfe51-kube-api-access-bg2bn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-z4nvw\" (UID: \"83a9d8c9-4726-4175-bc22-38c1e39bfe51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:16.258840 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.258717    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83a9d8c9-4726-4175-bc22-38c1e39bfe51-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-z4nvw\" (UID: \"83a9d8c9-4726-4175-bc22-38c1e39bfe51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:16.359454 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.359416    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83a9d8c9-4726-4175-bc22-38c1e39bfe51-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-z4nvw\" (UID: \"83a9d8c9-4726-4175-bc22-38c1e39bfe51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:16.359615 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.359472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83a9d8c9-4726-4175-bc22-38c1e39bfe51-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-z4nvw\" (UID: \"83a9d8c9-4726-4175-bc22-38c1e39bfe51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:16.359615 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.359495    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83a9d8c9-4726-4175-bc22-38c1e39bfe51-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-z4nvw\" (UID: \"83a9d8c9-4726-4175-bc22-38c1e39bfe51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:16.359615 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.359525    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83a9d8c9-4726-4175-bc22-38c1e39bfe51-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-z4nvw\" (UID: \"83a9d8c9-4726-4175-bc22-38c1e39bfe51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:16.359615 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.359550    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg2bn\" (UniqueName: \"kubernetes.io/projected/83a9d8c9-4726-4175-bc22-38c1e39bfe51-kube-api-access-bg2bn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-z4nvw\" (UID: \"83a9d8c9-4726-4175-bc22-38c1e39bfe51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:16.359615 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.359579    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83a9d8c9-4726-4175-bc22-38c1e39bfe51-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-z4nvw\" (UID: \"83a9d8c9-4726-4175-bc22-38c1e39bfe51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:16.359997 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.359949    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83a9d8c9-4726-4175-bc22-38c1e39bfe51-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-z4nvw\" (UID: \"83a9d8c9-4726-4175-bc22-38c1e39bfe51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:16.359997 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.359991    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83a9d8c9-4726-4175-bc22-38c1e39bfe51-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-z4nvw\" (UID: \"83a9d8c9-4726-4175-bc22-38c1e39bfe51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:16.360204 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.360054    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83a9d8c9-4726-4175-bc22-38c1e39bfe51-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-z4nvw\" (UID: \"83a9d8c9-4726-4175-bc22-38c1e39bfe51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:16.361883 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.361859    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83a9d8c9-4726-4175-bc22-38c1e39bfe51-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-z4nvw\" (UID: \"83a9d8c9-4726-4175-bc22-38c1e39bfe51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:16.361986 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.361908    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83a9d8c9-4726-4175-bc22-38c1e39bfe51-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-z4nvw\" (UID: \"83a9d8c9-4726-4175-bc22-38c1e39bfe51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:16.370223 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.370166    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg2bn\" (UniqueName: \"kubernetes.io/projected/83a9d8c9-4726-4175-bc22-38c1e39bfe51-kube-api-access-bg2bn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-z4nvw\" (UID: \"83a9d8c9-4726-4175-bc22-38c1e39bfe51\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:16.427059 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.427027    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:16.556766 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.556743    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"]
Jul 23 19:31:16.558726 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:31:16.558698    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a9d8c9_4726_4175_bc22_38c1e39bfe51.slice/crio-b938316be06d8cb962d2baa22e691a3a1bf46218e1a7395b406ab9d163591d50 WatchSource:0}: Error finding container b938316be06d8cb962d2baa22e691a3a1bf46218e1a7395b406ab9d163591d50: Status 404 returned error can't find the container with id b938316be06d8cb962d2baa22e691a3a1bf46218e1a7395b406ab9d163591d50
Jul 23 19:31:16.562882 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:16.562865    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 19:31:17.256049 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:17.256016    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw" event={"ID":"83a9d8c9-4726-4175-bc22-38c1e39bfe51","Type":"ContainerStarted","Data":"87d9086e85120c59737d5466eff4588437a3001522867c83d8f72715fd8ecd22"}
Jul 23 19:31:17.256464 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:17.256066    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw" event={"ID":"83a9d8c9-4726-4175-bc22-38c1e39bfe51","Type":"ContainerStarted","Data":"b938316be06d8cb962d2baa22e691a3a1bf46218e1a7395b406ab9d163591d50"}
Jul 23 19:31:17.276915 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:17.276856    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw" podStartSLOduration=0.970389487 podStartE2EDuration="1.276839367s" totalImagesPullingTime="306.44988ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:31:17.27553029 +0000 UTC m=+678.112537022" watchObservedRunningTime="2026-07-23 19:31:17.276839367 +0000 UTC m=+678.113846073"
Jul 23 19:31:26.427538 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:26.427499    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:26.427933 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:26.427581    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:26.444269 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:26.444224    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:31:27.314577 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:31:27.314546    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-z4nvw"
Jul 23 19:33:26.306856 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:33:26.306772    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56d6ccb556-6752j"]
Jul 23 19:33:26.307414 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:33:26.306969    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-56d6ccb556-6752j" podUID="ec0ec77d-bb13-462a-bbd7-9c45d9f430e8" containerName="manager" containerID="cri-o://f9123fd02d135875b76b4f2ae0a4f16e029ec6c6c595ebf2cafe0ac38642af96" gracePeriod=30
Jul 23 19:33:26.558881 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:33:26.558823    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56d6ccb556-6752j"
Jul 23 19:33:26.642543 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:33:26.642509    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k55g6\" (UniqueName: \"kubernetes.io/projected/ec0ec77d-bb13-462a-bbd7-9c45d9f430e8-kube-api-access-k55g6\") pod \"ec0ec77d-bb13-462a-bbd7-9c45d9f430e8\" (UID: \"ec0ec77d-bb13-462a-bbd7-9c45d9f430e8\") "
Jul 23 19:33:26.642543 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:33:26.642546    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec0ec77d-bb13-462a-bbd7-9c45d9f430e8-webhook-cert\") pod \"ec0ec77d-bb13-462a-bbd7-9c45d9f430e8\" (UID: \"ec0ec77d-bb13-462a-bbd7-9c45d9f430e8\") "
Jul 23 19:33:26.644708 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:33:26.644682    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec0ec77d-bb13-462a-bbd7-9c45d9f430e8-kube-api-access-k55g6" (OuterVolumeSpecName: "kube-api-access-k55g6") pod "ec0ec77d-bb13-462a-bbd7-9c45d9f430e8" (UID: "ec0ec77d-bb13-462a-bbd7-9c45d9f430e8"). InnerVolumeSpecName "kube-api-access-k55g6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:33:26.644821 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:33:26.644712    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec0ec77d-bb13-462a-bbd7-9c45d9f430e8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ec0ec77d-bb13-462a-bbd7-9c45d9f430e8" (UID: "ec0ec77d-bb13-462a-bbd7-9c45d9f430e8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:33:26.743564 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:33:26.743522    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k55g6\" (UniqueName: \"kubernetes.io/projected/ec0ec77d-bb13-462a-bbd7-9c45d9f430e8-kube-api-access-k55g6\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:33:26.743564 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:33:26.743561    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec0ec77d-bb13-462a-bbd7-9c45d9f430e8-webhook-cert\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:33:26.788024 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:33:26.787991    2578 generic.go:356] "Generic (PLEG): container finished" podID="ec0ec77d-bb13-462a-bbd7-9c45d9f430e8" containerID="f9123fd02d135875b76b4f2ae0a4f16e029ec6c6c595ebf2cafe0ac38642af96" exitCode=0
Jul 23 19:33:26.788175 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:33:26.788034    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56d6ccb556-6752j"
Jul 23 19:33:26.788175 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:33:26.788080    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56d6ccb556-6752j" event={"ID":"ec0ec77d-bb13-462a-bbd7-9c45d9f430e8","Type":"ContainerDied","Data":"f9123fd02d135875b76b4f2ae0a4f16e029ec6c6c595ebf2cafe0ac38642af96"}
Jul 23 19:33:26.788175 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:33:26.788136    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56d6ccb556-6752j" event={"ID":"ec0ec77d-bb13-462a-bbd7-9c45d9f430e8","Type":"ContainerDied","Data":"463538f6e5935ef1e08920caf77f2b3eb7cbe1d45c33b30adf9598ffc5e63ad0"}
Jul 23 19:33:26.788175 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:33:26.788158    2578 scope.go:117] "RemoveContainer" containerID="f9123fd02d135875b76b4f2ae0a4f16e029ec6c6c595ebf2cafe0ac38642af96"
Jul 23 19:33:26.801176 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:33:26.801154    2578 scope.go:117] "RemoveContainer" containerID="f9123fd02d135875b76b4f2ae0a4f16e029ec6c6c595ebf2cafe0ac38642af96"
Jul 23 19:33:26.801497 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:33:26.801469    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9123fd02d135875b76b4f2ae0a4f16e029ec6c6c595ebf2cafe0ac38642af96\": container with ID starting with f9123fd02d135875b76b4f2ae0a4f16e029ec6c6c595ebf2cafe0ac38642af96 not found: ID does not exist" containerID="f9123fd02d135875b76b4f2ae0a4f16e029ec6c6c595ebf2cafe0ac38642af96"
Jul 23 19:33:26.801594 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:33:26.801502    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9123fd02d135875b76b4f2ae0a4f16e029ec6c6c595ebf2cafe0ac38642af96"} err="failed to get container status \"f9123fd02d135875b76b4f2ae0a4f16e029ec6c6c595ebf2cafe0ac38642af96\": rpc error: code = NotFound desc = could not find container \"f9123fd02d135875b76b4f2ae0a4f16e029ec6c6c595ebf2cafe0ac38642af96\": container with ID starting with f9123fd02d135875b76b4f2ae0a4f16e029ec6c6c595ebf2cafe0ac38642af96 not found: ID does not exist"
Jul 23 19:33:26.811656 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:33:26.811599    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56d6ccb556-6752j"]
Jul 23 19:33:26.814870 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:33:26.814851    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-56d6ccb556-6752j"]
Jul 23 19:33:27.651399 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:33:27.651367    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec0ec77d-bb13-462a-bbd7-9c45d9f430e8" path="/var/lib/kubelet/pods/ec0ec77d-bb13-462a-bbd7-9c45d9f430e8/volumes"
Jul 23 19:34:27.592181 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:27.592147    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56d6ccb556-dc78z"]
Jul 23 19:34:27.592695 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:27.592467    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec0ec77d-bb13-462a-bbd7-9c45d9f430e8" containerName="manager"
Jul 23 19:34:27.592695 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:27.592479    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec0ec77d-bb13-462a-bbd7-9c45d9f430e8" containerName="manager"
Jul 23 19:34:27.592695 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:27.592551    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec0ec77d-bb13-462a-bbd7-9c45d9f430e8" containerName="manager"
Jul 23 19:34:27.595227 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:27.595209    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56d6ccb556-dc78z"
Jul 23 19:34:27.598376 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:27.598352    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 19:34:27.598376 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:27.598375    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 19:34:27.598575 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:27.598352    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nsblt\""
Jul 23 19:34:27.605878 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:27.605856    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56d6ccb556-dc78z"]
Jul 23 19:34:27.634716 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:27.634690    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e67be2bf-3898-4974-860c-b0fdb9f0f07a-webhook-cert\") pod \"maas-controller-56d6ccb556-dc78z\" (UID: \"e67be2bf-3898-4974-860c-b0fdb9f0f07a\") " pod="opendatahub/maas-controller-56d6ccb556-dc78z"
Jul 23 19:34:27.634849 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:27.634768    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qrt4\" (UniqueName: \"kubernetes.io/projected/e67be2bf-3898-4974-860c-b0fdb9f0f07a-kube-api-access-5qrt4\") pod \"maas-controller-56d6ccb556-dc78z\" (UID: \"e67be2bf-3898-4974-860c-b0fdb9f0f07a\") " pod="opendatahub/maas-controller-56d6ccb556-dc78z"
Jul 23 19:34:27.735646 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:27.735608    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e67be2bf-3898-4974-860c-b0fdb9f0f07a-webhook-cert\") pod \"maas-controller-56d6ccb556-dc78z\" (UID: \"e67be2bf-3898-4974-860c-b0fdb9f0f07a\") " pod="opendatahub/maas-controller-56d6ccb556-dc78z"
Jul 23 19:34:27.735853 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:27.735701    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qrt4\" (UniqueName: \"kubernetes.io/projected/e67be2bf-3898-4974-860c-b0fdb9f0f07a-kube-api-access-5qrt4\") pod \"maas-controller-56d6ccb556-dc78z\" (UID: \"e67be2bf-3898-4974-860c-b0fdb9f0f07a\") " pod="opendatahub/maas-controller-56d6ccb556-dc78z"
Jul 23 19:34:27.738075 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:27.738049    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e67be2bf-3898-4974-860c-b0fdb9f0f07a-webhook-cert\") pod \"maas-controller-56d6ccb556-dc78z\" (UID: \"e67be2bf-3898-4974-860c-b0fdb9f0f07a\") " pod="opendatahub/maas-controller-56d6ccb556-dc78z"
Jul 23 19:34:27.754462 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:27.754435    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qrt4\" (UniqueName: \"kubernetes.io/projected/e67be2bf-3898-4974-860c-b0fdb9f0f07a-kube-api-access-5qrt4\") pod \"maas-controller-56d6ccb556-dc78z\" (UID: \"e67be2bf-3898-4974-860c-b0fdb9f0f07a\") " pod="opendatahub/maas-controller-56d6ccb556-dc78z"
Jul 23 19:34:27.906178 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:27.906089    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56d6ccb556-dc78z"
Jul 23 19:34:28.242135 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:28.241968    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56d6ccb556-dc78z"]
Jul 23 19:34:28.244282 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:34:28.244241    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode67be2bf_3898_4974_860c_b0fdb9f0f07a.slice/crio-10d248c0574cb7ebcbfcaf9e92d587ed9305ff9c22ac1c7fdaa3c0199da5acf4 WatchSource:0}: Error finding container 10d248c0574cb7ebcbfcaf9e92d587ed9305ff9c22ac1c7fdaa3c0199da5acf4: Status 404 returned error can't find the container with id 10d248c0574cb7ebcbfcaf9e92d587ed9305ff9c22ac1c7fdaa3c0199da5acf4
Jul 23 19:34:29.043127 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:29.043090    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56d6ccb556-dc78z" event={"ID":"e67be2bf-3898-4974-860c-b0fdb9f0f07a","Type":"ContainerStarted","Data":"60c48581b9f8f2e9d5caa39b0022637fb9df6c814d061979b95033816dea53db"}
Jul 23 19:34:29.043527 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:29.043172    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56d6ccb556-dc78z" event={"ID":"e67be2bf-3898-4974-860c-b0fdb9f0f07a","Type":"ContainerStarted","Data":"10d248c0574cb7ebcbfcaf9e92d587ed9305ff9c22ac1c7fdaa3c0199da5acf4"}
Jul 23 19:34:29.043527 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:29.043208    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56d6ccb556-dc78z"
Jul 23 19:34:29.060368 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:29.060317    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56d6ccb556-dc78z" podStartSLOduration=1.6749123369999999 podStartE2EDuration="2.060300138s" totalImagesPullingTime="385.387801ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:34:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:34:29.059433315 +0000 UTC m=+869.896440024" watchObservedRunningTime="2026-07-23 19:34:29.060300138 +0000 UTC m=+869.897306844"
Jul 23 19:34:40.048990 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:40.048960    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56d6ccb556-dc78z"
Jul 23 19:34:44.716408 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:44.716373    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56d6ccb556-dc78z"]
Jul 23 19:34:44.716798 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:44.716574    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-56d6ccb556-dc78z" podUID="e67be2bf-3898-4974-860c-b0fdb9f0f07a" containerName="manager" containerID="cri-o://60c48581b9f8f2e9d5caa39b0022637fb9df6c814d061979b95033816dea53db" gracePeriod=30
Jul 23 19:34:44.981954 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:44.981931    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56d6ccb556-dc78z"
Jul 23 19:34:45.071735 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.071704    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qrt4\" (UniqueName: \"kubernetes.io/projected/e67be2bf-3898-4974-860c-b0fdb9f0f07a-kube-api-access-5qrt4\") pod \"e67be2bf-3898-4974-860c-b0fdb9f0f07a\" (UID: \"e67be2bf-3898-4974-860c-b0fdb9f0f07a\") "
Jul 23 19:34:45.071856 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.071806    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e67be2bf-3898-4974-860c-b0fdb9f0f07a-webhook-cert\") pod \"e67be2bf-3898-4974-860c-b0fdb9f0f07a\" (UID: \"e67be2bf-3898-4974-860c-b0fdb9f0f07a\") "
Jul 23 19:34:45.073648 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.073618    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e67be2bf-3898-4974-860c-b0fdb9f0f07a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e67be2bf-3898-4974-860c-b0fdb9f0f07a" (UID: "e67be2bf-3898-4974-860c-b0fdb9f0f07a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:34:45.073748 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.073675    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e67be2bf-3898-4974-860c-b0fdb9f0f07a-kube-api-access-5qrt4" (OuterVolumeSpecName: "kube-api-access-5qrt4") pod "e67be2bf-3898-4974-860c-b0fdb9f0f07a" (UID: "e67be2bf-3898-4974-860c-b0fdb9f0f07a"). InnerVolumeSpecName "kube-api-access-5qrt4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:34:45.110539 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.110508    2578 generic.go:356] "Generic (PLEG): container finished" podID="e67be2bf-3898-4974-860c-b0fdb9f0f07a" containerID="60c48581b9f8f2e9d5caa39b0022637fb9df6c814d061979b95033816dea53db" exitCode=0
Jul 23 19:34:45.110670 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.110556    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56d6ccb556-dc78z"
Jul 23 19:34:45.110670 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.110582    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56d6ccb556-dc78z" event={"ID":"e67be2bf-3898-4974-860c-b0fdb9f0f07a","Type":"ContainerDied","Data":"60c48581b9f8f2e9d5caa39b0022637fb9df6c814d061979b95033816dea53db"}
Jul 23 19:34:45.110670 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.110638    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56d6ccb556-dc78z" event={"ID":"e67be2bf-3898-4974-860c-b0fdb9f0f07a","Type":"ContainerDied","Data":"10d248c0574cb7ebcbfcaf9e92d587ed9305ff9c22ac1c7fdaa3c0199da5acf4"}
Jul 23 19:34:45.110670 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.110666    2578 scope.go:117] "RemoveContainer" containerID="60c48581b9f8f2e9d5caa39b0022637fb9df6c814d061979b95033816dea53db"
Jul 23 19:34:45.121726 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.121704    2578 scope.go:117] "RemoveContainer" containerID="60c48581b9f8f2e9d5caa39b0022637fb9df6c814d061979b95033816dea53db"
Jul 23 19:34:45.122321 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:34:45.122301    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60c48581b9f8f2e9d5caa39b0022637fb9df6c814d061979b95033816dea53db\": container with ID starting with 60c48581b9f8f2e9d5caa39b0022637fb9df6c814d061979b95033816dea53db not found: ID does not exist" containerID="60c48581b9f8f2e9d5caa39b0022637fb9df6c814d061979b95033816dea53db"
Jul 23 19:34:45.122401 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.122329    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60c48581b9f8f2e9d5caa39b0022637fb9df6c814d061979b95033816dea53db"} err="failed to get container status \"60c48581b9f8f2e9d5caa39b0022637fb9df6c814d061979b95033816dea53db\": rpc error: code = NotFound desc = could not find container \"60c48581b9f8f2e9d5caa39b0022637fb9df6c814d061979b95033816dea53db\": container with ID starting with 60c48581b9f8f2e9d5caa39b0022637fb9df6c814d061979b95033816dea53db not found: ID does not exist"
Jul 23 19:34:45.134841 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.134817    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-56d6ccb556-dc78z"]
Jul 23 19:34:45.138573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.138553    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-56d6ccb556-dc78z"]
Jul 23 19:34:45.172503 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.172477    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e67be2bf-3898-4974-860c-b0fdb9f0f07a-webhook-cert\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:34:45.172503 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.172499    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qrt4\" (UniqueName: \"kubernetes.io/projected/e67be2bf-3898-4974-860c-b0fdb9f0f07a-kube-api-access-5qrt4\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:34:45.651801 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.651768    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e67be2bf-3898-4974-860c-b0fdb9f0f07a" path="/var/lib/kubelet/pods/e67be2bf-3898-4974-860c-b0fdb9f0f07a/volumes"
Jul 23 19:34:45.906342 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.906261    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56d6ccb556-w9b8x"]
Jul 23 19:34:45.906705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.906681    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67be2bf-3898-4974-860c-b0fdb9f0f07a" containerName="manager"
Jul 23 19:34:45.906705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.906701    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67be2bf-3898-4974-860c-b0fdb9f0f07a" containerName="manager"
Jul 23 19:34:45.906815 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.906791    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e67be2bf-3898-4974-860c-b0fdb9f0f07a" containerName="manager"
Jul 23 19:34:45.910979 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.910961    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56d6ccb556-w9b8x"
Jul 23 19:34:45.913995 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.913974    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nsblt\""
Jul 23 19:34:45.914105 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.914016    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 19:34:45.914105 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.913982    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 19:34:45.918546 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.918471    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56d6ccb556-w9b8x"]
Jul 23 19:34:45.978973 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.978947    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95f4ccee-1845-4367-a859-aa3419a6373d-webhook-cert\") pod \"maas-controller-56d6ccb556-w9b8x\" (UID: \"95f4ccee-1845-4367-a859-aa3419a6373d\") " pod="opendatahub/maas-controller-56d6ccb556-w9b8x"
Jul 23 19:34:45.979109 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:45.978996    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbtxx\" (UniqueName: \"kubernetes.io/projected/95f4ccee-1845-4367-a859-aa3419a6373d-kube-api-access-hbtxx\") pod \"maas-controller-56d6ccb556-w9b8x\" (UID: \"95f4ccee-1845-4367-a859-aa3419a6373d\") " pod="opendatahub/maas-controller-56d6ccb556-w9b8x"
Jul 23 19:34:46.080031 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:46.079998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95f4ccee-1845-4367-a859-aa3419a6373d-webhook-cert\") pod \"maas-controller-56d6ccb556-w9b8x\" (UID: \"95f4ccee-1845-4367-a859-aa3419a6373d\") " pod="opendatahub/maas-controller-56d6ccb556-w9b8x"
Jul 23 19:34:46.080174 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:46.080040    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbtxx\" (UniqueName: \"kubernetes.io/projected/95f4ccee-1845-4367-a859-aa3419a6373d-kube-api-access-hbtxx\") pod \"maas-controller-56d6ccb556-w9b8x\" (UID: \"95f4ccee-1845-4367-a859-aa3419a6373d\") " pod="opendatahub/maas-controller-56d6ccb556-w9b8x"
Jul 23 19:34:46.082432 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:46.082405    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95f4ccee-1845-4367-a859-aa3419a6373d-webhook-cert\") pod \"maas-controller-56d6ccb556-w9b8x\" (UID: \"95f4ccee-1845-4367-a859-aa3419a6373d\") " pod="opendatahub/maas-controller-56d6ccb556-w9b8x"
Jul 23 19:34:46.089817 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:46.089794    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbtxx\" (UniqueName: \"kubernetes.io/projected/95f4ccee-1845-4367-a859-aa3419a6373d-kube-api-access-hbtxx\") pod \"maas-controller-56d6ccb556-w9b8x\" (UID: \"95f4ccee-1845-4367-a859-aa3419a6373d\") " pod="opendatahub/maas-controller-56d6ccb556-w9b8x"
Jul 23 19:34:46.222112 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:46.222083    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56d6ccb556-w9b8x"
Jul 23 19:34:46.354208 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:46.354182    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56d6ccb556-w9b8x"]
Jul 23 19:34:46.356275 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:34:46.356234    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95f4ccee_1845_4367_a859_aa3419a6373d.slice/crio-8e376c83b2ef9f0280ad1c097ee168588901186b3cfb63020980b76a5b2b8e16 WatchSource:0}: Error finding container 8e376c83b2ef9f0280ad1c097ee168588901186b3cfb63020980b76a5b2b8e16: Status 404 returned error can't find the container with id 8e376c83b2ef9f0280ad1c097ee168588901186b3cfb63020980b76a5b2b8e16
Jul 23 19:34:47.121676 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:47.121638    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56d6ccb556-w9b8x" event={"ID":"95f4ccee-1845-4367-a859-aa3419a6373d","Type":"ContainerStarted","Data":"8e7a8762049dca7a12f81cd036997a79483dc1916f6b327fbb8755a37421d148"}
Jul 23 19:34:47.122057 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:47.121687    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56d6ccb556-w9b8x" event={"ID":"95f4ccee-1845-4367-a859-aa3419a6373d","Type":"ContainerStarted","Data":"8e376c83b2ef9f0280ad1c097ee168588901186b3cfb63020980b76a5b2b8e16"}
Jul 23 19:34:47.122057 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:47.121768    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56d6ccb556-w9b8x"
Jul 23 19:34:47.140050 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:47.140005    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56d6ccb556-w9b8x" podStartSLOduration=1.821930648 podStartE2EDuration="2.139989513s" totalImagesPullingTime="318.058865ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:34:47.138556662 +0000 UTC m=+887.975563394" watchObservedRunningTime="2026-07-23 19:34:47.139989513 +0000 UTC m=+887.976996220"
Jul 23 19:34:58.127340 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:34:58.127243    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56d6ccb556-w9b8x"
Jul 23 19:39:28.508368 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:39:28.508285    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn"]
Jul 23 19:39:28.508914 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:39:28.508505    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn" podUID="16da2f4c-c9cc-41a6-b065-a224fcae6840" containerName="manager" containerID="cri-o://9a9c195b39473d4ab4c1cb8ba6f9da810bd5b78b72e404b51184c56cc6fbc615" gracePeriod=10
Jul 23 19:39:31.451610 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:39:31.451583    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn"
Jul 23 19:39:31.547021 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:39:31.546946    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16da2f4c-c9cc-41a6-b065-a224fcae6840-extensions-socket-volume\") pod \"16da2f4c-c9cc-41a6-b065-a224fcae6840\" (UID: \"16da2f4c-c9cc-41a6-b065-a224fcae6840\") "
Jul 23 19:39:31.547021 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:39:31.547014    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjnjm\" (UniqueName: \"kubernetes.io/projected/16da2f4c-c9cc-41a6-b065-a224fcae6840-kube-api-access-gjnjm\") pod \"16da2f4c-c9cc-41a6-b065-a224fcae6840\" (UID: \"16da2f4c-c9cc-41a6-b065-a224fcae6840\") "
Jul 23 19:39:31.547333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:39:31.547308    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16da2f4c-c9cc-41a6-b065-a224fcae6840-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "16da2f4c-c9cc-41a6-b065-a224fcae6840" (UID: "16da2f4c-c9cc-41a6-b065-a224fcae6840"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:39:31.548920 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:39:31.548898    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16da2f4c-c9cc-41a6-b065-a224fcae6840-kube-api-access-gjnjm" (OuterVolumeSpecName: "kube-api-access-gjnjm") pod "16da2f4c-c9cc-41a6-b065-a224fcae6840" (UID: "16da2f4c-c9cc-41a6-b065-a224fcae6840"). InnerVolumeSpecName "kube-api-access-gjnjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:39:31.647748 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:39:31.647721    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjnjm\" (UniqueName: \"kubernetes.io/projected/16da2f4c-c9cc-41a6-b065-a224fcae6840-kube-api-access-gjnjm\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:39:31.647748 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:39:31.647745    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16da2f4c-c9cc-41a6-b065-a224fcae6840-extensions-socket-volume\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:39:32.325644 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:39:32.325609    2578 generic.go:356] "Generic (PLEG): container finished" podID="16da2f4c-c9cc-41a6-b065-a224fcae6840" containerID="9a9c195b39473d4ab4c1cb8ba6f9da810bd5b78b72e404b51184c56cc6fbc615" exitCode=0
Jul 23 19:39:32.325809 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:39:32.325656    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn"
Jul 23 19:39:32.325809 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:39:32.325689    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn" event={"ID":"16da2f4c-c9cc-41a6-b065-a224fcae6840","Type":"ContainerDied","Data":"9a9c195b39473d4ab4c1cb8ba6f9da810bd5b78b72e404b51184c56cc6fbc615"}
Jul 23 19:39:32.325809 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:39:32.325739    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn" event={"ID":"16da2f4c-c9cc-41a6-b065-a224fcae6840","Type":"ContainerDied","Data":"d46c1a2c1f7f38772ffe385de3c0b81a824ba25f851c11ae3c259fbddc96b826"}
Jul 23 19:39:32.325809 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:39:32.325760    2578 scope.go:117] "RemoveContainer" containerID="9a9c195b39473d4ab4c1cb8ba6f9da810bd5b78b72e404b51184c56cc6fbc615"
Jul 23 19:39:32.335160 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:39:32.335141    2578 scope.go:117] "RemoveContainer" containerID="9a9c195b39473d4ab4c1cb8ba6f9da810bd5b78b72e404b51184c56cc6fbc615"
Jul 23 19:39:32.335403 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:39:32.335383    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a9c195b39473d4ab4c1cb8ba6f9da810bd5b78b72e404b51184c56cc6fbc615\": container with ID starting with 9a9c195b39473d4ab4c1cb8ba6f9da810bd5b78b72e404b51184c56cc6fbc615 not found: ID does not exist" containerID="9a9c195b39473d4ab4c1cb8ba6f9da810bd5b78b72e404b51184c56cc6fbc615"
Jul 23 19:39:32.335458 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:39:32.335410    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a9c195b39473d4ab4c1cb8ba6f9da810bd5b78b72e404b51184c56cc6fbc615"} err="failed to get container status \"9a9c195b39473d4ab4c1cb8ba6f9da810bd5b78b72e404b51184c56cc6fbc615\": rpc error: code = NotFound desc = could not find container \"9a9c195b39473d4ab4c1cb8ba6f9da810bd5b78b72e404b51184c56cc6fbc615\": container with ID starting with 9a9c195b39473d4ab4c1cb8ba6f9da810bd5b78b72e404b51184c56cc6fbc615 not found: ID does not exist"
Jul 23 19:39:32.344385 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:39:32.344363    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn"]
Jul 23 19:39:32.353505 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:39:32.353484    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5ntvn"]
Jul 23 19:39:33.651529 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:39:33.651490    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16da2f4c-c9cc-41a6-b065-a224fcae6840" path="/var/lib/kubelet/pods/16da2f4c-c9cc-41a6-b065-a224fcae6840/volumes"
Jul 23 19:40:29.644773 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:40:29.644742    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzt97"]
Jul 23 19:40:29.645363 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:40:29.645185    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16da2f4c-c9cc-41a6-b065-a224fcae6840" containerName="manager"
Jul 23 19:40:29.645363 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:40:29.645204    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="16da2f4c-c9cc-41a6-b065-a224fcae6840" containerName="manager"
Jul 23 19:40:29.645363 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:40:29.645309    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="16da2f4c-c9cc-41a6-b065-a224fcae6840" containerName="manager"
Jul 23 19:40:29.648131 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:40:29.648100    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzt97"
Jul 23 19:40:29.651391 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:40:29.651373    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-44wf7\""
Jul 23 19:40:29.660228 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:40:29.660205    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzt97"]
Jul 23 19:40:29.713720 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:40:29.713676    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5w8g\" (UniqueName: \"kubernetes.io/projected/302b7d6b-787f-4852-a81a-73efa58a2046-kube-api-access-m5w8g\") pod \"kuadrant-operator-controller-manager-86878c769f-jzt97\" (UID: \"302b7d6b-787f-4852-a81a-73efa58a2046\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzt97"
Jul 23 19:40:29.713882 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:40:29.713774    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/302b7d6b-787f-4852-a81a-73efa58a2046-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jzt97\" (UID: \"302b7d6b-787f-4852-a81a-73efa58a2046\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzt97"
Jul 23 19:40:29.814451 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:40:29.814408    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/302b7d6b-787f-4852-a81a-73efa58a2046-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jzt97\" (UID: \"302b7d6b-787f-4852-a81a-73efa58a2046\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzt97"
Jul 23 19:40:29.814599 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:40:29.814493    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5w8g\" (UniqueName: \"kubernetes.io/projected/302b7d6b-787f-4852-a81a-73efa58a2046-kube-api-access-m5w8g\") pod \"kuadrant-operator-controller-manager-86878c769f-jzt97\" (UID: \"302b7d6b-787f-4852-a81a-73efa58a2046\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzt97"
Jul 23 19:40:29.814774 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:40:29.814743    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/302b7d6b-787f-4852-a81a-73efa58a2046-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jzt97\" (UID: \"302b7d6b-787f-4852-a81a-73efa58a2046\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzt97"
Jul 23 19:40:29.823043 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:40:29.823021    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5w8g\" (UniqueName: \"kubernetes.io/projected/302b7d6b-787f-4852-a81a-73efa58a2046-kube-api-access-m5w8g\") pod \"kuadrant-operator-controller-manager-86878c769f-jzt97\" (UID: \"302b7d6b-787f-4852-a81a-73efa58a2046\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzt97"
Jul 23 19:40:29.958605 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:40:29.958528    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzt97"
Jul 23 19:40:30.095540 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:40:30.095515    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzt97"]
Jul 23 19:40:30.098045 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:40:30.098019    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod302b7d6b_787f_4852_a81a_73efa58a2046.slice/crio-c38c87bb50d6dbc1d44d0ccc5ae5b5a2c3653ac040db71e41085699b6835b8cf WatchSource:0}: Error finding container c38c87bb50d6dbc1d44d0ccc5ae5b5a2c3653ac040db71e41085699b6835b8cf: Status 404 returned error can't find the container with id c38c87bb50d6dbc1d44d0ccc5ae5b5a2c3653ac040db71e41085699b6835b8cf
Jul 23 19:40:30.563465 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:40:30.563435    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzt97" event={"ID":"302b7d6b-787f-4852-a81a-73efa58a2046","Type":"ContainerStarted","Data":"fa1bf2aa0563538bd5fe342b378af627ae795e19a2615cc30d11b845b503edc2"}
Jul 23 19:40:30.563646 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:40:30.563486    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzt97" event={"ID":"302b7d6b-787f-4852-a81a-73efa58a2046","Type":"ContainerStarted","Data":"c38c87bb50d6dbc1d44d0ccc5ae5b5a2c3653ac040db71e41085699b6835b8cf"}
Jul 23 19:40:30.563646 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:40:30.563519    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzt97"
Jul 23 19:40:30.584007 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:40:30.583649    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzt97" podStartSLOduration=1.5836290800000001 podStartE2EDuration="1.58362908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:40:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:40:30.581373043 +0000 UTC m=+1231.418379762" watchObservedRunningTime="2026-07-23 19:40:30.58362908 +0000 UTC m=+1231.420635788"
Jul 23 19:40:41.570178 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:40:41.570143    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jzt97"
Jul 23 19:43:08.922298 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:08.922263    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"]
Jul 23 19:43:08.925683 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:08.925667    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:08.928043 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:08.928022    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-58bd3f18-kserve-self-signed-certs\""
Jul 23 19:43:08.943197 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:08.943175    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"]
Jul 23 19:43:08.944908 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:08.944885    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h64qv\" (UniqueName: \"kubernetes.io/projected/a5446a9a-43e1-4b26-9646-369ec3fdade1-kube-api-access-h64qv\") pod \"e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") " pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:08.945001 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:08.944932    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5446a9a-43e1-4b26-9646-369ec3fdade1-tls-certs\") pod \"e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") " pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:08.945001 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:08.944953    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-model-cache\") pod \"e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") " pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:08.945074 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:08.945002    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-dshm\") pod \"e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") " pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:08.945074 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:08.945033    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-tmp-dir\") pod \"e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") " pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:08.945074 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:08.945063    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-home\") pod \"e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") " pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:09.045919 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:09.045890    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h64qv\" (UniqueName: \"kubernetes.io/projected/a5446a9a-43e1-4b26-9646-369ec3fdade1-kube-api-access-h64qv\") pod \"e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") " pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:09.046061 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:09.045932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5446a9a-43e1-4b26-9646-369ec3fdade1-tls-certs\") pod \"e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") " pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:09.046061 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:09.045950    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-model-cache\") pod \"e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") " pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:09.046061 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:09.045969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-dshm\") pod \"e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") " pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:09.046228 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:09.046148    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-tmp-dir\") pod \"e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") " pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:09.046228 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:09.046192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-home\") pod \"e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") " pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:09.046406 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:09.046385    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-model-cache\") pod \"e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") " pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:09.046551 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:09.046520    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-tmp-dir\") pod \"e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") " pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:09.046651 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:09.046551    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-home\") pod \"e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") " pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:09.048222 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:09.048199    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-dshm\") pod \"e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") " pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:09.048589 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:09.048568    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5446a9a-43e1-4b26-9646-369ec3fdade1-tls-certs\") pod \"e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") " pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:09.054916 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:09.054893    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h64qv\" (UniqueName: \"kubernetes.io/projected/a5446a9a-43e1-4b26-9646-369ec3fdade1-kube-api-access-h64qv\") pod \"e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") " pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:09.234005 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:09.233980    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:09.380868 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:09.380845    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"]
Jul 23 19:43:09.383151 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:43:09.383106    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5446a9a_43e1_4b26_9646_369ec3fdade1.slice/crio-e337df5ed01311e02cd153c3ad02079f43e80572cc0c4c282f2df10f50db0aaa WatchSource:0}: Error finding container e337df5ed01311e02cd153c3ad02079f43e80572cc0c4c282f2df10f50db0aaa: Status 404 returned error can't find the container with id e337df5ed01311e02cd153c3ad02079f43e80572cc0c4c282f2df10f50db0aaa
Jul 23 19:43:10.228304 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:10.228268    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8" event={"ID":"a5446a9a-43e1-4b26-9646-369ec3fdade1","Type":"ContainerStarted","Data":"8229ea21f5e142b90b9f912c40879fd8689b0320cc8592f2ccdc461ae9599d16"}
Jul 23 19:43:10.228304 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:10.228310    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8" event={"ID":"a5446a9a-43e1-4b26-9646-369ec3fdade1","Type":"ContainerStarted","Data":"e337df5ed01311e02cd153c3ad02079f43e80572cc0c4c282f2df10f50db0aaa"}
Jul 23 19:43:10.248757 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:10.248711    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8" podStartSLOduration=2.248696792 podStartE2EDuration="2.248696792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:43:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:43:10.247938424 +0000 UTC m=+1391.084945151" watchObservedRunningTime="2026-07-23 19:43:10.248696792 +0000 UTC m=+1391.085703495"
Jul 23 19:43:18.315826 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.315792    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"]
Jul 23 19:43:18.319110 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.319084    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:18.325522 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.323957    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-58bd3f18-kserve-self-signed-certs\""
Jul 23 19:43:18.331804 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.331781    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"]
Jul 23 19:43:18.410606 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.410570    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-home\") pod \"e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") " pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:18.410739 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.410612    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-dshm\") pod \"e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") " pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:18.410739 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.410645    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-model-cache\") pod \"e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") " pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:18.410739 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.410689    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwjdd\" (UniqueName: \"kubernetes.io/projected/3ce77bea-5c6b-479c-9327-a046cbce2624-kube-api-access-qwjdd\") pod \"e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") " pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:18.410739 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.410733    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-tmp-dir\") pod \"e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") " pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:18.410879 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.410754    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ce77bea-5c6b-479c-9327-a046cbce2624-tls-certs\") pod \"e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") " pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:18.511731 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.511698    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwjdd\" (UniqueName: \"kubernetes.io/projected/3ce77bea-5c6b-479c-9327-a046cbce2624-kube-api-access-qwjdd\") pod \"e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") " pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:18.511914 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.511746    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-tmp-dir\") pod \"e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") " pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:18.511914 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.511772    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ce77bea-5c6b-479c-9327-a046cbce2624-tls-certs\") pod \"e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") " pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:18.511914 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.511808    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-home\") pod \"e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") " pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:18.511914 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.511828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-dshm\") pod \"e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") " pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:18.511914 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.511867    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-model-cache\") pod \"e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") " pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:18.512287 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.512237    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-home\") pod \"e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") " pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:18.512287 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.512279    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-tmp-dir\") pod \"e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") " pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:18.512409 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.512321    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-model-cache\") pod \"e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") " pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:18.514196 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.514169    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-dshm\") pod \"e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") " pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:18.514359 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.514341    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ce77bea-5c6b-479c-9327-a046cbce2624-tls-certs\") pod \"e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") " pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:18.519127 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.519099    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwjdd\" (UniqueName: \"kubernetes.io/projected/3ce77bea-5c6b-479c-9327-a046cbce2624-kube-api-access-qwjdd\") pod \"e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") " pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:18.632280 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.632192    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:18.759098 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:18.759073    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"]
Jul 23 19:43:18.761205 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:43:18.761176    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ce77bea_5c6b_479c_9327_a046cbce2624.slice/crio-03a994e2749db5a43746a6cd267d6d7921acbcd92fcecdf6b52b485690cad732 WatchSource:0}: Error finding container 03a994e2749db5a43746a6cd267d6d7921acbcd92fcecdf6b52b485690cad732: Status 404 returned error can't find the container with id 03a994e2749db5a43746a6cd267d6d7921acbcd92fcecdf6b52b485690cad732
Jul 23 19:43:19.235104 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:19.235074    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:19.235271 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:19.235126    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:19.247776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:19.247751    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:19.269085 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:19.269052    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw" event={"ID":"3ce77bea-5c6b-479c-9327-a046cbce2624","Type":"ContainerStarted","Data":"23a0a428795a17a1cf3c9fb04f6ba503caa38e2e636a91afc3df9ac5e4c78e3d"}
Jul 23 19:43:19.269214 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:19.269094    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw" event={"ID":"3ce77bea-5c6b-479c-9327-a046cbce2624","Type":"ContainerStarted","Data":"03a994e2749db5a43746a6cd267d6d7921acbcd92fcecdf6b52b485690cad732"}
Jul 23 19:43:19.280464 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:19.280439    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:43:19.285462 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:19.285425    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw" podStartSLOduration=1.285411308 podStartE2EDuration="1.285411308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:43:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:43:19.284447621 +0000 UTC m=+1400.121454331" watchObservedRunningTime="2026-07-23 19:43:19.285411308 +0000 UTC m=+1400.122417992"
Jul 23 19:43:28.632348 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:28.632314    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:28.632736 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:28.632373    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:28.646636 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:28.646594    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:29.320179 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:29.320149    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:43:51.108890 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:51.108856    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"]
Jul 23 19:43:52.517305 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:43:52.517272    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"]
Jul 23 19:44:06.129837 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.129779    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8" podUID="a5446a9a-43e1-4b26-9646-369ec3fdade1" containerName="main" containerID="cri-o://8229ea21f5e142b90b9f912c40879fd8689b0320cc8592f2ccdc461ae9599d16" gracePeriod=45
Jul 23 19:44:06.371621 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.371593    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:44:06.481909 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.481871    2578 generic.go:356] "Generic (PLEG): container finished" podID="a5446a9a-43e1-4b26-9646-369ec3fdade1" containerID="8229ea21f5e142b90b9f912c40879fd8689b0320cc8592f2ccdc461ae9599d16" exitCode=0
Jul 23 19:44:06.482096 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.481921    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"
Jul 23 19:44:06.482096 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.481931    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8" event={"ID":"a5446a9a-43e1-4b26-9646-369ec3fdade1","Type":"ContainerDied","Data":"8229ea21f5e142b90b9f912c40879fd8689b0320cc8592f2ccdc461ae9599d16"}
Jul 23 19:44:06.482096 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.481969    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8" event={"ID":"a5446a9a-43e1-4b26-9646-369ec3fdade1","Type":"ContainerDied","Data":"e337df5ed01311e02cd153c3ad02079f43e80572cc0c4c282f2df10f50db0aaa"}
Jul 23 19:44:06.482096 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.481992    2578 scope.go:117] "RemoveContainer" containerID="8229ea21f5e142b90b9f912c40879fd8689b0320cc8592f2ccdc461ae9599d16"
Jul 23 19:44:06.489962 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.489943    2578 scope.go:117] "RemoveContainer" containerID="8229ea21f5e142b90b9f912c40879fd8689b0320cc8592f2ccdc461ae9599d16"
Jul 23 19:44:06.490207 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:44:06.490191    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8229ea21f5e142b90b9f912c40879fd8689b0320cc8592f2ccdc461ae9599d16\": container with ID starting with 8229ea21f5e142b90b9f912c40879fd8689b0320cc8592f2ccdc461ae9599d16 not found: ID does not exist" containerID="8229ea21f5e142b90b9f912c40879fd8689b0320cc8592f2ccdc461ae9599d16"
Jul 23 19:44:06.490282 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.490217    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8229ea21f5e142b90b9f912c40879fd8689b0320cc8592f2ccdc461ae9599d16"} err="failed to get container status \"8229ea21f5e142b90b9f912c40879fd8689b0320cc8592f2ccdc461ae9599d16\": rpc error: code = NotFound desc = could not find container \"8229ea21f5e142b90b9f912c40879fd8689b0320cc8592f2ccdc461ae9599d16\": container with ID starting with 8229ea21f5e142b90b9f912c40879fd8689b0320cc8592f2ccdc461ae9599d16 not found: ID does not exist"
Jul 23 19:44:06.516632 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.516605    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-home\") pod \"a5446a9a-43e1-4b26-9646-369ec3fdade1\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") "
Jul 23 19:44:06.516757 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.516658    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-tmp-dir\") pod \"a5446a9a-43e1-4b26-9646-369ec3fdade1\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") "
Jul 23 19:44:06.516757 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.516687    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5446a9a-43e1-4b26-9646-369ec3fdade1-tls-certs\") pod \"a5446a9a-43e1-4b26-9646-369ec3fdade1\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") "
Jul 23 19:44:06.516862 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.516767    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h64qv\" (UniqueName: \"kubernetes.io/projected/a5446a9a-43e1-4b26-9646-369ec3fdade1-kube-api-access-h64qv\") pod \"a5446a9a-43e1-4b26-9646-369ec3fdade1\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") "
Jul 23 19:44:06.516862 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.516794    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-dshm\") pod \"a5446a9a-43e1-4b26-9646-369ec3fdade1\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") "
Jul 23 19:44:06.516862 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.516839    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-model-cache\") pod \"a5446a9a-43e1-4b26-9646-369ec3fdade1\" (UID: \"a5446a9a-43e1-4b26-9646-369ec3fdade1\") "
Jul 23 19:44:06.517001 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.516872    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-home" (OuterVolumeSpecName: "home") pod "a5446a9a-43e1-4b26-9646-369ec3fdade1" (UID: "a5446a9a-43e1-4b26-9646-369ec3fdade1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:44:06.517001 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.516952    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a5446a9a-43e1-4b26-9646-369ec3fdade1" (UID: "a5446a9a-43e1-4b26-9646-369ec3fdade1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:44:06.517166 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.517128    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-home\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:44:06.517166 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.517144    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-model-cache" (OuterVolumeSpecName: "model-cache") pod "a5446a9a-43e1-4b26-9646-369ec3fdade1" (UID: "a5446a9a-43e1-4b26-9646-369ec3fdade1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:44:06.517166 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.517157    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-tmp-dir\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:44:06.519000 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.518976    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-dshm" (OuterVolumeSpecName: "dshm") pod "a5446a9a-43e1-4b26-9646-369ec3fdade1" (UID: "a5446a9a-43e1-4b26-9646-369ec3fdade1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:44:06.519080 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.519046    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5446a9a-43e1-4b26-9646-369ec3fdade1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a5446a9a-43e1-4b26-9646-369ec3fdade1" (UID: "a5446a9a-43e1-4b26-9646-369ec3fdade1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:44:06.519080 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.519048    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5446a9a-43e1-4b26-9646-369ec3fdade1-kube-api-access-h64qv" (OuterVolumeSpecName: "kube-api-access-h64qv") pod "a5446a9a-43e1-4b26-9646-369ec3fdade1" (UID: "a5446a9a-43e1-4b26-9646-369ec3fdade1"). InnerVolumeSpecName "kube-api-access-h64qv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:44:06.618388 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.618347    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h64qv\" (UniqueName: \"kubernetes.io/projected/a5446a9a-43e1-4b26-9646-369ec3fdade1-kube-api-access-h64qv\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:44:06.618388 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.618382    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-dshm\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:44:06.618388 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.618393    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5446a9a-43e1-4b26-9646-369ec3fdade1-model-cache\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:44:06.618388 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.618402    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5446a9a-43e1-4b26-9646-369ec3fdade1-tls-certs\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:44:06.803805 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.803770    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"]
Jul 23 19:44:06.807966 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:06.807941    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-58bd3f18-kserve-5c6f687c9f-bfvt8"]
Jul 23 19:44:07.539777 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:07.539726    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw" podUID="3ce77bea-5c6b-479c-9327-a046cbce2624" containerName="main" containerID="cri-o://23a0a428795a17a1cf3c9fb04f6ba503caa38e2e636a91afc3df9ac5e4c78e3d" gracePeriod=45
Jul 23 19:44:07.652510 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:07.652476    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5446a9a-43e1-4b26-9646-369ec3fdade1" path="/var/lib/kubelet/pods/a5446a9a-43e1-4b26-9646-369ec3fdade1/volumes"
Jul 23 19:44:07.788590 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:07.788562    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:44:07.928919 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:07.928823    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ce77bea-5c6b-479c-9327-a046cbce2624-tls-certs\") pod \"3ce77bea-5c6b-479c-9327-a046cbce2624\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") "
Jul 23 19:44:07.928919 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:07.928904    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-tmp-dir\") pod \"3ce77bea-5c6b-479c-9327-a046cbce2624\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") "
Jul 23 19:44:07.929147 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:07.928935    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-home\") pod \"3ce77bea-5c6b-479c-9327-a046cbce2624\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") "
Jul 23 19:44:07.929147 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:07.928962    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-model-cache\") pod \"3ce77bea-5c6b-479c-9327-a046cbce2624\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") "
Jul 23 19:44:07.929147 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:07.928992    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-dshm\") pod \"3ce77bea-5c6b-479c-9327-a046cbce2624\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") "
Jul 23 19:44:07.929147 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:07.929029    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwjdd\" (UniqueName: \"kubernetes.io/projected/3ce77bea-5c6b-479c-9327-a046cbce2624-kube-api-access-qwjdd\") pod \"3ce77bea-5c6b-479c-9327-a046cbce2624\" (UID: \"3ce77bea-5c6b-479c-9327-a046cbce2624\") "
Jul 23 19:44:07.929363 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:07.929169    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3ce77bea-5c6b-479c-9327-a046cbce2624" (UID: "3ce77bea-5c6b-479c-9327-a046cbce2624"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:44:07.929363 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:07.929199    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-home" (OuterVolumeSpecName: "home") pod "3ce77bea-5c6b-479c-9327-a046cbce2624" (UID: "3ce77bea-5c6b-479c-9327-a046cbce2624"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:44:07.929363 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:07.929330    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-tmp-dir\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:44:07.929363 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:07.929333    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-model-cache" (OuterVolumeSpecName: "model-cache") pod "3ce77bea-5c6b-479c-9327-a046cbce2624" (UID: "3ce77bea-5c6b-479c-9327-a046cbce2624"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:44:07.929363 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:07.929343    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-home\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:44:07.931094 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:07.931069    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ce77bea-5c6b-479c-9327-a046cbce2624-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3ce77bea-5c6b-479c-9327-a046cbce2624" (UID: "3ce77bea-5c6b-479c-9327-a046cbce2624"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:44:07.931199 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:07.931154    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ce77bea-5c6b-479c-9327-a046cbce2624-kube-api-access-qwjdd" (OuterVolumeSpecName: "kube-api-access-qwjdd") pod "3ce77bea-5c6b-479c-9327-a046cbce2624" (UID: "3ce77bea-5c6b-479c-9327-a046cbce2624"). InnerVolumeSpecName "kube-api-access-qwjdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:44:07.931199 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:07.931167    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-dshm" (OuterVolumeSpecName: "dshm") pod "3ce77bea-5c6b-479c-9327-a046cbce2624" (UID: "3ce77bea-5c6b-479c-9327-a046cbce2624"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:44:08.030084 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:08.030044    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-model-cache\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:44:08.030084 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:08.030077    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ce77bea-5c6b-479c-9327-a046cbce2624-dshm\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:44:08.030084 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:08.030086    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwjdd\" (UniqueName: \"kubernetes.io/projected/3ce77bea-5c6b-479c-9327-a046cbce2624-kube-api-access-qwjdd\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:44:08.030339 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:08.030096    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ce77bea-5c6b-479c-9327-a046cbce2624-tls-certs\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:44:08.491949 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:08.491913    2578 generic.go:356] "Generic (PLEG): container finished" podID="3ce77bea-5c6b-479c-9327-a046cbce2624" containerID="23a0a428795a17a1cf3c9fb04f6ba503caa38e2e636a91afc3df9ac5e4c78e3d" exitCode=0
Jul 23 19:44:08.492129 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:08.491956    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"
Jul 23 19:44:08.492129 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:08.491991    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw" event={"ID":"3ce77bea-5c6b-479c-9327-a046cbce2624","Type":"ContainerDied","Data":"23a0a428795a17a1cf3c9fb04f6ba503caa38e2e636a91afc3df9ac5e4c78e3d"}
Jul 23 19:44:08.492129 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:08.492031    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw" event={"ID":"3ce77bea-5c6b-479c-9327-a046cbce2624","Type":"ContainerDied","Data":"03a994e2749db5a43746a6cd267d6d7921acbcd92fcecdf6b52b485690cad732"}
Jul 23 19:44:08.492129 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:08.492049    2578 scope.go:117] "RemoveContainer" containerID="23a0a428795a17a1cf3c9fb04f6ba503caa38e2e636a91afc3df9ac5e4c78e3d"
Jul 23 19:44:08.501815 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:08.501798    2578 scope.go:117] "RemoveContainer" containerID="23a0a428795a17a1cf3c9fb04f6ba503caa38e2e636a91afc3df9ac5e4c78e3d"
Jul 23 19:44:08.502093 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:44:08.502069    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23a0a428795a17a1cf3c9fb04f6ba503caa38e2e636a91afc3df9ac5e4c78e3d\": container with ID starting with 23a0a428795a17a1cf3c9fb04f6ba503caa38e2e636a91afc3df9ac5e4c78e3d not found: ID does not exist" containerID="23a0a428795a17a1cf3c9fb04f6ba503caa38e2e636a91afc3df9ac5e4c78e3d"
Jul 23 19:44:08.502151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:08.502100    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23a0a428795a17a1cf3c9fb04f6ba503caa38e2e636a91afc3df9ac5e4c78e3d"} err="failed to get container status \"23a0a428795a17a1cf3c9fb04f6ba503caa38e2e636a91afc3df9ac5e4c78e3d\": rpc error: code = NotFound desc = could not find container \"23a0a428795a17a1cf3c9fb04f6ba503caa38e2e636a91afc3df9ac5e4c78e3d\": container with ID starting with 23a0a428795a17a1cf3c9fb04f6ba503caa38e2e636a91afc3df9ac5e4c78e3d not found: ID does not exist"
Jul 23 19:44:08.513217 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:08.513192    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"]
Jul 23 19:44:08.517551 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:08.517528    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-58bd3f18-kserve-5645cd78f5-9mbmw"]
Jul 23 19:44:09.651149 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:44:09.651116    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ce77bea-5c6b-479c-9327-a046cbce2624" path="/var/lib/kubelet/pods/3ce77bea-5c6b-479c-9327-a046cbce2624/volumes"
Jul 23 19:47:33.018844 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.018812    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"]
Jul 23 19:47:33.019341 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.019124    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5446a9a-43e1-4b26-9646-369ec3fdade1" containerName="main"
Jul 23 19:47:33.019341 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.019135    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5446a9a-43e1-4b26-9646-369ec3fdade1" containerName="main"
Jul 23 19:47:33.019341 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.019144    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ce77bea-5c6b-479c-9327-a046cbce2624" containerName="main"
Jul 23 19:47:33.019341 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.019150    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ce77bea-5c6b-479c-9327-a046cbce2624" containerName="main"
Jul 23 19:47:33.019341 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.019209    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5446a9a-43e1-4b26-9646-369ec3fdade1" containerName="main"
Jul 23 19:47:33.019341 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.019216    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ce77bea-5c6b-479c-9327-a046cbce2624" containerName="main"
Jul 23 19:47:33.022194 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.022178    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.025114 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.025092    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-12f58144-openshift-default-dockercfg-62xc6\""
Jul 23 19:47:33.048516 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.048494    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"]
Jul 23 19:47:33.131088 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.131056    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-data\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.131088 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.131089    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbtsq\" (UniqueName: \"kubernetes.io/projected/223f924f-83e4-4e35-9d8f-bb62b1631d6e-kube-api-access-lbtsq\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.131325 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.131123    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istiod-ca-cert\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.131325 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.131141    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-credential-socket\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.131325 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.131190    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-envoy\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.131325 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.131233    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-podinfo\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.131325 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.131274    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-token\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.131325 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.131295    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-workload-certs\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.131512 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.131345    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-workload-socket\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.231816 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.231778    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-envoy\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.231816 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.231823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-podinfo\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.231986 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.231931    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-token\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.231986 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.231962    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-workload-certs\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.232096 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.231990    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-workload-socket\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.232096 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.232032    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-data\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.232096 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.232047    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbtsq\" (UniqueName: \"kubernetes.io/projected/223f924f-83e4-4e35-9d8f-bb62b1631d6e-kube-api-access-lbtsq\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.232096 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.232086    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istiod-ca-cert\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.232326 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.232115    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-credential-socket\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.232384 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.232365    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-workload-certs\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.232444 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.232425    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-workload-socket\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.232557 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.232537    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-data\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.232690 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.232669    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-credential-socket\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.232915 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.232898    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istiod-ca-cert\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.234623 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.234596    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-envoy\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.234826 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.234810    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-podinfo\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.240758 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.240733    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbtsq\" (UniqueName: \"kubernetes.io/projected/223f924f-83e4-4e35-9d8f-bb62b1631d6e-kube-api-access-lbtsq\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.240900 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.240884    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-token\") pod \"e2e-ait-12f58144-openshift-default-798466b849-6h6gp\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") " pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.332687 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.332617    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:33.467455 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.467425    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"]
Jul 23 19:47:33.471087 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:47:33.471062    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod223f924f_83e4_4e35_9d8f_bb62b1631d6e.slice/crio-a84ae0c04250968f59d28229dbcc10f21431377dbcb506ee1d655f88c625f5db WatchSource:0}: Error finding container a84ae0c04250968f59d28229dbcc10f21431377dbcb506ee1d655f88c625f5db: Status 404 returned error can't find the container with id a84ae0c04250968f59d28229dbcc10f21431377dbcb506ee1d655f88c625f5db
Jul 23 19:47:33.473543 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.473509    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:47:33.473629 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.473583    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:47:33.473629 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:33.473614    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:47:34.371164 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:34.371135    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp" event={"ID":"223f924f-83e4-4e35-9d8f-bb62b1631d6e","Type":"ContainerStarted","Data":"1c4c66275edc71e0a0ade1c95411f7c1da8e385007dd1e507b0af8163b83bcfd"}
Jul 23 19:47:34.371657 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:34.371193    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp" event={"ID":"223f924f-83e4-4e35-9d8f-bb62b1631d6e","Type":"ContainerStarted","Data":"a84ae0c04250968f59d28229dbcc10f21431377dbcb506ee1d655f88c625f5db"}
Jul 23 19:47:34.391012 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:34.390964    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp" podStartSLOduration=2.390949625 podStartE2EDuration="2.390949625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:47:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:47:34.389783935 +0000 UTC m=+1655.226790667" watchObservedRunningTime="2026-07-23 19:47:34.390949625 +0000 UTC m=+1655.227956410"
Jul 23 19:47:35.333042 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:35.333006    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:35.337777 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:35.337754    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:35.374877 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:35.374851    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:35.375620 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:35.375601    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:50.376941 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:50.376859    2578 patch_prober.go:28] interesting pod/e2e-ait-12f58144-openshift-default-798466b849-6h6gp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 23 19:47:50.376941 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:50.376923    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp" podUID="223f924f-83e4-4e35-9d8f-bb62b1631d6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 23 19:47:50.438029 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:50.437996    2578 generic.go:356] "Generic (PLEG): container finished" podID="223f924f-83e4-4e35-9d8f-bb62b1631d6e" containerID="1c4c66275edc71e0a0ade1c95411f7c1da8e385007dd1e507b0af8163b83bcfd" exitCode=0
Jul 23 19:47:50.438029 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:50.438032    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp" event={"ID":"223f924f-83e4-4e35-9d8f-bb62b1631d6e","Type":"ContainerDied","Data":"1c4c66275edc71e0a0ade1c95411f7c1da8e385007dd1e507b0af8163b83bcfd"}
Jul 23 19:47:50.438408 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:50.438389    2578 scope.go:117] "RemoveContainer" containerID="1c4c66275edc71e0a0ade1c95411f7c1da8e385007dd1e507b0af8163b83bcfd"
Jul 23 19:47:50.439415 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:50.439380    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:47:50.439512 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:50.439454    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:47:50.439512 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:50.439507    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:47:51.447159 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:51.447123    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp" event={"ID":"223f924f-83e4-4e35-9d8f-bb62b1631d6e","Type":"ContainerStarted","Data":"d5d7a08e229c799690e95d750871cbbbf898887b8affd2029835c939e0dc9de9"}
Jul 23 19:47:52.333501 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:52.333464    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:52.333989 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:52.333963    2578 patch_prober.go:28] interesting pod/e2e-ait-12f58144-openshift-default-798466b849-6h6gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 23 19:47:52.334210 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:52.334175    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp" podUID="223f924f-83e4-4e35-9d8f-bb62b1631d6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 23 19:47:53.332996 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:53.332954    2578 patch_prober.go:28] interesting pod/e2e-ait-12f58144-openshift-default-798466b849-6h6gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 23 19:47:53.333522 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:53.333020    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp" podUID="223f924f-83e4-4e35-9d8f-bb62b1631d6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 23 19:47:54.333959 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:54.333925    2578 patch_prober.go:28] interesting pod/e2e-ait-12f58144-openshift-default-798466b849-6h6gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 23 19:47:54.334551 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:54.334521    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp" podUID="223f924f-83e4-4e35-9d8f-bb62b1631d6e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 23 19:47:55.337499 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:55.337466    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:55.337951 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:55.337930    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:47:55.338566 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:47:55.338547    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:48:16.460695 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:16.460656    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"]
Jul 23 19:48:16.461136 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:16.460909    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp" podUID="223f924f-83e4-4e35-9d8f-bb62b1631d6e" containerName="istio-proxy" containerID="cri-o://d5d7a08e229c799690e95d750871cbbbf898887b8affd2029835c939e0dc9de9" gracePeriod=30
Jul 23 19:48:17.442467 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.442429    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"]
Jul 23 19:48:17.444780 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.444761    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.447336 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.447314    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-7d09e9f8-gw-openshift-default-dockercfg-ktg85\""
Jul 23 19:48:17.463409 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.463382    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"]
Jul 23 19:48:17.482722 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.482691    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdqjd\" (UniqueName: \"kubernetes.io/projected/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-kube-api-access-pdqjd\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.482832 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.482746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-credential-socket\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.482832 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.482799    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-workload-socket\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.482832 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.482828    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-workload-certs\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.482939 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.482852    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-data\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.482939 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.482876    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-podinfo\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.482939 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.482906    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istiod-ca-cert\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.483027 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.482963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-token\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.483062 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.483035    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-envoy\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.584006 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.583979    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-credential-socket\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.584142 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.584025    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-workload-socket\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.584142 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.584050    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-workload-certs\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.584142 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.584074    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-data\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.584142 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.584097    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-podinfo\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.584142 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.584128    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istiod-ca-cert\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.584433 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.584188    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-token\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.584433 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.584223    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-envoy\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.584433 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.584286    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdqjd\" (UniqueName: \"kubernetes.io/projected/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-kube-api-access-pdqjd\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.584588 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.584478    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-workload-socket\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.584588 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.584501    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-data\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.584588 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.584560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-workload-certs\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.584733 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.584593    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-credential-socket\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.585015 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.584990    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istiod-ca-cert\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.586549 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.586521    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-envoy\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.586826 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.586805    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-podinfo\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.600964 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.600943    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdqjd\" (UniqueName: \"kubernetes.io/projected/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-kube-api-access-pdqjd\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.602397 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.602379    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-token\") pod \"e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") " pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.755613 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.755581    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:17.893403 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.893380    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"]
Jul 23 19:48:17.895636 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:48:17.895611    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod917477ce_f2a3_4c8d_b488_cebdb0f4e4cc.slice/crio-091f85a205ebdcc125c8627ec799a1878a79dfe55648324d4ad46a946ca041b0 WatchSource:0}: Error finding container 091f85a205ebdcc125c8627ec799a1878a79dfe55648324d4ad46a946ca041b0: Status 404 returned error can't find the container with id 091f85a205ebdcc125c8627ec799a1878a79dfe55648324d4ad46a946ca041b0
Jul 23 19:48:17.897599 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.897571    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:48:17.897691 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.897641    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:48:17.897691 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:17.897684    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:48:18.576493 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:18.576451    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p" event={"ID":"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc","Type":"ContainerStarted","Data":"3726ad72832add2933161f4c8d0b2bc36690269ac27ddf565b5958400f970eac"}
Jul 23 19:48:18.576863 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:18.576503    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p" event={"ID":"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc","Type":"ContainerStarted","Data":"091f85a205ebdcc125c8627ec799a1878a79dfe55648324d4ad46a946ca041b0"}
Jul 23 19:48:18.602080 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:18.602036    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p" podStartSLOduration=1.602020953 podStartE2EDuration="1.602020953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:48:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:48:18.599926516 +0000 UTC m=+1699.436933220" watchObservedRunningTime="2026-07-23 19:48:18.602020953 +0000 UTC m=+1699.439027738"
Jul 23 19:48:18.756139 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:18.756103    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:18.760836 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:18.760812    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:19.581412 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:19.581377    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:19.582179 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:19.582161    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:21.591593 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.591562    2578 generic.go:356] "Generic (PLEG): container finished" podID="223f924f-83e4-4e35-9d8f-bb62b1631d6e" containerID="d5d7a08e229c799690e95d750871cbbbf898887b8affd2029835c939e0dc9de9" exitCode=0
Jul 23 19:48:21.591983 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.591629    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp" event={"ID":"223f924f-83e4-4e35-9d8f-bb62b1631d6e","Type":"ContainerDied","Data":"d5d7a08e229c799690e95d750871cbbbf898887b8affd2029835c939e0dc9de9"}
Jul 23 19:48:21.591983 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.591697    2578 scope.go:117] "RemoveContainer" containerID="1c4c66275edc71e0a0ade1c95411f7c1da8e385007dd1e507b0af8163b83bcfd"
Jul 23 19:48:21.711833 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.711811    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:48:21.720297 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.720275    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-token\") pod \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") "
Jul 23 19:48:21.720411 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.720334    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-workload-socket\") pod \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") "
Jul 23 19:48:21.720411 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.720374    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istiod-ca-cert\") pod \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") "
Jul 23 19:48:21.720411 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.720402    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-podinfo\") pod \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") "
Jul 23 19:48:21.720580 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.720447    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-data\") pod \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") "
Jul 23 19:48:21.720580 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.720469    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-workload-certs\") pod \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") "
Jul 23 19:48:21.720580 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.720509    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-envoy\") pod \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") "
Jul 23 19:48:21.720710 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.720623    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "223f924f-83e4-4e35-9d8f-bb62b1631d6e" (UID: "223f924f-83e4-4e35-9d8f-bb62b1631d6e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:48:21.720822 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.720797    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "223f924f-83e4-4e35-9d8f-bb62b1631d6e" (UID: "223f924f-83e4-4e35-9d8f-bb62b1631d6e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:48:21.720885 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.720591    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-credential-socket\") pod \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") "
Jul 23 19:48:21.720941 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.720895    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbtsq\" (UniqueName: \"kubernetes.io/projected/223f924f-83e4-4e35-9d8f-bb62b1631d6e-kube-api-access-lbtsq\") pod \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\" (UID: \"223f924f-83e4-4e35-9d8f-bb62b1631d6e\") "
Jul 23 19:48:21.720995 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.720837    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "223f924f-83e4-4e35-9d8f-bb62b1631d6e" (UID: "223f924f-83e4-4e35-9d8f-bb62b1631d6e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:48:21.720995 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.720935    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "223f924f-83e4-4e35-9d8f-bb62b1631d6e" (UID: "223f924f-83e4-4e35-9d8f-bb62b1631d6e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:48:21.721183 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.721162    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-workload-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:48:21.721315 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.721187    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istiod-ca-cert\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:48:21.721315 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.721202    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-workload-certs\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:48:21.721315 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.721216    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-credential-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:48:21.721565 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.721535    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-data" (OuterVolumeSpecName: "istio-data") pod "223f924f-83e4-4e35-9d8f-bb62b1631d6e" (UID: "223f924f-83e4-4e35-9d8f-bb62b1631d6e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:48:21.722641 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.722595    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-token" (OuterVolumeSpecName: "istio-token") pod "223f924f-83e4-4e35-9d8f-bb62b1631d6e" (UID: "223f924f-83e4-4e35-9d8f-bb62b1631d6e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:48:21.722722 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.722703    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "223f924f-83e4-4e35-9d8f-bb62b1631d6e" (UID: "223f924f-83e4-4e35-9d8f-bb62b1631d6e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 19:48:21.723114 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.723093    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "223f924f-83e4-4e35-9d8f-bb62b1631d6e" (UID: "223f924f-83e4-4e35-9d8f-bb62b1631d6e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:48:21.723193 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.723110    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/223f924f-83e4-4e35-9d8f-bb62b1631d6e-kube-api-access-lbtsq" (OuterVolumeSpecName: "kube-api-access-lbtsq") pod "223f924f-83e4-4e35-9d8f-bb62b1631d6e" (UID: "223f924f-83e4-4e35-9d8f-bb62b1631d6e"). InnerVolumeSpecName "kube-api-access-lbtsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:48:21.822370 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.822335    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-podinfo\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:48:21.822370 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.822359    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-data\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:48:21.822370 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.822368    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-envoy\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:48:21.822370 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.822377    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbtsq\" (UniqueName: \"kubernetes.io/projected/223f924f-83e4-4e35-9d8f-bb62b1631d6e-kube-api-access-lbtsq\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:48:21.822607 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:21.822387    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/223f924f-83e4-4e35-9d8f-bb62b1631d6e-istio-token\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:48:22.597868 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:22.597832    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp" event={"ID":"223f924f-83e4-4e35-9d8f-bb62b1631d6e","Type":"ContainerDied","Data":"a84ae0c04250968f59d28229dbcc10f21431377dbcb506ee1d655f88c625f5db"}
Jul 23 19:48:22.598340 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:22.597893    2578 scope.go:117] "RemoveContainer" containerID="d5d7a08e229c799690e95d750871cbbbf898887b8affd2029835c939e0dc9de9"
Jul 23 19:48:22.598340 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:22.597837    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"
Jul 23 19:48:22.619087 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:22.619059    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"]
Jul 23 19:48:22.623114 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:22.623093    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-12f58144-openshift-default-798466b849-6h6gp"]
Jul 23 19:48:23.653500 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:23.653461    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="223f924f-83e4-4e35-9d8f-bb62b1631d6e" path="/var/lib/kubelet/pods/223f924f-83e4-4e35-9d8f-bb62b1631d6e/volumes"
Jul 23 19:48:34.583307 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:34.583275    2578 patch_prober.go:28] interesting pod/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 23 19:48:34.583722 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:34.583351    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p" podUID="917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 23 19:48:34.652867 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:34.652841    2578 generic.go:356] "Generic (PLEG): container finished" podID="917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" containerID="3726ad72832add2933161f4c8d0b2bc36690269ac27ddf565b5958400f970eac" exitCode=0
Jul 23 19:48:34.652986 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:34.652914    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p" event={"ID":"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc","Type":"ContainerDied","Data":"3726ad72832add2933161f4c8d0b2bc36690269ac27ddf565b5958400f970eac"}
Jul 23 19:48:34.653326 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:34.653304    2578 scope.go:117] "RemoveContainer" containerID="3726ad72832add2933161f4c8d0b2bc36690269ac27ddf565b5958400f970eac"
Jul 23 19:48:34.654362 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:34.654331    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:48:34.654441 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:34.654425    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:48:34.654485 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:34.654469    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:48:35.662069 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:35.662027    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p" event={"ID":"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc","Type":"ContainerStarted","Data":"f84ef12b5b91c99627e10954dbc65fcc45bbe5acc025cf833345cd0ac4a9d202"}
Jul 23 19:48:35.756733 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:35.756685    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:35.756946 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:35.756823    2578 patch_prober.go:28] interesting pod/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 23 19:48:35.756946 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:35.756877    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p" podUID="917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 23 19:48:36.756632 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:36.756589    2578 patch_prober.go:28] interesting pod/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 23 19:48:36.757120 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:36.756654    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p" podUID="917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 23 19:48:37.756861 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:37.756809    2578 patch_prober.go:28] interesting pod/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 23 19:48:37.757375 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:37.756881    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p" podUID="917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 23 19:48:38.756596 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:38.756559    2578 patch_prober.go:28] interesting pod/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 23 19:48:38.756886 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:38.756855    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p" podUID="917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 23 19:48:39.760558 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:39.760530    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:39.760926 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:39.760755    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:48:39.761513 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:48:39.761493    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:49:00.238114 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:00.238082    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"]
Jul 23 19:49:00.238587 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:00.238353    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p" podUID="917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" containerName="istio-proxy" containerID="cri-o://f84ef12b5b91c99627e10954dbc65fcc45bbe5acc025cf833345cd0ac4a9d202" gracePeriod=30
Jul 23 19:49:01.037394 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.037353    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"]
Jul 23 19:49:01.037852 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.037837    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="223f924f-83e4-4e35-9d8f-bb62b1631d6e" containerName="istio-proxy"
Jul 23 19:49:01.037899 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.037856    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="223f924f-83e4-4e35-9d8f-bb62b1631d6e" containerName="istio-proxy"
Jul 23 19:49:01.037899 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.037872    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="223f924f-83e4-4e35-9d8f-bb62b1631d6e" containerName="istio-proxy"
Jul 23 19:49:01.037899 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.037880    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="223f924f-83e4-4e35-9d8f-bb62b1631d6e" containerName="istio-proxy"
Jul 23 19:49:01.037987 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.037954    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="223f924f-83e4-4e35-9d8f-bb62b1631d6e" containerName="istio-proxy"
Jul 23 19:49:01.042262 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.042222    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.047716 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.047689    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-132311c3-openshift-default-dockercfg-vccs6\""
Jul 23 19:49:01.059155 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.059133    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"]
Jul 23 19:49:01.163908 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.163875    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-data\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.164068 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.163918    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn6js\" (UniqueName: \"kubernetes.io/projected/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-kube-api-access-pn6js\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.164068 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.163939    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-workload-certs\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.164068 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.163965    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-workload-socket\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.164068 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.164005    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-credential-socket\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.164068 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.164028    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-envoy\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.164068 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.164055    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-podinfo\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.164276 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.164088    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-token\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.164276 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.164102    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istiod-ca-cert\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.264718 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.264677    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-workload-certs\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.264718 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.264725    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-workload-socket\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.265226 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.264768    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-credential-socket\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.265226 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.264793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-envoy\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.265226 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.264818    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-podinfo\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.265226 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.264857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-token\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.265226 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.264983    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istiod-ca-cert\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.265226 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.265059    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-data\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.265226 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.265097    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn6js\" (UniqueName: \"kubernetes.io/projected/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-kube-api-access-pn6js\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.265226 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.265203    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-workload-certs\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.265226 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.265215    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-credential-socket\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.265703 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.265530    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-data\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.265703 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.265608    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-workload-socket\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.265962 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.265940    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istiod-ca-cert\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.267495 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.267466    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-podinfo\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.267599 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.267564    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-envoy\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.273159 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.273138    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-token\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.273987 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.273968    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn6js\" (UniqueName: \"kubernetes.io/projected/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-kube-api-access-pn6js\") pod \"e2e-ait-132311c3-openshift-default-689cbbb889-7bb97\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") " pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.352699 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.352616    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:01.490874 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.490808    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"]
Jul 23 19:49:01.493196 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:49:01.493162    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea7e52f0_7846_416e_9a75_827a5ee7ecf4.slice/crio-6fe64d61e612bf69970e558498b1c29d5ff901cce382801eca32ad977f4a4244 WatchSource:0}: Error finding container 6fe64d61e612bf69970e558498b1c29d5ff901cce382801eca32ad977f4a4244: Status 404 returned error can't find the container with id 6fe64d61e612bf69970e558498b1c29d5ff901cce382801eca32ad977f4a4244
Jul 23 19:49:01.495357 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.495321    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:49:01.495430 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.495390    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:49:01.495430 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.495424    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:49:01.774317 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.774281    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97" event={"ID":"ea7e52f0-7846-416e-9a75-827a5ee7ecf4","Type":"ContainerStarted","Data":"4c4e1b2e26ecaaabeb029a271fcc619d11b870043bc9653b969eef947d79191b"}
Jul 23 19:49:01.774501 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.774335    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97" event={"ID":"ea7e52f0-7846-416e-9a75-827a5ee7ecf4","Type":"ContainerStarted","Data":"6fe64d61e612bf69970e558498b1c29d5ff901cce382801eca32ad977f4a4244"}
Jul 23 19:49:01.799090 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:01.799048    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97" podStartSLOduration=1.799035019 podStartE2EDuration="1.799035019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:49:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:49:01.798052611 +0000 UTC m=+1742.635059331" watchObservedRunningTime="2026-07-23 19:49:01.799035019 +0000 UTC m=+1742.636041725"
Jul 23 19:49:02.353824 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:02.353793    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:02.358583 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:02.358554    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:02.778612 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:02.778577    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:02.779433 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:02.779408    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:05.492622 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.492599    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:49:05.604003 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.603923    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-credential-socket\") pod \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") "
Jul 23 19:49:05.604003 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.603955    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-workload-socket\") pod \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") "
Jul 23 19:49:05.604003 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.603989    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-token\") pod \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") "
Jul 23 19:49:05.604276 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.604099    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdqjd\" (UniqueName: \"kubernetes.io/projected/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-kube-api-access-pdqjd\") pod \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") "
Jul 23 19:49:05.604276 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.604130    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istiod-ca-cert\") pod \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") "
Jul 23 19:49:05.604276 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.604154    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-data\") pod \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") "
Jul 23 19:49:05.604276 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.604177    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-podinfo\") pod \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") "
Jul 23 19:49:05.604276 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.604213    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-envoy\") pod \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") "
Jul 23 19:49:05.604276 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.604230    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" (UID: "917477ce-f2a3-4c8d-b488-cebdb0f4e4cc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:49:05.604592 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.604246    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-workload-certs\") pod \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\" (UID: \"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc\") "
Jul 23 19:49:05.604592 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.604318    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" (UID: "917477ce-f2a3-4c8d-b488-cebdb0f4e4cc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:49:05.604592 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.604551    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-credential-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:49:05.604592 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.604568    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-workload-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:49:05.604792 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.604540    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" (UID: "917477ce-f2a3-4c8d-b488-cebdb0f4e4cc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:49:05.604792 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.604755    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" (UID: "917477ce-f2a3-4c8d-b488-cebdb0f4e4cc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:49:05.605419 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.605383    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-data" (OuterVolumeSpecName: "istio-data") pod "917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" (UID: "917477ce-f2a3-4c8d-b488-cebdb0f4e4cc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:49:05.606349 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.606327    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" (UID: "917477ce-f2a3-4c8d-b488-cebdb0f4e4cc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:49:05.606434 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.606364    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-token" (OuterVolumeSpecName: "istio-token") pod "917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" (UID: "917477ce-f2a3-4c8d-b488-cebdb0f4e4cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:49:05.606434 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.606369    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" (UID: "917477ce-f2a3-4c8d-b488-cebdb0f4e4cc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 19:49:05.606434 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.606369    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-kube-api-access-pdqjd" (OuterVolumeSpecName: "kube-api-access-pdqjd") pod "917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" (UID: "917477ce-f2a3-4c8d-b488-cebdb0f4e4cc"). InnerVolumeSpecName "kube-api-access-pdqjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:49:05.705591 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.705564    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-token\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:49:05.705696 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.705609    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdqjd\" (UniqueName: \"kubernetes.io/projected/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-kube-api-access-pdqjd\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:49:05.705696 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.705619    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istiod-ca-cert\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:49:05.705696 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.705628    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-data\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:49:05.705696 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.705635    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-podinfo\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:49:05.705696 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.705643    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-istio-envoy\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:49:05.705696 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.705650    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc-workload-certs\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:49:05.793548 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.793519    2578 generic.go:356] "Generic (PLEG): container finished" podID="917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" containerID="f84ef12b5b91c99627e10954dbc65fcc45bbe5acc025cf833345cd0ac4a9d202" exitCode=0
Jul 23 19:49:05.793675 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.793576    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"
Jul 23 19:49:05.793675 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.793605    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p" event={"ID":"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc","Type":"ContainerDied","Data":"f84ef12b5b91c99627e10954dbc65fcc45bbe5acc025cf833345cd0ac4a9d202"}
Jul 23 19:49:05.793747 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.793689    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p" event={"ID":"917477ce-f2a3-4c8d-b488-cebdb0f4e4cc","Type":"ContainerDied","Data":"091f85a205ebdcc125c8627ec799a1878a79dfe55648324d4ad46a946ca041b0"}
Jul 23 19:49:05.793747 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.793721    2578 scope.go:117] "RemoveContainer" containerID="f84ef12b5b91c99627e10954dbc65fcc45bbe5acc025cf833345cd0ac4a9d202"
Jul 23 19:49:05.802056 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.802041    2578 scope.go:117] "RemoveContainer" containerID="3726ad72832add2933161f4c8d0b2bc36690269ac27ddf565b5958400f970eac"
Jul 23 19:49:05.809403 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.809366    2578 scope.go:117] "RemoveContainer" containerID="f84ef12b5b91c99627e10954dbc65fcc45bbe5acc025cf833345cd0ac4a9d202"
Jul 23 19:49:05.809635 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:49:05.809616    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f84ef12b5b91c99627e10954dbc65fcc45bbe5acc025cf833345cd0ac4a9d202\": container with ID starting with f84ef12b5b91c99627e10954dbc65fcc45bbe5acc025cf833345cd0ac4a9d202 not found: ID does not exist" containerID="f84ef12b5b91c99627e10954dbc65fcc45bbe5acc025cf833345cd0ac4a9d202"
Jul 23 19:49:05.809690 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.809642    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f84ef12b5b91c99627e10954dbc65fcc45bbe5acc025cf833345cd0ac4a9d202"} err="failed to get container status \"f84ef12b5b91c99627e10954dbc65fcc45bbe5acc025cf833345cd0ac4a9d202\": rpc error: code = NotFound desc = could not find container \"f84ef12b5b91c99627e10954dbc65fcc45bbe5acc025cf833345cd0ac4a9d202\": container with ID starting with f84ef12b5b91c99627e10954dbc65fcc45bbe5acc025cf833345cd0ac4a9d202 not found: ID does not exist"
Jul 23 19:49:05.809690 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.809660    2578 scope.go:117] "RemoveContainer" containerID="3726ad72832add2933161f4c8d0b2bc36690269ac27ddf565b5958400f970eac"
Jul 23 19:49:05.809918 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:49:05.809896    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3726ad72832add2933161f4c8d0b2bc36690269ac27ddf565b5958400f970eac\": container with ID starting with 3726ad72832add2933161f4c8d0b2bc36690269ac27ddf565b5958400f970eac not found: ID does not exist" containerID="3726ad72832add2933161f4c8d0b2bc36690269ac27ddf565b5958400f970eac"
Jul 23 19:49:05.810018 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.809922    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3726ad72832add2933161f4c8d0b2bc36690269ac27ddf565b5958400f970eac"} err="failed to get container status \"3726ad72832add2933161f4c8d0b2bc36690269ac27ddf565b5958400f970eac\": rpc error: code = NotFound desc = could not find container \"3726ad72832add2933161f4c8d0b2bc36690269ac27ddf565b5958400f970eac\": container with ID starting with 3726ad72832add2933161f4c8d0b2bc36690269ac27ddf565b5958400f970eac not found: ID does not exist"
Jul 23 19:49:05.823657 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.823629    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"]
Jul 23 19:49:05.830995 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:05.830974    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-7d09e9f8-gw-openshift-default-65d87669f-5525p"]
Jul 23 19:49:07.652544 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:07.652509    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" path="/var/lib/kubelet/pods/917477ce-f2a3-4c8d-b488-cebdb0f4e4cc/volumes"
Jul 23 19:49:17.891235 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:17.891005    2578 patch_prober.go:28] interesting pod/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": read tcp 10.133.0.2:50084->10.133.0.38:15021: read: connection reset by peer" start-of-body=
Jul 23 19:49:17.891235 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:17.891073    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97" podUID="ea7e52f0-7846-416e-9a75-827a5ee7ecf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": read tcp 10.133.0.2:50084->10.133.0.38:15021: read: connection reset by peer"
Jul 23 19:49:18.855682 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:18.855646    2578 generic.go:356] "Generic (PLEG): container finished" podID="ea7e52f0-7846-416e-9a75-827a5ee7ecf4" containerID="4c4e1b2e26ecaaabeb029a271fcc619d11b870043bc9653b969eef947d79191b" exitCode=0
Jul 23 19:49:18.855852 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:18.855694    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97" event={"ID":"ea7e52f0-7846-416e-9a75-827a5ee7ecf4","Type":"ContainerDied","Data":"4c4e1b2e26ecaaabeb029a271fcc619d11b870043bc9653b969eef947d79191b"}
Jul 23 19:49:18.856029 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:18.856014    2578 scope.go:117] "RemoveContainer" containerID="4c4e1b2e26ecaaabeb029a271fcc619d11b870043bc9653b969eef947d79191b"
Jul 23 19:49:18.856966 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:18.856940    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:49:18.857032 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:18.857019    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:49:18.857067 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:18.857055    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:49:19.862030 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:19.861997    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97" event={"ID":"ea7e52f0-7846-416e-9a75-827a5ee7ecf4","Type":"ContainerStarted","Data":"5bd4f27b725e409fb138c138181e45ded916ea27bb7afea82bd7b6d885091664"}
Jul 23 19:49:20.353818 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:20.353774    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:20.354092 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:20.354062    2578 patch_prober.go:28] interesting pod/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 23 19:49:20.354176 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:20.354126    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97" podUID="ea7e52f0-7846-416e-9a75-827a5ee7ecf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 23 19:49:21.353110 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:21.353065    2578 patch_prober.go:28] interesting pod/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 23 19:49:21.353618 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:21.353136    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97" podUID="ea7e52f0-7846-416e-9a75-827a5ee7ecf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 23 19:49:22.353751 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:22.353704    2578 patch_prober.go:28] interesting pod/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 23 19:49:22.354291 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:22.353777    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97" podUID="ea7e52f0-7846-416e-9a75-827a5ee7ecf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 23 19:49:23.353652 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:23.353613    2578 patch_prober.go:28] interesting pod/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 23 19:49:23.353945 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:23.353913    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97" podUID="ea7e52f0-7846-416e-9a75-827a5ee7ecf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 23 19:49:24.356592 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:24.356563    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:24.357004 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:24.356841    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:24.357548 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:24.357527    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:45.176857 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:45.176824    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"]
Jul 23 19:49:45.177226 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:45.177024    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97" podUID="ea7e52f0-7846-416e-9a75-827a5ee7ecf4" containerName="istio-proxy" containerID="cri-o://5bd4f27b725e409fb138c138181e45ded916ea27bb7afea82bd7b6d885091664" gracePeriod=30
Jul 23 19:49:45.896176 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:45.896145    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"]
Jul 23 19:49:45.896495 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:45.896481    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" containerName="istio-proxy"
Jul 23 19:49:45.896551 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:45.896496    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" containerName="istio-proxy"
Jul 23 19:49:45.896551 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:45.896517    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" containerName="istio-proxy"
Jul 23 19:49:45.896551 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:45.896522    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" containerName="istio-proxy"
Jul 23 19:49:45.896638 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:45.896568    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="223f924f-83e4-4e35-9d8f-bb62b1631d6e" containerName="istio-proxy"
Jul 23 19:49:45.896638 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:45.896577    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" containerName="istio-proxy"
Jul 23 19:49:45.896638 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:45.896583    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="917477ce-f2a3-4c8d-b488-cebdb0f4e4cc" containerName="istio-proxy"
Jul 23 19:49:45.899542 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:45.899527    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:45.904208 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:45.904188    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f7b99782-openshift-default-dockercfg-8qsnx\""
Jul 23 19:49:45.921214 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:45.921190    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"]
Jul 23 19:49:46.045840 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.045807    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-data\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.046012 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.045849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istiod-ca-cert\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.046012 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.045875    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxkhz\" (UniqueName: \"kubernetes.io/projected/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-kube-api-access-fxkhz\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.046012 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.045921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-podinfo\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.046012 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.045946    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-token\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.046012 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.045992    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-workload-certs\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.046012 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.046010    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-workload-socket\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.046227 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.046033    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-credential-socket\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.046227 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.046105    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-envoy\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.147012 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.146937    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-envoy\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.147012 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.146976    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-data\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.147012 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.146998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istiod-ca-cert\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.147276 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.147020    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxkhz\" (UniqueName: \"kubernetes.io/projected/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-kube-api-access-fxkhz\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.147276 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.147038    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-podinfo\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.147276 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.147063    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-token\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.147276 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.147094    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-workload-certs\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.147498 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.147304    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-workload-socket\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.147498 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.147345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-credential-socket\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.147498 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.147398    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-data\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.147498 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.147455    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-workload-certs\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.147700 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.147620    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-workload-socket\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.147700 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.147683    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-credential-socket\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.147895 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.147874    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istiod-ca-cert\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.149290 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.149273    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-envoy\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.149552 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.149534    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-podinfo\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.154774 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.154749    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxkhz\" (UniqueName: \"kubernetes.io/projected/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-kube-api-access-fxkhz\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.154866 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.154809    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-token\") pod \"e2e-derive-f7b99782-openshift-default-5cf889b779-r227p\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") " pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.209428 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.209401    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:46.345033 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.345008    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"]
Jul 23 19:49:46.347589 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:49:46.347557    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cef3ae7_c4bb_4060_a6e3_adede3af1b4e.slice/crio-635f971ad6e615f8e6aab0e8778a955c6458a7f56fd5ce3af3d84211020cb997 WatchSource:0}: Error finding container 635f971ad6e615f8e6aab0e8778a955c6458a7f56fd5ce3af3d84211020cb997: Status 404 returned error can't find the container with id 635f971ad6e615f8e6aab0e8778a955c6458a7f56fd5ce3af3d84211020cb997
Jul 23 19:49:46.349887 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.349856    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:49:46.349958 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.349921    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:49:46.349958 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.349953    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:49:46.978842 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.978808    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p" event={"ID":"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e","Type":"ContainerStarted","Data":"30d861aa80e1611dd418ca069bbb796a2e0ee6a87f2b826cb51021c61818ff70"}
Jul 23 19:49:46.979007 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.978864    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p" event={"ID":"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e","Type":"ContainerStarted","Data":"635f971ad6e615f8e6aab0e8778a955c6458a7f56fd5ce3af3d84211020cb997"}
Jul 23 19:49:46.998558 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:46.998514    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p" podStartSLOduration=1.998498616 podStartE2EDuration="1.998498616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:49:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:49:46.99731055 +0000 UTC m=+1787.834317283" watchObservedRunningTime="2026-07-23 19:49:46.998498616 +0000 UTC m=+1787.835505365"
Jul 23 19:49:47.210459 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:47.210429    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:47.215106 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:47.215084    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:47.984215 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:47.984174    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:47.984994 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:47.984977    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:49:50.429625 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.429599    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:50.593488 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.593446    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istiod-ca-cert\") pod \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") "
Jul 23 19:49:50.593675 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.593524    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-envoy\") pod \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") "
Jul 23 19:49:50.593675 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.593552    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-data\") pod \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") "
Jul 23 19:49:50.593675 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.593599    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-token\") pod \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") "
Jul 23 19:49:50.593675 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.593628    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-podinfo\") pod \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") "
Jul 23 19:49:50.593675 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.593657    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-workload-certs\") pod \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") "
Jul 23 19:49:50.593925 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.593709    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-workload-socket\") pod \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") "
Jul 23 19:49:50.593925 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.593835    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-credential-socket\") pod \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") "
Jul 23 19:49:50.593925 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.593900    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pn6js\" (UniqueName: \"kubernetes.io/projected/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-kube-api-access-pn6js\") pod \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\" (UID: \"ea7e52f0-7846-416e-9a75-827a5ee7ecf4\") "
Jul 23 19:49:50.594074 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.593834    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ea7e52f0-7846-416e-9a75-827a5ee7ecf4" (UID: "ea7e52f0-7846-416e-9a75-827a5ee7ecf4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:49:50.594074 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.593966    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ea7e52f0-7846-416e-9a75-827a5ee7ecf4" (UID: "ea7e52f0-7846-416e-9a75-827a5ee7ecf4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:49:50.594074 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.593980    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ea7e52f0-7846-416e-9a75-827a5ee7ecf4" (UID: "ea7e52f0-7846-416e-9a75-827a5ee7ecf4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:49:50.594074 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.593994    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ea7e52f0-7846-416e-9a75-827a5ee7ecf4" (UID: "ea7e52f0-7846-416e-9a75-827a5ee7ecf4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:49:50.594297 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.594275    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istiod-ca-cert\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:49:50.594297 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.594296    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-workload-certs\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:49:50.594391 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.594309    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-workload-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:49:50.594391 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.594322    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-credential-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:49:50.594619 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.594602    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-data" (OuterVolumeSpecName: "istio-data") pod "ea7e52f0-7846-416e-9a75-827a5ee7ecf4" (UID: "ea7e52f0-7846-416e-9a75-827a5ee7ecf4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:49:50.596309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.596286    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ea7e52f0-7846-416e-9a75-827a5ee7ecf4" (UID: "ea7e52f0-7846-416e-9a75-827a5ee7ecf4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:49:50.596309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.596300    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ea7e52f0-7846-416e-9a75-827a5ee7ecf4" (UID: "ea7e52f0-7846-416e-9a75-827a5ee7ecf4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 19:49:50.596464 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.596311    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-token" (OuterVolumeSpecName: "istio-token") pod "ea7e52f0-7846-416e-9a75-827a5ee7ecf4" (UID: "ea7e52f0-7846-416e-9a75-827a5ee7ecf4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:49:50.596464 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.596356    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-kube-api-access-pn6js" (OuterVolumeSpecName: "kube-api-access-pn6js") pod "ea7e52f0-7846-416e-9a75-827a5ee7ecf4" (UID: "ea7e52f0-7846-416e-9a75-827a5ee7ecf4"). InnerVolumeSpecName "kube-api-access-pn6js". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:49:50.695152 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.695121    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-token\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:49:50.695152 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.695147    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-podinfo\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:49:50.695344 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.695160    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pn6js\" (UniqueName: \"kubernetes.io/projected/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-kube-api-access-pn6js\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:49:50.695344 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.695173    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-envoy\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:49:50.695344 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.695185    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea7e52f0-7846-416e-9a75-827a5ee7ecf4-istio-data\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:49:50.997405 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.997365    2578 generic.go:356] "Generic (PLEG): container finished" podID="ea7e52f0-7846-416e-9a75-827a5ee7ecf4" containerID="5bd4f27b725e409fb138c138181e45ded916ea27bb7afea82bd7b6d885091664" exitCode=0
Jul 23 19:49:50.997578 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.997421    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"
Jul 23 19:49:50.997578 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.997423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97" event={"ID":"ea7e52f0-7846-416e-9a75-827a5ee7ecf4","Type":"ContainerDied","Data":"5bd4f27b725e409fb138c138181e45ded916ea27bb7afea82bd7b6d885091664"}
Jul 23 19:49:50.997578 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.997486    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97" event={"ID":"ea7e52f0-7846-416e-9a75-827a5ee7ecf4","Type":"ContainerDied","Data":"6fe64d61e612bf69970e558498b1c29d5ff901cce382801eca32ad977f4a4244"}
Jul 23 19:49:50.997578 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:50.997516    2578 scope.go:117] "RemoveContainer" containerID="5bd4f27b725e409fb138c138181e45ded916ea27bb7afea82bd7b6d885091664"
Jul 23 19:49:51.006352 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:51.006335    2578 scope.go:117] "RemoveContainer" containerID="4c4e1b2e26ecaaabeb029a271fcc619d11b870043bc9653b969eef947d79191b"
Jul 23 19:49:51.013689 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:51.013669    2578 scope.go:117] "RemoveContainer" containerID="5bd4f27b725e409fb138c138181e45ded916ea27bb7afea82bd7b6d885091664"
Jul 23 19:49:51.013947 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:49:51.013928    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bd4f27b725e409fb138c138181e45ded916ea27bb7afea82bd7b6d885091664\": container with ID starting with 5bd4f27b725e409fb138c138181e45ded916ea27bb7afea82bd7b6d885091664 not found: ID does not exist" containerID="5bd4f27b725e409fb138c138181e45ded916ea27bb7afea82bd7b6d885091664"
Jul 23 19:49:51.014002 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:51.013956    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bd4f27b725e409fb138c138181e45ded916ea27bb7afea82bd7b6d885091664"} err="failed to get container status \"5bd4f27b725e409fb138c138181e45ded916ea27bb7afea82bd7b6d885091664\": rpc error: code = NotFound desc = could not find container \"5bd4f27b725e409fb138c138181e45ded916ea27bb7afea82bd7b6d885091664\": container with ID starting with 5bd4f27b725e409fb138c138181e45ded916ea27bb7afea82bd7b6d885091664 not found: ID does not exist"
Jul 23 19:49:51.014002 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:51.013973    2578 scope.go:117] "RemoveContainer" containerID="4c4e1b2e26ecaaabeb029a271fcc619d11b870043bc9653b969eef947d79191b"
Jul 23 19:49:51.014180 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:49:51.014161    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c4e1b2e26ecaaabeb029a271fcc619d11b870043bc9653b969eef947d79191b\": container with ID starting with 4c4e1b2e26ecaaabeb029a271fcc619d11b870043bc9653b969eef947d79191b not found: ID does not exist" containerID="4c4e1b2e26ecaaabeb029a271fcc619d11b870043bc9653b969eef947d79191b"
Jul 23 19:49:51.014225 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:51.014188    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c4e1b2e26ecaaabeb029a271fcc619d11b870043bc9653b969eef947d79191b"} err="failed to get container status \"4c4e1b2e26ecaaabeb029a271fcc619d11b870043bc9653b969eef947d79191b\": rpc error: code = NotFound desc = could not find container \"4c4e1b2e26ecaaabeb029a271fcc619d11b870043bc9653b969eef947d79191b\": container with ID starting with 4c4e1b2e26ecaaabeb029a271fcc619d11b870043bc9653b969eef947d79191b not found: ID does not exist"
Jul 23 19:49:51.023702 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:51.023682    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"]
Jul 23 19:49:51.028056 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:51.028034    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-132311c3-openshift-default-689cbbb889-7bb97"]
Jul 23 19:49:51.651734 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:49:51.651706    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea7e52f0-7846-416e-9a75-827a5ee7ecf4" path="/var/lib/kubelet/pods/ea7e52f0-7846-416e-9a75-827a5ee7ecf4/volumes"
Jul 23 19:50:02.985193 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:02.985160    2578 patch_prober.go:28] interesting pod/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 23 19:50:02.985660 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:02.985232    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p" podUID="1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 23 19:50:03.053223 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:03.053193    2578 generic.go:356] "Generic (PLEG): container finished" podID="1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" containerID="30d861aa80e1611dd418ca069bbb796a2e0ee6a87f2b826cb51021c61818ff70" exitCode=0
Jul 23 19:50:03.053367 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:03.053284    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p" event={"ID":"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e","Type":"ContainerDied","Data":"30d861aa80e1611dd418ca069bbb796a2e0ee6a87f2b826cb51021c61818ff70"}
Jul 23 19:50:03.053688 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:03.053673    2578 scope.go:117] "RemoveContainer" containerID="30d861aa80e1611dd418ca069bbb796a2e0ee6a87f2b826cb51021c61818ff70"
Jul 23 19:50:03.054610 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:03.054584    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:50:03.054669 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:03.054649    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:50:03.054703 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:03.054682    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:50:04.059688 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:04.059654    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p" event={"ID":"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e","Type":"ContainerStarted","Data":"4e553fc8c95630f43b27c29561e432b9d55cc8c4b66b8e67c948c1eeaba0b36d"}
Jul 23 19:50:04.210316 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:04.210278    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:50:04.210493 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:04.210461    2578 patch_prober.go:28] interesting pod/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 23 19:50:04.210542 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:04.210506    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p" podUID="1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 23 19:50:05.209769 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:05.209735    2578 patch_prober.go:28] interesting pod/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 23 19:50:05.210145 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:05.209789    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p" podUID="1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 23 19:50:06.209799 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:06.209763    2578 patch_prober.go:28] interesting pod/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 23 19:50:06.210204 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:06.209817    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p" podUID="1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 23 19:50:07.210673 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:07.210640    2578 patch_prober.go:28] interesting pod/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 23 19:50:07.211070 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:07.210694    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p" podUID="1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 23 19:50:08.231359 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:08.231329    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:50:08.231765 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:08.231596    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:50:08.233283 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:08.233246    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:50:28.407913 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:28.407880    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"]
Jul 23 19:50:28.408478 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:28.408134    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p" podUID="1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" containerName="istio-proxy" containerID="cri-o://4e553fc8c95630f43b27c29561e432b9d55cc8c4b66b8e67c948c1eeaba0b36d" gracePeriod=30
Jul 23 19:50:33.659617 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.659590    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:50:33.753505 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.753478    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istiod-ca-cert\") pod \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") "
Jul 23 19:50:33.753648 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.753523    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-token\") pod \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") "
Jul 23 19:50:33.753648 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.753548    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-workload-certs\") pod \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") "
Jul 23 19:50:33.753648 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.753573    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-envoy\") pod \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") "
Jul 23 19:50:33.753648 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.753603    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-workload-socket\") pod \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") "
Jul 23 19:50:33.753648 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.753622    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-podinfo\") pod \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") "
Jul 23 19:50:33.753648 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.753638    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-credential-socket\") pod \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") "
Jul 23 19:50:33.753934 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.753678    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxkhz\" (UniqueName: \"kubernetes.io/projected/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-kube-api-access-fxkhz\") pod \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") "
Jul 23 19:50:33.753934 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.753719    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-data\") pod \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\" (UID: \"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e\") "
Jul 23 19:50:33.753934 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.753795    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" (UID: "1cef3ae7-c4bb-4060-a6e3-adede3af1b4e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:50:33.754081 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.753953    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-workload-certs\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:50:33.754081 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.754011    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" (UID: "1cef3ae7-c4bb-4060-a6e3-adede3af1b4e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:50:33.754081 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.754036    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" (UID: "1cef3ae7-c4bb-4060-a6e3-adede3af1b4e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:50:33.754445 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.754419    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" (UID: "1cef3ae7-c4bb-4060-a6e3-adede3af1b4e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:50:33.754852 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.754823    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-data" (OuterVolumeSpecName: "istio-data") pod "1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" (UID: "1cef3ae7-c4bb-4060-a6e3-adede3af1b4e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:50:33.755809 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.755786    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" (UID: "1cef3ae7-c4bb-4060-a6e3-adede3af1b4e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:50:33.755904 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.755823    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" (UID: "1cef3ae7-c4bb-4060-a6e3-adede3af1b4e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 19:50:33.755904 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.755890    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-token" (OuterVolumeSpecName: "istio-token") pod "1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" (UID: "1cef3ae7-c4bb-4060-a6e3-adede3af1b4e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:50:33.755980 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.755931    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-kube-api-access-fxkhz" (OuterVolumeSpecName: "kube-api-access-fxkhz") pod "1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" (UID: "1cef3ae7-c4bb-4060-a6e3-adede3af1b4e"). InnerVolumeSpecName "kube-api-access-fxkhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:50:33.855036 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.855010    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istiod-ca-cert\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:50:33.855036 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.855035    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-token\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:50:33.855178 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.855043    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-envoy\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:50:33.855178 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.855051    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-workload-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:50:33.855178 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.855058    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-podinfo\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:50:33.855178 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.855066    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-credential-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:50:33.855178 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.855075    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxkhz\" (UniqueName: \"kubernetes.io/projected/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-kube-api-access-fxkhz\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:50:33.855178 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:33.855083    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e-istio-data\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:50:34.191636 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:34.191549    2578 generic.go:356] "Generic (PLEG): container finished" podID="1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" containerID="4e553fc8c95630f43b27c29561e432b9d55cc8c4b66b8e67c948c1eeaba0b36d" exitCode=0
Jul 23 19:50:34.191636 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:34.191594    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"
Jul 23 19:50:34.191636 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:34.191618    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p" event={"ID":"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e","Type":"ContainerDied","Data":"4e553fc8c95630f43b27c29561e432b9d55cc8c4b66b8e67c948c1eeaba0b36d"}
Jul 23 19:50:34.191917 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:34.191674    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p" event={"ID":"1cef3ae7-c4bb-4060-a6e3-adede3af1b4e","Type":"ContainerDied","Data":"635f971ad6e615f8e6aab0e8778a955c6458a7f56fd5ce3af3d84211020cb997"}
Jul 23 19:50:34.191917 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:34.191702    2578 scope.go:117] "RemoveContainer" containerID="4e553fc8c95630f43b27c29561e432b9d55cc8c4b66b8e67c948c1eeaba0b36d"
Jul 23 19:50:34.200982 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:34.200965    2578 scope.go:117] "RemoveContainer" containerID="30d861aa80e1611dd418ca069bbb796a2e0ee6a87f2b826cb51021c61818ff70"
Jul 23 19:50:34.208397 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:34.208380    2578 scope.go:117] "RemoveContainer" containerID="4e553fc8c95630f43b27c29561e432b9d55cc8c4b66b8e67c948c1eeaba0b36d"
Jul 23 19:50:34.208613 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:50:34.208593    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e553fc8c95630f43b27c29561e432b9d55cc8c4b66b8e67c948c1eeaba0b36d\": container with ID starting with 4e553fc8c95630f43b27c29561e432b9d55cc8c4b66b8e67c948c1eeaba0b36d not found: ID does not exist" containerID="4e553fc8c95630f43b27c29561e432b9d55cc8c4b66b8e67c948c1eeaba0b36d"
Jul 23 19:50:34.208682 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:34.208624    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e553fc8c95630f43b27c29561e432b9d55cc8c4b66b8e67c948c1eeaba0b36d"} err="failed to get container status \"4e553fc8c95630f43b27c29561e432b9d55cc8c4b66b8e67c948c1eeaba0b36d\": rpc error: code = NotFound desc = could not find container \"4e553fc8c95630f43b27c29561e432b9d55cc8c4b66b8e67c948c1eeaba0b36d\": container with ID starting with 4e553fc8c95630f43b27c29561e432b9d55cc8c4b66b8e67c948c1eeaba0b36d not found: ID does not exist"
Jul 23 19:50:34.208682 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:34.208649    2578 scope.go:117] "RemoveContainer" containerID="30d861aa80e1611dd418ca069bbb796a2e0ee6a87f2b826cb51021c61818ff70"
Jul 23 19:50:34.208882 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:50:34.208866    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30d861aa80e1611dd418ca069bbb796a2e0ee6a87f2b826cb51021c61818ff70\": container with ID starting with 30d861aa80e1611dd418ca069bbb796a2e0ee6a87f2b826cb51021c61818ff70 not found: ID does not exist" containerID="30d861aa80e1611dd418ca069bbb796a2e0ee6a87f2b826cb51021c61818ff70"
Jul 23 19:50:34.208920 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:34.208889    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d861aa80e1611dd418ca069bbb796a2e0ee6a87f2b826cb51021c61818ff70"} err="failed to get container status \"30d861aa80e1611dd418ca069bbb796a2e0ee6a87f2b826cb51021c61818ff70\": rpc error: code = NotFound desc = could not find container \"30d861aa80e1611dd418ca069bbb796a2e0ee6a87f2b826cb51021c61818ff70\": container with ID starting with 30d861aa80e1611dd418ca069bbb796a2e0ee6a87f2b826cb51021c61818ff70 not found: ID does not exist"
Jul 23 19:50:34.212125 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:34.212104    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"]
Jul 23 19:50:34.216276 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:34.216239    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f7b99782-openshift-default-5cf889b779-r227p"]
Jul 23 19:50:35.652073 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:50:35.652036    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" path="/var/lib/kubelet/pods/1cef3ae7-c4bb-4060-a6e3-adede3af1b4e/volumes"
Jul 23 19:52:05.566922 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.566892    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"]
Jul 23 19:52:05.567395 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.567216    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea7e52f0-7846-416e-9a75-827a5ee7ecf4" containerName="istio-proxy"
Jul 23 19:52:05.567395 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.567227    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea7e52f0-7846-416e-9a75-827a5ee7ecf4" containerName="istio-proxy"
Jul 23 19:52:05.567395 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.567264    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" containerName="istio-proxy"
Jul 23 19:52:05.567395 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.567269    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" containerName="istio-proxy"
Jul 23 19:52:05.567395 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.567280    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" containerName="istio-proxy"
Jul 23 19:52:05.567395 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.567286    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" containerName="istio-proxy"
Jul 23 19:52:05.567395 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.567334    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea7e52f0-7846-416e-9a75-827a5ee7ecf4" containerName="istio-proxy"
Jul 23 19:52:05.567395 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.567341    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea7e52f0-7846-416e-9a75-827a5ee7ecf4" containerName="istio-proxy"
Jul 23 19:52:05.567395 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.567348    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" containerName="istio-proxy"
Jul 23 19:52:05.570120 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.570099    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.572569 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.572554    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-536fc4c1-openshift-default-dockercfg-gcsv8\""
Jul 23 19:52:05.593558 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.593533    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"]
Jul 23 19:52:05.688638 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.688600    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/699f03d3-243e-4be2-9724-ef5aaa3497d3-istiod-ca-cert\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.688826 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.688670    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-workload-socket\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.688826 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.688721    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-data\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.688826 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.688752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-token\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.688826 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.688797    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-workload-certs\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.688826 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.688819    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-envoy\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.689056 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.688862    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd8x6\" (UniqueName: \"kubernetes.io/projected/699f03d3-243e-4be2-9724-ef5aaa3497d3-kube-api-access-sd8x6\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.689056 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.688905    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-podinfo\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.689056 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.688943    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-credential-socket\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.790108 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.790072    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd8x6\" (UniqueName: \"kubernetes.io/projected/699f03d3-243e-4be2-9724-ef5aaa3497d3-kube-api-access-sd8x6\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.790309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.790118    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-podinfo\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.790309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.790149    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-credential-socket\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.790309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.790182    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/699f03d3-243e-4be2-9724-ef5aaa3497d3-istiod-ca-cert\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.790309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.790245    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-workload-socket\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.790309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.790296    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-data\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.790573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.790327    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-token\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.790573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.790352    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-workload-certs\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.790573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.790372    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-envoy\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.790746 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.790650    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-workload-socket\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.790802 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.790738    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-data\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.790852 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.790786    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-workload-certs\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.790978 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.790957    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-credential-socket\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.791039 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.790999    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/699f03d3-243e-4be2-9724-ef5aaa3497d3-istiod-ca-cert\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.792620 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.792601    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-envoy\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.792724 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.792707    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-podinfo\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.797780 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.797763    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd8x6\" (UniqueName: \"kubernetes.io/projected/699f03d3-243e-4be2-9724-ef5aaa3497d3-kube-api-access-sd8x6\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.797889 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.797874    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-token\") pod \"e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") " pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:05.881174 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:05.881109    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:06.014759 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:06.014731    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"]
Jul 23 19:52:06.015999 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:52:06.015971    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod699f03d3_243e_4be2_9724_ef5aaa3497d3.slice/crio-5074c19611b59f89d67a1a15b1ce0f859249a2667d88caee3674e8f1638648a2 WatchSource:0}: Error finding container 5074c19611b59f89d67a1a15b1ce0f859249a2667d88caee3674e8f1638648a2: Status 404 returned error can't find the container with id 5074c19611b59f89d67a1a15b1ce0f859249a2667d88caee3674e8f1638648a2
Jul 23 19:52:06.018118 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:06.018084    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:52:06.018215 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:06.018146    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:52:06.018215 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:06.018176    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:52:06.584639 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:06.584610    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m" event={"ID":"699f03d3-243e-4be2-9724-ef5aaa3497d3","Type":"ContainerStarted","Data":"94b93f08b3abd16b1af757aca82f4f54d189c025fc0e72a98cbf13b1c4c9fd22"}
Jul 23 19:52:06.584992 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:06.584656    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m" event={"ID":"699f03d3-243e-4be2-9724-ef5aaa3497d3","Type":"ContainerStarted","Data":"5074c19611b59f89d67a1a15b1ce0f859249a2667d88caee3674e8f1638648a2"}
Jul 23 19:52:06.604326 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:06.604283    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m" podStartSLOduration=1.604266914 podStartE2EDuration="1.604266914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:52:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:52:06.602506432 +0000 UTC m=+1927.439513155" watchObservedRunningTime="2026-07-23 19:52:06.604266914 +0000 UTC m=+1927.441273610"
Jul 23 19:52:06.881457 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:06.881363    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:07.886267 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:07.886215    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:08.589981 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:08.589950    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"]
Jul 23 19:52:08.590335 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:08.590321    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea7e52f0-7846-416e-9a75-827a5ee7ecf4" containerName="istio-proxy"
Jul 23 19:52:08.590389 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:08.590337    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea7e52f0-7846-416e-9a75-827a5ee7ecf4" containerName="istio-proxy"
Jul 23 19:52:08.590389 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:08.590383    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cef3ae7-c4bb-4060-a6e3-adede3af1b4e" containerName="istio-proxy"
Jul 23 19:52:08.593633 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:08.593598    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:08.593766 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:08.593690    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"
Jul 23 19:52:08.594796 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:08.594778    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:08.596021 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:08.596005    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-536fc4c1-serving-cert\""
Jul 23 19:52:08.607756 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:08.607730    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"]
Jul 23 19:52:08.713835 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:08.713790    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29b09b9-3138-499e-8e6b-75115a64fdfd-openshift-service-ca\") pod \"maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r\" (UID: \"b29b09b9-3138-499e-8e6b-75115a64fdfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"
Jul 23 19:52:08.713835 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:08.713833    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbrp4\" (UniqueName: \"kubernetes.io/projected/b29b09b9-3138-499e-8e6b-75115a64fdfd-kube-api-access-tbrp4\") pod \"maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r\" (UID: \"b29b09b9-3138-499e-8e6b-75115a64fdfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"
Jul 23 19:52:08.714070 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:08.713931    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29b09b9-3138-499e-8e6b-75115a64fdfd-maas-api-tls\") pod \"maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r\" (UID: \"b29b09b9-3138-499e-8e6b-75115a64fdfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"
Jul 23 19:52:08.814993 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:08.814954    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29b09b9-3138-499e-8e6b-75115a64fdfd-openshift-service-ca\") pod \"maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r\" (UID: \"b29b09b9-3138-499e-8e6b-75115a64fdfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"
Jul 23 19:52:08.814993 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:08.814992    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbrp4\" (UniqueName: \"kubernetes.io/projected/b29b09b9-3138-499e-8e6b-75115a64fdfd-kube-api-access-tbrp4\") pod \"maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r\" (UID: \"b29b09b9-3138-499e-8e6b-75115a64fdfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"
Jul 23 19:52:08.815297 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:08.815271    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29b09b9-3138-499e-8e6b-75115a64fdfd-maas-api-tls\") pod \"maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r\" (UID: \"b29b09b9-3138-499e-8e6b-75115a64fdfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"
Jul 23 19:52:08.815380 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:52:08.815328    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-serving-cert: secret "maas-api-e2e-mt-536fc4c1-serving-cert" not found
Jul 23 19:52:08.815421 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:52:08.815389    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b29b09b9-3138-499e-8e6b-75115a64fdfd-maas-api-tls podName:b29b09b9-3138-499e-8e6b-75115a64fdfd nodeName:}" failed. No retries permitted until 2026-07-23 19:52:09.315371218 +0000 UTC m=+1930.152377902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b29b09b9-3138-499e-8e6b-75115a64fdfd-maas-api-tls") pod "maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r" (UID: "b29b09b9-3138-499e-8e6b-75115a64fdfd") : secret "maas-api-e2e-mt-536fc4c1-serving-cert" not found
Jul 23 19:52:08.815750 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:08.815732    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29b09b9-3138-499e-8e6b-75115a64fdfd-openshift-service-ca\") pod \"maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r\" (UID: \"b29b09b9-3138-499e-8e6b-75115a64fdfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"
Jul 23 19:52:08.825702 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:08.825677    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbrp4\" (UniqueName: \"kubernetes.io/projected/b29b09b9-3138-499e-8e6b-75115a64fdfd-kube-api-access-tbrp4\") pod \"maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r\" (UID: \"b29b09b9-3138-499e-8e6b-75115a64fdfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"
Jul 23 19:52:09.319711 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:09.319668    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29b09b9-3138-499e-8e6b-75115a64fdfd-maas-api-tls\") pod \"maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r\" (UID: \"b29b09b9-3138-499e-8e6b-75115a64fdfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"
Jul 23 19:52:09.322129 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:09.322107    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29b09b9-3138-499e-8e6b-75115a64fdfd-maas-api-tls\") pod \"maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r\" (UID: \"b29b09b9-3138-499e-8e6b-75115a64fdfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"
Jul 23 19:52:09.507655 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:09.507621    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"
Jul 23 19:52:09.862685 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:09.862604    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"]
Jul 23 19:52:09.865738 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:52:09.865706    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29b09b9_3138_499e_8e6b_75115a64fdfd.slice/crio-38306b9a58e2ad3282f915e5d4ee4798b8837104d58982c4ac9d91d9f134de06 WatchSource:0}: Error finding container 38306b9a58e2ad3282f915e5d4ee4798b8837104d58982c4ac9d91d9f134de06: Status 404 returned error can't find the container with id 38306b9a58e2ad3282f915e5d4ee4798b8837104d58982c4ac9d91d9f134de06
Jul 23 19:52:09.867160 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:09.867140    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 19:52:10.602672 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:10.602619    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r" event={"ID":"b29b09b9-3138-499e-8e6b-75115a64fdfd","Type":"ContainerStarted","Data":"fa340c74c05ab3ab7ec0c68700817a4f9884825ee50aa514f4a1462a351fce20"}
Jul 23 19:52:10.603044 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:10.602703    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r" event={"ID":"b29b09b9-3138-499e-8e6b-75115a64fdfd","Type":"ContainerStarted","Data":"38306b9a58e2ad3282f915e5d4ee4798b8837104d58982c4ac9d91d9f134de06"}
Jul 23 19:52:10.603044 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:10.602903    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"
Jul 23 19:52:10.619807 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:10.619766    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r" podStartSLOduration=2.112136979 podStartE2EDuration="2.619752696s" totalImagesPullingTime="507.615717ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:52:10.618529826 +0000 UTC m=+1931.455536534" watchObservedRunningTime="2026-07-23 19:52:10.619752696 +0000 UTC m=+1931.456759401"
Jul 23 19:52:16.612493 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:16.612459    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"
Jul 23 19:52:20.862306 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:52:20.860229    2578 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/system-systemd\\\\x2dcoredump.slice/systemd-coredump@4-23396-0.service\": RecentStats: unable to find data in memory cache]"
Jul 23 19:52:21.653920 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:21.653884    2578 generic.go:356] "Generic (PLEG): container finished" podID="699f03d3-243e-4be2-9724-ef5aaa3497d3" containerID="94b93f08b3abd16b1af757aca82f4f54d189c025fc0e72a98cbf13b1c4c9fd22" exitCode=0
Jul 23 19:52:21.654082 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:21.653948    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m" event={"ID":"699f03d3-243e-4be2-9724-ef5aaa3497d3","Type":"ContainerDied","Data":"94b93f08b3abd16b1af757aca82f4f54d189c025fc0e72a98cbf13b1c4c9fd22"}
Jul 23 19:52:21.654295 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:21.654281    2578 scope.go:117] "RemoveContainer" containerID="94b93f08b3abd16b1af757aca82f4f54d189c025fc0e72a98cbf13b1c4c9fd22"
Jul 23 19:52:21.655271 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:21.655231    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:52:21.655353 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:21.655308    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:52:21.655353 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:21.655338    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:52:22.663268 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:22.663204    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m" event={"ID":"699f03d3-243e-4be2-9724-ef5aaa3497d3","Type":"ContainerStarted","Data":"e9fe65ff97b9a1730401f17b3c559e9a40263b86887b1a6fbfce66f26d04f0be"}
Jul 23 19:52:22.881625 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:22.881585    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:22.882912 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:22.882882    2578 patch_prober.go:28] interesting pod/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 23 19:52:22.883054 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:22.882939    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m" podUID="699f03d3-243e-4be2-9724-ef5aaa3497d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 23 19:52:23.594474 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:23.594427    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:23.882009 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:23.881919    2578 patch_prober.go:28] interesting pod/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 23 19:52:23.882009 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:23.881990    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m" podUID="699f03d3-243e-4be2-9724-ef5aaa3497d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 23 19:52:24.881559 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:24.881523    2578 patch_prober.go:28] interesting pod/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 23 19:52:24.881727 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:24.881582    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m" podUID="699f03d3-243e-4be2-9724-ef5aaa3497d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 23 19:52:25.882140 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:25.882104    2578 patch_prober.go:28] interesting pod/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 23 19:52:25.882640 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:25.882162    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m" podUID="699f03d3-243e-4be2-9724-ef5aaa3497d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 23 19:52:26.885532 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:26.885503    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:26.886398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:26.886377    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:30.701321 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:30.701287    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"]
Jul 23 19:52:30.701733 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:30.701554    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r" podUID="b29b09b9-3138-499e-8e6b-75115a64fdfd" containerName="maas-api" containerID="cri-o://fa340c74c05ab3ab7ec0c68700817a4f9884825ee50aa514f4a1462a351fce20" gracePeriod=30
Jul 23 19:52:30.945667 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:30.945645    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"
Jul 23 19:52:31.003816 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:31.003792    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29b09b9-3138-499e-8e6b-75115a64fdfd-openshift-service-ca\") pod \"b29b09b9-3138-499e-8e6b-75115a64fdfd\" (UID: \"b29b09b9-3138-499e-8e6b-75115a64fdfd\") "
Jul 23 19:52:31.003946 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:31.003832    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29b09b9-3138-499e-8e6b-75115a64fdfd-maas-api-tls\") pod \"b29b09b9-3138-499e-8e6b-75115a64fdfd\" (UID: \"b29b09b9-3138-499e-8e6b-75115a64fdfd\") "
Jul 23 19:52:31.003946 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:31.003871    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbrp4\" (UniqueName: \"kubernetes.io/projected/b29b09b9-3138-499e-8e6b-75115a64fdfd-kube-api-access-tbrp4\") pod \"b29b09b9-3138-499e-8e6b-75115a64fdfd\" (UID: \"b29b09b9-3138-499e-8e6b-75115a64fdfd\") "
Jul 23 19:52:31.004136 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:31.004115    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b29b09b9-3138-499e-8e6b-75115a64fdfd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b29b09b9-3138-499e-8e6b-75115a64fdfd" (UID: "b29b09b9-3138-499e-8e6b-75115a64fdfd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:52:31.006041 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:31.006016    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b29b09b9-3138-499e-8e6b-75115a64fdfd-kube-api-access-tbrp4" (OuterVolumeSpecName: "kube-api-access-tbrp4") pod "b29b09b9-3138-499e-8e6b-75115a64fdfd" (UID: "b29b09b9-3138-499e-8e6b-75115a64fdfd"). InnerVolumeSpecName "kube-api-access-tbrp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:52:31.006147 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:31.006035    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b29b09b9-3138-499e-8e6b-75115a64fdfd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b29b09b9-3138-499e-8e6b-75115a64fdfd" (UID: "b29b09b9-3138-499e-8e6b-75115a64fdfd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:52:31.105014 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:31.104991    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b29b09b9-3138-499e-8e6b-75115a64fdfd-openshift-service-ca\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:52:31.105014 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:31.105013    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b29b09b9-3138-499e-8e6b-75115a64fdfd-maas-api-tls\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:52:31.105150 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:31.105023    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbrp4\" (UniqueName: \"kubernetes.io/projected/b29b09b9-3138-499e-8e6b-75115a64fdfd-kube-api-access-tbrp4\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:52:31.701264 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:31.701212    2578 generic.go:356] "Generic (PLEG): container finished" podID="b29b09b9-3138-499e-8e6b-75115a64fdfd" containerID="fa340c74c05ab3ab7ec0c68700817a4f9884825ee50aa514f4a1462a351fce20" exitCode=0
Jul 23 19:52:31.701428 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:31.701277    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"
Jul 23 19:52:31.701428 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:31.701293    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r" event={"ID":"b29b09b9-3138-499e-8e6b-75115a64fdfd","Type":"ContainerDied","Data":"fa340c74c05ab3ab7ec0c68700817a4f9884825ee50aa514f4a1462a351fce20"}
Jul 23 19:52:31.701428 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:31.701340    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r" event={"ID":"b29b09b9-3138-499e-8e6b-75115a64fdfd","Type":"ContainerDied","Data":"38306b9a58e2ad3282f915e5d4ee4798b8837104d58982c4ac9d91d9f134de06"}
Jul 23 19:52:31.701428 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:31.701369    2578 scope.go:117] "RemoveContainer" containerID="fa340c74c05ab3ab7ec0c68700817a4f9884825ee50aa514f4a1462a351fce20"
Jul 23 19:52:31.709293 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:31.709111    2578 scope.go:117] "RemoveContainer" containerID="fa340c74c05ab3ab7ec0c68700817a4f9884825ee50aa514f4a1462a351fce20"
Jul 23 19:52:31.709393 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:52:31.709376    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa340c74c05ab3ab7ec0c68700817a4f9884825ee50aa514f4a1462a351fce20\": container with ID starting with fa340c74c05ab3ab7ec0c68700817a4f9884825ee50aa514f4a1462a351fce20 not found: ID does not exist" containerID="fa340c74c05ab3ab7ec0c68700817a4f9884825ee50aa514f4a1462a351fce20"
Jul 23 19:52:31.709454 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:31.709421    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa340c74c05ab3ab7ec0c68700817a4f9884825ee50aa514f4a1462a351fce20"} err="failed to get container status \"fa340c74c05ab3ab7ec0c68700817a4f9884825ee50aa514f4a1462a351fce20\": rpc error: code = NotFound desc = could not find container \"fa340c74c05ab3ab7ec0c68700817a4f9884825ee50aa514f4a1462a351fce20\": container with ID starting with fa340c74c05ab3ab7ec0c68700817a4f9884825ee50aa514f4a1462a351fce20 not found: ID does not exist"
Jul 23 19:52:31.716511 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:31.716489    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"]
Jul 23 19:52:31.722295 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:31.722274    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-536fc4c1-5c57755596-pkr8r"]
Jul 23 19:52:33.651953 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:33.651923    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b29b09b9-3138-499e-8e6b-75115a64fdfd" path="/var/lib/kubelet/pods/b29b09b9-3138-499e-8e6b-75115a64fdfd/volumes"
Jul 23 19:52:41.629511 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:41.629475    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"]
Jul 23 19:52:41.630006 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:41.629680    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m" podUID="699f03d3-243e-4be2-9724-ef5aaa3497d3" containerName="istio-proxy" containerID="cri-o://e9fe65ff97b9a1730401f17b3c559e9a40263b86887b1a6fbfce66f26d04f0be" gracePeriod=30
Jul 23 19:52:41.888618 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:41.888535    2578 patch_prober.go:28] interesting pod/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 23 19:52:41.888618 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:41.888604    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m" podUID="699f03d3-243e-4be2-9724-ef5aaa3497d3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 19:52:46.766417 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.766385    2578 generic.go:356] "Generic (PLEG): container finished" podID="699f03d3-243e-4be2-9724-ef5aaa3497d3" containerID="e9fe65ff97b9a1730401f17b3c559e9a40263b86887b1a6fbfce66f26d04f0be" exitCode=0
Jul 23 19:52:46.766797 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.766482    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m" event={"ID":"699f03d3-243e-4be2-9724-ef5aaa3497d3","Type":"ContainerDied","Data":"e9fe65ff97b9a1730401f17b3c559e9a40263b86887b1a6fbfce66f26d04f0be"}
Jul 23 19:52:46.766797 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.766575    2578 scope.go:117] "RemoveContainer" containerID="94b93f08b3abd16b1af757aca82f4f54d189c025fc0e72a98cbf13b1c4c9fd22"
Jul 23 19:52:46.881787 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.881763    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:46.934913 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.934836    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-podinfo\") pod \"699f03d3-243e-4be2-9724-ef5aaa3497d3\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") "
Jul 23 19:52:46.934913 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.934879    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/699f03d3-243e-4be2-9724-ef5aaa3497d3-istiod-ca-cert\") pod \"699f03d3-243e-4be2-9724-ef5aaa3497d3\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") "
Jul 23 19:52:46.934913 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.934905    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-envoy\") pod \"699f03d3-243e-4be2-9724-ef5aaa3497d3\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") "
Jul 23 19:52:46.935245 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.934949    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-token\") pod \"699f03d3-243e-4be2-9724-ef5aaa3497d3\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") "
Jul 23 19:52:46.935245 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.935001    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-workload-certs\") pod \"699f03d3-243e-4be2-9724-ef5aaa3497d3\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") "
Jul 23 19:52:46.935245 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.935028    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd8x6\" (UniqueName: \"kubernetes.io/projected/699f03d3-243e-4be2-9724-ef5aaa3497d3-kube-api-access-sd8x6\") pod \"699f03d3-243e-4be2-9724-ef5aaa3497d3\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") "
Jul 23 19:52:46.935245 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.935057    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-data\") pod \"699f03d3-243e-4be2-9724-ef5aaa3497d3\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") "
Jul 23 19:52:46.935245 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.935082    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-credential-socket\") pod \"699f03d3-243e-4be2-9724-ef5aaa3497d3\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") "
Jul 23 19:52:46.935245 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.935124    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-workload-socket\") pod \"699f03d3-243e-4be2-9724-ef5aaa3497d3\" (UID: \"699f03d3-243e-4be2-9724-ef5aaa3497d3\") "
Jul 23 19:52:46.935635 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.935606    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "699f03d3-243e-4be2-9724-ef5aaa3497d3" (UID: "699f03d3-243e-4be2-9724-ef5aaa3497d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:52:46.935715 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.935674    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "699f03d3-243e-4be2-9724-ef5aaa3497d3" (UID: "699f03d3-243e-4be2-9724-ef5aaa3497d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:52:46.935791 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.935771    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "699f03d3-243e-4be2-9724-ef5aaa3497d3" (UID: "699f03d3-243e-4be2-9724-ef5aaa3497d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:52:46.935936 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.935801    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/699f03d3-243e-4be2-9724-ef5aaa3497d3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "699f03d3-243e-4be2-9724-ef5aaa3497d3" (UID: "699f03d3-243e-4be2-9724-ef5aaa3497d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:52:46.936358 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.936333    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-data" (OuterVolumeSpecName: "istio-data") pod "699f03d3-243e-4be2-9724-ef5aaa3497d3" (UID: "699f03d3-243e-4be2-9724-ef5aaa3497d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:52:46.937330 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.937303    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-token" (OuterVolumeSpecName: "istio-token") pod "699f03d3-243e-4be2-9724-ef5aaa3497d3" (UID: "699f03d3-243e-4be2-9724-ef5aaa3497d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:52:46.937555 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.937528    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/699f03d3-243e-4be2-9724-ef5aaa3497d3-kube-api-access-sd8x6" (OuterVolumeSpecName: "kube-api-access-sd8x6") pod "699f03d3-243e-4be2-9724-ef5aaa3497d3" (UID: "699f03d3-243e-4be2-9724-ef5aaa3497d3"). InnerVolumeSpecName "kube-api-access-sd8x6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:52:46.937642 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.937593    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "699f03d3-243e-4be2-9724-ef5aaa3497d3" (UID: "699f03d3-243e-4be2-9724-ef5aaa3497d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:52:46.937758 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:46.937731    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "699f03d3-243e-4be2-9724-ef5aaa3497d3" (UID: "699f03d3-243e-4be2-9724-ef5aaa3497d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 19:52:47.036660 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:47.036631    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-podinfo\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:52:47.036660 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:47.036657    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/699f03d3-243e-4be2-9724-ef5aaa3497d3-istiod-ca-cert\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:52:47.036660 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:47.036666    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-envoy\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:52:47.036867 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:47.036675    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-token\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:52:47.036867 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:47.036695    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-workload-certs\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:52:47.036867 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:47.036703    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd8x6\" (UniqueName: \"kubernetes.io/projected/699f03d3-243e-4be2-9724-ef5aaa3497d3-kube-api-access-sd8x6\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:52:47.036867 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:47.036714    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-istio-data\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:52:47.036867 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:47.036730    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-credential-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:52:47.036867 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:47.036738    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/699f03d3-243e-4be2-9724-ef5aaa3497d3-workload-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:52:47.772416 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:47.772388    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"
Jul 23 19:52:47.772416 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:47.772397    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m" event={"ID":"699f03d3-243e-4be2-9724-ef5aaa3497d3","Type":"ContainerDied","Data":"5074c19611b59f89d67a1a15b1ce0f859249a2667d88caee3674e8f1638648a2"}
Jul 23 19:52:47.772957 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:47.772449    2578 scope.go:117] "RemoveContainer" containerID="e9fe65ff97b9a1730401f17b3c559e9a40263b86887b1a6fbfce66f26d04f0be"
Jul 23 19:52:47.790791 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:47.790763    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"]
Jul 23 19:52:47.795000 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:47.794978    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-536fc4c1-openshift-default-659ddbb595-csq2m"]
Jul 23 19:52:49.651643 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:52:49.651608    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="699f03d3-243e-4be2-9724-ef5aaa3497d3" path="/var/lib/kubelet/pods/699f03d3-243e-4be2-9724-ef5aaa3497d3/volumes"
Jul 23 19:53:01.654207 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.654167    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"]
Jul 23 19:53:01.654686 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.654629    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b29b09b9-3138-499e-8e6b-75115a64fdfd" containerName="maas-api"
Jul 23 19:53:01.654686 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.654648    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b29b09b9-3138-499e-8e6b-75115a64fdfd" containerName="maas-api"
Jul 23 19:53:01.654686 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.654663    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="699f03d3-243e-4be2-9724-ef5aaa3497d3" containerName="istio-proxy"
Jul 23 19:53:01.654686 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.654671    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="699f03d3-243e-4be2-9724-ef5aaa3497d3" containerName="istio-proxy"
Jul 23 19:53:01.654686 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.654682    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="699f03d3-243e-4be2-9724-ef5aaa3497d3" containerName="istio-proxy"
Jul 23 19:53:01.654939 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.654690    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="699f03d3-243e-4be2-9724-ef5aaa3497d3" containerName="istio-proxy"
Jul 23 19:53:01.654939 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.654771    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="699f03d3-243e-4be2-9724-ef5aaa3497d3" containerName="istio-proxy"
Jul 23 19:53:01.654939 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.654783    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b29b09b9-3138-499e-8e6b-75115a64fdfd" containerName="maas-api"
Jul 23 19:53:01.654939 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.654794    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="699f03d3-243e-4be2-9724-ef5aaa3497d3" containerName="istio-proxy"
Jul 23 19:53:01.659335 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.659314    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.662004 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.661986    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9051a48a-openshift-default-dockercfg-hpsx2\""
Jul 23 19:53:01.669808 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.669781    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"]
Jul 23 19:53:01.763189 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.763099    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5190001c-f7ba-4480-9f52-d5365fc25f90-istiod-ca-cert\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.763393 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.763201    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-credential-socket\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.763393 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.763301    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-token\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.763393 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.763378    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-workload-socket\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.763541 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.763415    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-workload-certs\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.763541 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.763497    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-data\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.763541 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.763525    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-podinfo\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.763650 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.763550    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsxzj\" (UniqueName: \"kubernetes.io/projected/5190001c-f7ba-4480-9f52-d5365fc25f90-kube-api-access-gsxzj\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.763650 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.763584    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-envoy\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.864945 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.864904    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-data\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.864945 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.864943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-podinfo\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.865157 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.864959    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsxzj\" (UniqueName: \"kubernetes.io/projected/5190001c-f7ba-4480-9f52-d5365fc25f90-kube-api-access-gsxzj\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.865157 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.864987    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-envoy\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.865157 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.865021    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5190001c-f7ba-4480-9f52-d5365fc25f90-istiod-ca-cert\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.865381 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.865192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-credential-socket\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.865381 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.865300    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-token\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.865381 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.865377    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-workload-socket\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.865543 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.865409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-workload-certs\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.865543 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.865468    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-data\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.865657 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.865570    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-credential-socket\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.865751 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.865716    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-workload-certs\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.865819 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.865777    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-workload-socket\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.865819 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.865804    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5190001c-f7ba-4480-9f52-d5365fc25f90-istiod-ca-cert\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.867408 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.867383    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-envoy\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.867742 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.867721    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-podinfo\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.873086 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.873060    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-token\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.873203 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.873188    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsxzj\" (UniqueName: \"kubernetes.io/projected/5190001c-f7ba-4480-9f52-d5365fc25f90-kube-api-access-gsxzj\") pod \"e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") " pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:01.970347 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:01.970308    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:02.109392 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:02.109368    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"]
Jul 23 19:53:02.111647 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:53:02.111615    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5190001c_f7ba_4480_9f52_d5365fc25f90.slice/crio-e3bcca440119fe7411729a98cfadf59b6078680cc0a6803f88720c598bd638f9 WatchSource:0}: Error finding container e3bcca440119fe7411729a98cfadf59b6078680cc0a6803f88720c598bd638f9: Status 404 returned error can't find the container with id e3bcca440119fe7411729a98cfadf59b6078680cc0a6803f88720c598bd638f9
Jul 23 19:53:02.113643 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:02.113612    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:53:02.113746 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:02.113672    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:53:02.113746 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:02.113701    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:53:02.837633 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:02.837593    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm" event={"ID":"5190001c-f7ba-4480-9f52-d5365fc25f90","Type":"ContainerStarted","Data":"a8a52b574556830dfad1f0a8fc2cff299e8d8a1f9fa0512f41013d66ed56f244"}
Jul 23 19:53:02.838084 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:02.837658    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm" event={"ID":"5190001c-f7ba-4480-9f52-d5365fc25f90","Type":"ContainerStarted","Data":"e3bcca440119fe7411729a98cfadf59b6078680cc0a6803f88720c598bd638f9"}
Jul 23 19:53:02.858203 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:02.858158    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm" podStartSLOduration=1.85814309 podStartE2EDuration="1.85814309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:53:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:53:02.85652865 +0000 UTC m=+1983.693535369" watchObservedRunningTime="2026-07-23 19:53:02.85814309 +0000 UTC m=+1983.695149796"
Jul 23 19:53:02.970875 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:02.970841    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:03.975816 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:03.975784    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:04.847012 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:04.846976    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:04.848518 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:04.848482    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:13.924760 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:13.924721    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"]
Jul 23 19:53:13.927867 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:13.927849    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:13.931465 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:13.931442    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9051a48a\"/\"e2e-lifecycle-model-9051a48a-kserve-self-signed-certs\""
Jul 23 19:53:13.931570 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:13.931493    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9051a48a\"/\"openshift-service-ca.crt\""
Jul 23 19:53:13.931570 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:13.931533    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9051a48a\"/\"kube-root-ca.crt\""
Jul 23 19:53:13.931570 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:13.931545    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9051a48a\"/\"default-dockercfg-w78zr\""
Jul 23 19:53:13.943174 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:13.943150    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"]
Jul 23 19:53:13.971657 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:13.971633    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-model-cache\") pod \"e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") " pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:13.971781 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:13.971667    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5b13d2-97de-4095-b443-3067be43960c-tls-certs\") pod \"e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") " pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:13.971781 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:13.971688    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-tmp-dir\") pod \"e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") " pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:13.971781 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:13.971727    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-home\") pod \"e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") " pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:13.971781 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:13.971749    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-dshm\") pod \"e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") " pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:13.971933 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:13.971780    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mxwg\" (UniqueName: \"kubernetes.io/projected/ee5b13d2-97de-4095-b443-3067be43960c-kube-api-access-2mxwg\") pod \"e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") " pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:14.072593 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:14.072561    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-home\") pod \"e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") " pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:14.072808 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:14.072794    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-dshm\") pod \"e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") " pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:14.072922 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:14.072910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mxwg\" (UniqueName: \"kubernetes.io/projected/ee5b13d2-97de-4095-b443-3067be43960c-kube-api-access-2mxwg\") pod \"e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") " pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:14.073028 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:14.073017    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-model-cache\") pod \"e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") " pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:14.073114 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:14.073105    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5b13d2-97de-4095-b443-3067be43960c-tls-certs\") pod \"e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") " pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:14.073201 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:14.073192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-tmp-dir\") pod \"e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") " pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:14.073707 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:14.073691    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-tmp-dir\") pod \"e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") " pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:14.074138 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:14.074126    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-model-cache\") pod \"e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") " pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:14.074404 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:14.074390    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-home\") pod \"e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") " pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:14.075839 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:14.075818    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-dshm\") pod \"e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") " pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:14.076321 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:14.076305    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5b13d2-97de-4095-b443-3067be43960c-tls-certs\") pod \"e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") " pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:14.081234 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:14.081213    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mxwg\" (UniqueName: \"kubernetes.io/projected/ee5b13d2-97de-4095-b443-3067be43960c-kube-api-access-2mxwg\") pod \"e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") " pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:14.258564 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:14.258521    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:14.415036 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:14.414981    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"]
Jul 23 19:53:14.417619 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:53:14.417592    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee5b13d2_97de_4095_b443_3067be43960c.slice/crio-9a80e25744e87eab111209e5ccc3bc6bb2247486802dc2ef2fcf47651a782f1b WatchSource:0}: Error finding container 9a80e25744e87eab111209e5ccc3bc6bb2247486802dc2ef2fcf47651a782f1b: Status 404 returned error can't find the container with id 9a80e25744e87eab111209e5ccc3bc6bb2247486802dc2ef2fcf47651a782f1b
Jul 23 19:53:14.891381 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:14.891349    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j" event={"ID":"ee5b13d2-97de-4095-b443-3067be43960c","Type":"ContainerStarted","Data":"eba82e57b717b4bc10c57a269ead2a90380dacce506e454e1617ddb3dee3f052"}
Jul 23 19:53:14.891528 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:14.891391    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j" event={"ID":"ee5b13d2-97de-4095-b443-3067be43960c","Type":"ContainerStarted","Data":"9a80e25744e87eab111209e5ccc3bc6bb2247486802dc2ef2fcf47651a782f1b"}
Jul 23 19:53:14.908909 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:14.908860    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j" podStartSLOduration=1.908845653 podStartE2EDuration="1.908845653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:53:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:53:14.906520232 +0000 UTC m=+1995.743526939" watchObservedRunningTime="2026-07-23 19:53:14.908845653 +0000 UTC m=+1995.745852360"
Jul 23 19:53:19.848796 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:19.848759    2578 patch_prober.go:28] interesting pod/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 23 19:53:19.849197 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:19.848824    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm" podUID="5190001c-f7ba-4480-9f52-d5365fc25f90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 23 19:53:19.915213 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:19.915182    2578 generic.go:356] "Generic (PLEG): container finished" podID="5190001c-f7ba-4480-9f52-d5365fc25f90" containerID="a8a52b574556830dfad1f0a8fc2cff299e8d8a1f9fa0512f41013d66ed56f244" exitCode=0
Jul 23 19:53:19.915377 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:19.915273    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm" event={"ID":"5190001c-f7ba-4480-9f52-d5365fc25f90","Type":"ContainerDied","Data":"a8a52b574556830dfad1f0a8fc2cff299e8d8a1f9fa0512f41013d66ed56f244"}
Jul 23 19:53:19.915656 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:19.915639    2578 scope.go:117] "RemoveContainer" containerID="a8a52b574556830dfad1f0a8fc2cff299e8d8a1f9fa0512f41013d66ed56f244"
Jul 23 19:53:19.916595 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:19.916567    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:53:19.916696 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:19.916629    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:53:19.916696 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:19.916661    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:53:20.921329 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:20.921294    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm" event={"ID":"5190001c-f7ba-4480-9f52-d5365fc25f90","Type":"ContainerStarted","Data":"6c5e08a0e849c20d64821aa4a77479ff4bf893a4db6f28ca825bc37af01a4531"}
Jul 23 19:53:20.971529 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:20.971487    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:20.971761 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:20.971735    2578 patch_prober.go:28] interesting pod/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 23 19:53:20.971847 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:20.971798    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm" podUID="5190001c-f7ba-4480-9f52-d5365fc25f90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 23 19:53:21.971043 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:21.971004    2578 patch_prober.go:28] interesting pod/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 23 19:53:21.971491 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:21.971060    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm" podUID="5190001c-f7ba-4480-9f52-d5365fc25f90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 23 19:53:22.971626 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:22.971593    2578 patch_prober.go:28] interesting pod/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 23 19:53:22.972005 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:22.971649    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm" podUID="5190001c-f7ba-4480-9f52-d5365fc25f90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 23 19:53:23.970662 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:23.970627    2578 patch_prober.go:28] interesting pod/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 23 19:53:23.970862 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:23.970681    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm" podUID="5190001c-f7ba-4480-9f52-d5365fc25f90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 23 19:53:24.259574 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:24.259476    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:24.259574 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:24.259547    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:24.272408 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:24.272385    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:24.949685 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:24.949658    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:53:24.975575 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:24.975547    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:24.975998 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:24.975976    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:53:24.976624 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:53:24.976599    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:54:04.680226 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:04.680190    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"]
Jul 23 19:54:19.700102 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:19.700048    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j" podUID="ee5b13d2-97de-4095-b443-3067be43960c" containerName="main" containerID="cri-o://eba82e57b717b4bc10c57a269ead2a90380dacce506e454e1617ddb3dee3f052" gracePeriod=45
Jul 23 19:54:19.941752 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:19.941726    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:54:20.011331 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.011305    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5b13d2-97de-4095-b443-3067be43960c-tls-certs\") pod \"ee5b13d2-97de-4095-b443-3067be43960c\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") "
Jul 23 19:54:20.011511 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.011347    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-dshm\") pod \"ee5b13d2-97de-4095-b443-3067be43960c\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") "
Jul 23 19:54:20.011511 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.011379    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-tmp-dir\") pod \"ee5b13d2-97de-4095-b443-3067be43960c\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") "
Jul 23 19:54:20.011511 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.011430    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-model-cache\") pod \"ee5b13d2-97de-4095-b443-3067be43960c\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") "
Jul 23 19:54:20.011511 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.011450    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-home\") pod \"ee5b13d2-97de-4095-b443-3067be43960c\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") "
Jul 23 19:54:20.011511 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.011479    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mxwg\" (UniqueName: \"kubernetes.io/projected/ee5b13d2-97de-4095-b443-3067be43960c-kube-api-access-2mxwg\") pod \"ee5b13d2-97de-4095-b443-3067be43960c\" (UID: \"ee5b13d2-97de-4095-b443-3067be43960c\") "
Jul 23 19:54:20.011782 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.011693    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ee5b13d2-97de-4095-b443-3067be43960c" (UID: "ee5b13d2-97de-4095-b443-3067be43960c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:54:20.011782 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.011685    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-home" (OuterVolumeSpecName: "home") pod "ee5b13d2-97de-4095-b443-3067be43960c" (UID: "ee5b13d2-97de-4095-b443-3067be43960c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:54:20.011782 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.011715    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-model-cache" (OuterVolumeSpecName: "model-cache") pod "ee5b13d2-97de-4095-b443-3067be43960c" (UID: "ee5b13d2-97de-4095-b443-3067be43960c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:54:20.013524 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.013497    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee5b13d2-97de-4095-b443-3067be43960c-kube-api-access-2mxwg" (OuterVolumeSpecName: "kube-api-access-2mxwg") pod "ee5b13d2-97de-4095-b443-3067be43960c" (UID: "ee5b13d2-97de-4095-b443-3067be43960c"). InnerVolumeSpecName "kube-api-access-2mxwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:54:20.013628 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.013541    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee5b13d2-97de-4095-b443-3067be43960c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ee5b13d2-97de-4095-b443-3067be43960c" (UID: "ee5b13d2-97de-4095-b443-3067be43960c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:54:20.013628 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.013541    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-dshm" (OuterVolumeSpecName: "dshm") pod "ee5b13d2-97de-4095-b443-3067be43960c" (UID: "ee5b13d2-97de-4095-b443-3067be43960c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:54:20.112067 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.112037    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee5b13d2-97de-4095-b443-3067be43960c-tls-certs\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:54:20.112067 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.112065    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-dshm\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:54:20.112281 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.112077    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-tmp-dir\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:54:20.112281 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.112108    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-model-cache\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:54:20.112281 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.112119    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee5b13d2-97de-4095-b443-3067be43960c-home\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:54:20.112281 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.112130    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mxwg\" (UniqueName: \"kubernetes.io/projected/ee5b13d2-97de-4095-b443-3067be43960c-kube-api-access-2mxwg\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:54:20.178838 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.178811    2578 generic.go:356] "Generic (PLEG): container finished" podID="ee5b13d2-97de-4095-b443-3067be43960c" containerID="eba82e57b717b4bc10c57a269ead2a90380dacce506e454e1617ddb3dee3f052" exitCode=0
Jul 23 19:54:20.178965 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.178854    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"
Jul 23 19:54:20.178965 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.178900    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j" event={"ID":"ee5b13d2-97de-4095-b443-3067be43960c","Type":"ContainerDied","Data":"eba82e57b717b4bc10c57a269ead2a90380dacce506e454e1617ddb3dee3f052"}
Jul 23 19:54:20.178965 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.178944    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j" event={"ID":"ee5b13d2-97de-4095-b443-3067be43960c","Type":"ContainerDied","Data":"9a80e25744e87eab111209e5ccc3bc6bb2247486802dc2ef2fcf47651a782f1b"}
Jul 23 19:54:20.179124 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.178965    2578 scope.go:117] "RemoveContainer" containerID="eba82e57b717b4bc10c57a269ead2a90380dacce506e454e1617ddb3dee3f052"
Jul 23 19:54:20.187979 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.187963    2578 scope.go:117] "RemoveContainer" containerID="eba82e57b717b4bc10c57a269ead2a90380dacce506e454e1617ddb3dee3f052"
Jul 23 19:54:20.188210 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:54:20.188192    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eba82e57b717b4bc10c57a269ead2a90380dacce506e454e1617ddb3dee3f052\": container with ID starting with eba82e57b717b4bc10c57a269ead2a90380dacce506e454e1617ddb3dee3f052 not found: ID does not exist" containerID="eba82e57b717b4bc10c57a269ead2a90380dacce506e454e1617ddb3dee3f052"
Jul 23 19:54:20.188294 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.188222    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eba82e57b717b4bc10c57a269ead2a90380dacce506e454e1617ddb3dee3f052"} err="failed to get container status \"eba82e57b717b4bc10c57a269ead2a90380dacce506e454e1617ddb3dee3f052\": rpc error: code = NotFound desc = could not find container \"eba82e57b717b4bc10c57a269ead2a90380dacce506e454e1617ddb3dee3f052\": container with ID starting with eba82e57b717b4bc10c57a269ead2a90380dacce506e454e1617ddb3dee3f052 not found: ID does not exist"
Jul 23 19:54:20.199280 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.199242    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"]
Jul 23 19:54:20.202808 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:20.202791    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-9051a48a/e2e-lifecycle-model-9051a48a-kserve-956f5575-xpq4j"]
Jul 23 19:54:21.651308 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:21.651221    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee5b13d2-97de-4095-b443-3067be43960c" path="/var/lib/kubelet/pods/ee5b13d2-97de-4095-b443-3067be43960c/volumes"
Jul 23 19:54:53.937264 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:53.937213    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"]
Jul 23 19:54:53.937857 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:53.937455    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm" podUID="5190001c-f7ba-4480-9f52-d5365fc25f90" containerName="istio-proxy" containerID="cri-o://6c5e08a0e849c20d64821aa4a77479ff4bf893a4db6f28ca825bc37af01a4531" gracePeriod=30
Jul 23 19:54:54.978376 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:54.978340    2578 patch_prober.go:28] interesting pod/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 19:54:54.978819 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:54.978418    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm" podUID="5190001c-f7ba-4480-9f52-d5365fc25f90" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 19:54:59.189168 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.189145    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:54:59.307763 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.307733    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-workload-certs\") pod \"5190001c-f7ba-4480-9f52-d5365fc25f90\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") "
Jul 23 19:54:59.307917 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.307791    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-token\") pod \"5190001c-f7ba-4480-9f52-d5365fc25f90\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") "
Jul 23 19:54:59.307917 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.307815    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-workload-socket\") pod \"5190001c-f7ba-4480-9f52-d5365fc25f90\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") "
Jul 23 19:54:59.307917 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.307829    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-data\") pod \"5190001c-f7ba-4480-9f52-d5365fc25f90\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") "
Jul 23 19:54:59.307917 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.307852    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5190001c-f7ba-4480-9f52-d5365fc25f90-istiod-ca-cert\") pod \"5190001c-f7ba-4480-9f52-d5365fc25f90\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") "
Jul 23 19:54:59.307917 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.307888    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-credential-socket\") pod \"5190001c-f7ba-4480-9f52-d5365fc25f90\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") "
Jul 23 19:54:59.307917 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.307910    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-podinfo\") pod \"5190001c-f7ba-4480-9f52-d5365fc25f90\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") "
Jul 23 19:54:59.308232 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.307941    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-envoy\") pod \"5190001c-f7ba-4480-9f52-d5365fc25f90\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") "
Jul 23 19:54:59.308232 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.307968    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsxzj\" (UniqueName: \"kubernetes.io/projected/5190001c-f7ba-4480-9f52-d5365fc25f90-kube-api-access-gsxzj\") pod \"5190001c-f7ba-4480-9f52-d5365fc25f90\" (UID: \"5190001c-f7ba-4480-9f52-d5365fc25f90\") "
Jul 23 19:54:59.308232 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.307973    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5190001c-f7ba-4480-9f52-d5365fc25f90" (UID: "5190001c-f7ba-4480-9f52-d5365fc25f90"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:54:59.308232 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.308113    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5190001c-f7ba-4480-9f52-d5365fc25f90" (UID: "5190001c-f7ba-4480-9f52-d5365fc25f90"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:54:59.308486 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.308234    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-workload-certs\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:54:59.308486 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.308276    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-workload-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:54:59.308486 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.308288    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5190001c-f7ba-4480-9f52-d5365fc25f90" (UID: "5190001c-f7ba-4480-9f52-d5365fc25f90"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:54:59.308486 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.308396    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5190001c-f7ba-4480-9f52-d5365fc25f90-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5190001c-f7ba-4480-9f52-d5365fc25f90" (UID: "5190001c-f7ba-4480-9f52-d5365fc25f90"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:54:59.308830 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.308803    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-data" (OuterVolumeSpecName: "istio-data") pod "5190001c-f7ba-4480-9f52-d5365fc25f90" (UID: "5190001c-f7ba-4480-9f52-d5365fc25f90"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:54:59.310205 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.310163    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5190001c-f7ba-4480-9f52-d5365fc25f90" (UID: "5190001c-f7ba-4480-9f52-d5365fc25f90"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 19:54:59.310422 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.310342    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5190001c-f7ba-4480-9f52-d5365fc25f90-kube-api-access-gsxzj" (OuterVolumeSpecName: "kube-api-access-gsxzj") pod "5190001c-f7ba-4480-9f52-d5365fc25f90" (UID: "5190001c-f7ba-4480-9f52-d5365fc25f90"). InnerVolumeSpecName "kube-api-access-gsxzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:54:59.310500 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.310395    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-token" (OuterVolumeSpecName: "istio-token") pod "5190001c-f7ba-4480-9f52-d5365fc25f90" (UID: "5190001c-f7ba-4480-9f52-d5365fc25f90"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:54:59.310500 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.310400    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5190001c-f7ba-4480-9f52-d5365fc25f90" (UID: "5190001c-f7ba-4480-9f52-d5365fc25f90"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:54:59.349847 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.349818    2578 generic.go:356] "Generic (PLEG): container finished" podID="5190001c-f7ba-4480-9f52-d5365fc25f90" containerID="6c5e08a0e849c20d64821aa4a77479ff4bf893a4db6f28ca825bc37af01a4531" exitCode=0
Jul 23 19:54:59.349936 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.349867    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"
Jul 23 19:54:59.349936 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.349909    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm" event={"ID":"5190001c-f7ba-4480-9f52-d5365fc25f90","Type":"ContainerDied","Data":"6c5e08a0e849c20d64821aa4a77479ff4bf893a4db6f28ca825bc37af01a4531"}
Jul 23 19:54:59.350007 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.349986    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm" event={"ID":"5190001c-f7ba-4480-9f52-d5365fc25f90","Type":"ContainerDied","Data":"e3bcca440119fe7411729a98cfadf59b6078680cc0a6803f88720c598bd638f9"}
Jul 23 19:54:59.350044 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.350010    2578 scope.go:117] "RemoveContainer" containerID="6c5e08a0e849c20d64821aa4a77479ff4bf893a4db6f28ca825bc37af01a4531"
Jul 23 19:54:59.359321 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.359299    2578 scope.go:117] "RemoveContainer" containerID="a8a52b574556830dfad1f0a8fc2cff299e8d8a1f9fa0512f41013d66ed56f244"
Jul 23 19:54:59.366434 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.366418    2578 scope.go:117] "RemoveContainer" containerID="6c5e08a0e849c20d64821aa4a77479ff4bf893a4db6f28ca825bc37af01a4531"
Jul 23 19:54:59.366668 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:54:59.366652    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c5e08a0e849c20d64821aa4a77479ff4bf893a4db6f28ca825bc37af01a4531\": container with ID starting with 6c5e08a0e849c20d64821aa4a77479ff4bf893a4db6f28ca825bc37af01a4531 not found: ID does not exist" containerID="6c5e08a0e849c20d64821aa4a77479ff4bf893a4db6f28ca825bc37af01a4531"
Jul 23 19:54:59.366719 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.366675    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c5e08a0e849c20d64821aa4a77479ff4bf893a4db6f28ca825bc37af01a4531"} err="failed to get container status \"6c5e08a0e849c20d64821aa4a77479ff4bf893a4db6f28ca825bc37af01a4531\": rpc error: code = NotFound desc = could not find container \"6c5e08a0e849c20d64821aa4a77479ff4bf893a4db6f28ca825bc37af01a4531\": container with ID starting with 6c5e08a0e849c20d64821aa4a77479ff4bf893a4db6f28ca825bc37af01a4531 not found: ID does not exist"
Jul 23 19:54:59.366719 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.366691    2578 scope.go:117] "RemoveContainer" containerID="a8a52b574556830dfad1f0a8fc2cff299e8d8a1f9fa0512f41013d66ed56f244"
Jul 23 19:54:59.366919 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:54:59.366904    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8a52b574556830dfad1f0a8fc2cff299e8d8a1f9fa0512f41013d66ed56f244\": container with ID starting with a8a52b574556830dfad1f0a8fc2cff299e8d8a1f9fa0512f41013d66ed56f244 not found: ID does not exist" containerID="a8a52b574556830dfad1f0a8fc2cff299e8d8a1f9fa0512f41013d66ed56f244"
Jul 23 19:54:59.366968 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.366921    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8a52b574556830dfad1f0a8fc2cff299e8d8a1f9fa0512f41013d66ed56f244"} err="failed to get container status \"a8a52b574556830dfad1f0a8fc2cff299e8d8a1f9fa0512f41013d66ed56f244\": rpc error: code = NotFound desc = could not find container \"a8a52b574556830dfad1f0a8fc2cff299e8d8a1f9fa0512f41013d66ed56f244\": container with ID starting with a8a52b574556830dfad1f0a8fc2cff299e8d8a1f9fa0512f41013d66ed56f244 not found: ID does not exist"
Jul 23 19:54:59.374958 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.374936    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"]
Jul 23 19:54:59.378987 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.378967    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9051a48a-openshift-default-56f9b8746c-dt2xm"]
Jul 23 19:54:59.409664 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.409647    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-podinfo\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:54:59.409664 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.409665    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-envoy\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:54:59.409773 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.409674    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsxzj\" (UniqueName: \"kubernetes.io/projected/5190001c-f7ba-4480-9f52-d5365fc25f90-kube-api-access-gsxzj\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:54:59.409773 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.409684    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-token\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:54:59.409773 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.409694    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-istio-data\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:54:59.409773 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.409701    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5190001c-f7ba-4480-9f52-d5365fc25f90-istiod-ca-cert\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:54:59.409773 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.409729    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5190001c-f7ba-4480-9f52-d5365fc25f90-credential-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:54:59.653445 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:54:59.653356    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5190001c-f7ba-4480-9f52-d5365fc25f90" path="/var/lib/kubelet/pods/5190001c-f7ba-4480-9f52-d5365fc25f90/volumes"
Jul 23 19:55:50.014920 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.014887    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"]
Jul 23 19:55:50.015541 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.015417    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee5b13d2-97de-4095-b443-3067be43960c" containerName="main"
Jul 23 19:55:50.015541 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.015439    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee5b13d2-97de-4095-b443-3067be43960c" containerName="main"
Jul 23 19:55:50.015541 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.015456    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5190001c-f7ba-4480-9f52-d5365fc25f90" containerName="istio-proxy"
Jul 23 19:55:50.015541 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.015466    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5190001c-f7ba-4480-9f52-d5365fc25f90" containerName="istio-proxy"
Jul 23 19:55:50.015762 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.015560    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5190001c-f7ba-4480-9f52-d5365fc25f90" containerName="istio-proxy"
Jul 23 19:55:50.015762 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.015573    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee5b13d2-97de-4095-b443-3067be43960c" containerName="main"
Jul 23 19:55:50.015762 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.015583    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5190001c-f7ba-4480-9f52-d5365fc25f90" containerName="istio-proxy"
Jul 23 19:55:50.018558 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.018537    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.021195 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.021170    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-4223ab-openshift-default-dockercfg-fkrbh\""
Jul 23 19:55:50.031828 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.031805    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"]
Jul 23 19:55:50.112174 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.112149    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-data\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.112331 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.112195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-envoy\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.112331 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.112220    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-token\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.112331 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.112241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-credential-socket\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.112331 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.112278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-workload-certs\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.112331 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.112299    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxhs5\" (UniqueName: \"kubernetes.io/projected/12ec2da7-80f0-4cba-a248-2b4c6afee54a-kube-api-access-vxhs5\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.112501 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.112366    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istiod-ca-cert\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.112501 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.112399    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-podinfo\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.112501 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.112418    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-workload-socket\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.213475 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.213449    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istiod-ca-cert\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.213639 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.213479    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-podinfo\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.213639 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.213496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-workload-socket\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.213639 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.213511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-data\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.213639 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.213618    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-envoy\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.213866 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.213668    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-token\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.213866 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.213698    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-credential-socket\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.213866 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.213727    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-workload-certs\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.213866 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.213762    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxhs5\" (UniqueName: \"kubernetes.io/projected/12ec2da7-80f0-4cba-a248-2b4c6afee54a-kube-api-access-vxhs5\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.214070 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.213998    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-workload-socket\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.214070 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.214045    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-data\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.214196 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.214176    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-credential-socket\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.214333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.214314    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-workload-certs\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.214390 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.214373    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istiod-ca-cert\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.216064 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.216040    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-envoy\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.216164 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.216107    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-podinfo\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.222470 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.222440    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxhs5\" (UniqueName: \"kubernetes.io/projected/12ec2da7-80f0-4cba-a248-2b4c6afee54a-kube-api-access-vxhs5\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.222573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.222541    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-token\") pod \"e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") " pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.328769 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.328690    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:50.463383 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.463360    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"]
Jul 23 19:55:50.466208 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:55:50.466181    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12ec2da7_80f0_4cba_a248_2b4c6afee54a.slice/crio-abaeed9e3c729ebeeb316491e90a11141731bd9e83048adbab448c4db48f7721 WatchSource:0}: Error finding container abaeed9e3c729ebeeb316491e90a11141731bd9e83048adbab448c4db48f7721: Status 404 returned error can't find the container with id abaeed9e3c729ebeeb316491e90a11141731bd9e83048adbab448c4db48f7721
Jul 23 19:55:50.468809 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.468779    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:55:50.468898 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.468855    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:55:50.468964 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.468899    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:55:50.570155 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.570121    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr" event={"ID":"12ec2da7-80f0-4cba-a248-2b4c6afee54a","Type":"ContainerStarted","Data":"2b5f225719254f70999287af179abca2657e30992ef6f5bec6f160dec6298e73"}
Jul 23 19:55:50.570339 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.570179    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr" event={"ID":"12ec2da7-80f0-4cba-a248-2b4c6afee54a","Type":"ContainerStarted","Data":"abaeed9e3c729ebeeb316491e90a11141731bd9e83048adbab448c4db48f7721"}
Jul 23 19:55:50.605049 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:50.604954    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr" podStartSLOduration=1.60493985 podStartE2EDuration="1.60493985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:55:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:55:50.602495203 +0000 UTC m=+2151.439501932" watchObservedRunningTime="2026-07-23 19:55:50.60493985 +0000 UTC m=+2151.441946557"
Jul 23 19:55:51.329218 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:51.329180    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:51.334924 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:51.334898    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:51.575823 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:51.575761    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:51.576788 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:51.576766    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:55:52.755982 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:52.755939    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl"]
Jul 23 19:55:52.756504 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:52.756274    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5190001c-f7ba-4480-9f52-d5365fc25f90" containerName="istio-proxy"
Jul 23 19:55:52.756504 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:52.756286    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5190001c-f7ba-4480-9f52-d5365fc25f90" containerName="istio-proxy"
Jul 23 19:55:52.759301 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:52.759277    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl"
Jul 23 19:55:52.761848 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:52.761826    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-4223ab-serving-cert\""
Jul 23 19:55:52.780664 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:52.780640    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl"]
Jul 23 19:55:52.836720 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:52.836665    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8d6b042-1989-46f6-8a18-1a3524231d12-maas-api-tls\") pod \"maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl\" (UID: \"b8d6b042-1989-46f6-8a18-1a3524231d12\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl"
Jul 23 19:55:52.836720 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:52.836723    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8d6b042-1989-46f6-8a18-1a3524231d12-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl\" (UID: \"b8d6b042-1989-46f6-8a18-1a3524231d12\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl"
Jul 23 19:55:52.836978 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:52.836834    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jg5h\" (UniqueName: \"kubernetes.io/projected/b8d6b042-1989-46f6-8a18-1a3524231d12-kube-api-access-4jg5h\") pod \"maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl\" (UID: \"b8d6b042-1989-46f6-8a18-1a3524231d12\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl"
Jul 23 19:55:52.937891 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:52.937858    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jg5h\" (UniqueName: \"kubernetes.io/projected/b8d6b042-1989-46f6-8a18-1a3524231d12-kube-api-access-4jg5h\") pod \"maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl\" (UID: \"b8d6b042-1989-46f6-8a18-1a3524231d12\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl"
Jul 23 19:55:52.938100 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:52.937999    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8d6b042-1989-46f6-8a18-1a3524231d12-maas-api-tls\") pod \"maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl\" (UID: \"b8d6b042-1989-46f6-8a18-1a3524231d12\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl"
Jul 23 19:55:52.938100 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:52.938042    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8d6b042-1989-46f6-8a18-1a3524231d12-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl\" (UID: \"b8d6b042-1989-46f6-8a18-1a3524231d12\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl"
Jul 23 19:55:52.939027 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:52.938996    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8d6b042-1989-46f6-8a18-1a3524231d12-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl\" (UID: \"b8d6b042-1989-46f6-8a18-1a3524231d12\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl"
Jul 23 19:55:52.941055 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:52.941034    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8d6b042-1989-46f6-8a18-1a3524231d12-maas-api-tls\") pod \"maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl\" (UID: \"b8d6b042-1989-46f6-8a18-1a3524231d12\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl"
Jul 23 19:55:52.952490 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:52.952469    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jg5h\" (UniqueName: \"kubernetes.io/projected/b8d6b042-1989-46f6-8a18-1a3524231d12-kube-api-access-4jg5h\") pod \"maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl\" (UID: \"b8d6b042-1989-46f6-8a18-1a3524231d12\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl"
Jul 23 19:55:53.069485 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:53.069399    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl"
Jul 23 19:55:53.198215 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:53.198183    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl"]
Jul 23 19:55:53.201608 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:55:53.201577    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8d6b042_1989_46f6_8a18_1a3524231d12.slice/crio-de0a2445e8a51cd02abc2ea83a0261dc2d261cadab08cee27cfd49005b67dfeb WatchSource:0}: Error finding container de0a2445e8a51cd02abc2ea83a0261dc2d261cadab08cee27cfd49005b67dfeb: Status 404 returned error can't find the container with id de0a2445e8a51cd02abc2ea83a0261dc2d261cadab08cee27cfd49005b67dfeb
Jul 23 19:55:53.586794 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:53.586751    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl" event={"ID":"b8d6b042-1989-46f6-8a18-1a3524231d12","Type":"ContainerStarted","Data":"de0a2445e8a51cd02abc2ea83a0261dc2d261cadab08cee27cfd49005b67dfeb"}
Jul 23 19:55:54.593337 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:54.593301    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl" event={"ID":"b8d6b042-1989-46f6-8a18-1a3524231d12","Type":"ContainerStarted","Data":"9b97ff5989bf098bd262ee86e56bb6c50eea708c61a7f5a64e0de74f12664d77"}
Jul 23 19:55:54.593760 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:54.593469    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl"
Jul 23 19:55:54.610170 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:54.610126    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl" podStartSLOduration=2.143006186 podStartE2EDuration="2.610113059s" totalImagesPullingTime="467.106873ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:55:54.60892057 +0000 UTC m=+2155.445927299" watchObservedRunningTime="2026-07-23 19:55:54.610113059 +0000 UTC m=+2155.447119766"
Jul 23 19:55:57.704507 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.704474    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"]
Jul 23 19:55:57.707966 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.707942    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.710855 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.710833    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-111c5d-openshift-default-dockercfg-8jcrw\""
Jul 23 19:55:57.720627 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.720600    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"]
Jul 23 19:55:57.782187 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.782154    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-podinfo\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.782187 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.782188    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-credential-socket\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.782440 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.782212    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-workload-certs\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.782440 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.782230    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-token\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.782440 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.782296    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srrwk\" (UniqueName: \"kubernetes.io/projected/b1215753-c31c-40e3-b027-6c1e262f6d1d-kube-api-access-srrwk\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.782440 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.782356    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-data\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.782440 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.782381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1215753-c31c-40e3-b027-6c1e262f6d1d-istiod-ca-cert\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.782440 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.782429    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-workload-socket\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.782674 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.782462    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-envoy\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.882903 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.882867    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-podinfo\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.882903 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.882909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-credential-socket\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.883165 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.882938    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-workload-certs\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.883165 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.883053    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-token\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.883165 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.883088    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srrwk\" (UniqueName: \"kubernetes.io/projected/b1215753-c31c-40e3-b027-6c1e262f6d1d-kube-api-access-srrwk\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.883165 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.883142    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-data\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.883435 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.883167    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1215753-c31c-40e3-b027-6c1e262f6d1d-istiod-ca-cert\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.883435 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.883220    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-workload-socket\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.883435 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.883280    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-envoy\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.883435 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.883312    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-workload-certs\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.883435 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.883346    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-credential-socket\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.883730 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.883508    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-data\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.883730 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.883623    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-workload-socket\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.883866 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.883848    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1215753-c31c-40e3-b027-6c1e262f6d1d-istiod-ca-cert\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.885387 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.885361    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-envoy\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.885509 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.885394    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-podinfo\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.890744 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.890722    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-token\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:57.890880 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:57.890864    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srrwk\" (UniqueName: \"kubernetes.io/projected/b1215753-c31c-40e3-b027-6c1e262f6d1d-kube-api-access-srrwk\") pod \"e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") " pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:58.018444 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:58.018418    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:58.153352 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:58.153329    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"]
Jul 23 19:55:58.155885 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:55:58.155846    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1215753_c31c_40e3_b027_6c1e262f6d1d.slice/crio-1f402890e42def603e6232519b3da57d340436fb66844ad20b152c493ea868ad WatchSource:0}: Error finding container 1f402890e42def603e6232519b3da57d340436fb66844ad20b152c493ea868ad: Status 404 returned error can't find the container with id 1f402890e42def603e6232519b3da57d340436fb66844ad20b152c493ea868ad
Jul 23 19:55:58.158325 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:58.158287    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:55:58.158426 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:58.158365    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:55:58.158426 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:58.158410    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:55:58.614300 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:58.614265    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256" event={"ID":"b1215753-c31c-40e3-b027-6c1e262f6d1d","Type":"ContainerStarted","Data":"64b02f256ab5950ce134739c42a74ccd79d229292fe750b62e75ff64fa63d947"}
Jul 23 19:55:58.614469 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:58.614320    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256" event={"ID":"b1215753-c31c-40e3-b027-6c1e262f6d1d","Type":"ContainerStarted","Data":"1f402890e42def603e6232519b3da57d340436fb66844ad20b152c493ea868ad"}
Jul 23 19:55:58.633737 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:58.633686    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256" podStartSLOduration=1.633671524 podStartE2EDuration="1.633671524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:55:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:55:58.632551979 +0000 UTC m=+2159.469558735" watchObservedRunningTime="2026-07-23 19:55:58.633671524 +0000 UTC m=+2159.470678288"
Jul 23 19:55:59.018784 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:59.018759    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:59.023513 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:59.023489    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:59.618697 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:59.618666    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:55:59.619496 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:55:59.619474    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:56:00.603615 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:00.603584    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl"
Jul 23 19:56:07.617454 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:07.617413    2578 patch_prober.go:28] interesting pod/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 19:56:07.617902 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:07.617477    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr" podUID="12ec2da7-80f0-4cba-a248-2b4c6afee54a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 19:56:08.663662 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:08.663625    2578 generic.go:356] "Generic (PLEG): container finished" podID="12ec2da7-80f0-4cba-a248-2b4c6afee54a" containerID="2b5f225719254f70999287af179abca2657e30992ef6f5bec6f160dec6298e73" exitCode=0
Jul 23 19:56:08.664076 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:08.663701    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr" event={"ID":"12ec2da7-80f0-4cba-a248-2b4c6afee54a","Type":"ContainerDied","Data":"2b5f225719254f70999287af179abca2657e30992ef6f5bec6f160dec6298e73"}
Jul 23 19:56:08.664139 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:08.664124    2578 scope.go:117] "RemoveContainer" containerID="2b5f225719254f70999287af179abca2657e30992ef6f5bec6f160dec6298e73"
Jul 23 19:56:08.665310 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:08.665276    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:56:08.665442 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:08.665362    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:56:08.665442 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:08.665413    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:56:09.698688 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:09.698651    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr" event={"ID":"12ec2da7-80f0-4cba-a248-2b4c6afee54a","Type":"ContainerStarted","Data":"f864cc32546a1863390e11a7812382cb3c5b68c8030281d10ab67c72e9511ce8"}
Jul 23 19:56:10.329914 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:10.329877    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:56:10.330146 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:10.330117    2578 patch_prober.go:28] interesting pod/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 23 19:56:10.330226 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:10.330183    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr" podUID="12ec2da7-80f0-4cba-a248-2b4c6afee54a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 23 19:56:11.329675 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:11.329618    2578 patch_prober.go:28] interesting pod/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 23 19:56:11.329675 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:11.329671    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr" podUID="12ec2da7-80f0-4cba-a248-2b4c6afee54a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 23 19:56:12.330103 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:12.330057    2578 patch_prober.go:28] interesting pod/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 23 19:56:12.330512 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:12.330139    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr" podUID="12ec2da7-80f0-4cba-a248-2b4c6afee54a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 23 19:56:13.329753 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:13.329714    2578 patch_prober.go:28] interesting pod/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Jul 23 19:56:13.329943 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:13.329774    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr" podUID="12ec2da7-80f0-4cba-a248-2b4c6afee54a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Jul 23 19:56:14.333151 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:14.333115    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:56:14.333617 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:14.333522    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:56:14.334327 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:14.334303    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:56:15.661432 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:15.661388    2578 patch_prober.go:28] interesting pod/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 19:56:15.661834 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:15.661476    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256" podUID="b1215753-c31c-40e3-b027-6c1e262f6d1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 19:56:16.730192 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:16.730120    2578 generic.go:356] "Generic (PLEG): container finished" podID="b1215753-c31c-40e3-b027-6c1e262f6d1d" containerID="64b02f256ab5950ce134739c42a74ccd79d229292fe750b62e75ff64fa63d947" exitCode=0
Jul 23 19:56:16.730581 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:16.730199    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256" event={"ID":"b1215753-c31c-40e3-b027-6c1e262f6d1d","Type":"ContainerDied","Data":"64b02f256ab5950ce134739c42a74ccd79d229292fe750b62e75ff64fa63d947"}
Jul 23 19:56:16.730624 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:16.730603    2578 scope.go:117] "RemoveContainer" containerID="64b02f256ab5950ce134739c42a74ccd79d229292fe750b62e75ff64fa63d947"
Jul 23 19:56:16.731519 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:16.731494    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:56:16.731580 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:16.731559    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:56:16.731620 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:16.731592    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:56:17.739180 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:17.739139    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256" event={"ID":"b1215753-c31c-40e3-b027-6c1e262f6d1d","Type":"ContainerStarted","Data":"7d8cef9676d8966efc56357041ae5e64874c2d1b21232bc6c8b823abd2553c15"}
Jul 23 19:56:18.019149 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:18.019058    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:56:18.019361 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:18.019335    2578 patch_prober.go:28] interesting pod/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 23 19:56:18.019431 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:18.019406    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256" podUID="b1215753-c31c-40e3-b027-6c1e262f6d1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 23 19:56:19.018857 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:19.018826    2578 patch_prober.go:28] interesting pod/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 23 19:56:19.019233 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:19.018876    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256" podUID="b1215753-c31c-40e3-b027-6c1e262f6d1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 23 19:56:20.019125 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:20.019088    2578 patch_prober.go:28] interesting pod/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 23 19:56:20.019565 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:20.019148    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256" podUID="b1215753-c31c-40e3-b027-6c1e262f6d1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 23 19:56:21.019236 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:21.019197    2578 patch_prober.go:28] interesting pod/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 23 19:56:21.019628 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:21.019285    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256" podUID="b1215753-c31c-40e3-b027-6c1e262f6d1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 23 19:56:22.022648 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:22.022620    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:56:22.023017 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:22.022944    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:56:22.023548 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:56:22.023527    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:57:35.831145 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:35.831040    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl"]
Jul 23 19:57:35.831634 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:35.831303    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl" podUID="b8d6b042-1989-46f6-8a18-1a3524231d12" containerName="maas-api" containerID="cri-o://9b97ff5989bf098bd262ee86e56bb6c50eea708c61a7f5a64e0de74f12664d77" gracePeriod=30
Jul 23 19:57:36.078855 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:36.078831    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl"
Jul 23 19:57:36.092303 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:36.092225    2578 generic.go:356] "Generic (PLEG): container finished" podID="b8d6b042-1989-46f6-8a18-1a3524231d12" containerID="9b97ff5989bf098bd262ee86e56bb6c50eea708c61a7f5a64e0de74f12664d77" exitCode=0
Jul 23 19:57:36.092303 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:36.092288    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl"
Jul 23 19:57:36.092450 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:36.092323    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl" event={"ID":"b8d6b042-1989-46f6-8a18-1a3524231d12","Type":"ContainerDied","Data":"9b97ff5989bf098bd262ee86e56bb6c50eea708c61a7f5a64e0de74f12664d77"}
Jul 23 19:57:36.092450 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:36.092389    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl" event={"ID":"b8d6b042-1989-46f6-8a18-1a3524231d12","Type":"ContainerDied","Data":"de0a2445e8a51cd02abc2ea83a0261dc2d261cadab08cee27cfd49005b67dfeb"}
Jul 23 19:57:36.092450 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:36.092412    2578 scope.go:117] "RemoveContainer" containerID="9b97ff5989bf098bd262ee86e56bb6c50eea708c61a7f5a64e0de74f12664d77"
Jul 23 19:57:36.101701 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:36.101678    2578 scope.go:117] "RemoveContainer" containerID="9b97ff5989bf098bd262ee86e56bb6c50eea708c61a7f5a64e0de74f12664d77"
Jul 23 19:57:36.101971 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:57:36.101952    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b97ff5989bf098bd262ee86e56bb6c50eea708c61a7f5a64e0de74f12664d77\": container with ID starting with 9b97ff5989bf098bd262ee86e56bb6c50eea708c61a7f5a64e0de74f12664d77 not found: ID does not exist" containerID="9b97ff5989bf098bd262ee86e56bb6c50eea708c61a7f5a64e0de74f12664d77"
Jul 23 19:57:36.102067 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:36.101978    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b97ff5989bf098bd262ee86e56bb6c50eea708c61a7f5a64e0de74f12664d77"} err="failed to get container status \"9b97ff5989bf098bd262ee86e56bb6c50eea708c61a7f5a64e0de74f12664d77\": rpc error: code = NotFound desc = could not find container \"9b97ff5989bf098bd262ee86e56bb6c50eea708c61a7f5a64e0de74f12664d77\": container with ID starting with 9b97ff5989bf098bd262ee86e56bb6c50eea708c61a7f5a64e0de74f12664d77 not found: ID does not exist"
Jul 23 19:57:36.147080 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:36.147057    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8d6b042-1989-46f6-8a18-1a3524231d12-openshift-service-ca\") pod \"b8d6b042-1989-46f6-8a18-1a3524231d12\" (UID: \"b8d6b042-1989-46f6-8a18-1a3524231d12\") "
Jul 23 19:57:36.147221 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:36.147117    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jg5h\" (UniqueName: \"kubernetes.io/projected/b8d6b042-1989-46f6-8a18-1a3524231d12-kube-api-access-4jg5h\") pod \"b8d6b042-1989-46f6-8a18-1a3524231d12\" (UID: \"b8d6b042-1989-46f6-8a18-1a3524231d12\") "
Jul 23 19:57:36.147221 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:36.147143    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8d6b042-1989-46f6-8a18-1a3524231d12-maas-api-tls\") pod \"b8d6b042-1989-46f6-8a18-1a3524231d12\" (UID: \"b8d6b042-1989-46f6-8a18-1a3524231d12\") "
Jul 23 19:57:36.147445 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:36.147422    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8d6b042-1989-46f6-8a18-1a3524231d12-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b8d6b042-1989-46f6-8a18-1a3524231d12" (UID: "b8d6b042-1989-46f6-8a18-1a3524231d12"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:57:36.149181 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:36.149158    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8d6b042-1989-46f6-8a18-1a3524231d12-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b8d6b042-1989-46f6-8a18-1a3524231d12" (UID: "b8d6b042-1989-46f6-8a18-1a3524231d12"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 19:57:36.149295 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:36.149223    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8d6b042-1989-46f6-8a18-1a3524231d12-kube-api-access-4jg5h" (OuterVolumeSpecName: "kube-api-access-4jg5h") pod "b8d6b042-1989-46f6-8a18-1a3524231d12" (UID: "b8d6b042-1989-46f6-8a18-1a3524231d12"). InnerVolumeSpecName "kube-api-access-4jg5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:57:36.248134 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:36.248108    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8d6b042-1989-46f6-8a18-1a3524231d12-openshift-service-ca\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:57:36.248134 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:36.248131    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jg5h\" (UniqueName: \"kubernetes.io/projected/b8d6b042-1989-46f6-8a18-1a3524231d12-kube-api-access-4jg5h\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:57:36.248297 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:36.248142    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8d6b042-1989-46f6-8a18-1a3524231d12-maas-api-tls\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:57:36.415022 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:36.414983    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl"]
Jul 23 19:57:36.419614 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:36.419589    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4223ab-845c7cc9f9-l68cl"]
Jul 23 19:57:37.651838 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:37.651805    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8d6b042-1989-46f6-8a18-1a3524231d12" path="/var/lib/kubelet/pods/b8d6b042-1989-46f6-8a18-1a3524231d12/volumes"
Jul 23 19:57:46.895538 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:46.895500    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"]
Jul 23 19:57:46.896153 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:46.895759    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr" podUID="12ec2da7-80f0-4cba-a248-2b4c6afee54a" containerName="istio-proxy" containerID="cri-o://f864cc32546a1863390e11a7812382cb3c5b68c8030281d10ab67c72e9511ce8" gracePeriod=30
Jul 23 19:57:52.148215 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.148193    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:57:52.168916 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.168835    2578 generic.go:356] "Generic (PLEG): container finished" podID="12ec2da7-80f0-4cba-a248-2b4c6afee54a" containerID="f864cc32546a1863390e11a7812382cb3c5b68c8030281d10ab67c72e9511ce8" exitCode=0
Jul 23 19:57:52.168916 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.168883    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"
Jul 23 19:57:52.169126 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.168921    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr" event={"ID":"12ec2da7-80f0-4cba-a248-2b4c6afee54a","Type":"ContainerDied","Data":"f864cc32546a1863390e11a7812382cb3c5b68c8030281d10ab67c72e9511ce8"}
Jul 23 19:57:52.169126 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.168974    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr" event={"ID":"12ec2da7-80f0-4cba-a248-2b4c6afee54a","Type":"ContainerDied","Data":"abaeed9e3c729ebeeb316491e90a11141731bd9e83048adbab448c4db48f7721"}
Jul 23 19:57:52.169126 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.169004    2578 scope.go:117] "RemoveContainer" containerID="f864cc32546a1863390e11a7812382cb3c5b68c8030281d10ab67c72e9511ce8"
Jul 23 19:57:52.178264 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.178229    2578 scope.go:117] "RemoveContainer" containerID="2b5f225719254f70999287af179abca2657e30992ef6f5bec6f160dec6298e73"
Jul 23 19:57:52.185859 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.185838    2578 scope.go:117] "RemoveContainer" containerID="f864cc32546a1863390e11a7812382cb3c5b68c8030281d10ab67c72e9511ce8"
Jul 23 19:57:52.186118 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:57:52.186099    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f864cc32546a1863390e11a7812382cb3c5b68c8030281d10ab67c72e9511ce8\": container with ID starting with f864cc32546a1863390e11a7812382cb3c5b68c8030281d10ab67c72e9511ce8 not found: ID does not exist" containerID="f864cc32546a1863390e11a7812382cb3c5b68c8030281d10ab67c72e9511ce8"
Jul 23 19:57:52.186185 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.186127    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f864cc32546a1863390e11a7812382cb3c5b68c8030281d10ab67c72e9511ce8"} err="failed to get container status \"f864cc32546a1863390e11a7812382cb3c5b68c8030281d10ab67c72e9511ce8\": rpc error: code = NotFound desc = could not find container \"f864cc32546a1863390e11a7812382cb3c5b68c8030281d10ab67c72e9511ce8\": container with ID starting with f864cc32546a1863390e11a7812382cb3c5b68c8030281d10ab67c72e9511ce8 not found: ID does not exist"
Jul 23 19:57:52.186185 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.186144    2578 scope.go:117] "RemoveContainer" containerID="2b5f225719254f70999287af179abca2657e30992ef6f5bec6f160dec6298e73"
Jul 23 19:57:52.186402 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:57:52.186386    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b5f225719254f70999287af179abca2657e30992ef6f5bec6f160dec6298e73\": container with ID starting with 2b5f225719254f70999287af179abca2657e30992ef6f5bec6f160dec6298e73 not found: ID does not exist" containerID="2b5f225719254f70999287af179abca2657e30992ef6f5bec6f160dec6298e73"
Jul 23 19:57:52.186455 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.186407    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b5f225719254f70999287af179abca2657e30992ef6f5bec6f160dec6298e73"} err="failed to get container status \"2b5f225719254f70999287af179abca2657e30992ef6f5bec6f160dec6298e73\": rpc error: code = NotFound desc = could not find container \"2b5f225719254f70999287af179abca2657e30992ef6f5bec6f160dec6298e73\": container with ID starting with 2b5f225719254f70999287af179abca2657e30992ef6f5bec6f160dec6298e73 not found: ID does not exist"
Jul 23 19:57:52.284033 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.283995    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-workload-socket\") pod \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") "
Jul 23 19:57:52.284191 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.284050    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-data\") pod \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") "
Jul 23 19:57:52.284191 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.284103    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-envoy\") pod \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") "
Jul 23 19:57:52.284191 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.284149    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istiod-ca-cert\") pod \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") "
Jul 23 19:57:52.284191 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.284178    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-credential-socket\") pod \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") "
Jul 23 19:57:52.284446 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.284202    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-podinfo\") pod \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") "
Jul 23 19:57:52.284446 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.284221    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-token\") pod \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") "
Jul 23 19:57:52.284446 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.284267    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxhs5\" (UniqueName: \"kubernetes.io/projected/12ec2da7-80f0-4cba-a248-2b4c6afee54a-kube-api-access-vxhs5\") pod \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") "
Jul 23 19:57:52.284446 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.284287    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-workload-certs\") pod \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\" (UID: \"12ec2da7-80f0-4cba-a248-2b4c6afee54a\") "
Jul 23 19:57:52.284446 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.284320    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "12ec2da7-80f0-4cba-a248-2b4c6afee54a" (UID: "12ec2da7-80f0-4cba-a248-2b4c6afee54a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:57:52.284750 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.284509    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "12ec2da7-80f0-4cba-a248-2b4c6afee54a" (UID: "12ec2da7-80f0-4cba-a248-2b4c6afee54a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:57:52.284750 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.284535    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-workload-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:57:52.284853 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.284789    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "12ec2da7-80f0-4cba-a248-2b4c6afee54a" (UID: "12ec2da7-80f0-4cba-a248-2b4c6afee54a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:57:52.284924 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.284899    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "12ec2da7-80f0-4cba-a248-2b4c6afee54a" (UID: "12ec2da7-80f0-4cba-a248-2b4c6afee54a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:57:52.284996 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.284972    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-data" (OuterVolumeSpecName: "istio-data") pod "12ec2da7-80f0-4cba-a248-2b4c6afee54a" (UID: "12ec2da7-80f0-4cba-a248-2b4c6afee54a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:57:52.286483 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.286446    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "12ec2da7-80f0-4cba-a248-2b4c6afee54a" (UID: "12ec2da7-80f0-4cba-a248-2b4c6afee54a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 19:57:52.286602 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.286529    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12ec2da7-80f0-4cba-a248-2b4c6afee54a-kube-api-access-vxhs5" (OuterVolumeSpecName: "kube-api-access-vxhs5") pod "12ec2da7-80f0-4cba-a248-2b4c6afee54a" (UID: "12ec2da7-80f0-4cba-a248-2b4c6afee54a"). InnerVolumeSpecName "kube-api-access-vxhs5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:57:52.286677 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.286661    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "12ec2da7-80f0-4cba-a248-2b4c6afee54a" (UID: "12ec2da7-80f0-4cba-a248-2b4c6afee54a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:57:52.286741 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.286727    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-token" (OuterVolumeSpecName: "istio-token") pod "12ec2da7-80f0-4cba-a248-2b4c6afee54a" (UID: "12ec2da7-80f0-4cba-a248-2b4c6afee54a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:57:52.385649 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.385608    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istiod-ca-cert\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:57:52.385649 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.385636    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-credential-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:57:52.385649 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.385646    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-podinfo\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:57:52.385649 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.385655    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-token\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:57:52.385930 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.385664    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxhs5\" (UniqueName: \"kubernetes.io/projected/12ec2da7-80f0-4cba-a248-2b4c6afee54a-kube-api-access-vxhs5\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:57:52.385930 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.385672    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-workload-certs\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:57:52.385930 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.385680    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-data\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:57:52.385930 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.385688    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12ec2da7-80f0-4cba-a248-2b4c6afee54a-istio-envoy\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:57:52.491385 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.491356    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"]
Jul 23 19:57:52.497080 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:52.497053    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-4223ab-openshift-default-645cbdbd9c-6qdfr"]
Jul 23 19:57:53.652776 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:57:53.652746    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12ec2da7-80f0-4cba-a248-2b4c6afee54a" path="/var/lib/kubelet/pods/12ec2da7-80f0-4cba-a248-2b4c6afee54a/volumes"
Jul 23 19:58:08.621551 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:08.621518    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"]
Jul 23 19:58:08.621946 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:08.621772    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256" podUID="b1215753-c31c-40e3-b027-6c1e262f6d1d" containerName="istio-proxy" containerID="cri-o://7d8cef9676d8966efc56357041ae5e64874c2d1b21232bc6c8b823abd2553c15" gracePeriod=30
Jul 23 19:58:09.492582 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.492548    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"]
Jul 23 19:58:09.492945 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.492930    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12ec2da7-80f0-4cba-a248-2b4c6afee54a" containerName="istio-proxy"
Jul 23 19:58:09.492991 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.492947    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="12ec2da7-80f0-4cba-a248-2b4c6afee54a" containerName="istio-proxy"
Jul 23 19:58:09.492991 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.492961    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12ec2da7-80f0-4cba-a248-2b4c6afee54a" containerName="istio-proxy"
Jul 23 19:58:09.492991 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.492968    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="12ec2da7-80f0-4cba-a248-2b4c6afee54a" containerName="istio-proxy"
Jul 23 19:58:09.492991 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.492978    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8d6b042-1989-46f6-8a18-1a3524231d12" containerName="maas-api"
Jul 23 19:58:09.492991 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.492984    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8d6b042-1989-46f6-8a18-1a3524231d12" containerName="maas-api"
Jul 23 19:58:09.493146 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.493038    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="12ec2da7-80f0-4cba-a248-2b4c6afee54a" containerName="istio-proxy"
Jul 23 19:58:09.493146 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.493046    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="12ec2da7-80f0-4cba-a248-2b4c6afee54a" containerName="istio-proxy"
Jul 23 19:58:09.493146 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.493054    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8d6b042-1989-46f6-8a18-1a3524231d12" containerName="maas-api"
Jul 23 19:58:09.495782 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.495767    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.498453 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.498426    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-a8f21c-openshift-default-dockercfg-bbtwd\""
Jul 23 19:58:09.508612 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.508588    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"]
Jul 23 19:58:09.639499 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.639459    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-workload-certs\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.639499 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.639515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-podinfo\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.640050 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.639540    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-token\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.640050 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.639641    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-workload-socket\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.640050 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.639696    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-credential-socket\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.640050 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.639738    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istiod-ca-cert\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.640050 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.639772    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-envoy\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.640050 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.639799    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6l2l\" (UniqueName: \"kubernetes.io/projected/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-kube-api-access-x6l2l\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.640050 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.639826    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-data\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.740793 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.740755    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-workload-socket\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.740964 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.740797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-credential-socket\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.740964 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.740925    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istiod-ca-cert\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.741075 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.740972    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-envoy\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.741075 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.740998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6l2l\" (UniqueName: \"kubernetes.io/projected/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-kube-api-access-x6l2l\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.741075 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.741026    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-data\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.741232 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.741076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-workload-certs\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.741232 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.741127    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-podinfo\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.741232 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.741158    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-token\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.741441 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.741235    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-workload-socket\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.741441 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.741246    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-credential-socket\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.741549 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.741533    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-data\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.741652 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.741616    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-workload-certs\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.741838 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.741808    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istiod-ca-cert\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.743552 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.743490    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-envoy\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.743897 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.743873    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-podinfo\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.748775 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.748755    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-token\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.748775 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.748767    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6l2l\" (UniqueName: \"kubernetes.io/projected/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-kube-api-access-x6l2l\") pod \"e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") " pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.806823 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.806785    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:09.940884 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.940862    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"]
Jul 23 19:58:09.942800 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:58:09.942767    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c9e37dd_b08d_464c_9244_ac269fe3f2d3.slice/crio-01598a0cc980ef34455014017654f1fd8587b6aa68ec4e7510cfe440c25cf4aa WatchSource:0}: Error finding container 01598a0cc980ef34455014017654f1fd8587b6aa68ec4e7510cfe440c25cf4aa: Status 404 returned error can't find the container with id 01598a0cc980ef34455014017654f1fd8587b6aa68ec4e7510cfe440c25cf4aa
Jul 23 19:58:09.944863 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.944831    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:58:09.944943 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.944901    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:58:09.944943 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:09.944931    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:58:10.255363 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:10.255243    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs" event={"ID":"2c9e37dd-b08d-464c-9244-ac269fe3f2d3","Type":"ContainerStarted","Data":"e7bd00f95557fb6a6c97f7f7fc444409307be26f2f25f3f1ea52b96065acc905"}
Jul 23 19:58:10.255363 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:10.255317    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs" event={"ID":"2c9e37dd-b08d-464c-9244-ac269fe3f2d3","Type":"ContainerStarted","Data":"01598a0cc980ef34455014017654f1fd8587b6aa68ec4e7510cfe440c25cf4aa"}
Jul 23 19:58:10.275729 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:10.275683    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs" podStartSLOduration=1.275667651 podStartE2EDuration="1.275667651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:58:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:58:10.274166526 +0000 UTC m=+2291.111173235" watchObservedRunningTime="2026-07-23 19:58:10.275667651 +0000 UTC m=+2291.112674358"
Jul 23 19:58:10.807308 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:10.807271    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:11.812380 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:11.812348    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:12.264073 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:12.264044    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:12.265059 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:12.265037    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:13.877131 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:13.877110    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:58:13.975267 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:13.975224    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-podinfo\") pod \"b1215753-c31c-40e3-b027-6c1e262f6d1d\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") "
Jul 23 19:58:13.975420 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:13.975279    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-envoy\") pod \"b1215753-c31c-40e3-b027-6c1e262f6d1d\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") "
Jul 23 19:58:13.975420 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:13.975299    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-token\") pod \"b1215753-c31c-40e3-b027-6c1e262f6d1d\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") "
Jul 23 19:58:13.975420 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:13.975323    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-workload-socket\") pod \"b1215753-c31c-40e3-b027-6c1e262f6d1d\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") "
Jul 23 19:58:13.975420 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:13.975340    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1215753-c31c-40e3-b027-6c1e262f6d1d-istiod-ca-cert\") pod \"b1215753-c31c-40e3-b027-6c1e262f6d1d\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") "
Jul 23 19:58:13.975420 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:13.975379    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-credential-socket\") pod \"b1215753-c31c-40e3-b027-6c1e262f6d1d\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") "
Jul 23 19:58:13.975420 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:13.975402    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-workload-certs\") pod \"b1215753-c31c-40e3-b027-6c1e262f6d1d\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") "
Jul 23 19:58:13.975739 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:13.975429    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-data\") pod \"b1215753-c31c-40e3-b027-6c1e262f6d1d\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") "
Jul 23 19:58:13.975739 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:13.975462    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srrwk\" (UniqueName: \"kubernetes.io/projected/b1215753-c31c-40e3-b027-6c1e262f6d1d-kube-api-access-srrwk\") pod \"b1215753-c31c-40e3-b027-6c1e262f6d1d\" (UID: \"b1215753-c31c-40e3-b027-6c1e262f6d1d\") "
Jul 23 19:58:13.975739 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:13.975720    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b1215753-c31c-40e3-b027-6c1e262f6d1d" (UID: "b1215753-c31c-40e3-b027-6c1e262f6d1d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:58:13.975908 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:13.975734    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b1215753-c31c-40e3-b027-6c1e262f6d1d" (UID: "b1215753-c31c-40e3-b027-6c1e262f6d1d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:58:13.975908 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:13.975840    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b1215753-c31c-40e3-b027-6c1e262f6d1d" (UID: "b1215753-c31c-40e3-b027-6c1e262f6d1d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:58:13.976022 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:13.975992    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1215753-c31c-40e3-b027-6c1e262f6d1d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b1215753-c31c-40e3-b027-6c1e262f6d1d" (UID: "b1215753-c31c-40e3-b027-6c1e262f6d1d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:58:13.976416 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:13.976395    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-data" (OuterVolumeSpecName: "istio-data") pod "b1215753-c31c-40e3-b027-6c1e262f6d1d" (UID: "b1215753-c31c-40e3-b027-6c1e262f6d1d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:58:13.977480 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:13.977458    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b1215753-c31c-40e3-b027-6c1e262f6d1d" (UID: "b1215753-c31c-40e3-b027-6c1e262f6d1d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 19:58:13.977574 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:13.977516    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b1215753-c31c-40e3-b027-6c1e262f6d1d" (UID: "b1215753-c31c-40e3-b027-6c1e262f6d1d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:58:13.977897 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:13.977876    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-token" (OuterVolumeSpecName: "istio-token") pod "b1215753-c31c-40e3-b027-6c1e262f6d1d" (UID: "b1215753-c31c-40e3-b027-6c1e262f6d1d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:58:13.977957 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:13.977898    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1215753-c31c-40e3-b027-6c1e262f6d1d-kube-api-access-srrwk" (OuterVolumeSpecName: "kube-api-access-srrwk") pod "b1215753-c31c-40e3-b027-6c1e262f6d1d" (UID: "b1215753-c31c-40e3-b027-6c1e262f6d1d"). InnerVolumeSpecName "kube-api-access-srrwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:58:14.076562 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:14.076531    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-podinfo\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:58:14.076562 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:14.076559    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-envoy\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:58:14.076562 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:14.076571    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-token\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:58:14.076562 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:14.076579    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-workload-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:58:14.076868 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:14.076587    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1215753-c31c-40e3-b027-6c1e262f6d1d-istiod-ca-cert\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:58:14.076868 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:14.076596    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-credential-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:58:14.076868 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:14.076605    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-workload-certs\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:58:14.076868 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:14.076613    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1215753-c31c-40e3-b027-6c1e262f6d1d-istio-data\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:58:14.076868 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:14.076621    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srrwk\" (UniqueName: \"kubernetes.io/projected/b1215753-c31c-40e3-b027-6c1e262f6d1d-kube-api-access-srrwk\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:58:14.275306 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:14.275206    2578 generic.go:356] "Generic (PLEG): container finished" podID="b1215753-c31c-40e3-b027-6c1e262f6d1d" containerID="7d8cef9676d8966efc56357041ae5e64874c2d1b21232bc6c8b823abd2553c15" exitCode=0
Jul 23 19:58:14.275306 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:14.275278    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"
Jul 23 19:58:14.275481 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:14.275298    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256" event={"ID":"b1215753-c31c-40e3-b027-6c1e262f6d1d","Type":"ContainerDied","Data":"7d8cef9676d8966efc56357041ae5e64874c2d1b21232bc6c8b823abd2553c15"}
Jul 23 19:58:14.275481 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:14.275364    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256" event={"ID":"b1215753-c31c-40e3-b027-6c1e262f6d1d","Type":"ContainerDied","Data":"1f402890e42def603e6232519b3da57d340436fb66844ad20b152c493ea868ad"}
Jul 23 19:58:14.275481 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:14.275393    2578 scope.go:117] "RemoveContainer" containerID="7d8cef9676d8966efc56357041ae5e64874c2d1b21232bc6c8b823abd2553c15"
Jul 23 19:58:14.290943 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:14.290923    2578 scope.go:117] "RemoveContainer" containerID="64b02f256ab5950ce134739c42a74ccd79d229292fe750b62e75ff64fa63d947"
Jul 23 19:58:14.298336 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:14.298313    2578 scope.go:117] "RemoveContainer" containerID="7d8cef9676d8966efc56357041ae5e64874c2d1b21232bc6c8b823abd2553c15"
Jul 23 19:58:14.298577 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:58:14.298558    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d8cef9676d8966efc56357041ae5e64874c2d1b21232bc6c8b823abd2553c15\": container with ID starting with 7d8cef9676d8966efc56357041ae5e64874c2d1b21232bc6c8b823abd2553c15 not found: ID does not exist" containerID="7d8cef9676d8966efc56357041ae5e64874c2d1b21232bc6c8b823abd2553c15"
Jul 23 19:58:14.298629 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:14.298585    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d8cef9676d8966efc56357041ae5e64874c2d1b21232bc6c8b823abd2553c15"} err="failed to get container status \"7d8cef9676d8966efc56357041ae5e64874c2d1b21232bc6c8b823abd2553c15\": rpc error: code = NotFound desc = could not find container \"7d8cef9676d8966efc56357041ae5e64874c2d1b21232bc6c8b823abd2553c15\": container with ID starting with 7d8cef9676d8966efc56357041ae5e64874c2d1b21232bc6c8b823abd2553c15 not found: ID does not exist"
Jul 23 19:58:14.298629 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:14.298607    2578 scope.go:117] "RemoveContainer" containerID="64b02f256ab5950ce134739c42a74ccd79d229292fe750b62e75ff64fa63d947"
Jul 23 19:58:14.298835 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:58:14.298817    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64b02f256ab5950ce134739c42a74ccd79d229292fe750b62e75ff64fa63d947\": container with ID starting with 64b02f256ab5950ce134739c42a74ccd79d229292fe750b62e75ff64fa63d947 not found: ID does not exist" containerID="64b02f256ab5950ce134739c42a74ccd79d229292fe750b62e75ff64fa63d947"
Jul 23 19:58:14.298892 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:14.298844    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64b02f256ab5950ce134739c42a74ccd79d229292fe750b62e75ff64fa63d947"} err="failed to get container status \"64b02f256ab5950ce134739c42a74ccd79d229292fe750b62e75ff64fa63d947\": rpc error: code = NotFound desc = could not find container \"64b02f256ab5950ce134739c42a74ccd79d229292fe750b62e75ff64fa63d947\": container with ID starting with 64b02f256ab5950ce134739c42a74ccd79d229292fe750b62e75ff64fa63d947 not found: ID does not exist"
Jul 23 19:58:14.305296 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:14.305270    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"]
Jul 23 19:58:14.311388 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:14.311367    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-111c5d-openshift-default-544b6775cc-zw256"]
Jul 23 19:58:15.651372 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:15.651336    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1215753-c31c-40e3-b027-6c1e262f6d1d" path="/var/lib/kubelet/pods/b1215753-c31c-40e3-b027-6c1e262f6d1d/volumes"
Jul 23 19:58:17.339139 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.339103    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"]
Jul 23 19:58:17.339602 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.339585    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1215753-c31c-40e3-b027-6c1e262f6d1d" containerName="istio-proxy"
Jul 23 19:58:17.339657 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.339606    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1215753-c31c-40e3-b027-6c1e262f6d1d" containerName="istio-proxy"
Jul 23 19:58:17.339711 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.339701    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1215753-c31c-40e3-b027-6c1e262f6d1d" containerName="istio-proxy"
Jul 23 19:58:17.344333 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.344309    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.347012 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.346989    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-1d04d2-openshift-default-dockercfg-8gd8x\""
Jul 23 19:58:17.357825 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.357802    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"]
Jul 23 19:58:17.403638 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.403597    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-credential-socket\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.403638 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.403641    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-istio-envoy\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.403862 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.403666    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whdh8\" (UniqueName: \"kubernetes.io/projected/46514ca6-2710-4c19-a8cf-970b2468f611-kube-api-access-whdh8\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.403862 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.403737    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46514ca6-2710-4c19-a8cf-970b2468f611-istiod-ca-cert\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.403862 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.403757    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46514ca6-2710-4c19-a8cf-970b2468f611-istio-token\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.403862 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.403775    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-workload-certs\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.403862 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.403789    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-istio-data\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.404052 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.403855    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-workload-socket\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.404052 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.403904    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46514ca6-2710-4c19-a8cf-970b2468f611-istio-podinfo\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.504561 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.504527    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whdh8\" (UniqueName: \"kubernetes.io/projected/46514ca6-2710-4c19-a8cf-970b2468f611-kube-api-access-whdh8\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.504561 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.504562    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46514ca6-2710-4c19-a8cf-970b2468f611-istiod-ca-cert\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.504834 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.504583    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46514ca6-2710-4c19-a8cf-970b2468f611-istio-token\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.504834 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.504600    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-workload-certs\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.504834 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.504720    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-istio-data\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.504834 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.504754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-workload-socket\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.504834 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.504804    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46514ca6-2710-4c19-a8cf-970b2468f611-istio-podinfo\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.505101 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.504854    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-credential-socket\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.505101 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.504905    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-istio-envoy\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.505412 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.505382    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46514ca6-2710-4c19-a8cf-970b2468f611-istiod-ca-cert\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.505564 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.505424    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-istio-data\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.505564 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.505491    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-workload-socket\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.505673 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.505602    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-credential-socket\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.505673 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.505603    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-workload-certs\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.507243 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.507223    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-istio-envoy\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.507353 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.507335    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46514ca6-2710-4c19-a8cf-970b2468f611-istio-podinfo\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.512480 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.512453    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46514ca6-2710-4c19-a8cf-970b2468f611-istio-token\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.512737 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.512719    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whdh8\" (UniqueName: \"kubernetes.io/projected/46514ca6-2710-4c19-a8cf-970b2468f611-kube-api-access-whdh8\") pod \"e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") " pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.655280 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.655170    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:17.796938 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.796913    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"]
Jul 23 19:58:17.799269 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:58:17.799230    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46514ca6_2710_4c19_a8cf_970b2468f611.slice/crio-f6384bcd120ac755d67c8f7ab1808d3cfe04775419e60a9b9edefca90b9b3d11 WatchSource:0}: Error finding container f6384bcd120ac755d67c8f7ab1808d3cfe04775419e60a9b9edefca90b9b3d11: Status 404 returned error can't find the container with id f6384bcd120ac755d67c8f7ab1808d3cfe04775419e60a9b9edefca90b9b3d11
Jul 23 19:58:17.801403 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.801372    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:58:17.801496 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.801436    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:58:17.801496 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:17.801463    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:58:18.295822 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:18.295784    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf" event={"ID":"46514ca6-2710-4c19-a8cf-970b2468f611","Type":"ContainerStarted","Data":"7d47d46997e1d723c05d109c8d41f12213fac22f12108e32a70514a0b49efdf9"}
Jul 23 19:58:18.295989 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:18.295837    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf" event={"ID":"46514ca6-2710-4c19-a8cf-970b2468f611","Type":"ContainerStarted","Data":"f6384bcd120ac755d67c8f7ab1808d3cfe04775419e60a9b9edefca90b9b3d11"}
Jul 23 19:58:18.317856 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:18.317811    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf" podStartSLOduration=1.31779738 podStartE2EDuration="1.31779738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:58:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:58:18.316113589 +0000 UTC m=+2299.153120296" watchObservedRunningTime="2026-07-23 19:58:18.31779738 +0000 UTC m=+2299.154804091"
Jul 23 19:58:18.656172 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:18.656067    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:18.661077 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:18.661053    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:19.300435 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:19.300402    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:19.301403 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:19.301382    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:27.620321 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:27.619993    2578 patch_prober.go:28] interesting pod/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": read tcp 10.133.0.2:35050->10.133.0.47:15021: read: connection reset by peer" start-of-body=
Jul 23 19:58:27.620321 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:27.620057    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs" podUID="2c9e37dd-b08d-464c-9244-ac269fe3f2d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": read tcp 10.133.0.2:35050->10.133.0.47:15021: read: connection reset by peer"
Jul 23 19:58:28.344604 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:28.344571    2578 generic.go:356] "Generic (PLEG): container finished" podID="2c9e37dd-b08d-464c-9244-ac269fe3f2d3" containerID="e7bd00f95557fb6a6c97f7f7fc444409307be26f2f25f3f1ea52b96065acc905" exitCode=0
Jul 23 19:58:28.344783 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:28.344647    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs" event={"ID":"2c9e37dd-b08d-464c-9244-ac269fe3f2d3","Type":"ContainerDied","Data":"e7bd00f95557fb6a6c97f7f7fc444409307be26f2f25f3f1ea52b96065acc905"}
Jul 23 19:58:28.345028 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:28.345014    2578 scope.go:117] "RemoveContainer" containerID="e7bd00f95557fb6a6c97f7f7fc444409307be26f2f25f3f1ea52b96065acc905"
Jul 23 19:58:28.345970 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:28.345942    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:58:28.346073 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:28.346025    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:58:28.346134 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:28.346074    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:58:29.354506 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:29.354468    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs" event={"ID":"2c9e37dd-b08d-464c-9244-ac269fe3f2d3","Type":"ContainerStarted","Data":"cbdf0edb58076a4650892b83187572954f5db31ae8e10e114081c31e7de6ca49"}
Jul 23 19:58:29.807363 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:29.807324    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:29.807620 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:29.807413    2578 patch_prober.go:28] interesting pod/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 23 19:58:29.807743 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:29.807724    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs" podUID="2c9e37dd-b08d-464c-9244-ac269fe3f2d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 23 19:58:30.807971 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:30.807927    2578 patch_prober.go:28] interesting pod/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 23 19:58:30.808397 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:30.807987    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs" podUID="2c9e37dd-b08d-464c-9244-ac269fe3f2d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 23 19:58:31.807937 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:31.807892    2578 patch_prober.go:28] interesting pod/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 23 19:58:31.808146 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:31.807952    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs" podUID="2c9e37dd-b08d-464c-9244-ac269fe3f2d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 23 19:58:32.808227 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:32.808187    2578 patch_prober.go:28] interesting pod/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 23 19:58:32.808643 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:32.808243    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs" podUID="2c9e37dd-b08d-464c-9244-ac269fe3f2d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 23 19:58:33.811244 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:33.811219    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:33.811701 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:33.811683    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:33.812216 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:33.812197    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:58:35.342402 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:35.342363    2578 patch_prober.go:28] interesting pod/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 19:58:35.342837 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:35.342426    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf" podUID="46514ca6-2710-4c19-a8cf-970b2468f611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 19:58:37.397923 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:37.397890    2578 generic.go:356] "Generic (PLEG): container finished" podID="46514ca6-2710-4c19-a8cf-970b2468f611" containerID="7d47d46997e1d723c05d109c8d41f12213fac22f12108e32a70514a0b49efdf9" exitCode=0
Jul 23 19:58:37.398372 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:37.397969    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf" event={"ID":"46514ca6-2710-4c19-a8cf-970b2468f611","Type":"ContainerDied","Data":"7d47d46997e1d723c05d109c8d41f12213fac22f12108e32a70514a0b49efdf9"}
Jul 23 19:58:37.398425 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:37.398391    2578 scope.go:117] "RemoveContainer" containerID="7d47d46997e1d723c05d109c8d41f12213fac22f12108e32a70514a0b49efdf9"
Jul 23 19:58:37.399378 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:37.399353    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:58:37.399451 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:37.399434    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:58:37.399491 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:37.399481    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:58:38.404467 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:38.404427    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf" event={"ID":"46514ca6-2710-4c19-a8cf-970b2468f611","Type":"ContainerStarted","Data":"f7ad51ab68b2bf897c070a5e5519d8944a5b618568087d9012bc2bf51812dba4"}
Jul 23 19:58:38.656600 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:38.656053    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:38.656600 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:38.656219    2578 patch_prober.go:28] interesting pod/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 23 19:58:38.656600 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:38.656287    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf" podUID="46514ca6-2710-4c19-a8cf-970b2468f611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 23 19:58:39.656031 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:39.656000    2578 patch_prober.go:28] interesting pod/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 23 19:58:39.656621 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:39.656589    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf" podUID="46514ca6-2710-4c19-a8cf-970b2468f611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 23 19:58:40.655984 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:40.655946    2578 patch_prober.go:28] interesting pod/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 23 19:58:40.656298 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:40.656270    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf" podUID="46514ca6-2710-4c19-a8cf-970b2468f611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 23 19:58:41.656352 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:41.656316    2578 patch_prober.go:28] interesting pod/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 23 19:58:41.656929 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:41.656895    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf" podUID="46514ca6-2710-4c19-a8cf-970b2468f611" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 23 19:58:42.659565 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:42.659524    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:42.660052 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:42.659982    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:42.660705 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:42.660686    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:58:59.325749 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:59.325668    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"]
Jul 23 19:58:59.326229 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:58:59.325865    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs" podUID="2c9e37dd-b08d-464c-9244-ac269fe3f2d3" containerName="istio-proxy" containerID="cri-o://cbdf0edb58076a4650892b83187572954f5db31ae8e10e114081c31e7de6ca49" gracePeriod=30
Jul 23 19:59:03.814458 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:03.814422    2578 patch_prober.go:28] interesting pod/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 19:59:03.814820 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:03.814477    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs" podUID="2c9e37dd-b08d-464c-9244-ac269fe3f2d3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 19:59:04.529587 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.529556    2578 generic.go:356] "Generic (PLEG): container finished" podID="2c9e37dd-b08d-464c-9244-ac269fe3f2d3" containerID="cbdf0edb58076a4650892b83187572954f5db31ae8e10e114081c31e7de6ca49" exitCode=0
Jul 23 19:59:04.529735 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.529627    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs" event={"ID":"2c9e37dd-b08d-464c-9244-ac269fe3f2d3","Type":"ContainerDied","Data":"cbdf0edb58076a4650892b83187572954f5db31ae8e10e114081c31e7de6ca49"}
Jul 23 19:59:04.529735 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.529692    2578 scope.go:117] "RemoveContainer" containerID="e7bd00f95557fb6a6c97f7f7fc444409307be26f2f25f3f1ea52b96065acc905"
Jul 23 19:59:04.572337 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.572312    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:59:04.632987 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.632909    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-credential-socket\") pod \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") "
Jul 23 19:59:04.632987 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.632951    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istiod-ca-cert\") pod \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") "
Jul 23 19:59:04.633155 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.633013    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-workload-certs\") pod \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") "
Jul 23 19:59:04.633155 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.633042    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-podinfo\") pod \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") "
Jul 23 19:59:04.633155 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.633086    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6l2l\" (UniqueName: \"kubernetes.io/projected/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-kube-api-access-x6l2l\") pod \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") "
Jul 23 19:59:04.633155 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.633128    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-data\") pod \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") "
Jul 23 19:59:04.633408 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.633166    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-workload-socket\") pod \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") "
Jul 23 19:59:04.633408 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.633202    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-token\") pod \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") "
Jul 23 19:59:04.633408 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.633225    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-envoy\") pod \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\" (UID: \"2c9e37dd-b08d-464c-9244-ac269fe3f2d3\") "
Jul 23 19:59:04.633408 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.633162    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2c9e37dd-b08d-464c-9244-ac269fe3f2d3" (UID: "2c9e37dd-b08d-464c-9244-ac269fe3f2d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:59:04.633408 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.633333    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2c9e37dd-b08d-464c-9244-ac269fe3f2d3" (UID: "2c9e37dd-b08d-464c-9244-ac269fe3f2d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:59:04.633408 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.633389    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2c9e37dd-b08d-464c-9244-ac269fe3f2d3" (UID: "2c9e37dd-b08d-464c-9244-ac269fe3f2d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:59:04.633766 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.633507    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-workload-certs\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:59:04.633766 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.633524    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-credential-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:59:04.633766 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.633533    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2c9e37dd-b08d-464c-9244-ac269fe3f2d3" (UID: "2c9e37dd-b08d-464c-9244-ac269fe3f2d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:59:04.633766 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.633539    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istiod-ca-cert\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:59:04.634096 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.634064    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-data" (OuterVolumeSpecName: "istio-data") pod "2c9e37dd-b08d-464c-9244-ac269fe3f2d3" (UID: "2c9e37dd-b08d-464c-9244-ac269fe3f2d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:59:04.635357 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.635327    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2c9e37dd-b08d-464c-9244-ac269fe3f2d3" (UID: "2c9e37dd-b08d-464c-9244-ac269fe3f2d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 19:59:04.635510 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.635483    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-kube-api-access-x6l2l" (OuterVolumeSpecName: "kube-api-access-x6l2l") pod "2c9e37dd-b08d-464c-9244-ac269fe3f2d3" (UID: "2c9e37dd-b08d-464c-9244-ac269fe3f2d3"). InnerVolumeSpecName "kube-api-access-x6l2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:59:04.635606 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.635584    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-token" (OuterVolumeSpecName: "istio-token") pod "2c9e37dd-b08d-464c-9244-ac269fe3f2d3" (UID: "2c9e37dd-b08d-464c-9244-ac269fe3f2d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:59:04.636303 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.636284    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2c9e37dd-b08d-464c-9244-ac269fe3f2d3" (UID: "2c9e37dd-b08d-464c-9244-ac269fe3f2d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:59:04.734224 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.734192    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-token\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:59:04.734224 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.734221    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-envoy\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:59:04.734224 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.734231    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-podinfo\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:59:04.734459 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.734243    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6l2l\" (UniqueName: \"kubernetes.io/projected/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-kube-api-access-x6l2l\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:59:04.734459 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.734289    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-istio-data\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:59:04.734459 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:04.734298    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c9e37dd-b08d-464c-9244-ac269fe3f2d3-workload-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:59:05.534449 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:05.534420    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"
Jul 23 19:59:05.534911 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:05.534452    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs" event={"ID":"2c9e37dd-b08d-464c-9244-ac269fe3f2d3","Type":"ContainerDied","Data":"01598a0cc980ef34455014017654f1fd8587b6aa68ec4e7510cfe440c25cf4aa"}
Jul 23 19:59:05.534911 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:05.534512    2578 scope.go:117] "RemoveContainer" containerID="cbdf0edb58076a4650892b83187572954f5db31ae8e10e114081c31e7de6ca49"
Jul 23 19:59:05.558969 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:05.558947    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"]
Jul 23 19:59:05.566033 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:05.566012    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-a8f21c-openshift-default-75d68d8c5c-xvjjs"]
Jul 23 19:59:05.651560 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:05.651538    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c9e37dd-b08d-464c-9244-ac269fe3f2d3" path="/var/lib/kubelet/pods/2c9e37dd-b08d-464c-9244-ac269fe3f2d3/volumes"
Jul 23 19:59:26.250006 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:26.249968    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"]
Jul 23 19:59:26.250523 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:26.250188    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf" podUID="46514ca6-2710-4c19-a8cf-970b2468f611" containerName="istio-proxy" containerID="cri-o://f7ad51ab68b2bf897c070a5e5519d8944a5b618568087d9012bc2bf51812dba4" gracePeriod=30
Jul 23 19:59:27.121297 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.121239    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"]
Jul 23 19:59:27.121663 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.121649    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1215753-c31c-40e3-b027-6c1e262f6d1d" containerName="istio-proxy"
Jul 23 19:59:27.121716 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.121666    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1215753-c31c-40e3-b027-6c1e262f6d1d" containerName="istio-proxy"
Jul 23 19:59:27.121716 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.121675    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c9e37dd-b08d-464c-9244-ac269fe3f2d3" containerName="istio-proxy"
Jul 23 19:59:27.121716 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.121681    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c9e37dd-b08d-464c-9244-ac269fe3f2d3" containerName="istio-proxy"
Jul 23 19:59:27.121811 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.121745    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c9e37dd-b08d-464c-9244-ac269fe3f2d3" containerName="istio-proxy"
Jul 23 19:59:27.121811 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.121753    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c9e37dd-b08d-464c-9244-ac269fe3f2d3" containerName="istio-proxy"
Jul 23 19:59:27.121811 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.121760    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1215753-c31c-40e3-b027-6c1e262f6d1d" containerName="istio-proxy"
Jul 23 19:59:27.124640 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.124620    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.126966 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.126944    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-fb64e5-openshift-default-dockercfg-ckxfj\""
Jul 23 19:59:27.139961 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.139934    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"]
Jul 23 19:59:27.222613 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.222565    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istiod-ca-cert\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.222803 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.222639    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-workload-certs\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.222803 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.222665    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-podinfo\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.222803 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.222712    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rtvp\" (UniqueName: \"kubernetes.io/projected/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-kube-api-access-2rtvp\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.222803 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.222740    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-envoy\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.222803 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.222775    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-credential-socket\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.223083 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.222803    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-data\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.223083 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.222849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-token\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.223083 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.222909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-workload-socket\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.323848 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.323817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istiod-ca-cert\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.324337 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.323860    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-workload-certs\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.324337 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.323886    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-podinfo\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.324337 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.323923    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rtvp\" (UniqueName: \"kubernetes.io/projected/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-kube-api-access-2rtvp\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.324337 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.323950    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-envoy\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.324337 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.323982    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-credential-socket\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.324337 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.324114    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-data\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.324337 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.324177    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-token\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.324337 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.324283    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-workload-certs\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.324337 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.324292    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-workload-socket\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.324768 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.324346    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-credential-socket\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.324768 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.324537    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-data\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.324768 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.324623    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-workload-socket\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.324768 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.324645    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istiod-ca-cert\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.326201 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.326181    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-envoy\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.326459 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.326443    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-podinfo\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.331408 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.331388    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-token\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.331644 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.331623    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rtvp\" (UniqueName: \"kubernetes.io/projected/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-kube-api-access-2rtvp\") pod \"e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") " pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.435176 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.435092    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:27.566355 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.566330    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"]
Jul 23 19:59:27.568507 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:59:27.568479    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a95e9c6_7cb3_4572_9966_9f3486d35d2c.slice/crio-d6be9b9f1c7437bdb6ac4441970f0b336961f9e08b8805a889512a767e6eb8b8 WatchSource:0}: Error finding container d6be9b9f1c7437bdb6ac4441970f0b336961f9e08b8805a889512a767e6eb8b8: Status 404 returned error can't find the container with id d6be9b9f1c7437bdb6ac4441970f0b336961f9e08b8805a889512a767e6eb8b8
Jul 23 19:59:27.570743 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.570682    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:59:27.570810 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.570778    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:59:27.570810 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.570805    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:59:27.630039 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.630012    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q" event={"ID":"1a95e9c6-7cb3-4572-9966-9f3486d35d2c","Type":"ContainerStarted","Data":"ab7f0bcc188e828ac8cdb4dfb3cc62a51e5a0fbeae79f47b17903ecbcab2fba0"}
Jul 23 19:59:27.630143 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.630062    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q" event={"ID":"1a95e9c6-7cb3-4572-9966-9f3486d35d2c","Type":"ContainerStarted","Data":"d6be9b9f1c7437bdb6ac4441970f0b336961f9e08b8805a889512a767e6eb8b8"}
Jul 23 19:59:27.647726 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.647681    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q" podStartSLOduration=0.647664196 podStartE2EDuration="647.664196ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:59:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:59:27.647101541 +0000 UTC m=+2368.484108288" watchObservedRunningTime="2026-07-23 19:59:27.647664196 +0000 UTC m=+2368.484670904"
Jul 23 19:59:27.662277 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.662223    2578 patch_prober.go:28] interesting pod/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 19:59:27.662420 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:27.662295    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf" podUID="46514ca6-2710-4c19-a8cf-970b2468f611" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 19:59:28.435601 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:28.435565    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:28.440848 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:28.440822    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:28.633927 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:28.633895    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:28.634711 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:28.634693    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:31.492556 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.492532    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:59:31.561095 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.561024    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-credential-socket\") pod \"46514ca6-2710-4c19-a8cf-970b2468f611\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") "
Jul 23 19:59:31.561228 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.561099    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whdh8\" (UniqueName: \"kubernetes.io/projected/46514ca6-2710-4c19-a8cf-970b2468f611-kube-api-access-whdh8\") pod \"46514ca6-2710-4c19-a8cf-970b2468f611\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") "
Jul 23 19:59:31.561228 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.561120    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46514ca6-2710-4c19-a8cf-970b2468f611-istio-podinfo\") pod \"46514ca6-2710-4c19-a8cf-970b2468f611\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") "
Jul 23 19:59:31.561228 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.561141    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46514ca6-2710-4c19-a8cf-970b2468f611-istio-token\") pod \"46514ca6-2710-4c19-a8cf-970b2468f611\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") "
Jul 23 19:59:31.561228 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.561156    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-workload-socket\") pod \"46514ca6-2710-4c19-a8cf-970b2468f611\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") "
Jul 23 19:59:31.561228 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.561186    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-istio-data\") pod \"46514ca6-2710-4c19-a8cf-970b2468f611\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") "
Jul 23 19:59:31.561228 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.561213    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-istio-envoy\") pod \"46514ca6-2710-4c19-a8cf-970b2468f611\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") "
Jul 23 19:59:31.561600 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.561273    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "46514ca6-2710-4c19-a8cf-970b2468f611" (UID: "46514ca6-2710-4c19-a8cf-970b2468f611"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:59:31.561600 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.561564    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "46514ca6-2710-4c19-a8cf-970b2468f611" (UID: "46514ca6-2710-4c19-a8cf-970b2468f611"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:59:31.561724 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.561247    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-workload-certs\") pod \"46514ca6-2710-4c19-a8cf-970b2468f611\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") "
Jul 23 19:59:31.561724 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.561644    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "46514ca6-2710-4c19-a8cf-970b2468f611" (UID: "46514ca6-2710-4c19-a8cf-970b2468f611"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:59:31.561724 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.561681    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46514ca6-2710-4c19-a8cf-970b2468f611-istiod-ca-cert\") pod \"46514ca6-2710-4c19-a8cf-970b2468f611\" (UID: \"46514ca6-2710-4c19-a8cf-970b2468f611\") "
Jul 23 19:59:31.562032 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.562010    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-credential-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:59:31.562122 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.562035    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-workload-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:59:31.562122 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.562050    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-workload-certs\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:59:31.562122 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.562087    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46514ca6-2710-4c19-a8cf-970b2468f611-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "46514ca6-2710-4c19-a8cf-970b2468f611" (UID: "46514ca6-2710-4c19-a8cf-970b2468f611"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:59:31.562400 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.562375    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-istio-data" (OuterVolumeSpecName: "istio-data") pod "46514ca6-2710-4c19-a8cf-970b2468f611" (UID: "46514ca6-2710-4c19-a8cf-970b2468f611"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:59:31.563619 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.563592    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "46514ca6-2710-4c19-a8cf-970b2468f611" (UID: "46514ca6-2710-4c19-a8cf-970b2468f611"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:59:31.563619 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.563602    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46514ca6-2710-4c19-a8cf-970b2468f611-istio-token" (OuterVolumeSpecName: "istio-token") pod "46514ca6-2710-4c19-a8cf-970b2468f611" (UID: "46514ca6-2710-4c19-a8cf-970b2468f611"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:59:31.563812 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.563796    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/46514ca6-2710-4c19-a8cf-970b2468f611-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "46514ca6-2710-4c19-a8cf-970b2468f611" (UID: "46514ca6-2710-4c19-a8cf-970b2468f611"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 19:59:31.563907 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.563888    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46514ca6-2710-4c19-a8cf-970b2468f611-kube-api-access-whdh8" (OuterVolumeSpecName: "kube-api-access-whdh8") pod "46514ca6-2710-4c19-a8cf-970b2468f611" (UID: "46514ca6-2710-4c19-a8cf-970b2468f611"). InnerVolumeSpecName "kube-api-access-whdh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:59:31.648465 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.648439    2578 generic.go:356] "Generic (PLEG): container finished" podID="46514ca6-2710-4c19-a8cf-970b2468f611" containerID="f7ad51ab68b2bf897c070a5e5519d8944a5b618568087d9012bc2bf51812dba4" exitCode=0
Jul 23 19:59:31.648581 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.648532    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"
Jul 23 19:59:31.651467 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.651442    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf" event={"ID":"46514ca6-2710-4c19-a8cf-970b2468f611","Type":"ContainerDied","Data":"f7ad51ab68b2bf897c070a5e5519d8944a5b618568087d9012bc2bf51812dba4"}
Jul 23 19:59:31.651573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.651484    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf" event={"ID":"46514ca6-2710-4c19-a8cf-970b2468f611","Type":"ContainerDied","Data":"f6384bcd120ac755d67c8f7ab1808d3cfe04775419e60a9b9edefca90b9b3d11"}
Jul 23 19:59:31.651573 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.651507    2578 scope.go:117] "RemoveContainer" containerID="f7ad51ab68b2bf897c070a5e5519d8944a5b618568087d9012bc2bf51812dba4"
Jul 23 19:59:31.661305 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.661289    2578 scope.go:117] "RemoveContainer" containerID="7d47d46997e1d723c05d109c8d41f12213fac22f12108e32a70514a0b49efdf9"
Jul 23 19:59:31.662403 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.662384    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whdh8\" (UniqueName: \"kubernetes.io/projected/46514ca6-2710-4c19-a8cf-970b2468f611-kube-api-access-whdh8\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:59:31.662403 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.662405    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46514ca6-2710-4c19-a8cf-970b2468f611-istio-podinfo\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:59:31.662584 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.662414    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46514ca6-2710-4c19-a8cf-970b2468f611-istio-token\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:59:31.662584 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.662422    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-istio-data\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:59:31.662584 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.662430    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46514ca6-2710-4c19-a8cf-970b2468f611-istio-envoy\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:59:31.662584 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.662437    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46514ca6-2710-4c19-a8cf-970b2468f611-istiod-ca-cert\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 19:59:31.668416 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.668389    2578 scope.go:117] "RemoveContainer" containerID="f7ad51ab68b2bf897c070a5e5519d8944a5b618568087d9012bc2bf51812dba4"
Jul 23 19:59:31.668651 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:59:31.668631    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7ad51ab68b2bf897c070a5e5519d8944a5b618568087d9012bc2bf51812dba4\": container with ID starting with f7ad51ab68b2bf897c070a5e5519d8944a5b618568087d9012bc2bf51812dba4 not found: ID does not exist" containerID="f7ad51ab68b2bf897c070a5e5519d8944a5b618568087d9012bc2bf51812dba4"
Jul 23 19:59:31.668697 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.668658    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7ad51ab68b2bf897c070a5e5519d8944a5b618568087d9012bc2bf51812dba4"} err="failed to get container status \"f7ad51ab68b2bf897c070a5e5519d8944a5b618568087d9012bc2bf51812dba4\": rpc error: code = NotFound desc = could not find container \"f7ad51ab68b2bf897c070a5e5519d8944a5b618568087d9012bc2bf51812dba4\": container with ID starting with f7ad51ab68b2bf897c070a5e5519d8944a5b618568087d9012bc2bf51812dba4 not found: ID does not exist"
Jul 23 19:59:31.668697 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.668674    2578 scope.go:117] "RemoveContainer" containerID="7d47d46997e1d723c05d109c8d41f12213fac22f12108e32a70514a0b49efdf9"
Jul 23 19:59:31.668886 ip-10-0-141-53 kubenswrapper[2578]: E0723 19:59:31.668871    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d47d46997e1d723c05d109c8d41f12213fac22f12108e32a70514a0b49efdf9\": container with ID starting with 7d47d46997e1d723c05d109c8d41f12213fac22f12108e32a70514a0b49efdf9 not found: ID does not exist" containerID="7d47d46997e1d723c05d109c8d41f12213fac22f12108e32a70514a0b49efdf9"
Jul 23 19:59:31.668924 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.668891    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d47d46997e1d723c05d109c8d41f12213fac22f12108e32a70514a0b49efdf9"} err="failed to get container status \"7d47d46997e1d723c05d109c8d41f12213fac22f12108e32a70514a0b49efdf9\": rpc error: code = NotFound desc = could not find container \"7d47d46997e1d723c05d109c8d41f12213fac22f12108e32a70514a0b49efdf9\": container with ID starting with 7d47d46997e1d723c05d109c8d41f12213fac22f12108e32a70514a0b49efdf9 not found: ID does not exist"
Jul 23 19:59:31.674622 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.674602    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"]
Jul 23 19:59:31.678699 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:31.678681    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-1d04d2-openshift-default-7fc9cb9d79-jvsmf"]
Jul 23 19:59:33.651830 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:33.651799    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46514ca6-2710-4c19-a8cf-970b2468f611" path="/var/lib/kubelet/pods/46514ca6-2710-4c19-a8cf-970b2468f611/volumes"
Jul 23 19:59:34.590625 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.590593    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"]
Jul 23 19:59:34.590914 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.590901    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c9e37dd-b08d-464c-9244-ac269fe3f2d3" containerName="istio-proxy"
Jul 23 19:59:34.590914 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.590914    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c9e37dd-b08d-464c-9244-ac269fe3f2d3" containerName="istio-proxy"
Jul 23 19:59:34.591011 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.590926    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46514ca6-2710-4c19-a8cf-970b2468f611" containerName="istio-proxy"
Jul 23 19:59:34.591011 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.590932    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="46514ca6-2710-4c19-a8cf-970b2468f611" containerName="istio-proxy"
Jul 23 19:59:34.591011 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.590938    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46514ca6-2710-4c19-a8cf-970b2468f611" containerName="istio-proxy"
Jul 23 19:59:34.591011 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.590943    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="46514ca6-2710-4c19-a8cf-970b2468f611" containerName="istio-proxy"
Jul 23 19:59:34.591011 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.590995    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="46514ca6-2710-4c19-a8cf-970b2468f611" containerName="istio-proxy"
Jul 23 19:59:34.591011 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.591004    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="46514ca6-2710-4c19-a8cf-970b2468f611" containerName="istio-proxy"
Jul 23 19:59:34.594371 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.594348    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.596779 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.596761    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-470e58-openshift-default-dockercfg-dkgp7\""
Jul 23 19:59:34.606125 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.606105    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"]
Jul 23 19:59:34.688090 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.688060    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-workload-certs\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.688090 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.688095    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-istio-envoy\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.688666 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.688120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fff297d5-dae3-418b-950d-9c4261c6e293-istio-podinfo\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.688666 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.688147    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-workload-socket\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.688666 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.688220    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-credential-socket\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.688666 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.688277    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fff297d5-dae3-418b-950d-9c4261c6e293-istio-token\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.688666 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.688311    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-istio-data\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.688666 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.688336    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrd9l\" (UniqueName: \"kubernetes.io/projected/fff297d5-dae3-418b-950d-9c4261c6e293-kube-api-access-wrd9l\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.688666 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.688388    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fff297d5-dae3-418b-950d-9c4261c6e293-istiod-ca-cert\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.789444 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.789410    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fff297d5-dae3-418b-950d-9c4261c6e293-istio-podinfo\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.789633 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.789459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-workload-socket\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.789633 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.789483    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-credential-socket\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.789633 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.789502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fff297d5-dae3-418b-950d-9c4261c6e293-istio-token\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.789633 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.789520    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-istio-data\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.789633 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.789542    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrd9l\" (UniqueName: \"kubernetes.io/projected/fff297d5-dae3-418b-950d-9c4261c6e293-kube-api-access-wrd9l\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.789633 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.789595    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fff297d5-dae3-418b-950d-9c4261c6e293-istiod-ca-cert\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.789953 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.789663    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-workload-certs\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.789953 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.789685    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-istio-envoy\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.790060 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.789961    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-credential-socket\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.790060 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.790006    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-istio-data\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.790185 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.790057    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-workload-socket\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.790237 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.790200    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-workload-certs\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.790695 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.790673    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fff297d5-dae3-418b-950d-9c4261c6e293-istiod-ca-cert\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.791888 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.791864    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-istio-envoy\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.791983 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.791905    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fff297d5-dae3-418b-950d-9c4261c6e293-istio-podinfo\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.797057 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.797035    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fff297d5-dae3-418b-950d-9c4261c6e293-istio-token\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.797246 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.797230    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrd9l\" (UniqueName: \"kubernetes.io/projected/fff297d5-dae3-418b-950d-9c4261c6e293-kube-api-access-wrd9l\") pod \"e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") " pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:34.904279 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:34.904178    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:35.042453 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:35.042430    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"]
Jul 23 19:59:35.045087 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:59:35.045061    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfff297d5_dae3_418b_950d_9c4261c6e293.slice/crio-c0676116ca5aca39ed5aa21716a09972fdc96c75886c4bd0dd1e49522cb2edaf WatchSource:0}: Error finding container c0676116ca5aca39ed5aa21716a09972fdc96c75886c4bd0dd1e49522cb2edaf: Status 404 returned error can't find the container with id c0676116ca5aca39ed5aa21716a09972fdc96c75886c4bd0dd1e49522cb2edaf
Jul 23 19:59:35.047225 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:35.047195    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:59:35.047340 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:35.047294    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:59:35.047404 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:35.047339    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:59:35.668490 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:35.668463    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4" event={"ID":"fff297d5-dae3-418b-950d-9c4261c6e293","Type":"ContainerStarted","Data":"3c41e48401d6c5a35213f0978d3fc31cffbe7388abfef1c1b9f95090fa6498f7"}
Jul 23 19:59:35.668652 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:35.668508    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4" event={"ID":"fff297d5-dae3-418b-950d-9c4261c6e293","Type":"ContainerStarted","Data":"c0676116ca5aca39ed5aa21716a09972fdc96c75886c4bd0dd1e49522cb2edaf"}
Jul 23 19:59:35.687741 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:35.687697    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4" podStartSLOduration=1.687679709 podStartE2EDuration="1.687679709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:59:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:59:35.686200971 +0000 UTC m=+2376.523207675" watchObservedRunningTime="2026-07-23 19:59:35.687679709 +0000 UTC m=+2376.524686414"
Jul 23 19:59:35.904486 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:35.904443    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:36.909341 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:36.909304    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:37.677702 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:37.677673    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:37.678837 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:37.678812    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:37.699429 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:37.699396    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs"]
Jul 23 19:59:37.701798 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:37.701778    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs"
Jul 23 19:59:37.704227 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:37.704210    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-470e58-serving-cert\""
Jul 23 19:59:37.727309 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:37.726650    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs"]
Jul 23 19:59:37.816880 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:37.816847    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh7pj\" (UniqueName: \"kubernetes.io/projected/4509e7d2-0709-4a48-b609-a0e84ad030e2-kube-api-access-qh7pj\") pod \"maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs\" (UID: \"4509e7d2-0709-4a48-b609-a0e84ad030e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs"
Jul 23 19:59:37.817067 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:37.816952    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4509e7d2-0709-4a48-b609-a0e84ad030e2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs\" (UID: \"4509e7d2-0709-4a48-b609-a0e84ad030e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs"
Jul 23 19:59:37.817136 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:37.817094    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4509e7d2-0709-4a48-b609-a0e84ad030e2-maas-api-tls\") pod \"maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs\" (UID: \"4509e7d2-0709-4a48-b609-a0e84ad030e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs"
Jul 23 19:59:37.918295 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:37.918238    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh7pj\" (UniqueName: \"kubernetes.io/projected/4509e7d2-0709-4a48-b609-a0e84ad030e2-kube-api-access-qh7pj\") pod \"maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs\" (UID: \"4509e7d2-0709-4a48-b609-a0e84ad030e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs"
Jul 23 19:59:37.918295 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:37.918299    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4509e7d2-0709-4a48-b609-a0e84ad030e2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs\" (UID: \"4509e7d2-0709-4a48-b609-a0e84ad030e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs"
Jul 23 19:59:37.918785 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:37.918336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4509e7d2-0709-4a48-b609-a0e84ad030e2-maas-api-tls\") pod \"maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs\" (UID: \"4509e7d2-0709-4a48-b609-a0e84ad030e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs"
Jul 23 19:59:37.919030 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:37.919011    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4509e7d2-0709-4a48-b609-a0e84ad030e2-openshift-service-ca\") pod \"maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs\" (UID: \"4509e7d2-0709-4a48-b609-a0e84ad030e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs"
Jul 23 19:59:37.920637 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:37.920620    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4509e7d2-0709-4a48-b609-a0e84ad030e2-maas-api-tls\") pod \"maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs\" (UID: \"4509e7d2-0709-4a48-b609-a0e84ad030e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs"
Jul 23 19:59:37.946829 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:37.946741    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh7pj\" (UniqueName: \"kubernetes.io/projected/4509e7d2-0709-4a48-b609-a0e84ad030e2-kube-api-access-qh7pj\") pod \"maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs\" (UID: \"4509e7d2-0709-4a48-b609-a0e84ad030e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs"
Jul 23 19:59:38.012016 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:38.011982    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs"
Jul 23 19:59:38.194680 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:38.194660    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs"]
Jul 23 19:59:38.196576 ip-10-0-141-53 kubenswrapper[2578]: W0723 19:59:38.196529    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4509e7d2_0709_4a48_b609_a0e84ad030e2.slice/crio-0cd5e433e94a4645a5b696e6a67d942d6298520f5e51850250be7122944b10f1 WatchSource:0}: Error finding container 0cd5e433e94a4645a5b696e6a67d942d6298520f5e51850250be7122944b10f1: Status 404 returned error can't find the container with id 0cd5e433e94a4645a5b696e6a67d942d6298520f5e51850250be7122944b10f1
Jul 23 19:59:38.198302 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:38.198286    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 19:59:38.684777 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:38.684743    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs" event={"ID":"4509e7d2-0709-4a48-b609-a0e84ad030e2","Type":"ContainerStarted","Data":"297cfe7557aa3e51b964353e1a5dda2b4dd697049d1e4db6e561b8512b04c6f0"}
Jul 23 19:59:38.684960 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:38.684796    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs" event={"ID":"4509e7d2-0709-4a48-b609-a0e84ad030e2","Type":"ContainerStarted","Data":"0cd5e433e94a4645a5b696e6a67d942d6298520f5e51850250be7122944b10f1"}
Jul 23 19:59:38.684960 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:38.684823    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs"
Jul 23 19:59:38.702474 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:38.702426    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs" podStartSLOduration=1.33012219 podStartE2EDuration="1.702409307s" totalImagesPullingTime="372.287117ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 19:59:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:59:38.701343041 +0000 UTC m=+2379.538349762" watchObservedRunningTime="2026-07-23 19:59:38.702409307 +0000 UTC m=+2379.539416063"
Jul 23 19:59:44.446881 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:44.446680    2578 patch_prober.go:28] interesting pod/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": read tcp 10.133.0.2:34440->10.133.0.49:15021: read: connection reset by peer" start-of-body=
Jul 23 19:59:44.446881 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:44.446755    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q" podUID="1a95e9c6-7cb3-4572-9966-9f3486d35d2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": read tcp 10.133.0.2:34440->10.133.0.49:15021: read: connection reset by peer"
Jul 23 19:59:44.694230 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:44.694159    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs"
Jul 23 19:59:44.710815 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:44.710745    2578 generic.go:356] "Generic (PLEG): container finished" podID="1a95e9c6-7cb3-4572-9966-9f3486d35d2c" containerID="ab7f0bcc188e828ac8cdb4dfb3cc62a51e5a0fbeae79f47b17903ecbcab2fba0" exitCode=0
Jul 23 19:59:44.710815 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:44.710790    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q" event={"ID":"1a95e9c6-7cb3-4572-9966-9f3486d35d2c","Type":"ContainerDied","Data":"ab7f0bcc188e828ac8cdb4dfb3cc62a51e5a0fbeae79f47b17903ecbcab2fba0"}
Jul 23 19:59:44.711299 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:44.711265    2578 scope.go:117] "RemoveContainer" containerID="ab7f0bcc188e828ac8cdb4dfb3cc62a51e5a0fbeae79f47b17903ecbcab2fba0"
Jul 23 19:59:44.712560 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:44.712531    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:59:44.712623 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:44.712598    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:59:44.712660 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:44.712635    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:59:45.717957 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:45.717926    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q" event={"ID":"1a95e9c6-7cb3-4572-9966-9f3486d35d2c","Type":"ContainerStarted","Data":"e4ec7360444055186d3606321825c3d25e5322e28db1f1330909d556ad277f74"}
Jul 23 19:59:46.436160 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:46.436126    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:46.436638 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:46.436611    2578 patch_prober.go:28] interesting pod/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 23 19:59:46.436807 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:46.436782    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q" podUID="1a95e9c6-7cb3-4572-9966-9f3486d35d2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 23 19:59:47.435683 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:47.435645    2578 patch_prober.go:28] interesting pod/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 23 19:59:47.436313 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:47.436277    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q" podUID="1a95e9c6-7cb3-4572-9966-9f3486d35d2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 23 19:59:48.436587 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:48.436540    2578 patch_prober.go:28] interesting pod/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 23 19:59:48.437094 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:48.436623    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q" podUID="1a95e9c6-7cb3-4572-9966-9f3486d35d2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 23 19:59:49.436479 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:49.436433    2578 patch_prober.go:28] interesting pod/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 23 19:59:49.436706 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:49.436509    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q" podUID="1a95e9c6-7cb3-4572-9966-9f3486d35d2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 23 19:59:50.439753 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:50.439716    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:50.440280 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:50.440225    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:50.440931 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:50.440909    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 19:59:53.002992 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:53.002928    2578 patch_prober.go:28] interesting pod/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": read tcp 10.133.0.2:60190->10.133.0.50:15021: read: connection reset by peer" start-of-body=
Jul 23 19:59:53.003356 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:53.003044    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4" podUID="fff297d5-dae3-418b-950d-9c4261c6e293" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": read tcp 10.133.0.2:60190->10.133.0.50:15021: read: connection reset by peer"
Jul 23 19:59:53.760398 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:53.760365    2578 generic.go:356] "Generic (PLEG): container finished" podID="fff297d5-dae3-418b-950d-9c4261c6e293" containerID="3c41e48401d6c5a35213f0978d3fc31cffbe7388abfef1c1b9f95090fa6498f7" exitCode=0
Jul 23 19:59:53.760574 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:53.760441    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4" event={"ID":"fff297d5-dae3-418b-950d-9c4261c6e293","Type":"ContainerDied","Data":"3c41e48401d6c5a35213f0978d3fc31cffbe7388abfef1c1b9f95090fa6498f7"}
Jul 23 19:59:53.760847 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:53.760834    2578 scope.go:117] "RemoveContainer" containerID="3c41e48401d6c5a35213f0978d3fc31cffbe7388abfef1c1b9f95090fa6498f7"
Jul 23 19:59:53.761911 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:53.761880    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:59:53.761983 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:53.761966    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:59:53.762034 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:53.762008    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 19:59:54.768221 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:54.768188    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4" event={"ID":"fff297d5-dae3-418b-950d-9c4261c6e293","Type":"ContainerStarted","Data":"6f4eed45e6d4fa4e5b31622adf4c96969b70b3debfcfeb02b3665731b625f9e6"}
Jul 23 19:59:54.904508 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:54.904470    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:54.904765 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:54.904702    2578 patch_prober.go:28] interesting pod/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 23 19:59:54.904847 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:54.904757    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4" podUID="fff297d5-dae3-418b-950d-9c4261c6e293" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 23 19:59:55.904828 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:55.904792    2578 patch_prober.go:28] interesting pod/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 23 19:59:55.905194 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:55.904848    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4" podUID="fff297d5-dae3-418b-950d-9c4261c6e293" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 23 19:59:56.905551 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:56.905518    2578 patch_prober.go:28] interesting pod/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 23 19:59:56.905931 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:56.905574    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4" podUID="fff297d5-dae3-418b-950d-9c4261c6e293" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 23 19:59:57.905450 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:57.905416    2578 patch_prober.go:28] interesting pod/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 23 19:59:57.905644 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:57.905471    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4" podUID="fff297d5-dae3-418b-950d-9c4261c6e293" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 23 19:59:58.907880 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:58.907853    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:58.908296 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:58.908113    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 19:59:58.908868 ip-10-0-141-53 kubenswrapper[2578]: I0723 19:59:58.908849    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 20:02:14.317666 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.317633    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"]
Jul 23 20:02:14.319780 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.319765    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:14.322184 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.322160    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fb64e5\"/\"sub-test-model-fb64e5-kserve-self-signed-certs\""
Jul 23 20:02:14.323179 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.323158    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fb64e5\"/\"openshift-service-ca.crt\""
Jul 23 20:02:14.323309 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.323193    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fb64e5\"/\"default-dockercfg-hvlbz\""
Jul 23 20:02:14.323309 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.323157    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fb64e5\"/\"kube-root-ca.crt\""
Jul 23 20:02:14.328714 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.328692    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"]
Jul 23 20:02:14.496495 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.496462    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjtxk\" (UniqueName: \"kubernetes.io/projected/dfb5229c-0a2f-4756-8095-32fd58f74f59-kube-api-access-cjtxk\") pod \"sub-test-model-fb64e5-kserve-5b689f74c5-mfrht\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") " pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:14.496495 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.496498    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-dshm\") pod \"sub-test-model-fb64e5-kserve-5b689f74c5-mfrht\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") " pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:14.496702 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.496521    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-model-cache\") pod \"sub-test-model-fb64e5-kserve-5b689f74c5-mfrht\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") " pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:14.496702 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.496619    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfb5229c-0a2f-4756-8095-32fd58f74f59-tls-certs\") pod \"sub-test-model-fb64e5-kserve-5b689f74c5-mfrht\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") " pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:14.496702 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.496656    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-tmp-dir\") pod \"sub-test-model-fb64e5-kserve-5b689f74c5-mfrht\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") " pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:14.496804 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.496705    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-home\") pod \"sub-test-model-fb64e5-kserve-5b689f74c5-mfrht\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") " pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:14.597861 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.597774    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-model-cache\") pod \"sub-test-model-fb64e5-kserve-5b689f74c5-mfrht\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") " pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:14.597861 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.597828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfb5229c-0a2f-4756-8095-32fd58f74f59-tls-certs\") pod \"sub-test-model-fb64e5-kserve-5b689f74c5-mfrht\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") " pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:14.598093 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.597870    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-tmp-dir\") pod \"sub-test-model-fb64e5-kserve-5b689f74c5-mfrht\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") " pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:14.598093 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.597911    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-home\") pod \"sub-test-model-fb64e5-kserve-5b689f74c5-mfrht\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") " pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:14.598093 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.597979    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjtxk\" (UniqueName: \"kubernetes.io/projected/dfb5229c-0a2f-4756-8095-32fd58f74f59-kube-api-access-cjtxk\") pod \"sub-test-model-fb64e5-kserve-5b689f74c5-mfrht\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") " pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:14.598093 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.598004    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-dshm\") pod \"sub-test-model-fb64e5-kserve-5b689f74c5-mfrht\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") " pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:14.598374 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.598305    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-model-cache\") pod \"sub-test-model-fb64e5-kserve-5b689f74c5-mfrht\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") " pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:14.598374 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.598349    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-tmp-dir\") pod \"sub-test-model-fb64e5-kserve-5b689f74c5-mfrht\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") " pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:14.598464 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.598372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-home\") pod \"sub-test-model-fb64e5-kserve-5b689f74c5-mfrht\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") " pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:14.600285 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.600238    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-dshm\") pod \"sub-test-model-fb64e5-kserve-5b689f74c5-mfrht\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") " pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:14.600539 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.600520    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfb5229c-0a2f-4756-8095-32fd58f74f59-tls-certs\") pod \"sub-test-model-fb64e5-kserve-5b689f74c5-mfrht\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") " pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:14.606338 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.606314    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjtxk\" (UniqueName: \"kubernetes.io/projected/dfb5229c-0a2f-4756-8095-32fd58f74f59-kube-api-access-cjtxk\") pod \"sub-test-model-fb64e5-kserve-5b689f74c5-mfrht\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") " pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:14.630362 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.630336    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:14.759145 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:14.759117    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"]
Jul 23 20:02:14.761011 ip-10-0-141-53 kubenswrapper[2578]: W0723 20:02:14.760983    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddfb5229c_0a2f_4756_8095_32fd58f74f59.slice/crio-2e5c59ba8edbadefe3e95a4fe92d65d46e4b8947f8941c8ae126ab0fa98cd5f3 WatchSource:0}: Error finding container 2e5c59ba8edbadefe3e95a4fe92d65d46e4b8947f8941c8ae126ab0fa98cd5f3: Status 404 returned error can't find the container with id 2e5c59ba8edbadefe3e95a4fe92d65d46e4b8947f8941c8ae126ab0fa98cd5f3
Jul 23 20:02:15.386814 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:15.386780    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht" event={"ID":"dfb5229c-0a2f-4756-8095-32fd58f74f59","Type":"ContainerStarted","Data":"02d56e007867809ae0c8b6d934cdaca03bfbc195acbe044692b257db980cd534"}
Jul 23 20:02:15.387333 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:15.386822    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht" event={"ID":"dfb5229c-0a2f-4756-8095-32fd58f74f59","Type":"ContainerStarted","Data":"2e5c59ba8edbadefe3e95a4fe92d65d46e4b8947f8941c8ae126ab0fa98cd5f3"}
Jul 23 20:02:15.418460 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:15.418419    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht" podStartSLOduration=1.418404729 podStartE2EDuration="1.418404729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 20:02:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 20:02:15.417498977 +0000 UTC m=+2536.254505711" watchObservedRunningTime="2026-07-23 20:02:15.418404729 +0000 UTC m=+2536.255411436"
Jul 23 20:02:24.631044 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:24.631004    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:24.631484 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:24.631065    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:24.644592 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:24.644562    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:02:25.445014 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:02:25.444983    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:03:09.889873 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:09.889841    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"]
Jul 23 20:03:18.816787 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:18.816754    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"]
Jul 23 20:03:18.819467 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:18.819447    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:18.821998 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:18.821978    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fb64e5\"/\"rate-test-model-fb64e5-kserve-self-signed-certs\""
Jul 23 20:03:18.829754 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:18.829733    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"]
Jul 23 20:03:18.935264 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:18.935230    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-tmp-dir\") pod \"rate-test-model-fb64e5-kserve-849dfc555f-gn9wk\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") " pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:18.935452 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:18.935292    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9dcv\" (UniqueName: \"kubernetes.io/projected/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-kube-api-access-j9dcv\") pod \"rate-test-model-fb64e5-kserve-849dfc555f-gn9wk\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") " pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:18.935452 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:18.935320    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-dshm\") pod \"rate-test-model-fb64e5-kserve-849dfc555f-gn9wk\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") " pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:18.935452 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:18.935355    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-home\") pod \"rate-test-model-fb64e5-kserve-849dfc555f-gn9wk\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") " pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:18.935452 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:18.935376    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-model-cache\") pod \"rate-test-model-fb64e5-kserve-849dfc555f-gn9wk\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") " pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:18.935452 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:18.935397    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-tls-certs\") pod \"rate-test-model-fb64e5-kserve-849dfc555f-gn9wk\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") " pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:19.036481 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:19.036447    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-home\") pod \"rate-test-model-fb64e5-kserve-849dfc555f-gn9wk\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") " pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:19.036481 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:19.036479    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-model-cache\") pod \"rate-test-model-fb64e5-kserve-849dfc555f-gn9wk\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") " pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:19.036736 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:19.036503    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-tls-certs\") pod \"rate-test-model-fb64e5-kserve-849dfc555f-gn9wk\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") " pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:19.036736 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:19.036577    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-tmp-dir\") pod \"rate-test-model-fb64e5-kserve-849dfc555f-gn9wk\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") " pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:19.036736 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:19.036631    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9dcv\" (UniqueName: \"kubernetes.io/projected/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-kube-api-access-j9dcv\") pod \"rate-test-model-fb64e5-kserve-849dfc555f-gn9wk\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") " pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:19.036736 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:19.036671    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-dshm\") pod \"rate-test-model-fb64e5-kserve-849dfc555f-gn9wk\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") " pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:19.036955 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:19.036931    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-model-cache\") pod \"rate-test-model-fb64e5-kserve-849dfc555f-gn9wk\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") " pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:19.037013 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:19.036957    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-home\") pod \"rate-test-model-fb64e5-kserve-849dfc555f-gn9wk\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") " pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:19.037013 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:19.036984    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-tmp-dir\") pod \"rate-test-model-fb64e5-kserve-849dfc555f-gn9wk\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") " pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:19.038881 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:19.038850    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-dshm\") pod \"rate-test-model-fb64e5-kserve-849dfc555f-gn9wk\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") " pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:19.039281 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:19.039243    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-tls-certs\") pod \"rate-test-model-fb64e5-kserve-849dfc555f-gn9wk\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") " pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:19.045449 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:19.045428    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9dcv\" (UniqueName: \"kubernetes.io/projected/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-kube-api-access-j9dcv\") pod \"rate-test-model-fb64e5-kserve-849dfc555f-gn9wk\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") " pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:19.130918 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:19.130862    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:19.268528 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:19.268505    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"]
Jul 23 20:03:19.270590 ip-10-0-141-53 kubenswrapper[2578]: W0723 20:03:19.270551    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9ed5b8a_cf63_4300_984d_d9d1a66e79bd.slice/crio-c1c1b62dd705ac7a6c37b474aedfc15c0c77ed6c54e77d1935fc00f7322c6cfe WatchSource:0}: Error finding container c1c1b62dd705ac7a6c37b474aedfc15c0c77ed6c54e77d1935fc00f7322c6cfe: Status 404 returned error can't find the container with id c1c1b62dd705ac7a6c37b474aedfc15c0c77ed6c54e77d1935fc00f7322c6cfe
Jul 23 20:03:19.675303 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:19.675270    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk" event={"ID":"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd","Type":"ContainerStarted","Data":"ec6f884e11445f53d6c88934629d25a4a1fc3e3e90d6db18b9f88554e49cfcd4"}
Jul 23 20:03:19.675303 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:19.675307    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk" event={"ID":"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd","Type":"ContainerStarted","Data":"c1c1b62dd705ac7a6c37b474aedfc15c0c77ed6c54e77d1935fc00f7322c6cfe"}
Jul 23 20:03:19.691963 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:19.691915    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk" podStartSLOduration=1.691897424 podStartE2EDuration="1.691897424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 20:03:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 20:03:19.691612932 +0000 UTC m=+2600.528619638" watchObservedRunningTime="2026-07-23 20:03:19.691897424 +0000 UTC m=+2600.528904131"
Jul 23 20:03:24.910035 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:24.910000    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht" podUID="dfb5229c-0a2f-4756-8095-32fd58f74f59" containerName="main" containerID="cri-o://02d56e007867809ae0c8b6d934cdaca03bfbc195acbe044692b257db980cd534" gracePeriod=45
Jul 23 20:03:25.161871 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.161816    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:03:25.180757 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.180732    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjtxk\" (UniqueName: \"kubernetes.io/projected/dfb5229c-0a2f-4756-8095-32fd58f74f59-kube-api-access-cjtxk\") pod \"dfb5229c-0a2f-4756-8095-32fd58f74f59\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") "
Jul 23 20:03:25.180891 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.180789    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-home\") pod \"dfb5229c-0a2f-4756-8095-32fd58f74f59\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") "
Jul 23 20:03:25.180891 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.180820    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfb5229c-0a2f-4756-8095-32fd58f74f59-tls-certs\") pod \"dfb5229c-0a2f-4756-8095-32fd58f74f59\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") "
Jul 23 20:03:25.180891 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.180848    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-model-cache\") pod \"dfb5229c-0a2f-4756-8095-32fd58f74f59\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") "
Jul 23 20:03:25.181052 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.180896    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-tmp-dir\") pod \"dfb5229c-0a2f-4756-8095-32fd58f74f59\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") "
Jul 23 20:03:25.181052 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.180966    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-dshm\") pod \"dfb5229c-0a2f-4756-8095-32fd58f74f59\" (UID: \"dfb5229c-0a2f-4756-8095-32fd58f74f59\") "
Jul 23 20:03:25.181439 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.181393    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dfb5229c-0a2f-4756-8095-32fd58f74f59" (UID: "dfb5229c-0a2f-4756-8095-32fd58f74f59"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:03:25.181949 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.181897    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-home" (OuterVolumeSpecName: "home") pod "dfb5229c-0a2f-4756-8095-32fd58f74f59" (UID: "dfb5229c-0a2f-4756-8095-32fd58f74f59"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:03:25.182134 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.182113    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-model-cache" (OuterVolumeSpecName: "model-cache") pod "dfb5229c-0a2f-4756-8095-32fd58f74f59" (UID: "dfb5229c-0a2f-4756-8095-32fd58f74f59"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:03:25.183433 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.183405    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfb5229c-0a2f-4756-8095-32fd58f74f59-kube-api-access-cjtxk" (OuterVolumeSpecName: "kube-api-access-cjtxk") pod "dfb5229c-0a2f-4756-8095-32fd58f74f59" (UID: "dfb5229c-0a2f-4756-8095-32fd58f74f59"). InnerVolumeSpecName "kube-api-access-cjtxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 20:03:25.183543 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.183501    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfb5229c-0a2f-4756-8095-32fd58f74f59-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dfb5229c-0a2f-4756-8095-32fd58f74f59" (UID: "dfb5229c-0a2f-4756-8095-32fd58f74f59"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 20:03:25.183543 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.183507    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-dshm" (OuterVolumeSpecName: "dshm") pod "dfb5229c-0a2f-4756-8095-32fd58f74f59" (UID: "dfb5229c-0a2f-4756-8095-32fd58f74f59"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:03:25.281734 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.281707    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-tmp-dir\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:03:25.281734 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.281729    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-dshm\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:03:25.281734 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.281738    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjtxk\" (UniqueName: \"kubernetes.io/projected/dfb5229c-0a2f-4756-8095-32fd58f74f59-kube-api-access-cjtxk\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:03:25.281944 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.281748    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-home\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:03:25.281944 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.281756    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfb5229c-0a2f-4756-8095-32fd58f74f59-tls-certs\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:03:25.281944 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.281764    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfb5229c-0a2f-4756-8095-32fd58f74f59-model-cache\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:03:25.701422 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.701387    2578 generic.go:356] "Generic (PLEG): container finished" podID="dfb5229c-0a2f-4756-8095-32fd58f74f59" containerID="02d56e007867809ae0c8b6d934cdaca03bfbc195acbe044692b257db980cd534" exitCode=0
Jul 23 20:03:25.701422 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.701421    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"
Jul 23 20:03:25.701611 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.701470    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht" event={"ID":"dfb5229c-0a2f-4756-8095-32fd58f74f59","Type":"ContainerDied","Data":"02d56e007867809ae0c8b6d934cdaca03bfbc195acbe044692b257db980cd534"}
Jul 23 20:03:25.701611 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.701504    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht" event={"ID":"dfb5229c-0a2f-4756-8095-32fd58f74f59","Type":"ContainerDied","Data":"2e5c59ba8edbadefe3e95a4fe92d65d46e4b8947f8941c8ae126ab0fa98cd5f3"}
Jul 23 20:03:25.701611 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.701522    2578 scope.go:117] "RemoveContainer" containerID="02d56e007867809ae0c8b6d934cdaca03bfbc195acbe044692b257db980cd534"
Jul 23 20:03:25.709794 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.709774    2578 scope.go:117] "RemoveContainer" containerID="02d56e007867809ae0c8b6d934cdaca03bfbc195acbe044692b257db980cd534"
Jul 23 20:03:25.710044 ip-10-0-141-53 kubenswrapper[2578]: E0723 20:03:25.710024    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02d56e007867809ae0c8b6d934cdaca03bfbc195acbe044692b257db980cd534\": container with ID starting with 02d56e007867809ae0c8b6d934cdaca03bfbc195acbe044692b257db980cd534 not found: ID does not exist" containerID="02d56e007867809ae0c8b6d934cdaca03bfbc195acbe044692b257db980cd534"
Jul 23 20:03:25.710095 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.710053    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02d56e007867809ae0c8b6d934cdaca03bfbc195acbe044692b257db980cd534"} err="failed to get container status \"02d56e007867809ae0c8b6d934cdaca03bfbc195acbe044692b257db980cd534\": rpc error: code = NotFound desc = could not find container \"02d56e007867809ae0c8b6d934cdaca03bfbc195acbe044692b257db980cd534\": container with ID starting with 02d56e007867809ae0c8b6d934cdaca03bfbc195acbe044692b257db980cd534 not found: ID does not exist"
Jul 23 20:03:25.718571 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.718546    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"]
Jul 23 20:03:25.722824 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:25.722804    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-fb64e5/sub-test-model-fb64e5-kserve-5b689f74c5-mfrht"]
Jul 23 20:03:27.651665 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:27.651635    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfb5229c-0a2f-4756-8095-32fd58f74f59" path="/var/lib/kubelet/pods/dfb5229c-0a2f-4756-8095-32fd58f74f59/volumes"
Jul 23 20:03:29.131060 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:29.131026    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:29.131503 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:29.131072    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:29.143535 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:29.143505    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:03:29.730468 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:03:29.730432    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:04:36.859736 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:36.859697    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"]
Jul 23 20:04:51.879690 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:51.879599    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk" podUID="d9ed5b8a-cf63-4300-984d-d9d1a66e79bd" containerName="main" containerID="cri-o://ec6f884e11445f53d6c88934629d25a4a1fc3e3e90d6db18b9f88554e49cfcd4" gracePeriod=45
Jul 23 20:04:52.083210 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:52.083180    2578 generic.go:356] "Generic (PLEG): container finished" podID="d9ed5b8a-cf63-4300-984d-d9d1a66e79bd" containerID="ec6f884e11445f53d6c88934629d25a4a1fc3e3e90d6db18b9f88554e49cfcd4" exitCode=0
Jul 23 20:04:52.083386 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:52.083260    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk" event={"ID":"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd","Type":"ContainerDied","Data":"ec6f884e11445f53d6c88934629d25a4a1fc3e3e90d6db18b9f88554e49cfcd4"}
Jul 23 20:04:52.129508 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:52.129485    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:04:52.222792 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:52.222758    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-home\") pod \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") "
Jul 23 20:04:52.222974 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:52.222798    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-tmp-dir\") pod \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") "
Jul 23 20:04:52.222974 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:52.222818    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-tls-certs\") pod \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") "
Jul 23 20:04:52.222974 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:52.222868    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-dshm\") pod \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") "
Jul 23 20:04:52.222974 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:52.222894    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-model-cache\") pod \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") "
Jul 23 20:04:52.223196 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:52.222983    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9dcv\" (UniqueName: \"kubernetes.io/projected/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-kube-api-access-j9dcv\") pod \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\" (UID: \"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd\") "
Jul 23 20:04:52.223196 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:52.223095    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d9ed5b8a-cf63-4300-984d-d9d1a66e79bd" (UID: "d9ed5b8a-cf63-4300-984d-d9d1a66e79bd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:04:52.223196 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:52.223107    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-home" (OuterVolumeSpecName: "home") pod "d9ed5b8a-cf63-4300-984d-d9d1a66e79bd" (UID: "d9ed5b8a-cf63-4300-984d-d9d1a66e79bd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:04:52.223362 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:52.223290    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-model-cache" (OuterVolumeSpecName: "model-cache") pod "d9ed5b8a-cf63-4300-984d-d9d1a66e79bd" (UID: "d9ed5b8a-cf63-4300-984d-d9d1a66e79bd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:04:52.223439 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:52.223418    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-home\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:04:52.223521 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:52.223443    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-tmp-dir\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:04:52.223521 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:52.223453    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-model-cache\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:04:52.225128 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:52.225102    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d9ed5b8a-cf63-4300-984d-d9d1a66e79bd" (UID: "d9ed5b8a-cf63-4300-984d-d9d1a66e79bd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 20:04:52.225128 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:52.225116    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-kube-api-access-j9dcv" (OuterVolumeSpecName: "kube-api-access-j9dcv") pod "d9ed5b8a-cf63-4300-984d-d9d1a66e79bd" (UID: "d9ed5b8a-cf63-4300-984d-d9d1a66e79bd"). InnerVolumeSpecName "kube-api-access-j9dcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 20:04:52.225272 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:52.225163    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-dshm" (OuterVolumeSpecName: "dshm") pod "d9ed5b8a-cf63-4300-984d-d9d1a66e79bd" (UID: "d9ed5b8a-cf63-4300-984d-d9d1a66e79bd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:04:52.324202 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:52.324168    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9dcv\" (UniqueName: \"kubernetes.io/projected/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-kube-api-access-j9dcv\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:04:52.324202 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:52.324198    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-tls-certs\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:04:52.324202 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:52.324209    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd-dshm\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:04:53.089705 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:53.089593    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"
Jul 23 20:04:53.089705 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:53.089610    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk" event={"ID":"d9ed5b8a-cf63-4300-984d-d9d1a66e79bd","Type":"ContainerDied","Data":"c1c1b62dd705ac7a6c37b474aedfc15c0c77ed6c54e77d1935fc00f7322c6cfe"}
Jul 23 20:04:53.089705 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:53.089664    2578 scope.go:117] "RemoveContainer" containerID="ec6f884e11445f53d6c88934629d25a4a1fc3e3e90d6db18b9f88554e49cfcd4"
Jul 23 20:04:53.110584 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:53.110560    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"]
Jul 23 20:04:53.114423 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:53.114400    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-fb64e5/rate-test-model-fb64e5-kserve-849dfc555f-gn9wk"]
Jul 23 20:04:53.655624 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:04:53.655578    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9ed5b8a-cf63-4300-984d-d9d1a66e79bd" path="/var/lib/kubelet/pods/d9ed5b8a-cf63-4300-984d-d9d1a66e79bd/volumes"
Jul 23 20:05:18.747504 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:18.747474    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"]
Jul 23 20:05:18.747959 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:18.747686    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q" podUID="1a95e9c6-7cb3-4572-9966-9f3486d35d2c" containerName="istio-proxy" containerID="cri-o://e4ec7360444055186d3606321825c3d25e5322e28db1f1330909d556ad277f74" gracePeriod=30
Jul 23 20:05:20.443156 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:20.443115    2578 patch_prober.go:28] interesting pod/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 20:05:20.443550 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:20.443183    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q" podUID="1a95e9c6-7cb3-4572-9966-9f3486d35d2c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 20:05:23.997551 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:23.997525    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 20:05:24.085234 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.085157    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-workload-certs\") pod \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") "
Jul 23 20:05:24.085234 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.085194    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-credential-socket\") pod \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") "
Jul 23 20:05:24.085234 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.085222    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-token\") pod \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") "
Jul 23 20:05:24.085508 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.085275    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-workload-socket\") pod \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") "
Jul 23 20:05:24.085508 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.085312    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rtvp\" (UniqueName: \"kubernetes.io/projected/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-kube-api-access-2rtvp\") pod \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") "
Jul 23 20:05:24.085508 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.085341    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-podinfo\") pod \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") "
Jul 23 20:05:24.085508 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.085391    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-envoy\") pod \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") "
Jul 23 20:05:24.085508 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.085429    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istiod-ca-cert\") pod \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") "
Jul 23 20:05:24.085508 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.085452    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-data\") pod \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\" (UID: \"1a95e9c6-7cb3-4572-9966-9f3486d35d2c\") "
Jul 23 20:05:24.085508 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.085503    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1a95e9c6-7cb3-4572-9966-9f3486d35d2c" (UID: "1a95e9c6-7cb3-4572-9966-9f3486d35d2c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:05:24.085865 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.085547    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1a95e9c6-7cb3-4572-9966-9f3486d35d2c" (UID: "1a95e9c6-7cb3-4572-9966-9f3486d35d2c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:05:24.085865 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.085655    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1a95e9c6-7cb3-4572-9966-9f3486d35d2c" (UID: "1a95e9c6-7cb3-4572-9966-9f3486d35d2c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:05:24.085865 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.085826    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-workload-certs\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:05:24.086000 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.085869    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-credential-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:05:24.086000 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.085880    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1a95e9c6-7cb3-4572-9966-9f3486d35d2c" (UID: "1a95e9c6-7cb3-4572-9966-9f3486d35d2c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 20:05:24.086000 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.085888    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-workload-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:05:24.086611 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.086587    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-data" (OuterVolumeSpecName: "istio-data") pod "1a95e9c6-7cb3-4572-9966-9f3486d35d2c" (UID: "1a95e9c6-7cb3-4572-9966-9f3486d35d2c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:05:24.087673 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.087641    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1a95e9c6-7cb3-4572-9966-9f3486d35d2c" (UID: "1a95e9c6-7cb3-4572-9966-9f3486d35d2c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 20:05:24.087795 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.087709    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1a95e9c6-7cb3-4572-9966-9f3486d35d2c" (UID: "1a95e9c6-7cb3-4572-9966-9f3486d35d2c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:05:24.087904 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.087885    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-token" (OuterVolumeSpecName: "istio-token") pod "1a95e9c6-7cb3-4572-9966-9f3486d35d2c" (UID: "1a95e9c6-7cb3-4572-9966-9f3486d35d2c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 20:05:24.087998 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.087980    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-kube-api-access-2rtvp" (OuterVolumeSpecName: "kube-api-access-2rtvp") pod "1a95e9c6-7cb3-4572-9966-9f3486d35d2c" (UID: "1a95e9c6-7cb3-4572-9966-9f3486d35d2c"). InnerVolumeSpecName "kube-api-access-2rtvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 20:05:24.187002 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.186978    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-envoy\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:05:24.187002 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.187001    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istiod-ca-cert\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:05:24.187160 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.187009    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-data\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:05:24.187160 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.187018    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-token\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:05:24.187160 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.187026    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rtvp\" (UniqueName: \"kubernetes.io/projected/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-kube-api-access-2rtvp\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:05:24.187160 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.187037    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a95e9c6-7cb3-4572-9966-9f3486d35d2c-istio-podinfo\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:05:24.226435 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.226407    2578 generic.go:356] "Generic (PLEG): container finished" podID="1a95e9c6-7cb3-4572-9966-9f3486d35d2c" containerID="e4ec7360444055186d3606321825c3d25e5322e28db1f1330909d556ad277f74" exitCode=0
Jul 23 20:05:24.226551 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.226453    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"
Jul 23 20:05:24.226551 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.226500    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q" event={"ID":"1a95e9c6-7cb3-4572-9966-9f3486d35d2c","Type":"ContainerDied","Data":"e4ec7360444055186d3606321825c3d25e5322e28db1f1330909d556ad277f74"}
Jul 23 20:05:24.226642 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.226551    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q" event={"ID":"1a95e9c6-7cb3-4572-9966-9f3486d35d2c","Type":"ContainerDied","Data":"d6be9b9f1c7437bdb6ac4441970f0b336961f9e08b8805a889512a767e6eb8b8"}
Jul 23 20:05:24.226642 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.226573    2578 scope.go:117] "RemoveContainer" containerID="e4ec7360444055186d3606321825c3d25e5322e28db1f1330909d556ad277f74"
Jul 23 20:05:24.235367 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.235348    2578 scope.go:117] "RemoveContainer" containerID="ab7f0bcc188e828ac8cdb4dfb3cc62a51e5a0fbeae79f47b17903ecbcab2fba0"
Jul 23 20:05:24.242981 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.242962    2578 scope.go:117] "RemoveContainer" containerID="e4ec7360444055186d3606321825c3d25e5322e28db1f1330909d556ad277f74"
Jul 23 20:05:24.243263 ip-10-0-141-53 kubenswrapper[2578]: E0723 20:05:24.243228    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4ec7360444055186d3606321825c3d25e5322e28db1f1330909d556ad277f74\": container with ID starting with e4ec7360444055186d3606321825c3d25e5322e28db1f1330909d556ad277f74 not found: ID does not exist" containerID="e4ec7360444055186d3606321825c3d25e5322e28db1f1330909d556ad277f74"
Jul 23 20:05:24.243370 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.243352    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4ec7360444055186d3606321825c3d25e5322e28db1f1330909d556ad277f74"} err="failed to get container status \"e4ec7360444055186d3606321825c3d25e5322e28db1f1330909d556ad277f74\": rpc error: code = NotFound desc = could not find container \"e4ec7360444055186d3606321825c3d25e5322e28db1f1330909d556ad277f74\": container with ID starting with e4ec7360444055186d3606321825c3d25e5322e28db1f1330909d556ad277f74 not found: ID does not exist"
Jul 23 20:05:24.243415 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.243374    2578 scope.go:117] "RemoveContainer" containerID="ab7f0bcc188e828ac8cdb4dfb3cc62a51e5a0fbeae79f47b17903ecbcab2fba0"
Jul 23 20:05:24.243640 ip-10-0-141-53 kubenswrapper[2578]: E0723 20:05:24.243623    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab7f0bcc188e828ac8cdb4dfb3cc62a51e5a0fbeae79f47b17903ecbcab2fba0\": container with ID starting with ab7f0bcc188e828ac8cdb4dfb3cc62a51e5a0fbeae79f47b17903ecbcab2fba0 not found: ID does not exist" containerID="ab7f0bcc188e828ac8cdb4dfb3cc62a51e5a0fbeae79f47b17903ecbcab2fba0"
Jul 23 20:05:24.243674 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.243646    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab7f0bcc188e828ac8cdb4dfb3cc62a51e5a0fbeae79f47b17903ecbcab2fba0"} err="failed to get container status \"ab7f0bcc188e828ac8cdb4dfb3cc62a51e5a0fbeae79f47b17903ecbcab2fba0\": rpc error: code = NotFound desc = could not find container \"ab7f0bcc188e828ac8cdb4dfb3cc62a51e5a0fbeae79f47b17903ecbcab2fba0\": container with ID starting with ab7f0bcc188e828ac8cdb4dfb3cc62a51e5a0fbeae79f47b17903ecbcab2fba0 not found: ID does not exist"
Jul 23 20:05:24.247691 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.247669    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"]
Jul 23 20:05:24.252113 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:24.252095    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-fb64e5-openshift-default-7944f9fbff-qx47q"]
Jul 23 20:05:25.651109 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:25.651079    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a95e9c6-7cb3-4572-9966-9f3486d35d2c" path="/var/lib/kubelet/pods/1a95e9c6-7cb3-4572-9966-9f3486d35d2c/volumes"
Jul 23 20:05:29.630462 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:29.630422    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs"]
Jul 23 20:05:29.630869 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:29.630639    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs" podUID="4509e7d2-0709-4a48-b609-a0e84ad030e2" containerName="maas-api" containerID="cri-o://297cfe7557aa3e51b964353e1a5dda2b4dd697049d1e4db6e561b8512b04c6f0" gracePeriod=30
Jul 23 20:05:29.690558 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:29.690520    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs" podUID="4509e7d2-0709-4a48-b609-a0e84ad030e2" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.51:8443/health\": dial tcp 10.133.0.51:8443: connect: connection refused"
Jul 23 20:05:29.875075 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:29.875050    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs"
Jul 23 20:05:29.932884 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:29.932802    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qh7pj\" (UniqueName: \"kubernetes.io/projected/4509e7d2-0709-4a48-b609-a0e84ad030e2-kube-api-access-qh7pj\") pod \"4509e7d2-0709-4a48-b609-a0e84ad030e2\" (UID: \"4509e7d2-0709-4a48-b609-a0e84ad030e2\") "
Jul 23 20:05:29.932884 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:29.932849    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4509e7d2-0709-4a48-b609-a0e84ad030e2-openshift-service-ca\") pod \"4509e7d2-0709-4a48-b609-a0e84ad030e2\" (UID: \"4509e7d2-0709-4a48-b609-a0e84ad030e2\") "
Jul 23 20:05:29.933095 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:29.932927    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4509e7d2-0709-4a48-b609-a0e84ad030e2-maas-api-tls\") pod \"4509e7d2-0709-4a48-b609-a0e84ad030e2\" (UID: \"4509e7d2-0709-4a48-b609-a0e84ad030e2\") "
Jul 23 20:05:29.933339 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:29.933312    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4509e7d2-0709-4a48-b609-a0e84ad030e2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4509e7d2-0709-4a48-b609-a0e84ad030e2" (UID: "4509e7d2-0709-4a48-b609-a0e84ad030e2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 20:05:29.935001 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:29.934973    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4509e7d2-0709-4a48-b609-a0e84ad030e2-kube-api-access-qh7pj" (OuterVolumeSpecName: "kube-api-access-qh7pj") pod "4509e7d2-0709-4a48-b609-a0e84ad030e2" (UID: "4509e7d2-0709-4a48-b609-a0e84ad030e2"). InnerVolumeSpecName "kube-api-access-qh7pj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 20:05:29.935088 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:29.934996    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4509e7d2-0709-4a48-b609-a0e84ad030e2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4509e7d2-0709-4a48-b609-a0e84ad030e2" (UID: "4509e7d2-0709-4a48-b609-a0e84ad030e2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 20:05:30.034074 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:30.034037    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qh7pj\" (UniqueName: \"kubernetes.io/projected/4509e7d2-0709-4a48-b609-a0e84ad030e2-kube-api-access-qh7pj\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:05:30.034074 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:30.034071    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4509e7d2-0709-4a48-b609-a0e84ad030e2-openshift-service-ca\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:05:30.034273 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:30.034089    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4509e7d2-0709-4a48-b609-a0e84ad030e2-maas-api-tls\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:05:30.254155 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:30.254124    2578 generic.go:356] "Generic (PLEG): container finished" podID="4509e7d2-0709-4a48-b609-a0e84ad030e2" containerID="297cfe7557aa3e51b964353e1a5dda2b4dd697049d1e4db6e561b8512b04c6f0" exitCode=0
Jul 23 20:05:30.254356 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:30.254169    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs"
Jul 23 20:05:30.254356 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:30.254206    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs" event={"ID":"4509e7d2-0709-4a48-b609-a0e84ad030e2","Type":"ContainerDied","Data":"297cfe7557aa3e51b964353e1a5dda2b4dd697049d1e4db6e561b8512b04c6f0"}
Jul 23 20:05:30.254356 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:30.254272    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs" event={"ID":"4509e7d2-0709-4a48-b609-a0e84ad030e2","Type":"ContainerDied","Data":"0cd5e433e94a4645a5b696e6a67d942d6298520f5e51850250be7122944b10f1"}
Jul 23 20:05:30.254356 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:30.254295    2578 scope.go:117] "RemoveContainer" containerID="297cfe7557aa3e51b964353e1a5dda2b4dd697049d1e4db6e561b8512b04c6f0"
Jul 23 20:05:30.262862 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:30.262848    2578 scope.go:117] "RemoveContainer" containerID="297cfe7557aa3e51b964353e1a5dda2b4dd697049d1e4db6e561b8512b04c6f0"
Jul 23 20:05:30.263106 ip-10-0-141-53 kubenswrapper[2578]: E0723 20:05:30.263091    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"297cfe7557aa3e51b964353e1a5dda2b4dd697049d1e4db6e561b8512b04c6f0\": container with ID starting with 297cfe7557aa3e51b964353e1a5dda2b4dd697049d1e4db6e561b8512b04c6f0 not found: ID does not exist" containerID="297cfe7557aa3e51b964353e1a5dda2b4dd697049d1e4db6e561b8512b04c6f0"
Jul 23 20:05:30.263152 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:30.263118    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"297cfe7557aa3e51b964353e1a5dda2b4dd697049d1e4db6e561b8512b04c6f0"} err="failed to get container status \"297cfe7557aa3e51b964353e1a5dda2b4dd697049d1e4db6e561b8512b04c6f0\": rpc error: code = NotFound desc = could not find container \"297cfe7557aa3e51b964353e1a5dda2b4dd697049d1e4db6e561b8512b04c6f0\": container with ID starting with 297cfe7557aa3e51b964353e1a5dda2b4dd697049d1e4db6e561b8512b04c6f0 not found: ID does not exist"
Jul 23 20:05:30.274527 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:30.274501    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs"]
Jul 23 20:05:30.278613 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:30.278582    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-470e58-7dd56695c7-qgffs"]
Jul 23 20:05:31.651629 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:31.651601    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4509e7d2-0709-4a48-b609-a0e84ad030e2" path="/var/lib/kubelet/pods/4509e7d2-0709-4a48-b609-a0e84ad030e2/volumes"
Jul 23 20:05:40.591267 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:40.591207    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"]
Jul 23 20:05:40.591713 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:40.591451    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4" podUID="fff297d5-dae3-418b-950d-9c4261c6e293" containerName="istio-proxy" containerID="cri-o://6f4eed45e6d4fa4e5b31622adf4c96969b70b3debfcfeb02b3665731b625f9e6" gracePeriod=30
Jul 23 20:05:43.911158 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:43.911117    2578 patch_prober.go:28] interesting pod/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 20:05:43.911618 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:43.911188    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4" podUID="fff297d5-dae3-418b-950d-9c4261c6e293" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 20:05:45.837821 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:45.837798    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 20:05:45.964439 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:45.964353    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fff297d5-dae3-418b-950d-9c4261c6e293-istio-podinfo\") pod \"fff297d5-dae3-418b-950d-9c4261c6e293\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") "
Jul 23 20:05:45.964439 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:45.964399    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-credential-socket\") pod \"fff297d5-dae3-418b-950d-9c4261c6e293\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") "
Jul 23 20:05:45.964439 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:45.964424    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrd9l\" (UniqueName: \"kubernetes.io/projected/fff297d5-dae3-418b-950d-9c4261c6e293-kube-api-access-wrd9l\") pod \"fff297d5-dae3-418b-950d-9c4261c6e293\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") "
Jul 23 20:05:45.964678 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:45.964456    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-workload-socket\") pod \"fff297d5-dae3-418b-950d-9c4261c6e293\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") "
Jul 23 20:05:45.964678 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:45.964492    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fff297d5-dae3-418b-950d-9c4261c6e293-istio-token\") pod \"fff297d5-dae3-418b-950d-9c4261c6e293\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") "
Jul 23 20:05:45.964678 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:45.964537    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-istio-envoy\") pod \"fff297d5-dae3-418b-950d-9c4261c6e293\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") "
Jul 23 20:05:45.964678 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:45.964563    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-istio-data\") pod \"fff297d5-dae3-418b-950d-9c4261c6e293\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") "
Jul 23 20:05:45.964678 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:45.964590    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-workload-certs\") pod \"fff297d5-dae3-418b-950d-9c4261c6e293\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") "
Jul 23 20:05:45.964678 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:45.964635    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fff297d5-dae3-418b-950d-9c4261c6e293-istiod-ca-cert\") pod \"fff297d5-dae3-418b-950d-9c4261c6e293\" (UID: \"fff297d5-dae3-418b-950d-9c4261c6e293\") "
Jul 23 20:05:45.964678 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:45.964662    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fff297d5-dae3-418b-950d-9c4261c6e293" (UID: "fff297d5-dae3-418b-950d-9c4261c6e293"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:05:45.965046 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:45.964786    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fff297d5-dae3-418b-950d-9c4261c6e293" (UID: "fff297d5-dae3-418b-950d-9c4261c6e293"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:05:45.965046 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:45.964886    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-credential-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:05:45.965046 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:45.964906    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-workload-socket\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:05:45.965202 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:45.965126    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fff297d5-dae3-418b-950d-9c4261c6e293-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fff297d5-dae3-418b-950d-9c4261c6e293" (UID: "fff297d5-dae3-418b-950d-9c4261c6e293"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 20:05:45.965202 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:45.965152    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fff297d5-dae3-418b-950d-9c4261c6e293" (UID: "fff297d5-dae3-418b-950d-9c4261c6e293"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:05:45.965598 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:45.965569    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-istio-data" (OuterVolumeSpecName: "istio-data") pod "fff297d5-dae3-418b-950d-9c4261c6e293" (UID: "fff297d5-dae3-418b-950d-9c4261c6e293"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:05:45.966649 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:45.966630    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fff297d5-dae3-418b-950d-9c4261c6e293-kube-api-access-wrd9l" (OuterVolumeSpecName: "kube-api-access-wrd9l") pod "fff297d5-dae3-418b-950d-9c4261c6e293" (UID: "fff297d5-dae3-418b-950d-9c4261c6e293"). InnerVolumeSpecName "kube-api-access-wrd9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 20:05:45.966788 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:45.966771    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fff297d5-dae3-418b-950d-9c4261c6e293" (UID: "fff297d5-dae3-418b-950d-9c4261c6e293"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 20:05:45.967012 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:45.966990    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fff297d5-dae3-418b-950d-9c4261c6e293-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fff297d5-dae3-418b-950d-9c4261c6e293" (UID: "fff297d5-dae3-418b-950d-9c4261c6e293"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 20:05:45.967111 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:45.967011    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fff297d5-dae3-418b-950d-9c4261c6e293-istio-token" (OuterVolumeSpecName: "istio-token") pod "fff297d5-dae3-418b-950d-9c4261c6e293" (UID: "fff297d5-dae3-418b-950d-9c4261c6e293"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 20:05:46.065239 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:46.065202    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-istio-envoy\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:05:46.065239 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:46.065233    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-istio-data\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:05:46.065239 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:46.065243    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fff297d5-dae3-418b-950d-9c4261c6e293-workload-certs\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:05:46.065452 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:46.065271    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fff297d5-dae3-418b-950d-9c4261c6e293-istiod-ca-cert\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:05:46.065452 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:46.065280    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fff297d5-dae3-418b-950d-9c4261c6e293-istio-podinfo\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:05:46.065452 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:46.065288    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrd9l\" (UniqueName: \"kubernetes.io/projected/fff297d5-dae3-418b-950d-9c4261c6e293-kube-api-access-wrd9l\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:05:46.065452 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:46.065306    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fff297d5-dae3-418b-950d-9c4261c6e293-istio-token\") on node \"ip-10-0-141-53.ec2.internal\" DevicePath \"\""
Jul 23 20:05:46.324777 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:46.324749    2578 generic.go:356] "Generic (PLEG): container finished" podID="fff297d5-dae3-418b-950d-9c4261c6e293" containerID="6f4eed45e6d4fa4e5b31622adf4c96969b70b3debfcfeb02b3665731b625f9e6" exitCode=0
Jul 23 20:05:46.324943 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:46.324825    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"
Jul 23 20:05:46.324943 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:46.324842    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4" event={"ID":"fff297d5-dae3-418b-950d-9c4261c6e293","Type":"ContainerDied","Data":"6f4eed45e6d4fa4e5b31622adf4c96969b70b3debfcfeb02b3665731b625f9e6"}
Jul 23 20:05:46.324943 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:46.324897    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4" event={"ID":"fff297d5-dae3-418b-950d-9c4261c6e293","Type":"ContainerDied","Data":"c0676116ca5aca39ed5aa21716a09972fdc96c75886c4bd0dd1e49522cb2edaf"}
Jul 23 20:05:46.324943 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:46.324919    2578 scope.go:117] "RemoveContainer" containerID="6f4eed45e6d4fa4e5b31622adf4c96969b70b3debfcfeb02b3665731b625f9e6"
Jul 23 20:05:46.334043 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:46.334023    2578 scope.go:117] "RemoveContainer" containerID="3c41e48401d6c5a35213f0978d3fc31cffbe7388abfef1c1b9f95090fa6498f7"
Jul 23 20:05:46.341336 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:46.341319    2578 scope.go:117] "RemoveContainer" containerID="6f4eed45e6d4fa4e5b31622adf4c96969b70b3debfcfeb02b3665731b625f9e6"
Jul 23 20:05:46.341590 ip-10-0-141-53 kubenswrapper[2578]: E0723 20:05:46.341566    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f4eed45e6d4fa4e5b31622adf4c96969b70b3debfcfeb02b3665731b625f9e6\": container with ID starting with 6f4eed45e6d4fa4e5b31622adf4c96969b70b3debfcfeb02b3665731b625f9e6 not found: ID does not exist" containerID="6f4eed45e6d4fa4e5b31622adf4c96969b70b3debfcfeb02b3665731b625f9e6"
Jul 23 20:05:46.341641 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:46.341595    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f4eed45e6d4fa4e5b31622adf4c96969b70b3debfcfeb02b3665731b625f9e6"} err="failed to get container status \"6f4eed45e6d4fa4e5b31622adf4c96969b70b3debfcfeb02b3665731b625f9e6\": rpc error: code = NotFound desc = could not find container \"6f4eed45e6d4fa4e5b31622adf4c96969b70b3debfcfeb02b3665731b625f9e6\": container with ID starting with 6f4eed45e6d4fa4e5b31622adf4c96969b70b3debfcfeb02b3665731b625f9e6 not found: ID does not exist"
Jul 23 20:05:46.341641 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:46.341611    2578 scope.go:117] "RemoveContainer" containerID="3c41e48401d6c5a35213f0978d3fc31cffbe7388abfef1c1b9f95090fa6498f7"
Jul 23 20:05:46.341820 ip-10-0-141-53 kubenswrapper[2578]: E0723 20:05:46.341804    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c41e48401d6c5a35213f0978d3fc31cffbe7388abfef1c1b9f95090fa6498f7\": container with ID starting with 3c41e48401d6c5a35213f0978d3fc31cffbe7388abfef1c1b9f95090fa6498f7 not found: ID does not exist" containerID="3c41e48401d6c5a35213f0978d3fc31cffbe7388abfef1c1b9f95090fa6498f7"
Jul 23 20:05:46.341859 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:46.341827    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c41e48401d6c5a35213f0978d3fc31cffbe7388abfef1c1b9f95090fa6498f7"} err="failed to get container status \"3c41e48401d6c5a35213f0978d3fc31cffbe7388abfef1c1b9f95090fa6498f7\": rpc error: code = NotFound desc = could not find container \"3c41e48401d6c5a35213f0978d3fc31cffbe7388abfef1c1b9f95090fa6498f7\": container with ID starting with 3c41e48401d6c5a35213f0978d3fc31cffbe7388abfef1c1b9f95090fa6498f7 not found: ID does not exist"
Jul 23 20:05:46.347313 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:46.347294    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"]
Jul 23 20:05:46.351310 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:46.351289    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-470e58-openshift-default-6fc56485f9-h5rd4"]
Jul 23 20:05:46.772559 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:46.772531    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56d6ccb556-w9b8x_95f4ccee-1845-4367-a859-aa3419a6373d/manager/0.log"
Jul 23 20:05:47.129578 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:47.129501    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-559f567dc-btqjt_bfb58184-a3bd-46cd-b823-1cf79ded9dc5/copy-manifests/0.log"
Jul 23 20:05:47.142579 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:47.142539    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-559f567dc-btqjt_bfb58184-a3bd-46cd-b823-1cf79ded9dc5/manager/0.log"
Jul 23 20:05:47.651110 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:47.651073    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fff297d5-dae3-418b-950d-9c4261c6e293" path="/var/lib/kubelet/pods/fff297d5-dae3-418b-950d-9c4261c6e293/volumes"
Jul 23 20:05:47.733019 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:47.732988    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-76bbd449ff-fz5z7_42bb3ed8-a7c3-498f-8898-5a2ebd4958c9/maas-api/0.log"
Jul 23 20:05:49.609831 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:49.609777    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2nvbw_8ca212e8-2df0-46b8-8616-e18c3cd0acec/manager/0.log"
Jul 23 20:05:49.718985 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:49.718961    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-k7m6d_eeb58892-a871-4c92-b643-87cb9fec136c/kuadrant-console-plugin/0.log"
Jul 23 20:05:49.832004 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:49.831976    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6dfxc_8ba1a77a-23e3-416f-a73a-a8deef6a712b/registry-server/0.log"
Jul 23 20:05:49.948006 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:49.947909    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jzt97_302b7d6b-787f-4852-a81a-73efa58a2046/manager/0.log"
Jul 23 20:05:50.175899 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:50.175868    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jmb6n_b3e9ab8b-b605-474b-aae1-d8303dd4e488/manager/0.log"
Jul 23 20:05:50.537356 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:50.537327    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jjcpr_15c3a29e-d89e-4c8a-b6ea-2de0145430ae/istio-proxy/0.log"
Jul 23 20:05:51.693730 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:51.693704    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-gjk7b_17f9ca16-90de-46d8-8e2e-210cb836ad6c/main/0.log"
Jul 23 20:05:52.136072 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:52.136043    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-z4nvw_83a9d8c9-4726-4175-bc22-38c1e39bfe51/main/0.log"
Jul 23 20:05:58.387738 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.387703    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tjlxs/must-gather-h6t8c"]
Jul 23 20:05:58.388208 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.387993    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4509e7d2-0709-4a48-b609-a0e84ad030e2" containerName="maas-api"
Jul 23 20:05:58.388208 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.388005    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4509e7d2-0709-4a48-b609-a0e84ad030e2" containerName="maas-api"
Jul 23 20:05:58.388208 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.388013    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfb5229c-0a2f-4756-8095-32fd58f74f59" containerName="main"
Jul 23 20:05:58.388208 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.388020    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfb5229c-0a2f-4756-8095-32fd58f74f59" containerName="main"
Jul 23 20:05:58.388208 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.388031    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a95e9c6-7cb3-4572-9966-9f3486d35d2c" containerName="istio-proxy"
Jul 23 20:05:58.388208 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.388037    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a95e9c6-7cb3-4572-9966-9f3486d35d2c" containerName="istio-proxy"
Jul 23 20:05:58.388208 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.388043    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fff297d5-dae3-418b-950d-9c4261c6e293" containerName="istio-proxy"
Jul 23 20:05:58.388208 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.388048    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fff297d5-dae3-418b-950d-9c4261c6e293" containerName="istio-proxy"
Jul 23 20:05:58.388208 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.388058    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fff297d5-dae3-418b-950d-9c4261c6e293" containerName="istio-proxy"
Jul 23 20:05:58.388208 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.388063    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fff297d5-dae3-418b-950d-9c4261c6e293" containerName="istio-proxy"
Jul 23 20:05:58.388208 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.388073    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9ed5b8a-cf63-4300-984d-d9d1a66e79bd" containerName="main"
Jul 23 20:05:58.388208 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.388078    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9ed5b8a-cf63-4300-984d-d9d1a66e79bd" containerName="main"
Jul 23 20:05:58.388208 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.388088    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a95e9c6-7cb3-4572-9966-9f3486d35d2c" containerName="istio-proxy"
Jul 23 20:05:58.388208 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.388093    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a95e9c6-7cb3-4572-9966-9f3486d35d2c" containerName="istio-proxy"
Jul 23 20:05:58.388208 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.388138    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfb5229c-0a2f-4756-8095-32fd58f74f59" containerName="main"
Jul 23 20:05:58.388208 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.388145    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a95e9c6-7cb3-4572-9966-9f3486d35d2c" containerName="istio-proxy"
Jul 23 20:05:58.388208 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.388150    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fff297d5-dae3-418b-950d-9c4261c6e293" containerName="istio-proxy"
Jul 23 20:05:58.388208 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.388158    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4509e7d2-0709-4a48-b609-a0e84ad030e2" containerName="maas-api"
Jul 23 20:05:58.388208 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.388164    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fff297d5-dae3-418b-950d-9c4261c6e293" containerName="istio-proxy"
Jul 23 20:05:58.388208 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.388169    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9ed5b8a-cf63-4300-984d-d9d1a66e79bd" containerName="main"
Jul 23 20:05:58.388890 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.388270    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a95e9c6-7cb3-4572-9966-9f3486d35d2c" containerName="istio-proxy"
Jul 23 20:05:58.392297 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.392277    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjlxs/must-gather-h6t8c"
Jul 23 20:05:58.402265 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.402229    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tjlxs\"/\"kube-root-ca.crt\""
Jul 23 20:05:58.402367 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.402232    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tjlxs\"/\"openshift-service-ca.crt\""
Jul 23 20:05:58.413720 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.413697    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjlxs/must-gather-h6t8c"]
Jul 23 20:05:58.459921 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.459899    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjwsn\" (UniqueName: \"kubernetes.io/projected/17c825ea-cc00-4848-988f-48a6d3a18c63-kube-api-access-gjwsn\") pod \"must-gather-h6t8c\" (UID: \"17c825ea-cc00-4848-988f-48a6d3a18c63\") " pod="openshift-must-gather-tjlxs/must-gather-h6t8c"
Jul 23 20:05:58.460036 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.459937    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/17c825ea-cc00-4848-988f-48a6d3a18c63-must-gather-output\") pod \"must-gather-h6t8c\" (UID: \"17c825ea-cc00-4848-988f-48a6d3a18c63\") " pod="openshift-must-gather-tjlxs/must-gather-h6t8c"
Jul 23 20:05:58.561235 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.561203    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjwsn\" (UniqueName: \"kubernetes.io/projected/17c825ea-cc00-4848-988f-48a6d3a18c63-kube-api-access-gjwsn\") pod \"must-gather-h6t8c\" (UID: \"17c825ea-cc00-4848-988f-48a6d3a18c63\") " pod="openshift-must-gather-tjlxs/must-gather-h6t8c"
Jul 23 20:05:58.561405 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.561245    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/17c825ea-cc00-4848-988f-48a6d3a18c63-must-gather-output\") pod \"must-gather-h6t8c\" (UID: \"17c825ea-cc00-4848-988f-48a6d3a18c63\") " pod="openshift-must-gather-tjlxs/must-gather-h6t8c"
Jul 23 20:05:58.561565 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.561547    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/17c825ea-cc00-4848-988f-48a6d3a18c63-must-gather-output\") pod \"must-gather-h6t8c\" (UID: \"17c825ea-cc00-4848-988f-48a6d3a18c63\") " pod="openshift-must-gather-tjlxs/must-gather-h6t8c"
Jul 23 20:05:58.572591 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.572570    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjwsn\" (UniqueName: \"kubernetes.io/projected/17c825ea-cc00-4848-988f-48a6d3a18c63-kube-api-access-gjwsn\") pod \"must-gather-h6t8c\" (UID: \"17c825ea-cc00-4848-988f-48a6d3a18c63\") " pod="openshift-must-gather-tjlxs/must-gather-h6t8c"
Jul 23 20:05:58.700999 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.700920    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjlxs/must-gather-h6t8c"
Jul 23 20:05:58.827260 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.827226    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjlxs/must-gather-h6t8c"]
Jul 23 20:05:58.829399 ip-10-0-141-53 kubenswrapper[2578]: W0723 20:05:58.829370    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17c825ea_cc00_4848_988f_48a6d3a18c63.slice/crio-53895e05d8f6ff86b88a2be551d876afbf3b6dde44ab7d7424d4204e6df19f1b WatchSource:0}: Error finding container 53895e05d8f6ff86b88a2be551d876afbf3b6dde44ab7d7424d4204e6df19f1b: Status 404 returned error can't find the container with id 53895e05d8f6ff86b88a2be551d876afbf3b6dde44ab7d7424d4204e6df19f1b
Jul 23 20:05:58.831176 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:58.831160    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 20:05:59.385517 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:05:59.385480    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjlxs/must-gather-h6t8c" event={"ID":"17c825ea-cc00-4848-988f-48a6d3a18c63","Type":"ContainerStarted","Data":"53895e05d8f6ff86b88a2be551d876afbf3b6dde44ab7d7424d4204e6df19f1b"}
Jul 23 20:06:00.393318 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:00.393238    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjlxs/must-gather-h6t8c" event={"ID":"17c825ea-cc00-4848-988f-48a6d3a18c63","Type":"ContainerStarted","Data":"8642fa8d5aa5381a20ae96ead5402798fa06c527c214a5a6249cf54b2a51fb10"}
Jul 23 20:06:00.393802 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:00.393333    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjlxs/must-gather-h6t8c" event={"ID":"17c825ea-cc00-4848-988f-48a6d3a18c63","Type":"ContainerStarted","Data":"aacd2d5949ee96ec5fcc2139a52bfd6f384f5c5c504db6663f2bc2206925bfc7"}
Jul 23 20:06:00.409004 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:00.408960    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tjlxs/must-gather-h6t8c" podStartSLOduration=1.631234176 podStartE2EDuration="2.408943662s" totalImagesPullingTime="777.709486ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 20:05:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 20:06:00.408263983 +0000 UTC m=+2761.245270690" watchObservedRunningTime="2026-07-23 20:06:00.408943662 +0000 UTC m=+2761.245950368"
Jul 23 20:06:01.164491 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:01.164460    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bq6sp_eeb46c3e-ed2a-4ae2-90bf-da9d75c24cbf/global-pull-secret-syncer/0.log"
Jul 23 20:06:01.357267 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:01.357227    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kt2wc_bd32cdc1-4e4a-4115-a2f7-63375ec6d511/konnectivity-agent/0.log"
Jul 23 20:06:01.443030 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:01.442960    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-53.ec2.internal_e6a766f128fe58a47aa95c2312516db4/haproxy/0.log"
Jul 23 20:06:07.016931 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:07.016898    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2nvbw_8ca212e8-2df0-46b8-8616-e18c3cd0acec/manager/0.log"
Jul 23 20:06:07.069538 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:07.069505    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-k7m6d_eeb58892-a871-4c92-b643-87cb9fec136c/kuadrant-console-plugin/0.log"
Jul 23 20:06:07.147164 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:07.147127    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6dfxc_8ba1a77a-23e3-416f-a73a-a8deef6a712b/registry-server/0.log"
Jul 23 20:06:07.440327 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:07.440088    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jzt97_302b7d6b-787f-4852-a81a-73efa58a2046/manager/0.log"
Jul 23 20:06:07.572641 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:07.572603    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jmb6n_b3e9ab8b-b605-474b-aae1-d8303dd4e488/manager/0.log"
Jul 23 20:06:09.719993 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:09.719953    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bhk9f_bb868267-1dbb-43b8-b876-39a9018d0e90/node-exporter/0.log"
Jul 23 20:06:09.741318 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:09.741285    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bhk9f_bb868267-1dbb-43b8-b876-39a9018d0e90/kube-rbac-proxy/0.log"
Jul 23 20:06:09.763724 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:09.763698    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bhk9f_bb868267-1dbb-43b8-b876-39a9018d0e90/init-textfile/0.log"
Jul 23 20:06:10.929497 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:10.929451    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"]
Jul 23 20:06:10.935757 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:10.935723    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"
Jul 23 20:06:10.938929 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:10.938898    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tjlxs\"/\"default-dockercfg-sm7kz\""
Jul 23 20:06:10.946608 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:10.946577    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"]
Jul 23 20:06:10.993848 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:10.993801    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad09221a-6fff-4c6f-a2d9-188110f5067b-sys\") pod \"perf-node-gather-daemonset-lqp72\" (UID: \"ad09221a-6fff-4c6f-a2d9-188110f5067b\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"
Jul 23 20:06:10.994042 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:10.993858    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad09221a-6fff-4c6f-a2d9-188110f5067b-lib-modules\") pod \"perf-node-gather-daemonset-lqp72\" (UID: \"ad09221a-6fff-4c6f-a2d9-188110f5067b\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"
Jul 23 20:06:10.994042 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:10.993959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpgvh\" (UniqueName: \"kubernetes.io/projected/ad09221a-6fff-4c6f-a2d9-188110f5067b-kube-api-access-lpgvh\") pod \"perf-node-gather-daemonset-lqp72\" (UID: \"ad09221a-6fff-4c6f-a2d9-188110f5067b\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"
Jul 23 20:06:10.994042 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:10.994018    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ad09221a-6fff-4c6f-a2d9-188110f5067b-proc\") pod \"perf-node-gather-daemonset-lqp72\" (UID: \"ad09221a-6fff-4c6f-a2d9-188110f5067b\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"
Jul 23 20:06:10.994215 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:10.994043    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ad09221a-6fff-4c6f-a2d9-188110f5067b-podres\") pod \"perf-node-gather-daemonset-lqp72\" (UID: \"ad09221a-6fff-4c6f-a2d9-188110f5067b\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"
Jul 23 20:06:11.095183 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:11.095135    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpgvh\" (UniqueName: \"kubernetes.io/projected/ad09221a-6fff-4c6f-a2d9-188110f5067b-kube-api-access-lpgvh\") pod \"perf-node-gather-daemonset-lqp72\" (UID: \"ad09221a-6fff-4c6f-a2d9-188110f5067b\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"
Jul 23 20:06:11.095381 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:11.095209    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ad09221a-6fff-4c6f-a2d9-188110f5067b-proc\") pod \"perf-node-gather-daemonset-lqp72\" (UID: \"ad09221a-6fff-4c6f-a2d9-188110f5067b\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"
Jul 23 20:06:11.095381 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:11.095236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ad09221a-6fff-4c6f-a2d9-188110f5067b-podres\") pod \"perf-node-gather-daemonset-lqp72\" (UID: \"ad09221a-6fff-4c6f-a2d9-188110f5067b\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"
Jul 23 20:06:11.095381 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:11.095282    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad09221a-6fff-4c6f-a2d9-188110f5067b-sys\") pod \"perf-node-gather-daemonset-lqp72\" (UID: \"ad09221a-6fff-4c6f-a2d9-188110f5067b\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"
Jul 23 20:06:11.095381 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:11.095309    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad09221a-6fff-4c6f-a2d9-188110f5067b-lib-modules\") pod \"perf-node-gather-daemonset-lqp72\" (UID: \"ad09221a-6fff-4c6f-a2d9-188110f5067b\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"
Jul 23 20:06:11.095381 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:11.095319    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ad09221a-6fff-4c6f-a2d9-188110f5067b-proc\") pod \"perf-node-gather-daemonset-lqp72\" (UID: \"ad09221a-6fff-4c6f-a2d9-188110f5067b\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"
Jul 23 20:06:11.095660 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:11.095406    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ad09221a-6fff-4c6f-a2d9-188110f5067b-podres\") pod \"perf-node-gather-daemonset-lqp72\" (UID: \"ad09221a-6fff-4c6f-a2d9-188110f5067b\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"
Jul 23 20:06:11.095660 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:11.095453    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad09221a-6fff-4c6f-a2d9-188110f5067b-sys\") pod \"perf-node-gather-daemonset-lqp72\" (UID: \"ad09221a-6fff-4c6f-a2d9-188110f5067b\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"
Jul 23 20:06:11.095660 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:11.095465    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ad09221a-6fff-4c6f-a2d9-188110f5067b-lib-modules\") pod \"perf-node-gather-daemonset-lqp72\" (UID: \"ad09221a-6fff-4c6f-a2d9-188110f5067b\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"
Jul 23 20:06:11.105921 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:11.105895    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpgvh\" (UniqueName: \"kubernetes.io/projected/ad09221a-6fff-4c6f-a2d9-188110f5067b-kube-api-access-lpgvh\") pod \"perf-node-gather-daemonset-lqp72\" (UID: \"ad09221a-6fff-4c6f-a2d9-188110f5067b\") " pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"
Jul 23 20:06:11.248359 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:11.248322    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"
Jul 23 20:06:11.435825 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:11.435791    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"]
Jul 23 20:06:11.439036 ip-10-0-141-53 kubenswrapper[2578]: W0723 20:06:11.438994    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podad09221a_6fff_4c6f_a2d9_188110f5067b.slice/crio-2dcc8d24f996670ec388fd0840f4ab6a21ae42f0380f09d3ec1f4d5d197b168c WatchSource:0}: Error finding container 2dcc8d24f996670ec388fd0840f4ab6a21ae42f0380f09d3ec1f4d5d197b168c: Status 404 returned error can't find the container with id 2dcc8d24f996670ec388fd0840f4ab6a21ae42f0380f09d3ec1f4d5d197b168c
Jul 23 20:06:11.470807 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:11.470728    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72" event={"ID":"ad09221a-6fff-4c6f-a2d9-188110f5067b","Type":"ContainerStarted","Data":"2dcc8d24f996670ec388fd0840f4ab6a21ae42f0380f09d3ec1f4d5d197b168c"}
Jul 23 20:06:12.478095 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:12.478056    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72" event={"ID":"ad09221a-6fff-4c6f-a2d9-188110f5067b","Type":"ContainerStarted","Data":"9a050c9e101772513ed909b611d3c9f3f5a8328063c061a7122668699df282bc"}
Jul 23 20:06:12.478605 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:12.478190    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"
Jul 23 20:06:12.497000 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:12.496915    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72" podStartSLOduration=2.496891021 podStartE2EDuration="2.496891021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 20:06:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 20:06:12.494006937 +0000 UTC m=+2773.331013669" watchObservedRunningTime="2026-07-23 20:06:12.496891021 +0000 UTC m=+2773.333897730"
Jul 23 20:06:14.410552 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:14.410524    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vb527_2a42456f-2357-4731-a2ea-e5f2078eb05d/dns/0.log"
Jul 23 20:06:14.443830 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:14.443803    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vb527_2a42456f-2357-4731-a2ea-e5f2078eb05d/kube-rbac-proxy/0.log"
Jul 23 20:06:14.600492 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:14.600463    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hk9xx_f4c27c31-3176-42eb-bfad-18e0d1c99c2c/dns-node-resolver/0.log"
Jul 23 20:06:15.170997 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:15.170968    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5f956744d9-wvnnl_f3d15f0f-d987-406a-9d7d-b2edf1317358/registry/0.log"
Jul 23 20:06:15.239070 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:15.239031    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rh6dh_e3da6f91-7977-4b04-9075-c77edf499350/node-ca/0.log"
Jul 23 20:06:16.273382 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:16.273348    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jjcpr_15c3a29e-d89e-4c8a-b6ea-2de0145430ae/istio-proxy/0.log"
Jul 23 20:06:17.536815 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:17.536787    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cwqmz_cfc02285-5ead-4883-9edc-09564c3c2cf9/serve-healthcheck-canary/0.log"
Jul 23 20:06:18.245356 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:18.245330    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fvqj9_09653eed-2296-4cb5-a06b-0f4b37981feb/kube-rbac-proxy/0.log"
Jul 23 20:06:18.269583 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:18.269555    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fvqj9_09653eed-2296-4cb5-a06b-0f4b37981feb/exporter/0.log"
Jul 23 20:06:18.292815 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:18.292783    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fvqj9_09653eed-2296-4cb5-a06b-0f4b37981feb/extractor/0.log"
Jul 23 20:06:18.493280 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:18.493228    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tjlxs/perf-node-gather-daemonset-lqp72"
Jul 23 20:06:21.164312 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:21.164281    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56d6ccb556-w9b8x_95f4ccee-1845-4367-a859-aa3419a6373d/manager/0.log"
Jul 23 20:06:21.399960 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:21.399918    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-559f567dc-btqjt_bfb58184-a3bd-46cd-b823-1cf79ded9dc5/manager/0.log"
Jul 23 20:06:21.416478 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:21.416408    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-559f567dc-btqjt_bfb58184-a3bd-46cd-b823-1cf79ded9dc5/copy-manifests/0.log"
Jul 23 20:06:21.463014 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:21.462937    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jjcpr_15c3a29e-d89e-4c8a-b6ea-2de0145430ae/istio-proxy/0.log"
Jul 23 20:06:22.813943 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:22.813910    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-84c9b5-zl6gd_d1ddd8e6-15b9-418a-8f16-399bf48c1e48/manager/0.log"
Jul 23 20:06:23.057963 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:23.057854    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4jjcpr_15c3a29e-d89e-4c8a-b6ea-2de0145430ae/istio-proxy/0.log"
Jul 23 20:06:27.426594 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:27.426552    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-9bd9v_07ec9ea6-8b34-4909-9fbb-9740c883b858/migrator/0.log"
Jul 23 20:06:27.447058 ip-10-0-141-53 kubenswrapper[2578]: I0723 20:06:27.447030    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-9bd9v_07ec9ea6-8b34-4909-9fbb-9740c883b858/graceful-termination/0.log"